In the model's community section Goog confirms they're working on a gguf version so you can host it like most other models.

https://huggingface.co/google/gemma-3n-E4B-it-litert-preview...

As far as I know it's based on Gemini nano architecture which exclusively runs on Android and Chrome. So I'm guessing you can't run it on Linux outside Chrome.