Agent mode

Code with AI on a plane or an air-gapped machine

Every cloud AI editor stops being an AI editor the moment the connection drops. With a local model pulled, Osmium does not — the model is a file on your disk and inference happens on your GPU.

How to run it

  1. 01While you still have a connection, pull the model you want with Ollama.
  2. 02Open Osmium once and select it under Settings → Local models.
  3. 03Disconnect. The editor, terminal, git, debugger, and agent all keep working.

Pull before you go

Model weights are gigabytes. Pull on good network, then verify the model responds once before you rely on it.

Air-gapped environments

Nothing in the local path needs to phone home. If your work cannot touch the internet, this is the configuration to use.

The catch

Cloud models, the Hub account link, and update checks obviously need a connection. Local inference does not.