Osmium

qwen2.5-coder:7b

Qwen2.5 Coder 7B on your own machine

The best default local coder on 8-16 GB. Tools and fill-in-the-middle. This is the one most people should start with.

Pull it

ollama pull qwen2.5-coder:7b

Then pick it in Osmium under Settings → Local models. Nothing else to configure.

Parameters
7B
VRAM (4-bit)
6 GB
Disk
~4.5 GB
Context
33K tokens
Tool calling
Yes
Reads images
No
Generates images
No
Coding
8/10
Explaining
7/10

Scores are our own product guidance, not benchmark results.

Which hardware runs it

Checked against GPU memory. Osmium runs the same check on your real machine and also looks at system RAM and free disk. Unified-memory Macs need more headroom because the GPU shares one pool with the operating system.

  • 4 GB — GTX 1650 / MX570Needs 6 GB; this tier has 4 GB.Too big
  • 6 GB — RTX 2060 / 3050Runs, but memory is tight (6 GB against 6 GB).Tight
  • 8 GB — RTX 3060 Ti / 4060Runs comfortably on 8 GB.Fits
  • 12 GB — RTX 3060 / 4070Runs comfortably on 12 GB.Fits
  • 16 GB — RTX 4060 Ti / 4080Runs comfortably on 16 GB.Fits
  • 24 GB — RTX 3090 / 4090Runs comfortably on 24 GB.Fits
  • Mac 16 GB unifiedRuns comfortably on 16 GB.Fits
  • Mac 24 GB unifiedRuns comfortably on 24 GB.Fits
  • Mac 36 GB unifiedRuns comfortably on 36 GB.Fits
  • Mac 64 GB unifiedRuns comfortably on 64 GB.Fits

Other coding models