Skip to content
EverrunsEverruns

Run models on your machine with the local provider

Changelog

Feature YolopCLI

In Yolop 0.17.1

Docsyolop#581yolop#599yolop#623

--provider local runs a model inside the Yolop process: no server, no API key and no network during a turn. The default model is Qwen3-30B-A3B-Instruct in Q4 GGUF. Fetch the weights first, since a turn never waits on a download:

Terminal window
yolop weights pull
yolop --provider local

The provider is experimental. The engine ships in separate release archives, yolop-<target>-metal.tar.gz and yolop-x86_64-unknown-linux-gnu-cuda.tar.gz. The default archive, which Homebrew installs, leaves it out, so the Linux tarball dropped from 29.9 MB to 18.2 MB. From source, build with the metal or cuda feature.

See Providers and models, #581, #599 and #623.