BitsRun docs
Run open AI models as private APIs that sleep when idle and bill by the second. Start here, or pick a topic below.
BitsRun turns an open model, such as Qwen3 8B from Ollama or any compatible repo on Hugging Face, into your own private API. It speaks the same language as the OpenAI API, so the code you already have works after you change two lines. When nobody calls it, it goes to sleep and costs nothing.
New here? These four steps take about ten minutes:
- Create your account with your email. There is no password to remember.
- Add credit from $10. Everything you run draws from this balance.
- Deploy your first model by typing its name, for example
qwen3:8b. - Call your endpoint with curl, Python or JavaScript.
What you pay for
You pay by the second, only while your model is awake and ready to answer. Starting a GPU, loading the model and sleeping are never billed. An NVIDIA L4 costs $0.95 an hour, which is $0.000264 a second. Read How billing works for worked examples.
- AsleepFree
- Starting a GPUFree
- Loading the modelFree
- Answering requestsBilled per second
- Waiting before sleepBilled, you pick 60 s to 1 h
The bitsrun terminal
bitsrun is one free tool for two jobs. As a command line, it deploys models, manages keys and shows your usage. Run it with no arguments and it becomes a full coding agent in your terminal: it reads and edits your files, runs commands after you approve them, works with any model provider (BitsRun, Anthropic, OpenAI, Google, Ollama on your computer and more), and lets you follow and steer the session from your phone.
curl -fsSL https://get.bitsrun.com | sh
bitsrun login
bitsrun deploy qwen3:8bOn macOS and Linux the installer puts bitsrun in ~/.local/bin. If that folder is not on your PATH yet, it prints the one line to add it. Run that line and open a new terminal before bitsrun login.
Start with Command line or the bitsrun coding agent.
Browse by topic
Still stuck?
Email support@bitsrun.com with what you tried and any request id you saw. A real person answers.