Model storage

Some models live in your own private storage at BitsRun. Storage is free up to your plan's amount, then costs a few cents per gigabyte each month.

What counts

A gated repo is one whose author asks you to accept their terms first, such as Llama or Gemma. See Gated and private repos and Upload your own model.

What it costs

Above the free amount, storage costs $0.05 per GB a month. It is charged once a day, on what you store at the end of each day (UTC), as a thirtieth of the monthly price.

Example. On Pay as you go you store a 16 GB fine-tune and a 5 GB quant: 21 GB in total, 11 GB above the free 10 GB.

11 GB x $0.05 = $0.55 a month, about $0.018 a day

See what you store

• Dashboard: the Uploads list on the Endpoints page shows each stored model and its size. Usage shows storage charges under Model storage.
• Terminal: bitsrun uploads lists your uploads; bitsrun whoami shows your plan.
• Mobile apps (coming soon): Account shows Model storage and how much your plan includes.

Free up space

Delete a stored model you no longer use:

bitsrun uploads rm <upload> --yes

A model that an endpoint still uses cannot be deleted (409 upload_in_use). Delete that endpoint first.

If your balance goes below $0

Storing models needs a positive balance. Below $0, we keep your stored models for 7 days and email you on the first day and again 2 days before the date. After 7 days, the stored models and the endpoints that use them are deleted. Adding credit that brings your balance back to $0 or more stops this.

What can go wrong

• 409 storage_quota_reached: this model would go past your plan's most storage. Delete a model you no longer use, or move to a bigger plan.
• 402 credit_required: add credit before uploading or copying a model.
• 409 upload_in_use: an endpoint still serves this upload. Delete the endpoint first.