Upload your own model

Use uploads for your own fine-tunes, merges or quants. The files go straight into your private storage and nobody else can use them.

What you can upload

• A GGUF file: one .gguf file (not split into parts), as exported by llama.cpp or similar tools. Runs on llama.cpp.
• A safetensors model folder: config.json, the tokenizer files and the .safetensors weights, as saved by Hugging Face transformers or sentence-transformers. Chat models run on vLLM, embedding models on Text Embeddings Inference. Up to 64 files; code and pickle files are never accepted.

The .gguf file and each .safetensors file must be at least 1 MB. Config and tokenizer files have no minimum.

From the dashboard

1. On Endpoints, select New endpoint.
2. Under Or upload your own model, choose A GGUF file or A safetensors model folder.
3. Wait for the upload and the check. You can select Stop upload at any time; nothing is saved.
4. Select Create endpoint.

From the terminal

Upload and deploy in one step:

bitsrun deploy ./my-model-Q4_K_M.gguf
bitsrun deploy ./my-finetune

Or upload now and deploy later:

bitsrun upload ./my-model-Q4_K_M.gguf
bitsrun uploads
bitsrun deploy upload:<id>

The CLI sends 4 parts at a time and retries a part that fails, so large files survive a shaky connection.

Storage and limits

• Uploads count toward your plan's model storage: 10 GB free on Pay-as-you-go, 200 GB on Pro, 1 TB on Business, then $0.05 per GB a month. See Model storage.
• Uploading needs a positive balance, because the files are stored for you.
• Up to 20 uploads per account. An upload you start but never finish is cleaned up after 2 days.

Delete an upload

bitsrun uploads rm <id>

You can only delete an upload no endpoint uses. Delete the endpoint first.

What can go wrong