Models that cannot be deployed
BitsRun refuses models that need their own code, are not text or embedding models, are split into parts or are too large, and the message always says what to try instead.
On this page
When a model cannot run, Check model or bitsrun deploy tells you why in plain words. Here is every reason and what to do.
The reasons
It needs its own code
Some repos ship Python code that must run to load the model (trust_remote_code). BitsRun never runs customer code, for your safety and everyone else's. Pick a version of the model that works without it, or a GGUF version.
It is not a text or embedding model
We serve text generation and embedding models today. Image generation, speech, rerankers and other kinds cannot be deployed yet. Vision-language models are served as text only.
The files are in folders
A repo that keeps its GGUF files in subfolders makes the right file impossible to guess. Open the .gguf file you want on Hugging Face and paste its link. BitsRun copies that file into your storage first. Copy the right name from Hugging Face shows where to find that link.
It is split into parts
GGUF files split into several pieces (-00001-of-00003.gguf) are not supported yet. Pick a repo with single-file quants.
It is too large
The model needs more memory than the biggest GPU (4x L4, 96 GB). Choose a quantized version. See Quantization.
The quant does not exist
You asked for a quant the repo does not have. Leave it empty for Q4_K_M, or use one the repo lists.
It was not found
Check the spelling and tag, or the Hugging Face owner and repo name. For a private repo, add a Hugging Face token that can read it.
It uses an unsafe format
Only safetensors and GGUF files are used. Pickle files (.bin, .pt) can run code when loaded, so they are never used.
Quick reference
| Error code | Short meaning |
|---|---|
model_custom_code | Needs its own Python code |
model_task_unsupported | Not a text or embedding model |
model_choose_file | Files in folders: paste the file link |
model_split_unsupported | GGUF split into parts |
model_too_large | Bigger than every GPU |
model_quant_not_found | No file with that quant |
model_not_found | Name or repo not found |
model_gated / model_no_access | Gated repo: accept terms and add your token |
All error codes are listed in Error codes.
Still stuck?
Email support@bitsrun.com with what you tried and any request id you saw. A real person answers.