Mixtral 8x7B
A 47 billion-parameterHow many numbers the model learned during training — the usual rough measure of its size. mixture-of-expertsA model split into parts where only a few run for each word, so it answers faster than its size suggests. model using ~13 billion parameters per token from Mistral AI. Sparse MoE with 8 experts, 2 active per token.
- Size
- 46.7B12.9B active
- Memory to run
- ~30 GBsmallest, 8K ctx
- Context
- 32Ktokens
- License
- PermissiveApache License 2.0
- Updated
- 13 Sept 2026
Which version to use
- Variant Mixtral 8x7B Instruct v0.1 · Mistral AITuned to follow instructions and hold a conversation. The usual choice.
- Variant Mixtral 8x7B Instruct v0.1 Parasite · ApolloRainesA community or third-party fine-tune of another variant.
Where it runs
Best-fitting version on each reference system, at an 8K contextHow much text the model can consider at once, counted in tokens — roughly ¾ of a word each..
Runs well 9
- A100 80GB server~157 tok/s est.
- Dual RTX 3090~69 tok/s est.
- GB10 mini workstation~7 tok/s est.
- MacBook Pro M3 Max 64 GB~31 tok/s est.
- MacBook Pro M4 Max 128 GB~42 tok/s est.
- Mac mini M4 Pro 48 GB~21 tok/s est.
- Mac Studio M2 Ultra 192 GB~62 tok/s est.
- RTX 5090 workstation~138 tok/s est.
- Ryzen AI Max+ 395 mini PC~6 tok/s est.
Slowly (CPU or offload) 4
- CPU-only Ryzen 9 7950X~6 tok/s est.
- RTX 4060 Ti 16GB budget build~11 tok/s est.
- RTX 4090 workstation~24 tok/s est.
- RX 7900 XTX desktop~24 tok/s est.
Too large 0
None of the reference systems.
Benchmarks
Each benchmarkA fixed set of questions every model is given, so their scores can be compared on the same task. is developer-reported; prompts and settings differ between labs. Bars are relative to the best open result.
Variants & downloads
Each variant is a separate set of weights. Expand one for its downloads: quantizationStoring each of the model’s numbers with fewer bits, so the file is smaller and needs less memory. trades a little quality for a much smaller file, and the memory column adds the working memoryExtra space the model needs while it answers. It grows with the length of the conversation, on top of the file itself. a conversation needs on top.
Variant Mixtral 8x7B Instruct v0.1Permissive
- What it is
- Tuned to follow instructions and hold a conversation. The usual choice.
- Publisher
- Mistral AI
- License
- Apache License 2.0 · commercial use allowed
- Released
- 11 Dec 2023
- huggingface
- mistralai/Mixtral-8x7B-Instruct-v0.1
Contributions are not open yet, so there is nothing here from members.
| Quantization | Format | Bits | Download | Memory @ 8K | Publisher |
|---|---|---|---|---|---|
| Download BF16native | safetensors | 16 | 87.0 GiB | Mistral AImistralai/Mixtral-8x7B-Instruct-v0.1 | |
| Download Q4_K_Mk quant | gguf | 4.89 | 26.6 GiB | LM Studio Communitylmstudio-community/Mixtral-8x7B-Instruct-v0.1-GGUF |
Variant Mixtral 8x7B Instruct v0.1 ParasitePermissive
- What it is
- A community or third-party fine-tune of another variant.
- Publisher
- ApolloRaines
- License
- Apache License 2.0 · commercial use allowed
- Released
- 21 Jul 2026
Contributions are not open yet, so there is nothing here from members.
No downloadable artifacts recorded.
Architecture details
- Parameters
- 46.70B
- Active / token
- 12.9B
- Architecture
- Mixture of experts
- Layers
- 32
- Attention heads
- 32
- KV heads
- 8
- Head dim
- 128
- KV cache @ 8K (fp16)
- 1.00 GiB
- Max context
- 32,768 tokens
Measured performance
Throughput on specific systems and runtimes, with the source of each measurement.
Community results
Reviews
Lineage
How this model’s variants relate to each other and to other models.
Sources & history
Sources
- Hugging Face Hub (live source, 1 record, 13 Sept 2026)
External identifiers
- huggingface mistralai/Mixtral-8x7B-Instruct-v0.1
- huggingface ApolloRaines/Mixtral-8x7B-Instruct-v0.1-Parasite
Field history
- base = "mistralai/Mixtral-8x7B-Instruct-v0.1" — Hugging Face Hub (current)
- derivation = "fine_tune" — Hugging Face Hub (current)
- license = "apache-2.0" — Hugging Face Hub (current)
- name = "Mixtral 8x7B Instruct v0.1 Parasite" — Hugging Face Hub (current)