Qwen3 4B
A 4 billion-parameterHow many numbers the model learned during training — the usual rough measure of its size. dense model from Qwen Team (Alibaba Cloud). Dense and MoE models with hybrid thinking modes.
- Size
- 4.02Bdense
- Memory to run
- —smallest, 8K ctx
- Context
- 32Ktokens
- License
- PermissiveApache License 2.0
- Updated
- 7 Nov 2026
Where it runs
Best-fitting version on each reference system, at an 8K contextHow much text the model can consider at once, counted in tokens — roughly ¾ of a word each..
Measured throughput
Versions & downloads
Each version is a separate set of weights. Expand one for its downloads: quantizationStoring each of the model’s numbers with fewer bits, so the file is smaller and needs less memory. trades a little quality for a much smaller file, and the memory column adds the working memoryExtra space the model needs while it answers. It grows with the length of the conversation, on top of the file itself. a conversation needs on top.
Variant Qwen3 4B BasePermissive
- Good for
- Publisher
- Qwen Team (Alibaba Cloud)
- License
- Apache License 2.0 · commercial use allowed
- Released
- 28 Apr 2025
- huggingface
- Qwen/Qwen3-4B-Base
Contributions are not open yet, so there is nothing here from members.
No downloadable artifacts recorded.
Variant Qwen3 4B Instruct 2507Permissive
- Good for
- Publisher
- Qwen Team (Alibaba Cloud)
- License
- Apache License 2.0 · commercial use allowed
- Released
- 5 Aug 2025
- huggingface
- Qwen/Qwen3-4B-Instruct-2507
Contributions are not open yet, so there is nothing here from members.
No downloadable artifacts recorded.
Variant SRA RiskGate 4BPermissive
- Good for
- Publisher
- sriram1983007
- License
- Apache License 2.0 · commercial use allowed
- Released
- 3 Oct 2026
- huggingface
- sriram1983007/SRA-RiskGate-4B
Contributions are not open yet, so there is nothing here from members.
No downloadable artifacts recorded.
Other sizes in Qwen3: Qwen3 0.6B, Qwen3 1.7B, Qwen3 8B, Qwen3 14B, Qwen3 30B-A3B, Qwen3 32B, Qwen3 235B-A22B
Benchmarks
Each benchmarkA fixed set of questions every model is given, so their scores can be compared on the same task. score is labelled with who produced it. Developer-reported scores use each lab’s own prompts and settings; a benchmark that runs every model itself uses one setup for all. Bars are relative to the best open result.
Community
Benchmark runs and reviews from people running it on their own hardware.
Benchmark runs
Reviews
Details & sources
Architecture
- Parameters
- 4.02B
- Active / token
- All (dense)
- Architecture
- Dense
- Layers
- 36
- Attention heads
- 32
- KV heads
- 8
- Head dim
- 128
- KV cache @ 8K (fp16)
- 1.13 GiB
- Max context
- 32,768 tokens
Lineage
How this model’s versions relate to each other and to other models.
Sources
- Hugging Face Hub (live source, 1 record, 7 Nov 2026)
External identifiers
- huggingface Qwen/Qwen3-4B-Base
- huggingface Qwen/Qwen3-4B-Instruct-2507
- huggingface sriram1983007/SRA-RiskGate-4B
Field history
- auto_promotion = {"repo":"Qwen/Qwen3-4B-Base","rule":"first_party_release","evidence":["publisher Qwen is Qwen Team (Alibaba Cloud), developer of Qwen, Qwen Coder, Qwen Math","repo name Qwen3-4B-Base belongs to family Qwen","config.json: 36 layers, 32 attention heads, 8 KV heads, head dim 128, context 32768","safetensors metadata: 4,022,468,096 parameters, consistent with 4B","published 2025-04-28 (Hugging Face repository creation date)","variant kind base stated by the name"]} — Hugging Face Hub (current)
- auto_promotion = {"repo":"Qwen/Qwen3-4B-Instruct-2507","rule":"first_party_release","evidence":["publisher Qwen is Qwen Team (Alibaba Cloud), developer of Qwen, Qwen Coder, Qwen Math","repo name Qwen3-4B-Instruct-2507 belongs to family Qwen","config.json: 36 layers, 32 attention heads, 8 KV heads, head dim 128, context 262144","safetensors metadata: 4,022,468,096 parameters, consistent with 4B","published 2025-08-05 (Hugging Face repository creation date)","variant kind instruct stated by the name"]} — Hugging Face Hub (current)
- base = "Qwen/Qwen3-4B-Instruct-2507" — Hugging Face Hub (current)
- derivation = "fine_tune" — Hugging Face Hub (current)
- license = "apache-2.0" — Hugging Face Hub (current)
- name = "SRA RiskGate 4B" — Hugging Face Hub (current)
Timeline
- Official Qwen3 GGUF quantizations published
- Qwen3 released with MoE and hybrid thinking