Catalog

Nothing is hand-written here: architectures come from the configuration file published by the vendor, hardware entries from the manufacturer database.

All families

34 entries

AlibabaQwen3 0.6B
0.8 B parameters41K contextL28 · KV8 · d128
Calculate with Qwen3 0.6B →model card ↗
AlibabaQwen3 1.7B
2.0 B parameters41K contextL28 · KV8 · d128
Calculate with Qwen3 1.7B →model card ↗
AlibabaQwen3 4B
4.0 B parameters41K contextL36 · KV8 · d128
Calculate with Qwen3 4B →model card ↗
AlibabaQwen3 8B
8.2 B parameters41K contextL36 · KV8 · d128
Calculate with Qwen3 8B →model card ↗
AlibabaQwen3 14B
14.8 B parameters41K contextL40 · KV8 · d128
Calculate with Qwen3 14B →model card ↗
AlibabaQwen3 32B
32.8 B parameters41K contextL64 · KV8 · d128
Calculate with Qwen3 32B →model card ↗
AlibabaQwen3 30B-A3BMoE
30.5 B parameters41K contextL48 · KV4 · d128
Calculate with Qwen3 30B-A3B →model card ↗
AlibabaQwen2.5 Coder 7Bsliding window
7.6 B parameters33K contextL28 · KV4 · d128
Calculate with Qwen2.5 Coder 7B →model card ↗
AlibabaQwen2.5 Coder 32Bsliding window
32.8 B parameters33K contextL64 · KV8 · d128
Calculate with Qwen2.5 Coder 32B →model card ↗
MetaLlama 3.2 1B
1.2 B parameters131K contextL16 · KV8 · d64
Calculate with Llama 3.2 1B →model card ↗
MetaLlama 3.2 3B
3.2 B parameters131K contextL28 · KV8 · d128
Calculate with Llama 3.2 3B →model card ↗
MetaLlama 3.1 8B
8.0 B parameters131K contextL32 · KV8 · d128
Calculate with Llama 3.1 8B →model card ↗
MetaLlama 3.3 70B
70.6 B parameters131K contextL80 · KV8 · d128
Calculate with Llama 3.3 70B →model card ↗
Mistral AIMistral 7B v0.3
7.2 B parameters33K contextL32 · KV8 · d128
Calculate with Mistral 7B v0.3 →model card ↗
Mistral AIMistral Nemo 12B
12.2 B parameters131K contextL40 · KV8 · d128
Calculate with Mistral Nemo 12B →model card ↗
Mistral AIMistral Small 3.1 24B
24.0 B parameters131K contextL40 · KV8 · d128
Calculate with Mistral Small 3.1 24B →model card ↗
Mistral AIMixtral 8x7BMoE
46.7 B parameters33K contextL32 · KV8 · d128
Calculate with Mixtral 8x7B →model card ↗
GoogleGemma 3 1Bsliding window
1.0 B parameters33K contextL26 · KV1 · d256
Calculate with Gemma 3 1B →model card ↗
GoogleGemma 3 4Bsliding window
4.3 B parameters131K contextL34 · KV4 · d256
Calculate with Gemma 3 4B →model card ↗
GoogleGemma 3 12Bsliding window
12.2 B parameters131K contextL48 · KV8 · d256
Calculate with Gemma 3 12B →model card ↗
GoogleGemma 3 27Bsliding window
27.4 B parameters131K contextL62 · KV16 · d128
Calculate with Gemma 3 27B →model card ↗
GoogleGemma 2 9Bsliding window
9.2 B parameters8.2K contextL42 · KV8 · d256
Calculate with Gemma 2 9B →model card ↗
OpenAIgpt-oss 20BMoEsliding window
20.9 B parameters131K contextL24 · KV8 · d64
Calculate with gpt-oss 20B →model card ↗
OpenAIgpt-oss 120BMoEsliding window
116.8 B parameters131K contextL36 · KV8 · d64
Calculate with gpt-oss 120B →model card ↗
MicrosoftPhi-4 14B
14.7 B parameters16K contextL40 · KV10 · d128
Calculate with Phi-4 14B →model card ↗
MicrosoftPhi-4 mini 3.8Bsliding window
3.8 B parameters131K contextL32 · KV8 · d128
Calculate with Phi-4 mini 3.8B →model card ↗
DeepSeekR1 Distill Qwen 7Bsliding window
7.6 B parameters131K contextL28 · KV4 · d128
Calculate with R1 Distill Qwen 7B →model card ↗
DeepSeekR1 Distill Qwen 14Bsliding window
14.8 B parameters131K contextL48 · KV8 · d128
Calculate with R1 Distill Qwen 14B →model card ↗
DeepSeekR1 Distill Qwen 32Bsliding window
32.8 B parameters131K contextL64 · KV8 · d128
Calculate with R1 Distill Qwen 32B →model card ↗
DeepSeekR1 Distill Llama 8B
8.0 B parameters131K contextL32 · KV8 · d128
Calculate with R1 Distill Llama 8B →model card ↗
Zhipu AIGLM-4 9B
9.4 B parameters131K contextL40 · KV2 · d128
Calculate with GLM-4 9B →model card ↗
Zhipu AIGLM-4 9B (0414)
9.4 B parameters33K contextL40 · KV2 · d128
Calculate with GLM-4 9B (0414) →model card ↗
Hugging FaceSmolLM3 3B
3.1 B parameters66K contextL36 · KV4 · d128
Calculate with SmolLM3 3B →model card ↗
IBMGranite 3.3 8B
8.2 B parameters131K contextL40 · KV8 · d128
Calculate with Granite 3.3 8B →model card ↗