大模型库 (36)
DeepSeek-R1 671B (MoE)
671B (37B active) · MLA-MoE
Q4_K_M VRAM: 378.7 GB
DeepSeek-V3-0324 671B (MoE)
671B (37B active) · MLA-MoE
Q4_K_M VRAM: 378.7 GB
DeepSeek-R1-Distill-Llama-70B
70.55B (70.55B active) · Dense-GQA
Q4_K_M VRAM: 43.09 GB
DeepSeek-R1-Distill-Qwen-32B
32.76B (32.76B active) · Dense-GQA
Q4_K_M VRAM: 21.23 GB
DeepSeek-R1-Distill-Qwen-14B
14.77B (14.77B active) · Dense-GQA
Q4_K_M VRAM: 10.61 GB
DeepSeek-R1-Distill-Llama-8B
8.03B (8.03B active) · Dense-GQA
Q4_K_M VRAM: 6.22 GB
DeepSeek-R1-Distill-Qwen-7B
7.62B (7.62B active) · Dense-GQA
Q4_K_M VRAM: 5.43 GB
Qwen3-235B-A22B (MoE)
235.1B (22.2B active) · MoE-GQA
Q4_K_M VRAM: 134.4 GB
Qwen3-30B-A3B (MoE)
30.53B (3.34B active) · MoE-GQA
Q4_K_M VRAM: 18.53 GB
Qwen3-32B
32.76B (32.76B active) · Dense-GQA
Q4_K_M VRAM: 21.22 GB
Qwen3-14B
14.77B (14.77B active) · Dense-GQA
Q4_K_M VRAM: 10.36 GB
Qwen3-8B
8.19B (8.19B active) · Dense-GQA
Q4_K_M VRAM: 6.47 GB
Qwen3-4B
4.02B (4.02B active) · Dense-GQA
Q4_K_M VRAM: 3.61 GB
Qwen2.5-72B-Instruct
72.71B (72.71B active) · Dense-GQA
Q4_K_M VRAM: 44.38 GB
Qwen2.5-Coder-32B-Instruct
32.76B (32.76B active) · Dense-GQA
Q4_K_M VRAM: 21.23 GB
Qwen2.5-14B-Instruct
14.77B (14.77B active) · Dense-GQA
Q4_K_M VRAM: 10.61 GB
Qwen2.5-7B-Instruct
7.62B (7.62B active) · Dense-GQA
Q4_K_M VRAM: 5.43 GB
QwQ-32B Reasoning
32.76B (32.76B active) · Dense-GQA
Q4_K_M VRAM: 21.23 GB
Llama-4-Maverick-17B-128E (400B MoE)
400B (17.2B active) · MoE-GQA
Q4_K_M VRAM: 227.32 GB
Llama-4-Scout-17B-16E (109B MoE)
109B (17.2B active) · MoE-GQA
Q4_K_M VRAM: 63.7 GB
Llama-3.3-70B-Instruct
70.55B (70.55B active) · Dense-GQA
Q4_K_M VRAM: 43.09 GB
Llama-3.1-405B-Instruct
405B (405B active) · Dense-GQA
Q4_K_M VRAM: 233.02 GB
Llama-3.1-70B-Instruct
70.55B (70.55B active) · Dense-GQA
Q4_K_M VRAM: 43.09 GB
Llama-3.1-8B-Instruct
8.03B (8.03B active) · Dense-GQA
Q4_K_M VRAM: 6.22 GB
Llama-3.2-3B-Instruct
3.21B (3.21B active) · Dense-GQA
Q4_K_M VRAM: 3.33 GB
Mistral-Large-2-123B
122.6B (122.6B active) · Dense-GQA
Q4_K_M VRAM: 72.84 GB
Mistral-Small-3.1-24B-Instruct
23.6B (23.6B active) · Dense-GQA
Q4_K_M VRAM: 15.28 GB
Mixtral-8x22B-Instruct (MoE)
140.6B (39.1B active) · MoE-GQA
Q4_K_M VRAM: 81.38 GB
Mixtral-8x7B-Instruct (MoE)
46.7B (12.9B active) · MoE-GQA
Q4_K_M VRAM: 27.8 GB
Codestral-22B
22.2B (22.2B active) · Dense-GQA
Q4_K_M VRAM: 14.81 GB
Google Gemma-3-27B-IT
27.4B (27.4B active) · Dense-GQA
Q4_K_M VRAM: 20.34 GB
Google Gemma-3-12B-IT
12.2B (12.2B active) · Dense-GQA
Q4_K_M VRAM: 10.75 GB
Google Gemma-3-4B-IT
4.3B (4.3B active) · Dense-GQA
Q4_K_M VRAM: 4.24 GB
Microsoft Phi-4 14B
14.66B (14.66B active) · Dense-GQA
Q4_K_M VRAM: 10.5 GB
Cohere Command-A 111B
111B (111B active) · Dense-GQA
Q4_K_M VRAM: 66.19 GB
GLM-4-32B-0414
32B (32B active) · Dense-GQA
Q4_K_M VRAM: 20.77 GB