❌ ÜBERSCHREITET EINZEL-GPU VRAM (NEEDS 2x Apple M4 Pro Mac Mini (64GB))
Mixtral-8x22B-Instruct (MoE) on Apple M4 Pro Mac Mini (64GB) (64GB VRAM)
You need 2x Apple M4 Pro Mac Mini (64GB) (128 GB total VRAM) for full GPU execution, or rent an A100/H100 80GB cloud instance.
🎛️ Interaktiver VRAM-, Kontext- & Offload-Konfigurator
📊 Echtzeit-Speicher- & Performance-Telemetrie
81.38 GB / 64 GB
🟦 Modellgewichte: 79.14 GB
🟪 KV-Cache: 1.75 GB
🟨 Engine-Puffer: 0.49 GB
Benötigter GPU-VRAM81.38 GB
Benötigter System-RAM (CPU)0.00 GB
Verfügbarer Hardware-VRAM64 GB (1x Apple M4 Pro Mac Mini (64GB))
VRAM-Reserve / Defizit-17.38 GB
Geschätzte Decode-Geschwindigkeit~5.7 tokens/sec
Geschätzte Prefill-Geschwindigkeit~122 tokens/sec
Time-to-First-Token (4K Prompt)~33477 ms
Transformer-TopologieMoE-GQA (56L, 8/48 KV/Q heads)
🚀 Startbefehl (vLLM / llama.cpp / Ollama)
ollama run mixtral:8x22b # Or llama.cpp server (8K context, Flash Attention): llama-server -hf mistralai/Mixtral-8x22B-Instruct-v0.1-GGUF -c 8192 -ngl 99 -fa
CLOUD-GPU PREISVERGLEICH & MIETEN-VS-KAUFEN RECHNER
Nicht genug lokaler VRAM? Cloud-GPU in 60 Sekunden starten (Mixtral-8x22B-Instruct (MoE): 81.38 GB in 4-bit)
Recommended Cloud Tier: Multi-GPU H100 / H200 Node · Full FP16 Needs: 264.58 GB
Amortisationszeit (Kauf vs. Miete): ~32 months (vs $2,199 hardware)
| Cloud Provider | RTX 4090 (24GB) | A100 (80GB) | H100 (80GB) | Est. Monthly Cost (4h/day) | Free Credit / Trial | Deploy |
|---|---|---|---|---|---|---|
| RunPod | $0.44 / hr | $1.39 / hr | $2.39 / hr | $52.80 / mo | Instant PyTorch / vLLM Templates + Serverless GPU | Auf RunPod starten → |
| Vast.ai | $0.29 / hr | $0.95 / hr | $1.79 / hr | $34.80 / mo | Save 50–70% on RTX 4090 / 5090 / A100 rentals | Spot-GPU mieten → |
| Vultr Cloud GPU | — | $1.79 / hr | $2.69 / hr | $214.80 / mo (A100) | $300 Free Credit | $300 Guthaben sichern → |
| DigitalOcean GPU | — | — | $2.99 / hr | $358.80 / mo (H100) | $200 Free Credit (60d) | $200 Startguthaben → |
Alle Quantisierungsstufen im Detail: Mixtral-8x22B-Instruct (MoE) × Apple M4 Pro Mac Mini (64GB)
| Quantization Format | Core / Emb BPW | Weights (GiB) | KV Cache (8K) | Total VRAM | 1x Apple M4 Pro Mac Mini (64GB) (64GB) | Decode / Prefill | Min GPUs |
|---|---|---|---|---|---|---|---|
| FP16 / BF16 (Unquantized) | 16 / 16 | 261.89 GB | 1.75 GB | 264.13 GB | Nein (+200.1GB) | ~1.2 / 122 tok/s | 5x |
| FP8 (W8A8 / E4M3) | 8.25 / 8.5 | 135.05 GB | 1.75 GB | 137.29 GB | Nein (+73.3GB) | ~2.2 / 122 tok/s | 3x |
| GGUF Q8_0 (8.50 bpw) | 8.5 / 8.5 | 139.13 GB | 1.75 GB | 141.37 GB | Nein (+77.4GB) | ~2.1 / 122 tok/s | 3x |
| GGUF Q6_K (6.56 bpw) | 6.56 / 6.56 | 107.37 GB | 1.75 GB | 109.62 GB | Nein (+45.6GB) | ~3.2 / 122 tok/s | 2x |
| GGUF Q5_K_M (5.69 bpw) | 5.69 / 6.56 | 93.17 GB | 1.75 GB | 95.42 GB | Nein (+31.4GB) | ~4.1 / 122 tok/s | 2x |
| GGUF Q4_K_M / AWQ (4.83 bpw) | 4.83 / 6.56 | 79.14 GB | 1.75 GB | 81.38 GB | Nein (+17.4GB) | ~5.7 / 122 tok/s | 2x |
| GGUF IQ4_XS (4.25 bpw) | 4.25 / 5.5 | 69.62 GB | 1.75 GB | 71.87 GB | Nein (+7.9GB) | ~7.8 / 122 tok/s | 2x |
| GGUF Q3_K_M (3.91 bpw) | 3.91 / 5 | 64.05 GB | 1.75 GB | 66.29 GB | Nein (+2.3GB) | ~9.9 / 122 tok/s | 2x |
Dieses Modell auf anderen GPUs testen
Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 5090 (32GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 4090 (24GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 5080 (16GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 4080 Super (16GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 4070 Ti Super (16GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 3090 (24GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 4060 Ti 16GB (16GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 3060 12GB (12GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX 6000 Ada (48GB)Mixtral-8x22B-Instruct (MoE) on NVIDIA RTX A6000 (48GB)
Weitere Modelle auf dieser GPU
DeepSeek-R1 671B (MoE) on Apple M4 Pro Mac Mini (64GB)DeepSeek-V3-0324 671B (MoE) on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Llama-70B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Qwen-32B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Qwen-14B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Llama-8B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Qwen-7B on Apple M4 Pro Mac Mini (64GB)Qwen3-235B-A22B (MoE) on Apple M4 Pro Mac Mini (64GB)Qwen3-30B-A3B (MoE) on Apple M4 Pro Mac Mini (64GB)Qwen3-32B on Apple M4 Pro Mac Mini (64GB)