❌ ÜBERSCHREITET EINZEL-GPU VRAM (NEEDS 4x Apple M4 Pro Mac Mini (64GB))
Llama-4-Maverick-17B-128E (400B MoE) on Apple M4 Pro Mac Mini (64GB) (64GB VRAM)
You need 4x Apple M4 Pro Mac Mini (64GB) (256 GB total VRAM) for full GPU execution, or rent an A100/H100 80GB cloud instance.
🎛️ Interaktiver VRAM-, Kontext- & Offload-Konfigurator
📊 Echtzeit-Speicher- & Performance-Telemetrie
227.32 GB / 64 GB
🟦 Modellgewichte: 225.33 GB
🟪 KV-Cache: 1.5 GB
🟨 Engine-Puffer: 0.49 GB
Benötigter GPU-VRAM227.32 GB
Benötigter System-RAM (CPU)0.00 GB
Verfügbarer Hardware-VRAM64 GB (1x Apple M4 Pro Mac Mini (64GB))
VRAM-Reserve / Defizit-163.32 GB
Geschätzte Decode-Geschwindigkeit~7.1 tokens/sec
Geschätzte Prefill-Geschwindigkeit~278 tokens/sec
Time-to-First-Token (4K Prompt)~14726 ms
Transformer-TopologieMoE-GQA (48L, 8/40 KV/Q heads)
🚀 Startbefehl (vLLM / llama.cpp / Ollama)
ollama run llama4:maverick # Or llama.cpp server (8K context, Flash Attention): llama-server -hf meta-llama/Llama-4-Maverick-17B-128E-Instruct-GGUF -c 8192 -ngl 99 -fa
CLOUD-GPU PREISVERGLEICH & MIETEN-VS-KAUFEN RECHNER
Nicht genug lokaler VRAM? Cloud-GPU in 60 Sekunden starten (Llama-4-Maverick-17B-128E (400B MoE): 227.32 GB in 4-bit)
Recommended Cloud Tier: Multi-GPU H100 / H200 Node · Full FP16 Needs: 747.5 GB
Amortisationszeit (Kauf vs. Miete): ~32 months (vs $2,199 hardware)
| Cloud Provider | RTX 4090 (24GB) | A100 (80GB) | H100 (80GB) | Est. Monthly Cost (4h/day) | Free Credit / Trial | Deploy |
|---|---|---|---|---|---|---|
| RunPod | $0.44 / hr | $1.39 / hr | $2.39 / hr | $52.80 / mo | Instant PyTorch / vLLM Templates + Serverless GPU | Auf RunPod starten → |
| Vast.ai | $0.29 / hr | $0.95 / hr | $1.79 / hr | $34.80 / mo | Save 50–70% on RTX 4090 / 5090 / A100 rentals | Spot-GPU mieten → |
| Vultr Cloud GPU | — | $1.79 / hr | $2.69 / hr | $214.80 / mo (A100) | $300 Free Credit | $300 Guthaben sichern → |
| DigitalOcean GPU | — | — | $2.99 / hr | $358.80 / mo (H100) | $200 Free Credit (60d) | $200 Startguthaben → |
Alle Quantisierungsstufen im Detail: Llama-4-Maverick-17B-128E (400B MoE) × Apple M4 Pro Mac Mini (64GB)
| Quantization Format | Core / Emb BPW | Weights (GiB) | KV Cache (8K) | Total VRAM | 1x Apple M4 Pro Mac Mini (64GB) (64GB) | Decode / Prefill | Min GPUs |
|---|---|---|---|---|---|---|---|
| FP16 / BF16 (Unquantized) | 16 / 16 | 745.06 GB | 1.5 GB | 747.05 GB | Nein (+683.0GB) | ~1.8 / 278 tok/s | 12x |
| FP8 (W8A8 / E4M3) | 8.25 / 8.5 | 384.23 GB | 1.5 GB | 386.22 GB | Nein (+322.2GB) | ~3.8 / 278 tok/s | 7x |
| GGUF Q8_0 (8.50 bpw) | 8.5 / 8.5 | 395.81 GB | 1.5 GB | 397.8 GB | Nein (+333.8GB) | ~3.6 / 278 tok/s | 7x |
| GGUF Q6_K (6.56 bpw) | 6.56 / 6.56 | 305.47 GB | 1.5 GB | 307.46 GB | Nein (+243.5GB) | ~4.9 / 278 tok/s | 5x |
| GGUF Q5_K_M (5.69 bpw) | 5.69 / 6.56 | 265.17 GB | 1.5 GB | 267.16 GB | Nein (+203.2GB) | ~5.8 / 278 tok/s | 5x |
| GGUF Q4_K_M / AWQ (4.83 bpw) | 4.83 / 6.56 | 225.33 GB | 1.5 GB | 227.32 GB | Nein (+163.3GB) | ~7.1 / 278 tok/s | 4x |
| GGUF IQ4_XS (4.25 bpw) | 4.25 / 5.5 | 198.21 GB | 1.5 GB | 200.2 GB | Nein (+136.2GB) | ~8.4 / 278 tok/s | 4x |
| GGUF Q3_K_M (3.91 bpw) | 3.91 / 5 | 182.34 GB | 1.5 GB | 184.33 GB | Nein (+120.3GB) | ~9.3 / 278 tok/s | 3x |
Dieses Modell auf anderen GPUs testen
Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 5090 (32GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 4090 (24GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 5080 (16GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 4080 Super (16GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 4070 Ti Super (16GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 3090 (24GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 4060 Ti 16GB (16GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 3060 12GB (12GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX 6000 Ada (48GB)Llama-4-Maverick-17B-128E (400B MoE) on NVIDIA RTX A6000 (48GB)
Weitere Modelle auf dieser GPU
DeepSeek-R1 671B (MoE) on Apple M4 Pro Mac Mini (64GB)DeepSeek-V3-0324 671B (MoE) on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Llama-70B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Qwen-32B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Qwen-14B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Llama-8B on Apple M4 Pro Mac Mini (64GB)DeepSeek-R1-Distill-Qwen-7B on Apple M4 Pro Mac Mini (64GB)Qwen3-235B-A22B (MoE) on Apple M4 Pro Mac Mini (64GB)Qwen3-30B-A3B (MoE) on Apple M4 Pro Mac Mini (64GB)Qwen3-32B on Apple M4 Pro Mac Mini (64GB)