Llama-4-Maverick-17B-128E (400B MoE) VRAM Requirements & GPU Benchmarks

Llama-4-Maverick-17B-128E (400B MoE) (400B total, 17.2B active, 48L, 8 KV heads, vocab 202048) requires 227.32 GB in 4-bit Q4_K_M, 386.22 GB in FP8, and 747.05 GB in FP16 at 8K context.

CLOUD-GPU PREISVERGLEICH & MIETEN-VS-KAUFEN RECHNER

Nicht genug lokaler VRAM? Cloud-GPU in 60 Sekunden starten (Llama-4-Maverick-17B-128E (400B MoE): 227.32 GB in 4-bit)

Recommended Cloud Tier: Multi-GPU H100 / H200 Node Β· Full FP16 Needs: 747.05 GB

Amortisationszeit (Kauf vs. Miete): ~32 months (vs $1,699 hardware)
Cloud Provider RTX 4090 (24GB) A100 (80GB) H100 (80GB) Est. Monthly Cost (4h/day) Free Credit / Trial Deploy
RunPod $0.44 / hr $1.39 / hr $2.39 / hr $52.80 / mo Instant PyTorch / vLLM Templates + Serverless GPU Auf RunPod starten β†’
Vast.ai $0.29 / hr $0.95 / hr $1.79 / hr $34.80 / mo Save 50–70% on RTX 4090 / 5090 / A100 rentals Spot-GPU mieten β†’
Vultr Cloud GPU β€” $1.79 / hr $2.69 / hr $214.80 / mo (A100) $300 Free Credit $300 Guthaben sichern β†’
DigitalOcean GPU β€” β€” $2.99 / hr $358.80 / mo (H100) $200 Free Credit (60d) $200 Startguthaben β†’
GPU Hardware VRAM Bandwidth FP16 (747.05GB) Q4_K_M (227.32GB) Decode / Prefill Speed Report
NVIDIA RTX 5090 32 GB 1792 GB/s Nein Nein ~6.6 / 3167 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 4090 24 GB 1008 GB/s Nein Nein ~6.3 / 2497 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 5080 16 GB 960 GB/s Nein Nein ~6.1 / 1704 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 4080 Super 16 GB 736 GB/s Nein Nein ~6.1 / 1578 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 4070 Ti Super 16 GB 672 GB/s Nein Nein ~6.1 / 1333 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 3090 24 GB 936 GB/s Nein Nein ~6.3 / 1073 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 4060 Ti 16GB 16 GB 288 GB/s Nein Nein ~6 / 667 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 3060 12GB 12 GB 360 GB/s Nein Nein ~5.9 / 384 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX 6000 Ada 48 GB 960 GB/s Nein Nein ~7 / 2754 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA RTX A6000 48 GB 768 GB/s Nein Nein ~7 / 1170 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA L40S 48GB 48 GB 864 GB/s Nein Nein ~7 / 5472 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA A100 80GB SXM 80 GB 2039 GB/s Nein Nein ~8.6 / 4716 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA H100 80GB SXM 80 GB 3350 GB/s Nein Nein ~8.7 / 14950 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA H200 141GB SXM 141 GB 4800 GB/s Nein Nein ~14.6 / 14950 tok/s Exakten VRAM & Speed berechnen β†’
NVIDIA Blackwell B200 192GB 192 GB 8000 GB/s Nein Nein ~34.6 / 18000 tok/s Exakten VRAM & Speed berechnen β†’
AMD Instinct MI300X 192GB 192 GB 5300 GB/s Nein Nein ~33.6 / 18000 tok/s Exakten VRAM & Speed berechnen β†’
2x NVIDIA RTX 3090 (48GB) 48 GB 936 GB/s Nein Nein ~7 / 2147 tok/s Exakten VRAM & Speed berechnen β†’
2x NVIDIA RTX 4090 (48GB) 48 GB 1008 GB/s Nein Nein ~7 / 4994 tok/s Exakten VRAM & Speed berechnen β†’
4x NVIDIA A100 80GB (320GB) 320 GB 2039 GB/s Nein Ja (71%) ~134.9 / 18000 tok/s Exakten VRAM & Speed berechnen β†’
8x NVIDIA H100 80GB (640GB) 640 GB 3350 GB/s Nein Ja (36%) ~221.7 / 18000 tok/s Exakten VRAM & Speed berechnen β†’
Apple M4 Max (128GB Unified) 128 GB 546 GB/s Nein Nein ~11 / 556 tok/s Exakten VRAM & Speed berechnen β†’
Apple M3 Ultra Mac Studio (512GB) 512 GB 819 GB/s Nein Ja (44%) ~59.3 / 819 tok/s Exakten VRAM & Speed berechnen β†’
Apple M4 Pro Mac Mini (64GB) 64 GB 273 GB/s Nein Nein ~7.1 / 278 tok/s Exakten VRAM & Speed berechnen β†’