Can I run this LLM? Requirements for every model, measured from real files.
89 models × every quantization × every GPU. Sizes are pulled daily from Hugging Face GGUF repos — not computed from formulas, so what you see is what you download.
Head-to-head comparisons
Frequently asked questions
How do I know if I can run an LLM on my PC?
Compare your VRAM (GPU) or system RAM (CPU inference) with the model's GGUF file size plus KV-cache overhead. Rough guide: an 8B model at Q4_K_M needs ~6 GB VRAM at 8K context, a 27-30B model needs ~18-20 GB, and 70B+ needs multi-GPU or CPU offload. Every ModelFit page lists the measured file size for each quantization so you can match it to your exact hardware.
Where do ModelFit's numbers come from?
Directly from the Hugging Face API, refreshed daily: the actual published GGUF file sizes from community repos (unsloth, Bartowski and others) plus KV-cache and runtime overhead for 8K context. Nothing is estimated from parameter-count formulas.
Which quantization should I pick?
Q4_K_M is the standard balance of quality and size. Drop to IQ3/Q3 only when VRAM is tight; choose Q5/Q6 when you have headroom and want maximum quality. Each model page shows what every quantization needs on your hardware.