LLM VRAM and Throughput Calculator
Find which local LLMs fit your GPU, Mac or CPU—or which hardware fits a model. Compare KV memory, prefill, decode, runtime support and measured speed references.
Find which local LLMs fit your GPU, Mac or CPU—or which hardware fits a model. Compare KV memory, prefill, decode, runtime support and measured speed references.
Estimate inference and training VRAM, maximum sequence length and microbatch, runtime and cost for full fine-tuning, LoRA and QLoRA. Compare GPU sharding, checkpointing and editable MFU assumptions.
Please confirm you want to block this member.
You will no longer be able to:
Please allow a few minutes for this process to complete.