LLM VRAM and Throughput Calculator
Find which local LLMs fit your GPU, Mac or CPU—or which hardware fits a model. Compare KV memory, prefill, decode, runtime support and measured speed references.
Hardware sizing for AI: how much GPU memory and speed a language model needs for its size, quantization and context length.
Find which local LLMs fit your GPU, Mac or CPU—or which hardware fits a model. Compare KV memory, prefill, decode, runtime support and measured speed references.
Please confirm you want to block this member.
You will no longer be able to:
Please allow a few minutes for this process to complete.