FitLLM
run.fitllm/fitllm
Will this LLM fit on your GPU, multi-GPU rig or Mac? Exact VRAM & KV-cache math. Read-only.
This endpoint completed initialize and tools/list. No tool was called.
- Rank
- #1653
- Score
- 82
- Tool tokens
- 1,044
- Tools
- 3
Tools
Token cost is the o200k count of the tools list JSON, including schemas, before any tool is called.
check_llm_fit
Check whether a specific local LLM fits in the memory of a specific GPU or Apple Silicon Mac. Returns fits/tight/won't-fit verdict with the memory breakdown (weights, KV cache, linear-attention state
what_fits_on_hardware
Rank which popular local LLMs fit on a given GPU or Apple Silicon Mac (at ~4-bit quantization, 8K context) — models that fit come first, biggest first, with max context each. Use when a user asks "wha
list_supported
List the built-in model names and hardware names this fit-checker knows (for mapping user wording to exact names). Standard text-only HuggingFace transformer configs can also be checked via fitllm.run
Nearby in Other
Free fantasy pools for the four tennis Grand Slams. What play for love means, and who is winning.
Directory and marketplace of local businesses and independent professionals near you.
Academic research search across PubMed and arXiv
Read-only access to live ADSBiq aircraft and network state, with community contribution metadata.