LLM Memory Calculator
LLM Memory Calculator
LLM Memory Calculator
This tool help you evalutate the memory needed to run a LLM on your Mac depending on the model and the context length.
It can evaluate memory usage with multiple llm frameworck (Torch, Tranformers..) but work better for MLX.
This tool can help you evaluate the quantity of memory needed to run a transformer model with the length of the context.
Model configuration:
Search a model first
Model configuration:
Search a model first
Model configuration:
Search a model first