FitLLM

FitLLM

Overview

Will this LLM fit on your GPU, multi-GPU rig or Mac? Exact VRAM & KV-cache math. Read-only.

Quick Start

Tip: If your OS has the MatrixHub Client registered, clicking Open MatrixHub Client in the sidebar will launch it. If not, the manual commands below do exactly the same thing.

1. Install the Component

Run the following command in your terminal to install the component.

matrix install mcp.run-fitllm-fitllm.sse.208c51c9b9@1.0.0 --alias fitllm

2. Run the Component

Once installed, you can start it with the run command.

matrix run fitllm

3. Use It

Your component is now running. You can interact with it at http://127.0.0.1:<port> (the port will be shown in your terminal).

Technical Details

For advanced use cases, you can view the raw component manifest file.
View Raw Manifest (JSON)