What Models? Helps Match Local AI Models to Your Hardware
A new tool called 'What Models?' helps users find the best local AI models for their GPU, VRAM, and system memory, with customizable minimum context windows, speed, and features.
Select your GPU
or
VRAM (GB)
Minimum context window
Minimum tokens/sec
Required features
System RAM (optional) ? Enter your system RAM to enable offloading. Models can use system memory to extend context windows or run larger models at reduced speed.
GB
Pick a GPU or enter VRAM to get started
Results
Select a GPU or enter your VRAM to see which models you can run.