Local Model Tools
Runtimes, servers, and interfaces for running language models on your own hardware instead of a hosted API.
Scoring method (open_source_ai_tools_v1): 40% GitHub activity (time-decay since last push) + 40% stars (log-normalized within category) + 20% license permissiveness, minus 5 points if archived. Last generated: 2026-11-08T07:01:40.632225+00:00
#1
10.0
Ollama
Run large language models locally
+ 186314 GitHub stars (top of category)
+ recently active
+ permissive license (MIT)
#2
9.89
llama.cpp
LLM inference in C/C++, runs on commodity hardware
+ 133685 GitHub stars (top of category)
+ recently active
+ permissive license (MIT)
#3
9.78
vLLM
High-throughput, memory-efficient inference and serving engine for LLMs
+ 96540 GitHub stars (top of category)
+ recently active
+ permissive license (Apache-2.0)
#4
9.48
SGLang
High-performance serving framework for language and multimodal models
+ 38570 GitHub stars (top of category)
+ recently active
+ permissive license (Apache-2.0)
#5
7.26
Text Generation WebUI
Open-source desktop app and web UI for running local LLMs
+ 47734 GitHub stars (top of category)
+ recently active
- restrictive/copyleft license (AGPL-3.0)
No tools match your filter.