HEEEXY
AI toolLocal AI

Awesome Local LLM

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

FreeOpen source

What you get

Awesome Local LLM is a free, open-source AI tool published on GitHub by rafska. A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally GitHub stars: 2,990 License: MIT (free to use) Topics: ai, awesome, awesome-list, llm, local, local-ai, local-llm, resources Last updated: 2026-10-21 How to get it: open the repository on GitHub, read the README and follow the setup steps. HEEEXY lists it in the Lab because it is popular, actively maintained and openly licensed.

More for local ai

  • Local Deep Research: ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
  • MakazhanAlpamys Soup: Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
  • Dograh Hq Dograh: Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.