Local LLMs

Search your Mac by what's in your files: photos, PDFs, recordings, videos and code. On-device, built on Google DeepMind's EmbeddingGemma 2. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsSwift★ 2.1k

Hundreds of models & providers. One command to find what runs on your hardware. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsRust★ 38k

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsGo★ 183k

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsC★ 9k

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsPython★ 23k

A vector index built on TurboQuant, written in Rust with Python bindings. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsRust★ 17k

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsPython★ 987

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsSwift★ 6.9k

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsGo★ 34k

Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsRust★ 1.3k

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024). Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsPython★ 75k

Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsJavaScript★ 67k

Local, open-source AI app builder for power users v0 / Lovable / Replit / Bolt alternative Star if you like it! Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsTypeScript★ 22k

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsRust★ 45k

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsPython★ 8.7k

Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer… Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsPython★ 2k

Open-Source API Development Ecosystem • https://hoppscotch.io • Offline, On-Prem & Cloud • Web, Desktop & CLI • Open-Source Alternative to Postman… Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsTypeScript★ 81k

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server. Why it matters: helps you run models on your own hardware without an API bill.

Local LLMsPython★ 7.5k