LLM tooling

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingC++★ 23k

Open-source personal finance app with an AI financial advisor: track your net worth, investments, ETFs, cash and debts on your own computer. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 3.1k

A privacy-first app that strips AI watermarks from content you own. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 24k

The chat decision assistant: before you reply, Jev reads the chat, judges intent and risk, and drafts replies you fill in with one tap. You press… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingKotlin★ 7.7k

Debloat macOS: turn off Apple Intelligence, analytics, ads and pop-ups. A native app and CLI, and every change can be undone. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingSwift★ 4.5k

Multiplayer agent harness for work. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 15k

Open-source AI brand visibility and competitor reports. Official website: https://niubigeo.ai/ | Paid services: AI testing by real people and GEO… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 7.6k

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 14k

PRINTFILM: AI short-video marketing and AI short-drama creation platform. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 5.1k

利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 130k

f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingHTML★ 173k

《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 6.4k

Source code for the Claude Opus 5.5 music video for I'm Upping My P(doom). Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingJavaScript★ 2.1k

把腾讯WorkBuddy账号变成 OpenAI 兼容 API 的多账号网关，同时自动完成任务中心全部任务，附 Web 管理面板（账号池可视化 / 积分任务 / 配置热更新）。基于 Sliverkiss/workbuddy2api 的增强分支. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingGo★ 3k

Fully automatic censorship removal for language models. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 35k

面向求职与开发场景的实用 AI Skills 集合，支持简历优化、岗位投递、面试准备与开发提效。 Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingHTML★ 5.6k

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 39k

DeepSeek Harness（DSH）一只住在 DSH 界面右下角的小鲸鱼娘，帮你盯着DeepSeek账户余额。QQ弹弹，支持拖拽吸附、左吸附翻转、数字滚动动画，随界面自动启用，建议直接喊来你的dsh安装. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingJavaScript★ 4.7k

Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 25k

Your Cheat Sheet For AI Engineering Interviews at Top AI Companies - Questions and Answers. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingMarkdown★ 1.7k

Build plugins that feel like native, first-class features of ChatGPT. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 1k

A high-throughput and memory-efficient inference and serving engine for LLMs. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 94k

Specialised AI models for logo design — a brand-analysis model turns a business into constraints, typography and symbol models construct the mark… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 1.5k

An AI prompt optimizer for writing better prompts and getting better AI results. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 38k

开放的侧边栏底座，支持三方拓展注册新侧边栏页面。内置文件渲染编辑/终端/侧边对话/Git/子代理页面 ｜ Open sidebar foundation, supports third-party extensions to register new sidebar pages. Built-in… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 4.1k

Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 168k

Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request). Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 1.2k

A starter kit for animating hand-painted cartoons with Claude: p5.js + p5.brush, the Clawd character, 31 acted emotions and a guide for the model. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingJavaScript★ 1.1k

claude-opus-5-5-demo. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingJavaScript★ 1.1k

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 61k

A Multilingual, Multimodal Translation Model Family. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 1.5k

EverRoom - A workspace that remembers your projects, decisions, and sources. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 3k

The AI chat app that sweats the details. Every top model, real memory, living documents, and your own tools. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 506

极致轻量｜阻止论文的防御性写作 | Anti-defensive writing for academic papers — 学术写作原则 Skill + prompt pack (CN/EN). Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 2.9k

Professional agent skills for screenwriting, television writing and dramaturgy. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 1.6k

A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 1.1k

A small, fast decision model, or system one model, for agentic workflows. Pick between options or rate on a scale faster than an LLM, with a… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 601

The open, local take on Jev: typed decisions from an LLM, without generating a single token. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 887

the development environment for pros. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingGo★ 1.2k

SGLang is a high-performance serving framework for large language models and multimodal models. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 37k

JevChat-Windows：聊天窗口旁挂的回复辅助。窗口截图 + 本地离线 OCR 读对方消息 → Jev 判断意图 → 3 条候选一键填入，发送永远手动. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 802

TypeLLM: LLMs with type-safe generation. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 946

腾讯 CodeBuddy 账号池管理控制台，内置 OpenAI 兼容反代网关：扫码批量纳管账号、定时签到与保活、密钥分组分发、IP 与模型白名单、调用日志与用量统计；支持带签名校验的一键更新。 Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 1.1k

Open-source project in LLM tooling. Why it matters: useful plumbing for shipping LLM-powered features.

LLM tooling★ 2.6k

An arbitrage bot is a smart contract connected to an external automation script that controls its operation. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingSolidity★ 2.8k

瞬息洞察 IP 纯净底色与风险评级。仅需一键探寻，物理坐标、机房源流与代理轨迹尽收眼底。一站式 IP 与网络诊断工具箱：查询归属、ASN、信誉与风险，检测网络出口、DNS/CDN、浏览器指纹与 WebRTC，聚合 AI 服务状态。 Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 1.1k

AirLLM 2.8T LLM inference with single 4GB GPU. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingJupyter Notebook★ 38k

TypeScript project in LLM tooling. Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingTypeScript★ 2.5k

Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and… Why it matters: useful plumbing for shipping LLM-powered features.

LLM toolingPython★ 1.5k