LLM Open Source Tools

InAI & Machine Learning

ESP32 firmware for LLM-powered voice chatbots via MCP

• 31,693 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toMem0

Add persistent user memory to any LLM app via API, Apache 2.0

• 31,339 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toTokenade

Cuts LLM context use by up to 98% per session via local MCP sandbox

• 31,315 GitHub stars
• CustomLicence Elastic License 2.0 (ELv2)
• #LLM

Alternative toCursor

Cursor alternative that routes AI to your own LLM provider

• 28,812 GitHub stars
• Apache-2.0Licence Apache-2.0

Alternative toDataGrip

AI text-to-SQL client for 40+ databases; local-first, self-hosted

• 28,327 GitHub stars
• CustomLicence Apache-2.0 with additional commercial restrictions (LicenseRef-Chat2DB)

Alternative toHugging Face Inference Endpoints

Local inference engine for DeepSeek V4 Flash/PRO and GLM 5.2

• 23,970 GitHub stars
• MITLicence MIT
• #LLM

Alternative toLM Studio

Fast LLM inference for Apple Silicon with persistent SSD KV caching

• 22,964 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toVoiceflow

Visual chatbot builder with LLM integration and live deployment

• 22,570 GitHub stars
• MITLicence MIT
• #Chatbots

Alternative toOpenAI

Alibaba's Apache 2.0 LLM in sizes from small to frontier scale

• 21,700 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toAtScale

Headless BI platform with a shared semantic layer for your data

• 21,046 GitHub stars