SoftPicksLocal LLM Tools
Explore the highest-rated open-source tools for running Large Language Models locally. Discover inference engines, GUI clients, and API wrappers for GGUF and safetensors models. Sorted by GitHub authority and active contributions.
Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden
🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with
PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no
A simple, locally hosted Web Search MCP server for use with Local LLMs
A curated list of OpenClaw resources, tools, skills, tutorials & articles. OpenClaw (formerly
Row-Bot - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR
The ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma,
A harness optimized to smaller LLMs
On-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs
Translate full-length books and documents with Ollama, OpenAI (comptatible), Gemini, Mistral, Poe or
Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs
Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local &
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across
Find the local LLM that actually runs and performs best on your hardware. Ranked by real,
From a goal to a task DAG, automatically. TypeScript-native multi-agent orchestration.