SoftPicksLocal LLM Tools
Explore the highest-rated open-source tools for running Large Language Models locally. Discover inference engines, GUI clients, and API wrappers for GGUF and safetensors models. Sorted by GitHub authority and active contributions.
🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with
PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no
A simple, locally hosted Web Search MCP server for use with Local LLMs
A curated list of OpenClaw resources, tools, skills, tutorials & articles. OpenClaw (formerly
Row-Bot - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal
Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR
The ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma,
A harness optimized to smaller LLMs
On-device, real-time multimodal AI. Have natural voice and vision conversations with an AI that runs
Translate full-length books and documents with Ollama, OpenAI (comptatible), Gemini, Mistral, Poe or
Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs
Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local &
Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across
Find the local LLM that actually runs and performs best on your hardware. Ranked by real,
From a goal to a task DAG, automatically. TypeScript-native multi-agent orchestration.