SoftPicksopen source
Kubernetes operator for local LLM inference with llama.cpp, vLLM, TGI, and mlx-server — multi-GPU
Portable multi-agent AI developer setup for Claude Code + Ollama. Role-based local LLM orchestration
A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model
Turn your Android phone into an OpenAI-compatible LLM inference server — Fully local, private and
Hyprdots, Hyprland Omarchy, Quickshell, Agentic Local-Ai, Custom Integrated, Minimal
A simple experiment on letting two local LLM have a conversation about anything!
Enterprise-ready self-hosted AI assistant runtime with sandboxed execution, secure credentials,
Modern desktop application (Rust + Tauri v2 + Svelte 5 + Candle (HF)) for communicating with AI
⚡ A local, privacy-focused AI desktop assistant for Windows. Control your PC remotely via Telegram
More than just Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts
Memory that learns what works.
Synthetic Autonomic Mind - An AI assistant for everyone.
Give a query, get a dataroom. Pi + self-hosted Qwen3.6 research harness on a single L4.
This repository provides a ready-to-use Google Colab notebook that turns Colab into a temporary
Run local LLM from Huggingface in React-Native or Expo using onnxruntime.
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
Chat, RAG search, multi-step Plans workflows, MCP tools, and Agents integration. Supports OpenAI,
Project Jarvis is a versatile AI assistant that integrates various functionalities.
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI.
M-Courtyard: Local AI Model Fine-tuning Assistant for Apple Silicon. Zero-code, zero-cloud,
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python.
Vibecode Editor is a fullstack, web-based IDE built with Next.js and Monaco Editor. It features
Openai-style, fast & lightweight local language model inference w/ documents
A python package for developing AI applications with local LLMs.