Inference Gateway Desktop, an AI client for any model provider (github.com via hn) ollamacodexopenai+1 17h
topic
Ollama
-
Inference Gateway Desktop A native desktop app for AI agents that work on your computer - with any model provider and your own API keys. Like Codex or Co-Work, but provider-agnostic: OpenAI, Anthropic, Google, local Ollama models or any Op…
-
Dynamic Agentic Harness with Recursive Self-Improvement (RSI) A universal, model-agnostic Dynamic Agentic Harness that wraps frozen LLMs (from local 9B–80B Ollama models to frontier cloud models) in a Just-In-Time (JIT) Self-Configuring &…
-
I built local-model-mcp, a small MCP server that lets a Claude session hand light, read-only work to a model running locally under Ollama. I designed it iteratively with Claude Code, deciding at each step which functions to add next, and C…
-
LM Studio vs. Ollama on Linux: same model files, measured on an RTX 3090 (homebrewserver.club via hn) ollama 2d
LM Studio and Ollama both run local language models, and both serve an API that other programs can use. This page runs the same two Qwen3.5 GGUF files in both, in Docker, on one RTX 3090.
-
Show HN: Zumungo – AI-driven home automation (zumungo.com via hn) ollama 4d
Just released Zumungo AI driven Home Automation zumungo.com. Zumungo uses the power and flexibility of well established open source projects such as HomeAssitant, Frigate, Whisper, go2rtc, Piper, Open AI, Ollama, etc.
-
-
Show HN: psi, a 6.4 MB cross-platform portable coding agent in ANSI C & Lua (psicode.ai via hn) ollamacodexopenai+1 7d
Choose your model. Anthropic, OpenAI Codex, OpenRouter, or local models with Ollama.
-
Show HN: AIVim – an open-source, Vim-inspired AI editor (news.ycombinator.com) ollama 8d
I thought it would be cool to have a modern, Vim-inspired editor with AI, so I built AIVim. Just revamped it.
-
Show HN: Infinity – Git-style branching for AI chats (infinitychat.app via hn) ollamachatgpt 9d
Hello HN, I'm Nik. I built Infinity for myself because I tend to love to rabbit-hole on various subjects.
-
Claude Code had 26 releases in October. Here's the one feature worth knowing, plus 11 other agents (www.reddit.comhttps) ollamacursorcodex+3 10d
Here's my list of agents that released something cool this month, Claude Code included. I dug through all the changelogs so you don't have to.
-
PaidinToken – Open LLM Token Pricing and Local GPU VRAM Calculator (www.paidintoken.com via hn) ollama 13d
Find out exactly which open-weight models your graphics card or Mac can run before downloading gigabytes of weights. Detailed VRAM requirements, recommended quantization profiles, and 1-click Ollama shell commands for 16 major hardware pro…
-
GTA in space (with AI NPCs) (www.reddit.com via reddit) ollama 2w
Pretty fun. Having a lot of fun building it too.
-
Show HN: Ollama Mock Server (ollama-mock.kinduff.com via hn) ollama 2w
A fake Ollama server for testing without running models. Same API, same port, any model name.
-
Show HN: StrictLLM – For when you need human-in-the-loop (strictllm.com via hn) ollamachatgptopenai+1 2w
Hi, We've been working on this for the last 9 months and are nervcited to share this on HN and gather input. StrictLLM is a desktop application for Mac, Windows, and Linux that will give you the following abilities: - Human-in-the-loop wit…
-
2TI Desktop Suite – Rust/Tauri Native Apps (<30MB RAM) with Ollama Perfect Audio (2tinteractive.com via hn) ollama 2w
Authenticated Update Engine Stdin-piped root privilege separation ensures seamless, secure apt and dpkg package updates without insecure password exposure. Suite infrastructure · 2TInteractive 2TI Launcher 1.1.1 is the single native cockpi…
-
Show HN: Clai.chat – Agents as JSON, config and (multi-vendor) transcript sync (www.clai.chat via hn) mistralollamadeepseek+3 2w
Command-line AI for people and agents: query OpenAI, Anthropic, Google, Mistral, DeepSeek, xAI, Ollama, and OpenRouter from your terminal with unix pipes, profiles, Agent Skills, and MCP tools. Share and rate configs on the clai.chat commu…
-
Show HN: Ollama client library for Golang with streaming API support (github.com via hn) ollama 2w
gollama A Go client library for the Ollama API. Manage models, generate completions, chat, and create embeddings against a local or remote Ollama server, with both streaming API support.
-
Ollama adds local text-to-speech, 100x faster than real time on Apple Silicon (ollama.com via hn) ollama 3w
Ollama now supports speech models, starting with Phonon from Gradium. Read text aloud in five languages and dozens of voices, streamed as it is generated, over 100 times faster than real time on Apple Silicon.
-
NeuronDump: Open a local LLM as a 3D graph, cut parts, see what breaks (github.com via hn) ollamallama 3w
NeuronDump Look inside any local LLM, find the parts it doesn't need, and make it smaller. NeuronDump reads GGUF model files (the format used by Ollama and llama.cpp) and shows what is inside: layers, attention heads, vocabulary, chat temp…
-
How Improved Voicebot agents now? Does Help Sales and support end to end (news.ycombinator.com) ollama 3w
from 2025, Voicebot agent are trending too much. I have thinking to create another voicebot with on premises option helps to BFSI client on their system.
-
Ollama flint requires 0.40.8 but most recent is 0.40.7 (news.ycombinator.com) ollama 3w
Anyone got to install latest https://ollama.com/library/flint from Ollama site? This needs 0.40.8 but the latest Ollama version is 0.40.7 and I checked with github version.
-
macOS 27 has a built-in, offline LLM you can call from Terminal (news.ycombinator.com) ollamallamachatgpt 3w
Apple appears to have made its Foundation Models accessible directly from Terminal in macOS 27. The interesting part is how little setup is required: ``` fm respond "Your Question" ``` You can also pipe text into it, request structured JSO…
-
Nexus-CLI (DeepSeek Web Bridge for Golang) ⚡ English | Русский | O'zbekcha A high-performance Golang CLI utility and local API proxy server that enables any application or coding agent to connect to DeepSeek V3 (deepseek-chat) and R1 (deep…
-
OpenCode Integration (DS V4.1 Flash 1017) (www.reddit.com via reddit) ollamahaikusonnet+4 3w
For context: I have no background in coding or the like, I've been using my Pro plan to work on personal projects vibe-coding and using resources/tools publicly available to get the most out of Claude. Projects worked/working on: google ex…
-
Claude Code setting cannot be recovered once clicked use Claude Code in Ollama! (www.reddit.com via reddit) ollamaclaude-code 3w
Does any one know how to resume Claude Code desktop setting, I accidentially installed ollama and click Claude Code in ollama, after than, all my setting in Claude Code gone!!! and it is like a junk software, even reinstall uninstall ollam…
-
Benchmarks yzma is fast because it calls llama.cpp in the same process. There is no external server.
-
2TI LMailer – Native Linux email and groupware (Rust, Tauri v2, local Ollama) (2tinteractive.com via hn) ollama 4w
could not extract summary
-
Rhino MCP (www.food4rhino.com via hn) model-context-protocolollamacopilot+2 4w
RhinoAiMCP connects Rhino 7 & 8 for Windows/Mac to AI assistants such as Claude Desktop, GitHub Copilot, Codex and Ollama through the Model Context Protocol (MCP). Use natural language to create geometry, explore design ideas and automate…
-
-
Mac mini M6 (32 GB) as a headless agent machine: how would you set it up? (www.reddit.com via reddit) ollamaclaude-code 4w
-
Show HN: EpochGo – Local-first multi-agent AutoML on Ollama ($0 API costs) (github.com via hn) ollama 5w
⚡ EpochGo Autonomous, Local-First Multi-Agent AutoML Platform by Epochlypse Research • Powered by CrewAI, Ollama, and Scikit-Learn / XGBoost / LightGBM / CatBoost Zero API keys. Zero cloud costs.
-
How to make it right? (www.reddit.com via reddit) ollamaopenclaw 5w
Hello! After spending several evenings trying to create a simple ai agent, I ended up with more questions than answers.
-
Show HN: Long term memory agent for "real world" data work (github.com via hn) ollamallamacodex+1 5w
Hi HN! I am an FDE and in all my clients' projects I have encountered the same problem: real world data preparation is the bottleneck.
-
Alternatives for Opus (www.reddit.com via reddit) ollamaqwenopus 5w
Hi all, I recently brought claude pro and been using Opus, I'm about to hit my weekly limit and stupidly used the free reset while i had the 5 hour cooldown instead of saving it for now. I'm wondering if there is any local ollama models th…
-
Sharing because this sub cares about running things locally. The engine itself contains no model.
-
I use Linux Mint XFCE as my daily driver and got jealous of all the Wispr Flow demos floating around. It's macOS/Windows-first and subscription-based, so instead of switching OS I spent a few weekends building the thing myself.
-
I trained a model to be wrong 98% of the time and 96% sure about it. It took three tries. (www.reddit.com via reddit) ollama 5w
Meet Bev. She is a decision model (the Jev / Nimble kind: you give her a situation and a question, she gives a probability for each answer), fine-tuned on Qwen3.5-9B to pick the worst answer on purpose.
-
Show HN: Flash-Agents – DSH as MCP for Claude (github.com via hn) ollamadeepseekcodex+1 5w
I do a lot of work using claude and codex. I use plenty of sub-agents.
-
Claude Code vs Claude Desktop vs ChatGPT Codex vs Local LLM (www.reddit.com via reddit) ollamachatgptcodex+1 5w
Hey, long title, but bear with me please :) I'm working on a video game, a small app for my personal use that I plan to release for $8, and some other small side projects. One of my buddies likes Codex better for coding, and Claude Code be…
-
Show HN: Bloby – Clippy on Steroids Chrome Extension Using Chrome AI and Ollama (chromewebstore.google.com via hn) ollama 6w
Overview Clippy on steroids Meet Bloby—your adorable, floating AI sidekick living right inside your browser! Think of Clippy, but supercharged with modern AI, total local privacy, 100x more squishiness, and best of all—it's 100% free with…
-
Show HN: Fast Ollama like router that gives a text-only model eyes and ears (github.com via hn) ollama 6w
funcroute A small C router that gives a text-only model eyes, ears and a filing cabinet. Point your client at funcroute instead of at a model vendor, and the cheap text-only model you already use starts handling screenshots, voice memos an…
-
I found that I'm not using even 1/3 of vim/vscode features anymore. That's wht I'm building rhun - a small code editor for Linux, Windows and Apple silicon Macs.
-
Sriti Core – Local-first LLM router that cascades Ollama to cloud to frontier (github.com via hn) ollama 6w
Sriti Core Intelligent, Reliability-Aware Model Routing & Cascade Engine for LLMs Key Features • Architecture • Quickstart • How It Works • Configuration • API Reference • Testing • Troubleshooting • License Overview Sriti Core is an open-…
-
Hey HN, Anders and Tom here. We're building Magnitude, an inference engine for agents that optimizes itself to run as fast as possible on your hardware.
-
Ollama now supports Jev-like decision models all locally in 0.35 (ollama.com via hn) ollama 6w
4,258 Downloads Updated 18 hours ago ollama run nimble Nimble requires Ollama 0.35 or later. Nimble is a 9B decision model from Bespoke Labs, fine-tuned from Qwen3.5-9B.
-
Got my most expensive coding AI Sub i ever gotten after trying Alternatives (www.reddit.com via reddit) ollamadeepseek 6w
My new Subscription So after using this professionally before, but at company cost, I finally pulled the plug and got myself a Max plan. I hope my wife will not castrate me with a spoon.
-
Why we removed Ollama from Return (and what replaced it) (returneditor.ai via hn) ollama 6w
Why we removed Ollama from Return (and what replaced it) Return is a document analysis tool built for lawyers. The people it serves work under privilege, and the first question they ask about an AI tool is always the same: where does the d…
-
I've been working on Yengi for several months. I am a teacher, not a professional software developer.
-
A tiny mascot that thinks, Ollama cloud and Kokoro STT now included (medium.com via hn) ollama 7w
medium.com Performing security verification This website uses a security service to protect against malicious bots. This page is displayed while the website verifies you are not a bot.
-
So this started when I saw PewDiePie's Odysseus thing and thought "ok but can I just make my Claude CLI and my Gemini CLI talk to each other". Turns out yes, and it got a bit out of hand.
-
Ollaya – Ollama for open-source, Jev-style decision models (ollaya.dev via hn) ollama 7w
Ollaya downloads and serves open decision models on your own machine. Typed, calibrated answers in milliseconds — private and open source.
-
IronWarden – A microsecond PII firewall for streaming LLMs in safe Rust (github.com via hn) vllmollamaopenai+1 7w
🏰 IronWarden High-Performance Sovereign AI Reverse Proxy & Privacy Firewall IronWarden is a sovereign, ultra-low-latency AI security reverse proxy and PII firewall written in bare-metal Rust. Point any OpenAI, Anthropic, or Ollama/vLLM SDK…
-
I built Kev, an Apache-2.0 open-source System One-style decision engine, using Claude Code during development. The project is free to try and can be run locally with your own model.
-
Show HN: Local-coder – Build a team of coding agents with local models (github.com via hn) ollama 8w
local-coder Turn the models your machine can run into a private, verified team of coding agents. local-coder builds a local coding-agent environment on top of Ollama and OpenCode.
-
Maki Maki is a Python framework for building multi-agent LLM applications. It supports multiple LLM backends (Ollama, OpenAI, Anthropic, HuggingFace), a plugin system with 16 built-in tools, a workflow engine with dependency resolution and…
-
Using local/non-Anthropic LLMs in Claude Desktop on Windows? (www.reddit.com via reddit) ollamaqwenanthropic+1 8w
I would like to be able to use non-Anthropic and local LLMs in Claude Desktop, and switch seamlessly between Opus and, for example, a local Qwen model. I found a tutorial showing how to do this with Ollama, but the tutorial is for Mac, and…
-
I built AIRUNCODE because I was frustrated by two patterns in current AI coding environments: cloud vendor lock-in that wipes project memory when switching providers, and platforms adding heavy markups on top of user API keys.AIRUNCODE is…
-
Ask HN: What happens when Claude Code goes away? (news.ycombinator.com) ollamaclaude-code 8w
I have become very proficient with Claude Code and I use it for everything, both at work and in my personal life. At this point, if I lost access to it, it would be like missing a body part.
-
Polygo, a local-first CLI that translates your app's strings with Ollama (github.com via hn) ollama 8w
polygo Lokalise for one person. A 4 MB CLI binary that translates your app's strings with a local model, tracks what changed in a lockfile, and refuses to write a translation with a broken placeholder or a missing plural form.
-
Benchmarking Local LLM Servers: Llama.cpp, Llamafile, LM Studio, and Ollama (blog.mozilla.ai via hn) ollamallama 8w
Benchmarking Local LLM Servers: llama.cpp, llamafile, LM Studio, and Ollama Benchmarking Local LLM Servers evaluates llama.cpp, llamafile, LM Studio, and Ollama across Mac, Linux, and Steam Deck. The study reveals build flags and configura…
-
Show HN: OpenBot, open source framework similar to Grok Bot (github.com via hn) ollamagrokopenai+1 8w
I think the path Grok Bot took is absolutely the right one, the collaborating bots model is easy to understand and it maps to workflows naturally. However, Grok Bot is closed source and quite expensive (I ran out of tokens on Ultra tier),…
-
Shodan indexes over 47.000 exposed Ollama instances (twitter.com via hn) ollamasecurity 8w
Ollama Shodan indexes over 47.000 exposed Ollama instances, including many running on expensive cloud GPUs. The API has no authentication, which means hackers can run prompts, steal models and exploit vulnerable versions.
-
Show HN: Echodot – Local-first AI that writes replies in your tone (github.com via hn) ollama 8w
I built echodot – a free, open-source desktop app that drafts replies in your personal writing style. Problem: Most AI writing tools either force you into their voice or require constant copy-pasting between apps.
-
Show HN: OpenDocBot – bring your own model to Word, Excel and PowerPoint (opendocbot.com via hn) ollamadeepseekgemini+3 8w
I got tired of the lock-in and black-box nature of AI inside MS Office. One vendor decides which models you can use, where your document data goes, and what the agent is actually allowed to do.
-
Show HN: A Coding Agent from Scratch (blog.softwarewrighter.com via hn) ollama 8w
I saw a post about building a coding agent from "first principles" and that inspired me to create my own. I used my own custom Rust-based ML DSL to implement this.
-
Ollama 0.33.3 changed what prompt_eval_duration measures (lognebudo.github.io via hn) ollama 8w
Ollama 0.33.3 changed what prompt_eval_duration measures If you compute prefill throughput from Ollama's metrics the way everyone has always computed it, your numbers have been wrong since 0.33.3 — and wrong in the flattering direction. On…
-
Notes on gotchas while migrating 35kb preprompts from Opus to self-hosted Ollama (patrickmccanna.net via hn) ollamacodexopus+1 9w
Motivations: Maybe you’re a Claude code/codex user diligently avoiding uploading personal data to LLM providers. Is it possible that the most valuable information isn’t your data- but the metadata about your sessions?
-
Show HN: I built Otis, a minimal AI agent that runs local models out of the box (triangllabs.ai via hn) ollamallama 9w
Hi everyone, Been working on Otis, an open-source ai agent that gives you one minimal experience across local and hosted open-weight models, privacy-focused by design. On setup it recommends a local model based on the hardware Otis is runn…
-
Gemma 4 26B on a 24 GB Mac Mini M4: from 66% CPU to 100% GPU (mac-mini-m4-doc.masterfabric.co via hn) ollamagemmamoe 9w
TL;DR Three facts and one command. Bench — Mac mini M4 · 24 GB unified memory · macOS 26.5 · Ollama 0.34.0 · gemma4:26b Q4_K_M (MoE, 25.2B total / ~4B active) · measured 2026-09-13 ollama ps )sudo sysctl iogpu.wired_limit_mb=20480 # raise…
-
Show HN: Raggy – A lightweight CLI tool for RAG over local documents (github.com via hn) ollamarag 9w
raggy A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with LangChain, Chroma, and Ollama. Hybrid database (vector + BM25 index) and embedding generation run fully locally.
-
Setting up OpenCode with Ollama and sbx on Mac (tensorsandtokens.com via hn) ollama 9w
Running Opencode with Ollama on mac. How to get started with running Ollama local models with Opencode and Docker Sandboxes.
-
Coding Sahayi – Local-first autonomous AI coding IDE (WinUI 3 and Ollama) (codingsahayi.github.io via hn) ollamafine-tuning 9w
Local-first autonomous WinUI 3 IDE powered by Ollama, ConPTY self-repair loops, and local fine-tuning.
-
Muse Spark thoughts? (www.reddit.com via reddit) ollamacursor 9w
So thoughts? I was playing with Muse before it dropped into Cursor for sometime, thought it was light years better then ollama especially at coding, which was instantly noticed.
-
What AI subscription should I switch to? (www.reddit.com via reddit) altmanollamaglm+1 9w
Big Claude user, but Anthropic got stingy as hell with the limits. I used to barely touch my weekly allowance; now I can burn through 20% in a day and I'm cooked in ~2 days.
-
Show HN: Gremlord – Run Claude Code on any model, with a budget (gremlord.com via hn) ollamaopenaianthropic+1 9w
Run the unmodified Claude Code on Anthropic, OpenAI, xAI, Ollama, or any OpenAI-compatible endpoint. Every token priced.
-
Ollama replacement 2-4x faster for no extra compute cost (github.com via hn) ollamallama 9w
llmash An Ollama-compatible server and command line for Windows, built on llama.cpp. It serves your GGUF files through llama-server and keeps Ollama's commands, API and model store, so anything already pointed at Ollama keeps working.
-
Show HN: MaskShift – a maximalist coding agent with zero NPM dependencies (github.com via hn) tool-callingvllmollama+6 10w
MaskShift is a local-first coding agent harness. Features: - Works with models that have no tool-calling API.
-
Bobbin: Pentest with a local LLM, so target data never leaves your machine (github.com via hn) ollamasecurity 10w
bobbin A small coding agent for small local models. A dependency-free agent runtime for local models via Ollama.
-
About two weeks ago I started an experiment: instead of prompting a local model to play a character, give it a folder and let it become one. The idea is simple.
-
Show HN: Building AI agents client-side JavaScript (news.ycombinator.com) function-callingvllmollama 10w
Hey HN, most agent systems default to server-side Python inside containers and chain frameworks. I wanted to see how far we could push agent in the browser with vanilla JavaScript https://buttercup.sh The reason this is interesting is beca…
-
Fixed the shitty Ollama api for Claude Desktop app (www.reddit.com via reddit) ollamaclaude-code 10w
Repo - https://github.com/aaditya-v-more/claude-ollama Problems fixed - No 1 Million context if using claude code desktop app extension api throwing errors and claude giving up Subagents in long workflows like /deep-research and /batch kep…
-
Ollama Plans Changed (ollama.com via hn) ollama 10w
Pricing Free For getting started with open models Includes: - Run models locally - Starter usage credits included - Includes access to starter models - Add credits to unlock all models - No service fees Pro Max For shorter, well-defined da…
-
Let's see how Fable 5.1 handles building true Swarm Intelligence (www.reddit.com via reddit) ollamasonnetanthropic 10w
Anthropic released Fable 5.1 today, everyone started blasting with it on High effort or higher for everything they should really be using Sonnet for. My entire Twitter/X feed is purely people complaining that they used their weekly usage w…
-
Ollama's Transparent Pricing (ollama.com via hn) ollama 10w
Ollama's transparent pricing August 31, 2026 Ollama’s Pro, Max, and Team plans now use transparent per-token pricing. Based on your feedback, every plan includes a monthly pool of usage credits.
-
18 month survey of unsecured Ollama servers and an unsolved mystery (day50.dev via hn) ollama 10w
Eighteen months of unsecured Ollama servers, reconstructed from the commit history of three scanners that publish what they find along with hundreds of mysterious servers that aren't as they appear. Thousands of real machines have Ollama l…
-
Ask HN: Best open source way to run local open-weight LLMs in 2026? (news.ycombinator.com) ollama 11w
As we are lucky to have great open weight models these days, I was wondering what is the recommended way to run these models locally, while staying with open source software that doesn't track you etc? The only tool I've really tested is O…
-
I always run so many AI agents that I keep ending up with mystery processes, stray localhost ports, and no quick way to tell what started what. So I built Port Visualizer, a free open-source Windows app that shows which process owns each T…
-
Hey everyone, TL;DR: Built a git-native orchestrator for my coding-agent backlog to safely run parallel agents overnight. It isolates every ticket in its own git worktree so they can't step on each other, and it pools local models (Ollama…
-
local model builds the automation once, then it's just python, no tokens per file (www.reddit.com via reddit) ollama 11w
been building a tool that takes a plain-english file chore and turns it into a graph of python steps. you basically tell it "grab the photos from this folder, fix the timezone, sort by date" and it wires the steps up for you.
-
AI-powered email agent that syncs your emails via IMAP (github.com via hn) ollamaopenaianthropic 11w
📧 EmailAI An AI-powered email agent that syncs your emails via IMAP and provides intelligent analysis using OpenAI, Anthropic, or local Ollama. ✨ Features 🔄 IMAP Sync - Mirror your email account locally with batch syncing 👁️ IDLE Support -…
-
Hallucinations and severe scope drifts inspite of planning. (www.reddit.com via reddit) ollamaglmhallucination 11w
I am using 20x plan. I am seeing a lot of hallucination and scope drift, and extremely slow execution.
-
Run Open Models on Claude Desktop (ollama.com via hn) ollama 11w
Claude Desktop support with Ollama August 25, 2026 Developers can now easily configure Claude Desktop to seamlessly work with Ollama as a third-party gateway provider. Use open models in Claude Use cloud models for larger coding and resear…
-
IBM Granite 4.2 8b is 5.2 GB but loads into 27 GB? (www.reddit.com via reddit) ollama 11w
I have a Linux server with an RTX 5060 Ti 16 GB. I am running Ollama as a Docker container with the NVIDIA GPU mounted into it.
-
LM studio and qwen 3.8 (www.reddit.com via reddit) ollamaqwen 11w
LM studio and bionic don't load into GPU fully ( Ollama does) and it crashes BSD ( Ollama Does not), with stop code: WHEA_UNCORRECTEABLE_ERROR (0x124), i am using the default load setting, all updated LM studio and drivers, What do i need…
-
PowerAI – A zero-dependency local terminal AI harness using Ollama (github.com via hn) ollama 11w
Landing Page & Web Simulator • Quick Install • Commands • How It Works • License Quick Install macOS & Linux (Bash / Zsh) curl -fsSL https://raw.githubusercontent.com/Luizhcrs/powerai/main/install.sh | bash Windows (PowerShell 5.1 / 7+) ir…
-
🍳 yeschef A kitchen for Claude Code and Codex. Local models on your own hardware (your line of cooks) that take the grunt work, talk it out in bounded rooms, and never hit a rate limit.
-
Significant improvements to Row-Bot recently. Looking for feedback. (github.com via reddit) ollama 11w
v4.5.0: Added native desktop control, agent execution budgets, concurrency limits, loop protection, and safer local embedding fallback. v4.6.0: Rebuilt agents around durable parent-led orchestration.
-
Locally deployed Large Language Models (LLMs) via inference engines such as Ollama run without the moderation and abuse detection present in API-served models. Therefore, the safety of LLMs depends on the defense mechanisms used, and their…
-
Split my GPUs across VMs and gained a ~3x performance boost in Ollama (www.reddit.comhttps) ollama 12w
tl;dr - split one VM (with 3 pooled GPUs) into two VMs (1 dedicated + 2 pooled); worth every second spent spooling up the extra VM. Some numbers: Qwen3.8:27b went from 12.2 tok/s to 33.91 tok/s muse-glimmer:30B went from about 14.3 tok/s t…
-
Mozilla killed orbit. I rebuilt it locally. (www.reddit.com via reddit) ollama 12w
Hey everyone! Last year, Mozilla released Orbit, an AI-powered browser summarizer hosted on a GCP server.
-
Running Ollama LFM2.5-2.6B on iGPU on Linux (arthurbrugiere.fr via reddit) ollama 12w
Running Ollama on iGPU on Linux Table of Contents Like everyone, I’m interested in running my own Large Language Models (LLM), so I installed Ollama in my homelab some time ago. Ollama is a tool to easily run LLM, and exposes this local AI…
-
My Git client uses the `claude` CLI as its AI backend instead of an API key (www.reddit.com via reddit) ollamaanthropic 12w
I build a desktop Git client called AngKorGit. For the AI parts I didn't want to ask people for an Anthropic API key, so instead it runs the `claude` CLI you already have installed and uses whatever plan you're already on.
-
Gemma 12B is obviously a very well trained model, I always thought the fine tuning they did on it wasn't really cut out for agentic coding. From my own experiences it struggles to use the tools it's given from Github Copilot and is also ve…
-
Maintainer here, so full disclosure up front. Anarlog is a desktop app and no bot joins the call.
-
Continue coding agent is dead. Alternatives? (news.ycombinator.com) continue-devollamacursor 12w
It was nice to use on vscode with offline Ollama but today notices it is not updated anymore. So, alternatives you use?
-
Show HN: ChickenButt a Native GTK Chat Client for Ollama on Linux (www.chickenbutt.dev via hn) ollama 12w
What's up, ChickenButt? I made a free, native GTK client called ChickenButt.
-
A proxy to translate OpenCode OpenAI calls to native Ollama, allows ctx >4096 (github.com via hn) ollamaopenai 12w
py-ollama-openai-bridge A lightweight HTTP proxy that translates OpenAI /v1/chat/completions requests to Ollama's native /api/chat API and back. The Problem Ollama's OpenAI-compatible endpoint (/v1/chat/completions) has serious runtime con…
-
Menu bar widget for Ollama Cloud usage (macOS, open source) (github.com via hn) ollama 12w
🦙 Ollama Usage Widget A native macOS menu bar widget that tracks your Ollama Cloud usage (weekly & session quotas, per-model request counts, cost) and your local Ollama server state — right from the menu bar. Features Menu bar pill — black…
-
Show HN: Ollama served my 40k-context model at 4k, silently (github.com via hn) ollama 12w
A model that advertises 40,960 tokens was being served 4,096 I've been running knowledge distillation experiments on consumer hardware: one RTX 5080 (16GB VRAM), 32GB of system RAM, an 850W supply, and Qwen3 at 1.7B, 4B, 8B, and 14B, all Q…
-
Ask HN: Is it safe to pass user input to Ollama? any way to sanitize it? (news.ycombinator.com) ollama 12w
I'd like to give user queries to ollama running a small model, but ollama does have a complex tokenization pipeline. Most software that processes user input has turned out to have flaws over the years, is there anything I can do to sanitiz…
-
New OllamaMQ v0.3.0 (news.ycombinator.com) vllmollama 12w
- loading / unloading models - ollama, lm-studio, vllm - optional security tokens and visibility and many more on - https://github.com/Chleba/ollamaMQ
-
ChatOSS is built on Ollama. If you use Ollama, ChatOSS local works out of the box.
-
VibePod 0.20: one CLI, multiple agents, switchable logins per run (www.reddit.com via reddit) ollamaqwencodex+1 12w
VibePod runs coding agents (Claude Code, Codex, Qwen Code, and others) in containers. 0.20 adds credential profiles — keep a subscription login, an API-key setup, and e.g.
-
GenOffice fork that works with any local LLM instead of a cloud account (github.com via hn) vllmollamallama+1 12w
GenOffice (local-LLM fork) A free, open-source AI Office suite — this fork drops the cloud-account requirement and talks to any OpenAI-compatible endpoint instead: a local server (Ollama, LM Studio, vLLM, llama.cpp server, text-generation-…
-
Show HN: Chrome extension that tracks job applications on your machine (github.com via hn) ollama 13w
I kept losing track of what I had submitted vs just opened, across Microsoft/Eightfold, Lever, etc. Chrome extension, load unpacked.
-
ClaudeAI to Leverage Local AI via LM Studio (www.reddit.com via reddit) ollama 13w
I am starting to explore some orchestrated use of local ai models, supervised with claude (desktop app with co-work). Essentially, having Claude driving local LM Studio and Ollama models for tasks.
-
Show HN: Visual knowledge graphs using Ollama and Embeddings (github.com via hn) ollama 13w
Local Knowledge Graph Ask a local model a question, watch it reason step by step, and see the steps drawn as a graph. Blue edges are embedding similarity — association.
-
Show HN: A new chat interface for Ollama (github.com via hn) ollama 13w
Not liking the design of the currently common ones so I made my own.
-
Claude Code plugin for translating from Claudish to English (www.reddit.comhttps) ollamagemmaclaude-code 13w
I (like thousands of other engineers) got tired of trying to understand Claude's writing. ASD-STE100 instructions didn't change much, so I decided to approach the problem in the 2026 style: use an LLM.
-
I wanted the "E.V." assistant from the new Spider-Man film, but actually running on my own machine — no cloud, no subscription. So I built it.
-
Hi /ClaudeAi community! let me showcase one of the coolest projects i worked untill now.
-
Show HN: Benchmark local LLMs fit for your device specs (github.com via hn) ollama 14w
Benchmark local LLMs with custom sets of tasks via Ollama and similar providers on a wide variety of metrics. You can use deterministic evaluation criteria or LLM judges with custom instructions.
-
could not extract summary
-
Show HN: Scout – a self-hosted Discord AI memory bot (github.com via hn) ollama 14w
Scout, a self-hosted Discord memory bot. Listens to the conversation and creates summaries and answers questions.
-
Benchmark scores are reported as properties of a model, yet the inference framework used to produce them, such as HuggingFace, vLLM, or Ollama, are considered non-influential and their names and versions are almost never disclosed. In this…
-
connects to wherever you're. Claude, ChatGPT, Codex, Claude Code, opencode, Local LLM (ollama), or any MCP client.
-
Homebench – Benchmark local LLMs for speed, memory, and quality (github.com via hn) ollamallama 14w
homebench **Benchmark the local LLMs you already have — speed, memory, and quality — as a live terminal leaderboard. homebench is a single-command TUI that discovers the models installed in your local runner (Ollama, LM Studio, llama.cpp,…
-
The rapid transition from reactive large language models (LLMs) to persistent, action-capable systems has exposed critical gaps in the architectural understanding of Agentic AI, particularly in separating inference, orchestration, and exec…
-
Anybody else does something like this ? I tend to save the big guys (Claude and codex) for the last days of the week, i use cheap models for most of my day to day work (now deepseek v4 flash) and save my quotas with the smart models for th…
-
Show HN: Hermes Notes PKB (github.com via hn) ollama 15w
20+ years of PKMS obsession plus big enough chops to be dangerous at vibe-coding have led to this: a full-featured, block-first personal knowledge base that you host yourself and can connect to your own AI. Imagine if Capacities and Obsidi…
-
Anthropic's new MCP spec, Kimi K3 open weights on Ollama, GPT Transcribe, plus (ddsboston.com via hn) model-context-protocolollamamcp+1 15w
Welcome to the daily AI news brief for vibe coders. It is Thursday, July 30, 2026, and the last 24 hours were about the plumbing you build on: a new Model Context Protocol spec, another open-weight model in your terminal, and two speech AP…
-
Show HN: MandoCode Desktop – Native Windows AI Coding Assistant on Ollama .NET (github.com via hn) ollama 15w
Quick backstory on how this version came to be: the original MandoCode is a CLI, and its UI is built with RazorConsole — Blazor components rendered into a terminal. Genuinely clever tech!
-
Agent and RAG for Obsidian, Need Feedback (news.ycombinator.com) ollamarag 15w
I just built this as a Personal/Portfolio project. I genuinely needed it, so I built it and I regularly use it.
-
I kept reaching for Opus by default on every project — "just in case" — with no real basis for the call. Then I'd burn through my limits on work Sonnet would have handled fine.
-
Hey everyone, Most MCP memory servers available right now are either simple key-value stores or bare-bones text search wrappers. They store data, but they don't really connect or curate it.
-
Show HN: Reply Better AI – browser AI writing that runs on-device or your Ollama (chromewebstore.google.com via hn) ollama 15w
Overview Improve and reply to messages with AI. Free and private, no key: on-device or a local model (Ollama/LM Studio).
-
Show HN: Kdeps – A New CLI Coding Agent That Runs on Open Weight Models (kdeps.com via hn) ollama 15w
Local AI agent Run `kdeps` and you are in an AI REPL. Use Ollama or llamafile for a fully offline, private coding agent - no API key, no cloud dependency.
-
Measured LLM inference speeds on Apple Silicon, with raw data (CC BY 4.0) (macyou.co via hn) ollama 15w
Benchmarks Apple Silicon LLM inference benchmarks Measured on our own production fleet — not estimated from spec sheets. Each figure is the median of 3 runs via the Ollama API with a fixed prompt and 512-token generation budget.
-
In addition to the previously supported modes (Quick/Balanced/Deep/Unlimited) where LLMs only gave you what you wanted in a limited budget, i took a look at what Bullets did in terms of response. Turns out representing responses in Bullets…
-
Kimi-K3 on Ollama (ollama.com via hn) ollama 15w
Currently Kimi K3 requires a Pro or Max subscription, and consumes extra usage credits. We’re quickly working on adding capacity to expand access.
-
Show HN: Parley – self-hosted LLM mesh for the machines you own (github.com via hn) ollamaopenai 15w
Parley One binary that turns every machine on your network — Apple Silicon Macs, NVIDIA workstations, spare CPU boxes — into one shared, private LLM cluster. OpenAI- and Ollama-compatible, so the tools you already use just work.
-
Command-hook compliance gate: Cursor rules + Ollama, no cloud judge (www.reddit.com via reddit) ollamacursor 16w
Cursor type: "prompt" hooks always use Cursor’s own model. No model / baseUrl — you can’t point them at Ollama.
-
Show HN: Lexicon a free Grammarly alternative, local writing assistant (lexicon-writer.pages.dev via hn) ollamallama 16w
Lexicon is a rich-text editor with grammar checking and AI writing tools (rewriting, tone shifting, and summarizing) that run entirely on your machine. No account, no API calls, and nothing uploaded.
-
TL;DR: Aesop is a multi-agent coding harness, built mostly by Claude running on itself. As of 0.4.0 it has two "seats" you point at any model from one config block — the seat that writes code, and the seat that decides whether to ship it.
-
Local CLI that profiles token spend for AI coding agent sessions (Claude, Cursor, Codex, Ollama). AgentCost Local open-source CLI that profiles what drives token spend in AI coding agent sessions — not just totals.
-
AI Firewall – Security Gateway and Reverse Proxy for LLM Traffic (github.com via hn) vllmollamagemini+2 16w
🛡️ AI Firewall — Security Gateway & Reverse Proxy for LLM Traffic AI Firewall is a security gateway that sits between your applications and LLM APIs (OpenAI, Anthropic, Gemini, Ollama, vLLM). It inspects prompts before they leave your peri…
-
Show HN: Mozilla killed Orbit, so I built a local-LLM extension (github.com via hn) ollama 16w
Hi HN, Last summer, Mozilla killed Orbit (their own page-summarizer extension). So I rebuilt it: fully local, running on WebLLM (Chrome/Edge), WASM (Firefox), or your own Ollama instance if you want a more powerful model.
-
Use AI Free – GUI, Web, CLI, Telegram, 2k MCP, 100K Skills (news.ycombinator.com) ollamamcp 17w
Use AI free — Gui, Web, Cli, Telegram, 2,000 MCP, 100K Skills . LiteLLM (100+ providers), local models via Ollama, /lang in 34 languages, Mesa Redonda, voice, OCR, MemPalace, embedded sandbox OS.
-
Show HN: Qelvora, a local Mac writing tool I built by directing Codex (qelvora.app via hn) ollamacodex 17w
Correct spelling and grammar in selected macOS text with Ollama models running locally. Read the guideLocal-first correction for macOS Polish text without sending it away.
-
I made a browser like Comet — free, and the agent doesn't stop after a few tasks (www.reddit.comhttps) mistralollamadeepseek 17w
I built a browser called Bah. Same family as Perplexity's Comet — an AI that actually operates the page instead of just chatting about it.
-
Show HN: Free Ollama AI Trading Desktop App (www.vaultcharts.com via hn) ollama 17w
VaultCharts·desktop charts·AI when you want it Fetch, scan, rank, confirm — like a co-trader on your desk. Indicators, patterns, and chart tools on your desktop — or ask the AI to pull the numbers.
-
Show HN: A Lightweight, open-source always-on-top local AI desktop companion (github.com via hn) ollamageminiopenai+1 17w
Built an desktop AI companion that always pinned at top. Some of the features: - Lightweight: Built on Tauri v2 + React + Rust for low RAM usage.
-
Hedos – Local models in one native Mac app (llama.cpp, MLX, diffusers) (www.hedos.ai via hn) ollamallama 17w
Local-first · Private · Open source One native home forevery local model on your Mac Every text, image, and speech model already on your Mac — pulled through Ollama, cached by Hugging Face, or dropped in by hand — discovered and run in one…
-
Show HN: Hillnote – local first Markdown workspace, AI via CLI, Ollama, MCP (hillnote.com via hn) ollamamcp 17w
57 words • 76 tokens • 1 minute read The writing tool that thinks alongside you. Hillnote is where you craft your thoughts in notes, drawings, databases and plans — powered by AI that runs on your device (even when you're offline).
-
Mnemo AI A local agentic AI assistant with MCP (Model Context Protocol) integration, RAG capabilities, and intelligent conversation management. Built on LangGraph with LangChain for multi-provider LLM support (Ollama, Amazon Bedrock, OpenA…
-
Coding with GLM 5.2 on OpenCode for a flat $20/month (meshintelligence.substack.com via hn) ollamaglm 17w
How to Code with GLM 5.2 on OpenCode Coding with GLM 5.2 on OpenCode is a bet on your own engineering. Decide the architecture and interfaces first, let the cheap model write the code on a fixed twenty-dollar Ollama plan, and bring a str I…
-
Show HN: GGUFun, play snake and a simple maze on Ollama using hand crafted GGUFs (ggufun.grokked.it via hn) ollama 18w
A couple weeks ago I was wondering if I could build a GGUF model file that, when run on ollama, would deterministically answer with the same exact sentence (not simply using a system prompt). That was surprisingly easy to implement, levera…
-
Show HN: Wisp – open-source private desktop AI overlay with MCP support (github.com via hn) ollamageminimcp 18w
I built Wisp because I kept alt-tabbing between my editor/browser/docs and chat apps, copying context over, waiting for an answer, then copying the result back. Wisp is a desktop overlay for using AI from whatever app you are already in.
-
I advise against using Hermes Agent (bednars.me via hn) ollamaopenclawcodex+1 18w
Why I advise against using Hermes Agent On the Ollama website, I saw that I could integrate any model they provide with the Hermes agent, but also with OpenClaw and other tools like Claude Code or Codex. I had heard about Hermes Agent befo…
-
Ollama vs. Llama.cpp – Quick Benchmark (blawg.pages.dev via hn) ollamallama 18w
Ollama vs llama-server — Quick Benchmark I got myself a Tesla V100 a while ago and thought why not put it to some good use for once: Curious about the feasibility of the somewhat controversial ollama in comparison to straight llama-server…
-
Local Agent Toolkit Keep frontier-model tokens for frontier-model work. local-agent lets Codex, Claude Code, or a human developer delegate small, bounded coding tasks to an Ollama model running on local hardware.
-
I pay for Claude Max while my GPU sits idle, so I built a small bridge between the two. Understudy is a single UserPromptSubmit hook.
-
An educational lab of AI agent architectures (github.com via hn) ollama 18w
LocalAgent An educational lab of AI agent architectures, built on LangChain and a local Ollama server. Each variant is a separate, runnable CLI so you can study one mechanism at a time and watch it work through the logs.
-
Ask HN: What model/AI platform do you use for the automatic translations? (news.ycombinator.com) ollama 18w
I'm looking for a high-quality solution for translating food recipes and/or menu content into 30–50 languages. Accuracy and natural wording matter much more than the cost.
-
TinyToT – Tree of Thoughts Inference Server (github.com via hn) ollamamcp 18w
TinyToT — Tree of Thoughts Inference Server A lightweight, Ollama-compatible inference server that answers questions through knowledge retrieval, structured reasoning chains, and MCP tool calling — with no model weights, no training, and n…
-
Ollama raises $65M, grows to nearly 9M users (techcrunch.com via hn) ollama 18w
The popular open source AI tool Ollama has raised a $65 million Series B, led by Theory Ventures, founder and CEO Jeff Morgan tells TechCrunch. This round follows a previous $15 million Series A led by Benchmark’s Peter Fenton.
-
Ollama Raises $65M to Accelerate Open Models (ollama.com via hn) ollama 18w
Ollama: all aboard open models July 9, 2026 Michael and I first met in college, where we started our first company, Kitematic, which made Docker dead-simple to run. In 2015, it was acquired by Docker.
-
Every week I'd be deep in a task, hit the limit, switch tools, and spend 20 minutes re-explaining everything. So I built CodePass, a terminal harness that runs your agent in a PTY, watches output for rate limits and failures, and switches…
-
Show HN: Rewire Text – system-wide text transforms with BYOK and local-models (sunsetmesasoftware.com via hn) ollamallamagemini+2 18w
I just launched Rewire Text, a Windows + macOS tool that transforms text in any app at the press of a hotkey. Sits in the menu bar / system tray until needed.
-
I rebuilt the Claude Code-style terminal workflow as a hackable multi-provider coding agent (www.reddit.com via reddit) vllmollamagrok+4 18w
Hello everyone, After the Claude Code leak started floating around, I spent time studying how the workflow was put together and rebuilt the core experience into my own project. I’m calling it Super Grokie, because it started as a joke but…
-
The "should I use Claude API or run Ollama locally" question comes up here weekly. Everyone has an opinion.
-
Show HN: Otaku – one terminal client for Ollama, LM Studio, and MLX (github.com via hn) ollamaopenai 18w
otaku One terminal client for all your local model servers. Chat, pipe, search your history, and manage RAM across Ollama, LM Studio, MLX (omlx), and any OpenAI-compatible endpoint — from a single command.
-
I had posted a while back about "agent-smith" a claude code skill that sends the heavy drafting to free models, gemini free tier, local ollama, so claude's tokens go to judgment instead of grunt work. shipped a big update this week and som…
-
Can you use Claude Desktop (code) but use local API? (www.reddit.com via reddit) vllmollamallama+1 19w
Hey all, So I tend to favor the Claude Desktop app in Code mode as the GUI does a great job of previewing code, MCP browser interactions/screenshot evals/etc. But I recall people saying they could get Claude Desktop to use a local API.
-
Show HN: Scalable AI Management Platform (github.com via hn) ollama 19w
Synaplan is Apache2, comes with Open Source helm charts for K8s and has all major AI APIS integrated, including Ollama for local fun. Pretty powerful for hosters, who want to run their branded version of it (explicitly wanted).
-
Ragit – chat with any folder of documents using a local LLM (github.com via hn) ollamarag 19w
ragit Local RAG CLI to chat with any folder of documents using Ollama. Install cd ~/ragit python3 -m pip install -e .
-
Faster Gemma 4 on MLX with multi-token prediction (ollama.com via hn) aiderollamagemma 19w
Gemma 4 is now significantly faster in Ollama 0.31 on Apple Silicon via multi-token prediction (MTP), powered by MLX. Performance is now up to 90% faster when used with coding agents, as measured using the Aider polyglot benchmark.
-
Good article about local LLM on MacBook Air (www.xda-developers.com via hn) ollama 19w
I have been using Ollama to run local LLMs on my Mac, and it has been working just fine. However, my Mac's overall performance took a hit because local LLMs are resource-hungry.
-
I built a local agent infrastructure that supports APIs and MCP. (www.reddit.com via reddit) model-context-protocolollamachatgpt+2 19w
I first just wanted to learn how to add a memory layer (how to use the mem0 Python library) when using Ollama but decided to expand into something bigger. From the first idea, I decided to make a modular system that supports APIs, MCP, and…
-
Squish – The fastest way to run local LLMs on Apple Silicon (squish.run via hn) ollamaopenai 20w
Fast local LLMs on Apple Silicon: sub-second model loads, faster than Ollama on long prompts. OpenAI and Ollama-compatible.
-
Tiny LLM Benchmark: Jetson Orin Nano Super 8GB (www.smolhub.com via hn) ollamallama 20w
Tiny LLM Benchmark: Jetson Orin Nano Super 8GB 8 tiny LLMs benchmarked across 4 power modes on Jetson Orin Nano Super 8GB: llama.cpp vs Ollama. 25W sweet spot: 43% more tok/s than 15W, better tok/J than MAXN.
-
This isn't a PPT. Repo speaks (news.ycombinator.com) ollama 20w
• EvolutionEngine— L1-L6 autonomous evolution loop • MemorySystem— declarative/episodic/procedural, weighted • NightlyReview— metacognition proto • CodeSandbox— self-modifying code • TokenBudget / LiveStatus / KnowledgeFusion Hunyuan API +…
-
Claude Max vs Codex Pro or both combined? (www.reddit.com via reddit) ollamaglmcodex+2 20w
I’m considering one heavier subscription (~€100/month) and want to know which provides better value for agentic coding. I tested GPT Pro and was satisfied with Codex.
-
Charon: A blind, end-to-end-encrypted marketplace for LLM inference (github.com via hn) ollama 20w
Charon A blind, end-to-end-encrypted marketplace for LLM inference, paid in bitcoin, built on the NUTS ecosystem. Providers run Ollama and choose which models to sell; consumers run any coding agent (via Nemesis8) against those models.
-
Ggrun v3 is 65% faster than Ollama (github.com via hn) ollama 20w
ggrun ggrun = "gguf run". Formerly llm-server.
-
How to Use WindowSill with Ollama for Private AI Writing (getwindowsill.app via hn) ollama 20w
Some things shouldn't leave your computer. Medical notes, legal drafts, journal entries, messages to your therapist, that honest performance review you're still editing.
-
Show HN: We built an open-source tool for real-time speech-to-speech translation (news.ycombinator.com) ollama 20w
For the past few days, we have been working on an open-source, self-hosted real-time speech-to-speech translation tool called PolyTalk. The goal was that there are people and organisations who need privacy around the tool they are using, a…
-
Open-source security auditors for Supabase, Strapi, Hasura and Ollama (github.com via hn) ollama 20w
Awesome Backend Security Auditors Curated, keyless security auditors for the modern backend stack — BaaS platforms, headless CMSs, GraphQL engines, workflow runners and local LLM servers. Every tool here runs locally and confirms each leak…
-
Show HN: Loqi, a "local-first" translation tool using Ollama/llama.cpp (github.com via hn) ollamagemmallama 20w
I got tired of sending every text I translate to Google/DeepL. Even with all the opt-out options and privacy policies, it never felt right especially for some work documents, personal writing, or anything sensitive.
-
Looks like I found a minor glitch in claude cli (www.reddit.com via reddit) ollamahaikusonnet+1 21w
https://preview.redd.it/0jai8prknl8h1.png?width=2040&format=png&auto=webp&s=61576e05a908614b672db1fc89cb46cd4e148cde Steps to reproduce Run claude cli with ollama provider (`ollama launch claude --model gemma4`) Run `/model` command in the…
-
Show HN: Codeflowmap – map a codebase's read/write/auth data flows (github.com via hn) ollamaopenai 21w
I've been vibe-coding tools to automate chunks of my consulting work, fell down a rabbit hole, and started building actual products. Suddenly I'm in a world of unknown-unknowns and known-unknowns.
-
Introducing Machinaos: AI That can Build itself depending on the Task and also a Multi Agent Orchestration Platform to run Loop Agents and Control Agents like Claude code, Codex, etc. Bring your own API keys or Claude Code sub (or run mode…
-
Show HN: Konxios a local first AI OS that connects LM Studio, Ollama and cloud (konxios.com via hn) ollama 21w
Hey All, I built Konxios (spelled as Conscious) because I had a problem, AI tools were multiplying, but my workflow was getting more fragmented with no privacy first solution. One tool for chat.
-
Show HN: Pair your iPhone to your own Ollama over Tailscale with a QR scan (github.com via hn) ollama 21w
MyLLM Connect Run your own private AI backend on your Mac or PC, and connect the MyLLM iOS app to it in one tap — over real HTTPS, from anywhere. MyLLM Connect is a small desktop companion (system-tray app for macOS and Windows) that turns…
-
How are you running scheduled LLM workflows without burning through API credits? (www.reddit.com via reddit) ollama 21w
Been trying to build recurring automated pipelines — pull data, analyze it, push outputs to a task manager — and wanted to keep it running through my Claude Max plan to avoid per-token API costs. Was using claude -p via SSH to trigger head…
-
Run Claude Code-style subagents across your local model fleet. subagent-fleet Run Claude Code-style subagents across your local model fleet.
-
Seer – an Ollama workspace where two models build and review code (manticthink.com via hn) ollama 22w
A free, private web UI for Ollama models. Chat with Ollama Cloud models using your own API key, or connect to the Ollama running on your own machine — with streaming replies, charts, in-browser code execution, and GitHub context.
-
Mantic Think – Private bring-your-own-key Ollama UI with AI debates (manticthink.com via hn) ollama 22w
A free, private web UI for Ollama models. Chat with Ollama Cloud models using your own API key, or connect to the Ollama running on your own machine — with streaming replies, charts, in-browser code execution, and GitHub context.
-
SemanticSourceCode – Local semantic code search with Ollama and SQLite (github.com via hn) ollama 22w
SemanticSourceCode A C# tool for semantic code search with local embeddings. Search your codebase by meaning, not just keywords.
-
OpenDevOps – An open-source AI agent that investigates AWS/Azure incidents (github.com via hn) mistralollamagemini+3 22w
OpenDevOps Agent Open-source multi-cloud DevOps agent (AWS + Azure). Bring any LLM via LiteLLM — OpenAI, Anthropic, OpenRouter, Groq, Gemini, Mistral, Ollama for air-gapped / regulated environments, or reuse your existing Claude Code subsc…
-
Show HN: Seer – Private Ollama Chat in the Browser, No Account Needed (manticthink.com via hn) ollama 22w
Built a free, private web UI for Ollama. You can chat with cloud models using your own API key, or connect it to a local Ollama instance running on your machine.
-
Show HN: MandoCode – local-first AI coding agent (.NET and Ollama) (github.com via hn) ollamamcp 22w
I built MandoCode, an open source CLI coding agent in .NET that runs against local Ollama models. No API keys, nothing leaves your machine (Ollama cloud models work too if you want them).
-
This paper explores the value of agentic AI tools for cybersecurity purposes. We evaluate the efficacy of a general-purpose GenAI Large Language Model- (GenAI-) based agent when powered by three different Ollama-hosted general-purpose open…
-
I've been running Ollama locally for a while and the one thing I kept missing was voice. Every solution I found either sent audio to the cloud, needed a GPU, or was locked to macOS.
-
Local LLM good for OCR of handwriting? (www.reddit.com via reddit) ollama 22w
I am using qwen3-vl:8b and ollama for doing OCR on scans of handwritten letters and it is doing a decent job. Any other models I should know about for this kind of OCR?
-
Built a minimalist coding agent optimized for memory footprint and speed (www.reddit.com via reddit) mistralvllmollama 22w
Hi everybody, I spent the last two weeks building zerostack, a coding agent in Rust, focused on memory footprint, shipping with ollama and vLLM integrations. I managed to get it to run at ~16MB (with peaks of 24MB) of RAM usage, and no CPU…
-
Ai development (www.reddit.com via reddit) ollamacopilotanthropic 22w
Anyone’s trying to develop their own AI? i am, trying to build the “skeleton”, all the tools he’s gonna use from domotica to copilot, everything else but the AI for now, i was thinking about Ollama, the alpha version of it is currently usi…
-
I built a free, visual, local-first AI agent platform because every option was either cloud-locked or required living in Docker or using a terminal. You've probably seen OpenClaw and Odysseus recently.
-
-
I'm brand new to running LLMs and the sheer number of tools is overwhelming (www.reddit.com via reddit) ollamagemmaqwen 22w
Hey everyone. I'm brand new to running LLMs in general, even more new to running them locally, and the sheer number of tools available is absolutely overwhelming.
-
-
Show HN: Ollama Dash – autoupdating dashboard for Ollama Models (ollamadash.up.railway.app via hn) ollama 22w
-
AutoMB – a CLI that brings 150+ AI commands, agents, and advisors to your terminal (www.reddit.com via reddit) ollamallamachatgpt+2 23w
-
-
Please tell me if you need the source code. My issue is that my Jarvis is stupid rn.
-
Hey guys, I’ve spent the last 3 months building an open-source (Apache 2.0) project called TrueNorth I kept running into the same problem at work: trying to get an LLM to talk to a human (like a medical intake or HR screener), guide them t…
-
Considering buying a maxed out MacBook Pro M5 Max with 128GB of RAM and one of the things I want to figure out before pulling the trigger is whether local models are good enough to actually replace cloud AI coding tools. My current setup i…
-
Friends Don’t Let Friends Use Ollama — So I Built Anvil (www.reddit.com via reddit) ollamallama 23w
Hi, I’m basically one of you, except I’m stepping onto the other side of the table today, fully prepared to accept your ridicule. Obvious disclosure: this is my project, so yes, this is self-promo — but I’m posting it here because this is…
-
I'm trying to use Claude Code with local Ollama models, but every prompt fails with: The strange part is that it happens even for extremely small prompts like: hi say apple What is 1+1? Answer with only one character.
-
Show HN: OMT – A simple Python CLI for testing local Ollama models (github.com via hn) ollama 23w
Selecting the "best" local model usually depends on the task and the hardware. I created this script as an easy way to test local Ollama models and keep the test output organized.
-
Beyondflow No-Code Multi-Agent Teams with Unlimited Runs. BYOK and Ollama (beyondflow.app via hn) ollamagpt-5gemini+1 23w
Researcher GPT-5 Engineer Claude Critic GPT-5 Innovator Gemini Manager Context Guardian Agentic Workflow Architecture · v1.0 The future of AI Collec An R&D platform where differents AI agents collaborate under the supervision of a Context…
-
I Replaced My AI Agent's Flat Fact Store with a Graph Database (news.ycombinator.com) ollama 23w
# I Replaced My AI Agent's Flat Fact Store with a Graph Database and It Runs in 85MB I've been building LocalClaw, a local-model-first AI agent framework running on personal hardware through Ollama. No cloud, no API costs.
-
Open-source AI Sales Agent with Next.js 15 and Ollama – zero API costs (github.com via hn) ollama 23w
AI Sales Agent An open-source, AI-powered sales agent built with Next.js 15. Generates content, finds leads, and automates outreach — all running locally with Ollama (no API costs).
-
Show HN: ContextBridge – Local-first AI reading sidebar using Ollama (chromewebstore.google.com via hn) ollamarag 23w
Overview Store, search, and chat with web page content locally. AI chat (BYOK), full-text search, markdown export, and optional RAG endpoint.
-
Simple way to make locally client Ollama available via WebSockets (github.com via hn) ollamaoperator 24w
ollama-wsock-connector A small Rust client that bridges a remote WebSocket service to a user's local Ollama instance — so a service operator can offer "bring-your-own local inference" without ever proxying or holding the user's prompts and…
-
Root cause: the 2-year-old bug behind "Ollama pull stuck at 99%" (gist.github.com via hn) ollama 24w
If you've used ollama for any length of time, you've probably hit this: pulling 9b6d12fa8910... 99% ▕████████████████████▏ 6.9 GB …and then it just sits there.
-
DDS Vibe Academy – 47 free AI coding masterclasses, built by AI agents (ddsboston.com via hn) ollamageminicursor+1 24w
The DDS Vibe Academy is a free, 38-class curriculum on AI coding published by Robert McCullock, founder of Design Delight Studio in Boston. Covering Claude Code, Google Antigravity, Gemini, Cursor, Ollama, and more.
-
Hybrid local and cloud LLM stack for regulated financial document processing? (news.ycombinator.com) ollama 24w
I'm scoping a hybrid AI pipeline for a consulting client in a regulated industry (GLBA-covered, NPI involved). Trying to validate the architecture before bringing on an engineer to build it.
-
Unpatched Ollama Vulnerabilities: Phishing Overlays and Data Exfiltration (www.promptarmor.com via hn) ollamaprompt-injectionsecurity 24w
Threat Intelligence Table of Content Unpatched Ollama Vulnerabilities: Phishing Overlays and Data Exfiltration Ollama’s desktop app is vulnerable to phishing overlay and data exfiltration attacks via indirect prompt injection, overwriting…
-
Qwen3.6 huge quality gain from Q4 to Q6 for coding agent (www.reddit.com) ollamallamadeepseek 24w
So, last week I tried to update my unused local LLM setup. I had to stop using it because quality was too low and deepseek was too cheap.
-
Tlamatini – Local-first AI dev assistant with 68 agents and hybrid RAG (github.com via hn) ollamarag 24w
Tlamatini A local-first AI developer assistant that goes beyond chat. Run it on your machine with Ollama.
-
Because standard coding agents are stateless, every session they start from scratch. I built Zerikai_memory around a different model: you decide when the agent learns your codebase, not the other way around.
-
Show HN: Harbor v0.4.19 – harbor launch –back end vLLM –web codex (github.com via hn) vllmollamarag+1 24w
https://github.com/user-attachments/assets/e4897391-c5a8-4391-93c3-9f8b76155f11 Setup your local LLM stack effortlessly. Starts fully configured Open WebUI and Ollama harbor up Now, Open WebUI can do Web RAG and TTS/STT harbor up searxng s…
-
Posted on other feeds last week and figured some of you out here might be interested as well; Someone commented asking if it supported OpenAI-compatible endpoints (LM Studio, vLLM, OpenRouter, Together, Groq, LocalAI…), so i have spent few…
-
Prompter – Compare and benchmark Ollama models side-by-side in your terminal (github.com via hn) ollama 24w
Multi-model Ollama comparison, benchmarking, and evaluation — in your terminal. Zero dependencies.
-
I developed and maintain Anubis OSS, an Apple Silicon Mac app for benchmarking local LLMs. Mostly built around Ollama (also handles LM Studio, MLX, and Apple Intelligence if you've got those).
-
could not extract summary
-
Hermes w/cloud LLM and w/local LLM does it work? (www.reddit.com) ollamagemmaopenclaw+1 25w
I’ve tried openclaw locally for about a month. Hardware: M5 Pro w/48 gb ram.
-
I built a local GUI for the TradingAgents framework — works with Ollama (www.reddit.com) ollamaminimaxglm+4 25w
https://preview.redd.it/i90oxxk7n03h1.png?width=1898&format=png&auto=webp&s=7d219c804fda7dfe122b84fcdb6d0d6883818c68 A while back I came across TradingAgents — a really cool multi-agent LLM stock analysis framework where like a dozen "agen…
-
Claude code in terminal models / combine with local llm? (www.reddit.com) ollamaqwenopus+1 25w
Hi, I’m pretty sure I have seen people typing /model and seeing all available models. I have to type models from memory.
-
Wanted to share a workflow I tested on a real flight, in case anyone else is trying to set up offline Claude Code. The core idea: using ollama to pull the needed model of what you need, and then use it to run claude code The setup, in orde…
-
Llama.cpp VS LiteRT on a custom Xiaomi 12 Pro 24/7 Server (V2 Redesign) (www.reddit.com) ollamallama 25w
https://preview.redd.it/sm4ysgdw1w2h1.png?width=1376&format=png&auto=webp&s=3705932403919814fbf2008a1cba189d17e0591e Thanks everyone for the advice on my previous post (24/7 Headless AI Server on Xiaomi 12 Pro (Snapdragon 8 Gen 1 + Ollama/…
-
Local compression helps (www.reddit.com) ollamadeepseek 25w
Just wanted to post a tip (I'm human, not an agent, watch: fart). I use Deepseek-v4-Flash on a lot of my agent work, and as I'm learning and testing these things.
-
Eve Agent V2 Unleashed – open-source local coding agent, powered by Ollama, FREE (github.com via hn) ollama 25w
◈ EVE AGENT V2 UNLEASHED ◈ Local-first autonomous AI coding agent — powered by Ollama No accounts. No cloud lock-in.
-
Best solution to generate reports locally with graphs, charts? Beginner question. (www.reddit.com) ollama 25w
So on a local lm like ollama, or lm studio etc. you can run questions and prompts.
-
I work on AxonFlow, a source-available (BSL 1.1) runtime for long-running agent workflows. We’ve been running it in front of Ollama-served models and OpenAI-compatible local endpoints (llama.cpp `--server`, vLLM, LM Studio).
-
Hey r/ClaudeAI, If you are using Claude Code or building terminal agents, you know the exact moment the context window starts degrading during long-running tasks. I wanted to build a persistent runtime layer to offload those heavy, multi-s…
-
I've been building this for the past few months as a side project — started because I didn't want to run llama.cpp from the command line every time I wanted to try a model. I just wanted something that worked with a click.
-
I've been running Claude Pro (Opus 4.7 / Sonnet 4.6) for about 3 weeks on a complex personal AI infrastructure project. I keep structured session logs with timestamps and Birkenbihl-style metacognitive fields after every session.
-
It keeps running into race conditions/OOM when switching between models, as the previous process doesn't unload from VRAM fast enough. What is the simplest fix for this right now?
-
Ollama Doesn't Know Its GPU Is on Another Machine (loopholelabs.io via hn) ollama 25w
On this page: We started an Ollama container on a MacBook. There's no NVIDIA GPU, no CUDA toolkit, and macOS doesn't even have CUDA drivers.
-
The Claude Code Production Playbook: Sub-Agents, Hooks, and MCP Integration (ddsboston.com via hn) ollamamcpanthropic+2 25w
Claude Code Masterclass 2026 The definitive end-to-end guide to Anthropic’s agentic coding tool — installation, Ollama local fallback, CLAUDE.md, Skills, Subagents, Agent Teams, Hooks, and MCP. Everything you need before building productio…
-
Do smaller quants silently break tool calls / JSON output? (www.reddit.com) vllmollamallama 25w
I posted recently about EvalShift, an OSS CLI for regression-testing LLM model changes. A few people pointed out that for LocalLLaMA, the more interesting use case may be quantization regression: Q8 -> Q4_K_M Same base model, same prompts,…
-
Hi everyone, I’ve open-sourced agentmw, a framework-agnostic middleware that sits between your LLM client and agent logic to make agents more reliable on long runs. Key features: • Real-time failure detection (loops, redundant calls, contr…
-
I first posted about PrivateScribe.ai ~1yr ago and have recently jumped back intent on bringing it to a functionality that makes it actually usable by non-technical users. One year ago it worked but only the bare minimum.
-
How do you actually test a voice AI agent without calling it yourself every time? (www.reddit.com) ollama 25w
So we've been working on a voice bot that handles customer calls and honestly the testing part has been brutal. We were literally calling the thing ourselves to check if it broke after every change.
-
CrustAI – Self-Hosted AI for Telegram/WhatsApp/Discord via Ollama, Zero Cloud (crustaidocs.netlify.app via hn) ollama 25w
This site was paused as it reached its usage limits. Please contact the site owner for more information.
-
Disclosure: I made this. Open-source, MIT, Windows + Linux.
-
Hey everyone, I wanted to share a project I've been working on called Glia. It is a 100% offline, local-first RAG and memory layer designed to connect your AI web chats (Claude, ChatGPT, DeepSeek) with your local developer tools (Claude Co…
-
`🧬 Flux‑Genotype – A CPU LLM that rewrites itself` I've been working on an open-source kernel called **flux-genotype**. It orchestrates local models (TinyLlama, Llama 3.2, Hermes 3, DeepSeek-Coder) into a self-modifying ecosystem.
-
Built this for myself after wanting to use local LLMs during work calls without the window showing up on screen share. Every existing tool was either cloud-only or a 200MB Electron app.
-
AI Agent Security Lecture (github.com via hn) ollama 25w
AI Agent Security (guest lecture, MIT 6.566, April 2026) You can run demos with uv, for example uv run 00completion.py. For some, you will need Ollama and the appropriate models downloaded.
-
Show HN: Thuki – local Al overlay for macOS (double-tap Control, no API key) (www.thuki.app via hn) ollamaagentic 26w
Thuki is a floating overlay that appears on double-tap Control from any macOS app, including fullscreen. Powered by Ollama, no API key, no account, no cloud.
-
EDIT 2: Trick-Assignment-828 pointed me at the actual rule update from the mods - Rule 3 Low Effort was expanded to cover LLM-assisted posts without disclosure. Disclosing now: Disclosure: I'm a non-native English speaker (German).
-
I’ve been seeing a lot of "Context Corruption" in multi-agent systems where agents slowly drift away from the facts or leak data they shouldn't. Things like context pollution and context exposure can leak major things like your API keys an…
-
Looking to migrate off of Ollama and LMStudio (www.reddit.com) vllmollamagemma+3 26w
Hello, I'm currently using Ollama / lm studio for things like code inference and proof reading emails, etc. Definitely not experienced in this space but looking to grow.
-
an alternative = similar experience to using windsurf but on local? (www.reddit.com) windsurfollamaagentic 26w
so i am not that experienced when it comes to llms, i just have ollama and open webui and occasionally test (play with) new releases from time to time. a few weeks ago i started using Windsurf, i do not know coding or anything but i loved…
-
Zerostack – Tiny Rust Coding Agent in 8MB of RAM (github.com via hn) ollamageminiopenai+1 26w
zerostack Minimal coding agent written in Rust, inspired by pi and opencode. Features Multi-provider: OpenRouter, OpenAI, Anthropic, Gemini, Ollama, plus custom providers Standard tools: all of the standard tools exposed to coding agents,…
-
So I’ve been nerding out hard about memory, and have come to the conclusion that context management is too high level and dynamically changing the weights would be best. Luckily, this morning I checked my news feed and saw this new paper!
-
Anthropic and OpenAI claims that their models are so powerful that it can “break” their box…but what so special about their agent implementation? Is it not just basic ReAct loops with tools?
-
macOS support in Lemonade has graduated out of beta! (www.reddit.com) ollama 26w
All major Lemonade capabilities, including OmniRouter, coding, image gen, speech gen, and transcription are all available on Lemonade for macOS thanks to the hard work of u/GeramyL. If you're on macOS and just looking into Lemonade for the…
-
Hello, After almost two years of on-and-off development, 5 complete architectural rewrites, and hitting a few brick walls, I’m finally open-sourcing a project I built to scratch my own privacy-paranoia itch: Nexidion. GitHub Repo: https://…
-
I built a 24h TPS + Intelligence Index table for Ollama Cloud models (www.reddit.com) ollamaglm 26w
I recently made ollamatps.com for my own model-selection workflow and thought it might be useful here too. It shows 39 Ollama cloud models sorted by average TPS over the last 24 hours, and I added the Artificial Analysis Intelligence Index…
-
My GPU power consumption is 250w (undervolted rtx3090) when I added Qwen3.5-27B-GGUF to Ollama using a template (Modelfile made by gpt). I gave it 3 task to test it, build a snake game, build a flappy bird game, and make an interactive gri…
-
I've already searched, but information is getting updated each week, so it's really hard to get an answer, I really hope some of you guys can give me some tips. And can I use an agent with it to enhance the code?
-
Claude Code is the best AI coding tool I've used. But being locked to one provider, one pricing model, and one model catalog always bothered me.
-
Like Ollama, but for your own cloud [Apache 2.0] (github.com via hn) ollama 26w
SIE: Superlinked Inference Engine Open-source inference server and production cluster for embeddings, reranking, and extraction. 85+ models.
-
Ollama Pre-Release Switches From Building on GGML to Using llama.cpp Directly (www.reddit.com) ollamallama 26w
https://github.com/ollama/ollama/releases/tag/v0.30.0-rc15 Hopefully this has more devs come to llama.cpp to support Day 1 releases due to Ollama now moving to using llama.cpp directly. Additionally, I hope that Ollama makes it clear that…
-
My own local first ai harness (www.reddit.com) vllmollamallama 26w
Hi, i just wanted to share what im playing with for last couple weaks. I built my own AI harness: TinyHarness My main goal was low memory footprint, it is not written in Typescript/Javascript/Python, leaving as much memory as possible for…
-
Automated AI researcher running locally with llama.cpp (www.reddit.com) ollamallamaopus+1 26w
Hi everyone, I'm happy to share ml-intern, which is a harness for agents to have tighter integration with Hugging Face's open-source libraries (transformers, datasets, trl, etc) and Hub infrastructure: https://github.com/huggingface/ml-int…
-
Will there be a non-cloud version of Deepseek V4 flash available for Ollama? Or do I need to go to another framework to get a version that will be supported?
-
Self-hosted bot that gives Claude Code 40+ GitHub webhook triggers + MCP tools (www.reddit.com) ollamamcpanthropic+1 26w
It runs Claude Agent SDK - with the full Claude Code feature set - in isolated worktrees with 4 built-in MCP servers (GitHub, GitHub Actions, Memory, Codebase Tools). You configure triggers in YAML: workflows: review-pr: triggers: events:…
-
Can I improve performance for qwen 3.6 27b? (www.reddit.com) ollamaqwen 26w
Hardware OS: Windows 11 Pro 10.0.26200, Build 26200 CPU: Intel Core Ultra 7 270K Plus, 24 cores / 24 threads, max clock 3.7 GHz RAM: 32 GB DDR5 @ 5600 MHz, 2x16 GB Crucial CP16G56C46U5.C8D GPU: 2x NVIDIA GeForce RTX 3090, 24 GB VRAM each,…
-
Building the QWEN3.6 - Codex Bridge Furthe + Kindergarten Harness Reality Check (www.reddit.com) ollamallamaqwen+2 26w
I got a bit further with my harness for running Qwen 3.6 model on Codex. While testing, analyzing, and building the harness, I evolved TBG(O)llama-swap into a full forensic UI bridge and LLM analytics tool where every harness finding, modi…
-
Complete beginner here. Can I self host agents such as Claude ? (www.reddit.com) ollama 26w
Hey everyone, I'm a complete beginner in AI Agents, and I do some self hosting at the moments, I was interested to know if it was possible to self host agents like claude one using our own IA. Because I know things like Ollama to run your…
-
How to run a Gemma4 MTP implementation on ollama or python transformers? (www.reddit.com) ollamallama 26w
Hi all I had a quick question while we wait for llama.cpp MTP implementation, have any of y'all tried Gemma4 MTP models on ollama and or transformers? What was your experience and or cli args and or workflows like?
-
LM Studio - 3 GPUs, one model per GPU as different servers (www.reddit.com) ollama 26w
LM Studio has been really easy to use, but it seems, like they dramatically changed the interface from 0.3 to 0.4. I have 3 GPUs, and want to assign one to a Research model at port 1234, one for Writing at 1235, one for Utility at 1236.
-
Vulkan or CPU llama cpp backend for local llm for coding/code assist (www.reddit.com) ollamacopilotllama+3 26w
Hi all I recently started a new job and we're doing python development for a ci cd metadata consolidation library for analytics and we cannot use no stuff like claude code or codex or gh copilot or any model APIs (free or paid). I got a la…
-
Have we overlooked MCP? (www.reddit.com) ollamaopenclawmcp+1 26w
Recently I've been looking at my personal AI infrastructure. I've built a lot of tools for personal use, a budget and tax helper, an eBay selling assistant, smart home integration, a thermal printer, a task tracker, an Obsidian memory vaul…
-
Show HN: Dragoman – Multi-model routing for Claude Code via sub-agents (github.com via hn) ollamageminiopenai+2 26w
I use Claude Code and also pay for Perplexity, OpenAI, Gemini, and run Ollama locally. Got tired of switching tabs when the right model for a question wasn't Claude.
-
Quick context: M3 max 64gb, currently running llama 3.3 70b q4 as my daily driver via ollama, qwen3 coder 30b for code (switched from qwen2.5 earlier this year), mlx for the smaller stuff. tried llama 4 scout earlier this year but 64gb is…
-
Gave Claude a local LLM as assistant on my Mac (www.reddit.com) ollamaqwenmcp 26w
Hi there! I was playing around with Ollama and LMstudio, testing local models and had the idea of letting Claude evaluate a few models on their actual capabilities rather than doing it myself.
-
So this is probably a pretty common thing, but I just want to ask in case am not missing something. I have pretty much no knowledge but trying to learn a bit more about AI's and local LLMs and the whole AI Stack.
-
Orc (working name) - auditable and declarative AI workflow (www.reddit.com) tool-useollamallama+1 26w
I’m building a small “Orchestration as Code” repo for LLM workflows. Does this concept make sense?
-
Miii – Claude Code-level terminal workflows offline, no API keys (www.npmjs.com via hn) autonomous-codingollamaclaude-code 27w
The local-first autonomous coding agent. Claude Code UX powered by Ollama.
-
Do you prefer plans or per-token pricing? (www.reddit.com) ollamaopenaianthropic 27w
A lot of cloud providers (Anthropic, OpenAI, Ollama) do plan pricing (non-transparent usage limits) while others like OpenRouter and some neoclouds do per-token pricing (more granular spend) What do you prefer for your agents? Better to se…
-
Argus – RAG based vulnerability scanner (github.com via hn) ollamaragsecurity+1 27w
argus A RAG-based (Retrieval-Augmented Generation) vulnerability scanner for Go, Python, Rust, npm/Node.js, Maven/Java, NuGet/.NET, and Ruby projects — powered by local Ollama models or any OpenAI-compatible API. No cloud lock-in.
-
Deepseek tui alternatives, when do you jump from single model terminal agents (www.reddit.com) aiderclineollama+2 27w
Been using Deepseek-Tui for days. solid for v4 workflows.
-
Hey everyone. Like a lot of you, I’ve been deeply frustrated by the state of commercial AI.
-
I built a CLI to stop local AI models from eating my disk twice — lmm (www.reddit.com) ollamallama 27w
Every tool (LM Studio, Ollama, llama.cpp) downloads models to its own directory. Same 8GB model × 3 tools = 24GB wasted.
-
Best way to use remaining tokens from ollama cloud (www.reddit.com) ollama 27w
Hey Bros, I have around 80% tokens for the week, If anyone needs it or suggest me what I can do with it will be helpful.
-
Best local agent setup for M5 Pro MacBook? (www.reddit.com) ollamacoworkagentic 27w
Looking to run AI agents locally on my M5 Pro MacBook. Been experimenting with ComfyUI for image generation and the results have been impressive.
-
Hey r/AI_Agents — we're launching Irene today, and I want to be straight about what it is, why we built it, and where it's going. What makes Irene different Affordable with massive token limits and the latest open-source models We have gen…
-
Show HN: KillClawd – a sarcastic AI desktop crab by local Ollama (github.com via hn) ollamacursor 27w
KillClawd is a desktop pet powered by a local LLM. It runs as a transparent always-on-top overlay — a tiny AI crab called Clawd who wanders your desktop, reacts to your cursor, fights mobs, explores castles, rides vehicles, and has genuine…
-
Hi HN, I built this for myself because I wanted my coding agent (Claude Code) to actually be able to use my Obsidian vault as a knowledge base, not just grep it. The use I get the most mileage from is asking the agent to find notes that sh…
-
Hello r/LocalLLaMA, Some time ago I posted here about the Linux distro for local AI workloads that I was building: https://www.reddit.com/r/LocalLLaMA/comments/1igpkc8/i_built_a_linux_distro_to_run_nvidia_gpus_for_ai/ It worked well, but I…
-
Ran a full eval against four local models last weekend and the spread between them is wider than I expected. All running through Ollama on CPU, no cloud, same prompts, same hardware.
-
Planning to build a PC for running local LLMs. Help me pick (www.reddit.com) ollamaopenclaw 27w
Planning to build my AI rig, to run Ollama / OpenClaw...which bundle should I start with? This will be a dedicated machine.
-
Show HN: Describe what makes a photo "bad" and let a local LLM flag them (github.com via hn) ollama 27w
BadPhotosOut A native macOS app that walks your Apple Photos library, asks a local Ollama vision model to judge each photo against a free-text criterion you supply, and surfaces the flagged photos with the model's reason. No automatic dele…
-
Looking for Open-Source/Free AI that can be trained on my personal writing style (www.reddit.com) ollama 27w
Hi everyone, I am looking for an AI tool or a specific workflow that allows me to train or fine-tune a model using my own texts. My main goal is to have the AI generate content that mimics my specific tone, sentence structure, and vocabula…
-
Claude for homelab (www.reddit.com) ollama 27w
Hey y'all, question. I don't code, but I'm running a unraid server with a lot of self hosted cloud storage, local ai and media stacks.
-
Which inference engine to choose for mlx? (www.reddit.com) ollamallama 27w
Is llama.cpp much slower for M4/M5? I heard ollama is faster due to mlx support since March.
-
using opencode with nemotron-3-nano:4b (www.reddit.com) ollama 27w
I wanted to try installing a simple small model like nemotron-3-nano:4b from ollama and try it for simple quick fixes offline without burning credits or time. the model works well on ollama run time but when I try to use it on opencode, th…
-
Show HN: Docker AI Stack, self-hosted LLM/STT/TTS/MCP in one compose file (github.com via hn) ollamamcp 27w
English | 简体中文 | 繁體中文 | Русский Docker AI Stack Deploy a complete, self-hosted AI stack on your own server with a single command. Zero-config: all services auto-configure on first start Secure: Ollama, LiteLLM, and MCP Gateway generate API…
-
Bleeding Llama: Critical Unauthenticated Memory Leak in Ollama (www.cyera.com via reddit) ollamallamasecurity 27w
Bleeding Llama: Critical Unauthenticated Memory Leak in Ollama TL;DR We discovered a critical vulnerability (CVE-2026–7482, CVSS 9.1) in Ollama that enables unauthenticated attackers to leak the entire Ollama process memory, potentially im…
-
Gemma4:31b-coding-mtp-bf16 - slow on Macbook M5 128gb (www.reddit.com) ollamagemmallama 27w
Very quick initial test of Gemma 4 new MTP model via Ollama (llama.cpp doesnt support yet) https://blog.google/innovation-and-ai/technology/developers-tools/multi-token-prediction-gemma-4/ Running in Open Webui to view token/s output and I…
-
BUILD portable AI system (www.reddit.com) mistralollamagemma+1 27w
Hey everyone, I’ve been thinking about a project idea and I’d love to get your feedback. The idea is to take a 1TB SSD and turn it into a fully portable AI system.
-
Testing an Ollama powered agent mode with gemma4 inside Modly (www.reddit.com) ollama 27w
Hey everyone ! Quick Modly update.
-
A plug-n-play open-source pruning tool that is workload-aware (www.reddit.com) vllmollamallama 27w
This project was born out of time I spent digging into a biologically inspired algorithm I was using to measure co-activation for placement of experts and ranks onto chips. The default scheduling that vllm provides can end up causing laten…
-
Ollama 20$ vs (Claude Code or Codex) 20$ subscription (www.reddit.com) ollamacodexclaude-code 27w
If you have to choose between these two, what would u choose? I've been using Ollama free cloud models; it is great for small tasks, but some cloud models need a subscription.
-
Questions about revisiting local LLM roleplay. (www.reddit.com) ollamadeepseek 27w
TLDR for those that dojr wanna read below I need a new good free place online to pickup roleplay where should that be and what can I do locally? 9070xt 32gb ram desktop and preferably but I know it not great, 4060 laptop 32gb ram.
-
I’ve been building a small open-source CLI coding agent for local models. It runs with Ollama and works best so far with Qwen Coder.
-
Show HN: Isonq – PDF/DXF and STEP to shop quoting (isonq.com via hn) ollama 27w
ISONQ reads PDF, DXF, DWG, and STEP files on the shop's own workstation and produces a priced quote. Nothing leaves the machine.
-
Ask HN: A Spec Driven Back end development platform to build and evolve safely (news.ycombinator.com) ollama 27w
I have build a CLI tool which help to scaffold the full project with docker, make, database setup. https://go-bootstrapper-docs.vercel.app/.
-
I built an AI tool that turns any movie into viral recap videos in minutes (www.reddit.com) mistralollamagemma+3 27w
Hey everyone, I built a tool that creates movie recap videos automatically using local models. The problem: making recap videos takes forever.
-
Plenty of CLI coding agents will talk to a local LLM, but the catch is the ecosystem. Skills, slash commands, MCP servers, plugins, hooks: all the interesting tooling has been built specifically for Claude Code, and parity on every other a…
-
I built an open-source desktop app that lets AI control your browser for you (www.reddit.com) ollamadeepseekopenai+1 28w
Hey everyone, I've been working on Autai — an open-source desktop app (Electron + React) that uses AI agents to automate your browser. You just type what you want in plain English, and the AI opens a real browser and does it for you.
-
Secondary PC options (www.reddit.com) ollama 28w
Hey everyone, I’ve been lurking here for while. I’ve really been enjoying messing around with my 6gb card on my laptop using Gwen 3.5 4B, ollama, and Open WebUI.
-
Using ollama for Openclaw (www.reddit.com) ollamaopenclaw 28w
Hi all, I have recently installed openclaw on a raspberry pi4, linking it to my local Ollama instance (RTX 3090 with 24Gb, as well as 96Gb of DDR5 RAM bought before the madness), in my case running Qwen3.6 (latest) capped at 16k context. A…
-
Persistent memory system for LLMs that actually learns mid-conversation (www.reddit.com) ollamaragmcp+2 28w
Every LLM conversation starts from zero. RAG helps, but it can't learn from what's happening right now.
-
Qwen 3.6 seems to have a lot of trouble with tool calling (www.reddit.com) ollamaqwencodex 28w
(I'm on Windows system running these models locally) I've used both Codex and OpenCode with Qwen 3.6 27b and 35b running locally. I'm having a bitch of a time getting them to correctly create files.
-
Orchestrating Claude Code teams with NATS and Google’s A2A protocol (www.reddit.com) ollamaclaude-code 28w
I’ve been building AON, a communication layer for Claude Code that moves beyond simple chat into structured team coordination. It implements the Agent2Agent (A2A) protocol over NATS pub/sub.
-
I've been experimenting with using Ollama to run Claude Code locally with models like Gemma 4, thinking I could avoid API costs. However, I quickly realised these models aren't really optimised for Claude Code's agentic workflows — they te…
-
LDR maintainer here. Thanks to the strong support of r/LocalLLaMA community LDR got very far.
-
llmfit: one command to check which AI models will actually run on your hardware (www.reddit.com) ollama 28w
llmfit: one command to check which AI models will actually run on your hardware Tired of downloading a 15GB model only to find out your system can't handle it? Found this Rust CLI tool called llmfit that scans your actual hardware (RAM, VR…
-
How can I locally run Deepseekv4 1.6T? I can use a VPS. (www.reddit.com) vllmollama 28w
I wanted to use vast.ai, but ollama doesnt have it, and when i used vLLM I didn't have success. I genuinely don't know what failed.
-
Show HN: Herald – Local-first terminal email client (herald-mail.app via hn) ollama 28w
Hi folks, Some time ago I tried to find a way to clean up my 10k emails inbox and could find anything which worked for me. So I built built my own tool which evolved into a client.
-
Need help optimizing qwen 3.6 on my 2x 5060ti 16gb (www.reddit.com) ollamallamaqwen 28w
Hi all, I tried to setup my pc to run llm, but got some issue: the first question of the chat is generally fine, but from the 3rd follow up question, the backend often be unresponsive and I have to manually restart the llama cpp server, or…
-
Most of my LLM cost was on the wrong tier of work. Classification, extraction, JSON formatting, summarization I'm going to review anyway.
-
Ai Doomsday Toolbox v0.938 (www.reddit.com) ollamallama 28w
Hello! It’s me again, the developer of ADT.
-
I’m building OpenYak, a desktop AI workspace for using local models with real files on your computer. In this demo I’m using Ollama with Qwen/Qwen3.6-35B-A3B to review an attached budget workbook.
-
Five labs, one suite, do model families have personalities? (benchmark) (www.reddit.com) ollamagemmamoe+1 28w
Bench 3 from my 18GB M3 Pro. Bench 2 was the 4B-class post where the comments were mostly right: I gave thinking models a fixed 1024-token cap, Qwen got kneecapped, Gemma E4B needed clearer active-param labeling, and the headline was partl…
-
Show HN: Capture the Flag game where LLMs are the only players (github.com via hn) ollama 28w
Set up a small R&D project which pit different LLMs against each other in a game of Capture the Flag. Each LLM has 30 seconds to prepare any defenses and 5 minutes to capture other flags while defending their own.
-
Show HN: Secure-by-default Ollama Docker image with built-in auth, only ~70MB (github.com via hn) ollamaopenai 28w
English | 简体中文 | 繁體中文 | Русский Ollama on Docker Docker image to run an Ollama local LLM server. Provides an OpenAI-compatible API for running large language models locally.
-
LocalPilot with Ollama as a Replacement for CoPilot in VS2026 (github.com via hn) ollamacopilot 28w
LocalPilot The Privacy-First AI Pair Programmer for Visual Studio. Bringing the power of local LLMs directly into your IDE with Ollama.
-
I've been messing around with Hermes for months, and quickly outgrew using it just as a fancy CLI assistant. My goal was to build a persistent, specialized team of local agents that could collaborate on long-term projects without me spoon-…
-
Ask HN: Are there any good open-source chat apps? (news.ycombinator.com) ollamaglmsonnet 28w
Hi HN family! I've recently been messing around with open models through ollama (glm-5.1 and kimi-k2.6), and I've been impressed with just how close they are to Claude Sonnet for my needs, especially programming.
-
What’s up with mobile LLMs? (www.reddit.com) vllmollama 28w
I see a lot of support for running LLMs on PCs with ollama to vLLM. Whats the current state for running on mobile?
-
Need your honest feedback on a new LLM server I'm building. (www.reddit.com) ollama 28w
Hi all, I am building an hi-performance and highly customizable local LLM server wrote 100% in Rust, custom CUDA kernels, zero latency, almost immediate TTFT, and plenty of other features. It is planned to be publish it on GitHub as open-s…
-
Show HN: Platypus – Local meeting transcription, notes, and chat (Tauri, Rust) (platypusnotes.com via hn) ollamageminiopenai 28w
Hi HN — I built Platypus as I wanted to combine note taking, live transcription and knowledge base management in one app. Granola / Notebook LM free local alternative.
-
Pebble – Menu-bar text polisher running on local Ollama (github.com via hn) ollama 28w
Pebble Menu-bar text-polish tool that rewrites your clipboard with a local Ollama model. One global shortcut, seven presets, zero cloud.
-
Most AI coding tools (Cursor, Aider, Claude Code) assume you have a 200k-token model. If you're running local LLMs through Ollama or LM Studio, or hitting free-tier cloud APIs like Groq or OpenRouter, you've got around 8k tokens to work wi…
-
Which large models support tool use in opencode etc? (www.reddit.com) tool-useollama 28w
I'm working on a homelab AI server with the goal of running small models on GPU and very large models on CPU - for example for overnight coding on complex problems. Specs: 2990WX, 256GB + RTX 2080ti (for now).
-
Hey all, so I am currently exploring and playing around with Karpathy's LLM Wiki using Claude Code with Ollama and other routed models. I want to create some agents and provide them with tools/plugins, libraries, MCPs, or harnesses to assi…
-
M4 Mac Mini, 16GB unified, basic spec. For a few weeks I had Qwen 3.5 35B-A3B UD-IQ3_XXS (12GB on disk) running under llama.cpp with --mmap and --flash-attn.
-
I built Claudex, a free-to-try open-source CLI for Claude Code-style workflows (www.reddit.com) clineollamacopilot+7 28w
https://reddit.com/link/1sxh0ec/video/egfs5inxtsxg1/player I built Claudex specifically for people who like Claude Code-style agentic coding workflows but want a simpler plug-and-play terminal setup The setup is the main thing I wanted to…
-
Show HN: Local RAG Pipeline with Weaviate and Ollama (www.storyblok.com via hn) ollamaqwenrag 29w
i’ve been experimenting with building a fully local rag pipeline: weaviate for vectors + hybrid search, node.js scripts, qwen 3.5 on ollama what i found is that most of the challenges live in retrieval and chunking, not the LLM, and a good…
-
Build your own voice assistant and run it locally – Whisper, Ollama, Bark (2024) (medium.com via hn) ollamarag 29w
9 min read Mar 31, 2024 -- After my latest post about how to build your own RAG and run it locally. Today, we’re taking it a step further by not only implementing the conversational abilities of large language models but also adding listen…
-
Running Gemma 4 31B on Mac with Ollama (sammyrulez.github.io via hn) ollamagemma 29w
A practical configuration for a 32 GB M5 Mac that still needs to remain usable Running large language models locally has become surprisingly practical on Apple Silicon. With a modern Mac, Ollama, and a carefully quantized GGUF model, it is…
-
Use Ollama to Enhance Claude — Two-Engine Setup Pair Claude Desktop on Anthropic with Claude Code routed through Ollama in your terminal. Strategy stays on Pro.
-
locally uncensored is a desktop app that combines four things most people run separately: chat, a coding agent, image generation, and video generation. all local, all on your hardware, no docker, no cloud account needed.
-
How do you actually use Qwen3 72B Instruct locally? (www.reddit.com) vllmollamallama 29w
I just got Qwen3 72B Instruct running on a high RAM setup and I’m kinda confused about the proper way to use it. What’s the correct workflow for running it smoothly (like best quant, tools, or runtime)?
-
Show HN: A minimal context engine with streaming API (github.com via hn) ollama 29w
I needed a better way to create and compare prompts when using local LLMs (e.g. via Ollama) in a workflow.
-
Local-first multi-agent simulation and prediction engine powered by Ollama (github.com via hn) ollama 29w
mirollama Local-first multi-agent simulation and prediction engine. Project Origin This project is a derivative work of: Upstream: https://github.com/666ghj/MiroFish.git Target repository: https://github.com/oswarld/mirollama This reposito…
-
I run a team of Claude agents that ships PRs to production — open source (www.reddit.com) ollamacodex 29w
I've been running a multi-agent system in production for a few months — a co-CTO agent + specialist agents (PM, dev, ops) that handle real engineering work end-to-end: design specs, code review, PR implementation, deploys, monitoring. The…
-
Watch it in action SOT-CLI (www.reddit.com) ollama 29w
Terminal AI that doesn’t babysit you. • SoT Method → near-zero token waste • Async multi-agent orchestration • Batch tools + unrestricted shell • Ollama / LM Studio / OpenRouter / NVIDIA Watch it take full OS control from one prompt (zero…
-
ASUS Ascent GX10 - Having tons of issues (www.reddit.com) vllmollama 29w
Hi all, Looking for some advice with a GX10 I purchased about 4 months ago. I've been having all kind of issues trying to run local models on this device.
-
Hi HN, I built VT Code, a semantic coding agent. Supports all SOTA and open sources model.
-
Open source memory layer so any AI agent can do what Claude.ai and ChatGPT do (alash3al.github.io via hn) ollamachatgptmcp 29w
Give any AI agent a persistent memory in minutes. Works with Claude, ChatGPT, Ollama, OpenRouter, and any MCP-compatible agent.
-
I work full-time as a Program Director. About 50-60 hours a week at my W-2.
-
Every time I restarted work on a side project after a few weeks, I'd spend the first hour just reading code trying to remember what I was doing and where I left off. Looked for a tool that could help — couldn't find anything that did what…
-
I've been building a personal AI assistant called Finn that runs entirely on your Mac. No cloud, no subscription, no data leaving your machine.
-
TLDR: Swapped Ollama for MLX on M1 Max (64GB) to run a 12-agent trading stack using Qwen 35B MoE. MLX wins on throughput and fine-grained sampler control, but I lost the "it just works" convenience of Ollama.
-
Ollama swap to llamacpp/llama server (www.reddit.com) ollamamoellama 29w
So I'm a newb in certain aspects but not in others, I'm currently running an AI stack on my unraid server: CPU: AMD Threadripper 3960X (24c/48t) Motherboard: Gigabyte TRX40 AORUS PRO WIFI RAM: 256GB DDR4-3200 G.Skill Trident Z GPU: Nvidia…
-
Anyone succeeded running Claude Cowork with Ollama? (www.reddit.com) ollamacoworkanthropic 29w
Anthropic opened Cowork for Bedrock/Vertex/Azure providers and also Custom Inference Endpoints. However, connecting it to a local proxy seems non-trivial.
-
Show HN: Qwen Lens Studio – multimodal app on Qwen3.6-35B-A3B, runs on Ollama (github.com via hn) ollamaqwen 29w
Qwen Lens Studio A multimodal AI studio built around a single Qwen vision-language model, exposed through five focused tools plus a batch runner and a persistent session log. Ship a screenshot → get code.
-
Any luck integrating local ollama models into VS Code Copilot Chat? (www.reddit.com) ollamacopilot 29w
Hi all, I tried quite a few models and approaches, but had no luck integrating local models into VS Code Copilot Chat extesion in a useful way. Of course I can see the models there and can choose them, but none of them seem to work even re…
-
Well, I have a RTX 4090 24GB + 64GB system RAM, AMD Ryzen 9 7950X. Any good model for using in Open WebUI (using Ollama backend?) that outpeforms GPT-5.4 mini, GPT-5.2 Thinking and even Claude Sonnet 3 (the 2024 model)?
-
Kimi 2.6 and qwen3.6 is out but still as slow as ever (www.reddit.com) ollama 29w
Has anyone tried these? I found this on ollama: https://ollama.com/library/kimi-k2.6, https://ollama.com/library/qwen3.6 My issue is that they are extremely slow on my local.
-
Issues running local model with vscode and cline (www.reddit.com) clineollama 29w
Hi all, Total noob here trying to set up a local model to help me with coding. I am trying the following setup - Ollama running the qwen2.5-coder:7b model in docker with the following compose file services: ollama: container_name: ollama i…
-
Claude Code drafted the prose. I did the research, direction, architecture, ran the code, caught the bugs, and reviewed every commit.
-
My Linux/Fedora Local Ai performance is trailing Windows massively? Are there specific ROCm environment variables or memory management tweaks for RDNA3 that I'm missing?
-
Show HN: LibreThinker, free AI assistant for LibreOffice Writer, 10k installs (librethinker.com via hn) mistralollamacopilot+3 29w
4 months ago, I released an extension for LibreOfffice Writer that adds an AI copilot to its sidebar. Did a Show HN at the time but got no interest T_T https://news.ycombinator.com/item?id=46233776 I’ve added several major features since t…
-
I use ollama local model for vscode copilot, but it seems could not get the context of the workspace. For example, I command it to edit or summarize the current opening file, but it does not know which file to work.
-
Edster – An open-source local AI agent with swarm mode and a web UI (github.com via hn) ollamaqwenrag 29w
👾 Nedster CLI Coding Agent An unstoppable, fully local, open-source coding agent that runs on your consumer GPU. Tags: ollama coding-agent local-ai cli rag chromadb python qwen Are you trying to use local LLMs to autonomously write code, r…
-
RAEDON 9070XT LOOKING FOR GOOD MODEL AI (www.reddit.com) ollama 29w
Hi guys, so i have this pc for the gaming,7800x3d, AMD 9070xt with 16GB of vram and CORSAIR Vengeance RGB DDR5 32GB DDR5 6000MHz CL30 AMD Expo. Last week i was searching for good ai uncensored models on hugging face for my AIself-hosted on…
-
Show HN: I built a coding agent that works with 8k context local models (github.com via hn) ollamadeepseekgemini+1 29w
Most AI coding agents assume you have a 200k-context model. In reality, the local models most people actually use have 8k windows — barely enough for one large file, let alone a whole project.
-
I am using an Arc Pro B70 to do inference, and it's token generation speed is fine using Ollama, but it takes *forever* to do a prefill. vLLM absolutely tackles the prefill problem (nearly instant responses), but I can't run nearly as larg…
-
-
Ollama alternative with dynamic model loading (www.reddit.com) ollamallama 29w
-
Show HN: Aide – A customizable Android assistant (voice, choose your provider) (aideassistant.com via hn) vllmollamachatgpt+1 29w
-
Package Manager for LLMs (www.reddit.com) ollama 29w
-
Anyone here actually using voice input in their local AI workflows? (www.reddit.com) ollama 29w
-
-
Choosing a Mac Mini for local LLMs — what would YOU actually buy? (www.reddit.com) ollamaopenclawqwen+1 29w
-
Gemm4:e4B-IT good at instructions following no refusals. (www.reddit.com) ollamagemma 29w
-
SOLVED! Was "Help needed: Ollama > qwen3.6 in OpenCode on 64Gb M4" (www.reddit.com) ollama 29w
-
-
Current recommended model for local openclaw (www.reddit.com) ollamaopenclaw 30w
-
-
Collegamento cluster (www.reddit.com) ollama 30w
-
New and Learning - Web enabled deep research model? (www.reddit.com) ollama 30w
-
One-command local AI stack setup for Ubuntu (CUDA, Ollama, llama.cpp, chat UIs) (github.com via hn) ollamallama 30w
-
I need testers - LAVIE-AI agent (www.reddit.com) ollama 30w
-
What I got by 5060Ti 16GB + Qwen3.6-35B-A3B-UD-Q5_K_M (www.reddit.com) ollamamoellama+2 30w
I tried local model couple weeks ago. At the beginning, I tried Ollama, but reddit says better to switch to llama.ccp.
-
When you load a model in these programs, you have to manually choose your context size or accept the default of 4096. In contrast, the newly released Unsloth Studio does not have this limitation, and VRAM/RAM is allocated as-needed so that…
-
Local Model Router: Ollama/OpenAI-compat bridges for local LLMs via llama.cpp (news.ycombinator.com) ollamallamaopenai 30w
A high-performance local LLM server providing drop-in API compatibility with Ollama and OpenAI, built on llama.cpp's llama-server. Features automatic VRAM management, Hugging Face integration, and modular architecture.
-
Tokens per second - RTX 5000 Ada generation (www.reddit.com) ollama 30w
Hi everyone, I am testing the LocalLLaMA. I have a laptop with an RTX 5000 Ada generation, with Ollama and Open Webui.
-
Saw a post about running hermes agent locally with gemma4 through ollama. zero api costs, unlimited tokens, full privacy.
-
I was building a classifier to label AI agent sessions as productive or dead-end. The task isn't keyword matching, it's intent judgment: did the agent actually accomplish the goal, or did it get stuck retrying the same Cloudflare wall 20 t…
-
made a desktop app that puts ollama, comfyui and coding into one window (www.reddit.com) vllmollama 30w
been using local AI for a while now but my workflow was a mess. ollama for chat, comfyui for images, different tools for video and coding.
-
I've been running into bottlenecks when trying to use multiple local LLMs on a single GPU. Currently switching manually between models in the terminal - starting/stopping Ollama, adjusting prompts, reloading contexts, etc.
-
Hola a todos! Aquí un novato en busca de ayuda (www.reddit.com) ollamallama 30w
Estoy un poco nuevo con esto de la IA, estoy tratando de aprender lo que más puedo temas como: * Skills * Agends * Models * LLM * Ollama * llama.cpp * Cuantizacion Pero estoy aún perdido, tengo en mi PC 32Gb de ram y quisiera ejecutar mode…
-
Benckmark Qwen 3.6-35b uncensored on Rtx3090 (www.reddit.com) ollamaqwen 30w
Hello I saw the new model is out but even with 24gb of vram, I have too many browser and task to use it , so I have downloaded and tested the version of HauHauCS https://huggingface.co/HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressiv…
-
Local LLM agent with persistent memory and learnable skills (github.com via hn) ollama 30w
localmind Run any local LLM with persistent memory and context. A single CLI binary that turns an Ollama-served model into an interactive agent with long-term recall, learnable skills, and permissioned tools.
-
M1 Pro 16GB users: what local LLM configs are actually usable day to day? (www.reddit.com) vllmollamallama 30w
I'm trying to get past generic "best model" recommendations and collect real-world configs from people on similar hardware. My setup: MacBook M1 Pro, 10-core CPU, 14-core GPU, 16 GB unified memory.
-
Been vibe coding a lot recently and kept running into the same problem finding actually usable tools without paying for 10 different subscriptions or donating my bank balance to Claude. So I put together a curated list focused on free or l…
-
Supermicro running Ollama on a $90,000 workstation... (www.youtube.com via reddit) ollama 30w
I think this should be a crime (at 3:00)
-
I currently use Haiku 4.5 in an automated content workflow. The process works like this: I take an existing article from my website, use a DataForSEO node to fetch competitor URLs and search intent data, and then generate a new article com…
-
Made a local-only agent benchmark + chaos tool, no cloud required (www.reddit.com) ollamaprompt-injectionsecurity+1 30w
Runs entirely on your machine. No API calls to any eval service.
-
MB Pro M5, 24GB/32GB difference? (www.reddit.com) ollamagemmacopilot 30w
Hi, I got new MB Pro 24GB/1TB. I've test Gemma 4 26B with ollama, 16k context.
-
Claude has had a rough week. Between the outage and the usage limit threads, I figured it was actually good timing to do something I had been meaning to try anyway: take the D&D skill I built a few weeks ago and see if I could migrate it t…
-
Ollama v0.21.0-Rc0 (github.com via hn) ollama 30w
Ollama Start building with open models. Download macOS curl -fsSL https://ollama.com/install.sh | sh or download manually Windows irm https://ollama.com/install.ps1 | iex or download manually Linux curl -fsSL https://ollama.com/install.sh…
-
Catai – Virtual pixel art cats for macOS that chat with you via Ollama (github.com via hn) ollama 30w
CATAI Virtual desktop pet cats for macOS — pixel art cats that live on your dock, chat with you via Ollama LLM, and debate ideas together to help you brainstorm and refine your thoughts. Features Dock companion — Cats walk along your dock…
-
So I already have a Mac Studio M4 Max (return window still available)with 64GB RAM, but I’m eyeing the Corsair AI Workstation 300 (Ryzen AI Max+ 395, 96 VRAM out of 128GB, $3,250). Both seem decent for running models locally with Ollama.
-
Hey r/LocalLLaMA, I wanted to share a project I've been working on called Job Bro. It’s a Chrome extension designed to help you analyze LinkedIn job descriptions without feeding your resume or career data into a proprietary black box if yo…
-
Jarvis AI Assistant (www.reddit.com) ollama 30w
As part of a personal project, i decided to build an AI assistant which helps with coding and homelab management. I really tried to make it as private as possible with local AI models running through Ollama.
-
What models to run and fun projects to do with it (www.reddit.com) ollama 30w
Hey yall, I want to explore more models and stuff i can do with them. What do you recommend?
-
Knlowledge Graph and hybrid DB (www.reddit.com) ollamagemma 30w
Hello, everybody! I'm building and hybrid database with Qdrant and Neo4j for a few personal projects.
-
MINISFORUM AI X1 Pro-370 (96GB) - Local Ollama Help (www.reddit.com) ollamallamadeepseek+1 30w
Hey all. This just got delivered yesterday.
-
I've been running 5-8 Claude Code sessions at a time and got tired of tab-switching to approve tool calls. So I built claudectl — a TUI that sits on top of all your sessions and lets a local LLM (ollama/llama.cpp) handle approvals for you.
-
Book Translator: Two-pass local translation with self-reflection via Ollama (github.com via hn) ollama 30w
Book Translator Translate long-form text files through a local Ollama-powered desktop and web app. Book Translator provides a two-stage workflow for translating books and large documents: first it generates a draft translation, then it run…
-
gemma4 e4b on rtx 5070 ti laptop 12GB running slow 5t/s llama.cpp (www.reddit.com) ollamagemmallama 30w
I hope sincerely someonecan help me because i have tried everything i can and i get this speed using ollama.cpp and opencode. I have put as detail i can my setup and how i am running it.
-
I've been building this for a couple of years. It started as "what if my AI assistant actually remembered things," and it became something bigger.
-
Ollama with Claude models and safety (www.reddit.com) ollamaclaude-code 30w
Hi all, I've been using Claude now every day for a while. Some coding, firmware tweaks, help with complex github instructions or complicated tasks.
-
The local LLM ecosystem doesn’t need Ollama (sleepingrobots.com via hn) ollamallama 30w
Friends Don't Let Friends Use Ollama Ollama gained traction by being the first easy llama.cpp wrapper, then spent years dodging attribution, misleading users, and pivoting to cloud, all while riding VC money earned on someone else's engine…
-
Got an ASUS NUC15 specifically for running Qwen locally on the Arc GPU. The marketing promised AI-ready performance.
-
I spent time setting up TinyGPU on an Apple Silicon Mac and comparing it against Ollama already installed locally. Short version: TinyGPU does work.
-
Deskdrop []() Deskdrop is an Android keyboard with AI built in. Use Ollama, any OpenAI-compatible server, or a cloud API key.
-
Hey, so I'm pretty new to Local model hosting and have been messing with it a bit. I'm not a SWE but am reasonably technical.
-
Hi everyone, I'm trying to run a local LLM via Ollama on a Hetzner cax21 VPS (ARM64, 4 vCPUs, 8GB RAM, 80GB SSD). I have Ollama running successfully via Coolify.
-
Ollama Cloud - Pro (www.reddit.com) ollamaminimaxgemma+1 30w
Hi. I've been looking at ollama cloud's Pro offering ($20), which says "Run 3 cloud models at a time".
-
do GLM-4.7 Flash Q4_K_M have problem with claude or agent? (www.reddit.com) ollamaglm 30w
I'm brand new to local LLMs and started with GLM-4.7 Flash q4_K_M. When I run it directly: ollama run glm-4.7-flash:q4_K_M it works pretty decently — nothing amazing, but usable and responsive.
-
After months of testing, I finally have a local setup that doesn't make me want to go back to the API. Hardware: RTX 3090 (24GB VRAM) Models tested: Qwen2.5-Coder 32B Q4_K_M, DeepSeek-Coder-V3 Q4, Llama 3.3 70B Q3_K_M Inference: llama.cpp…
-
AI writing feels "generic" because it lacks a feedback loop and social pressure. To fix this, I built an experimental system where AI agents participate in a literary circle.
-
Been trying to run local LLMs on my new Dell XPS 13 with Intel Arc 140V (Lunar Lake, 16GB) and hit a wall — Intel's official docs point to a portable zip frozen at Ollama v0.5.4 which can't pull any modern model. Spent a while debugging it…
-
Running on cpu :( (www.reddit.com) mistralollamallama+1 30w
I am in the midst of a POC project at work and am I have is 4 AMD Epyc cores and those are essentially virtualized. Does any one have any tricks?
-
Need practical local LLM advice: Only having a 4GB RAM box from 2016 (www.reddit.com) ollamallama 30w
Sorry, not so tech person. I’m trying to figure out the most practical local LLM setup using my spare machine: 4 GB RAM No GPU for now, so please assume CPU-first unless I mention otherwise.
-
Recommendations for a tiered local AI setup? (5090 + Mini PC + Obsidian) (www.reddit.com) ollamagemini 30w
Hey everyone, I’ve finally got my local media stack on my NAS migrated over to a new Mini PC running WSL2, sperately I have running my main gaming rig. now wnat to delve into the world of local AI models.
-
One-click LM Studio → Ollama model linker (www.reddit.com) ollama 30w
This has been a pain point for many, and I've seen some tools to address it, but they needed a lot of setup. So made this GUI tool with AI assist.
-
Hello, je suis en plein dans le montage d'une solution IA locale pour virer à terme perplexity, l'usage de chatgpt, claude etc..... mais je ne suis pas informaticien (perplexity est encore mon amie en ce moment !).
-
Any setup improvements/recommendations? (www.reddit.com) ollamasonnetclaude-code 30w
First of all, I am a super newbie at local AI. Recently I got a GMKTek Evo X2 96GB to replace Claude as the usage limits have gotten unusable.
-
I started developing an app with Claude, but the credits run out very quickly. I thought that now with my new computer I could run something directly on it.
-
Hey everyone, I'm a final year engineering student building a 3-agent LLM platform (Researcher, Writer, Validator) for my end-of-studies project. My setup: RTX 4050, 6GB VRAM 16GB RAM Running Mistral 7B via Ollama locally The problem: My s…
-
I've been on a hunt for a browser agent that can reliably handle daily agentic tasks: filling job applications, logging into sites and fetching data, making posts on my behalf, solving assignments and reporting results, and API/troubleshoo…
-
Show HN: Fleet Watch – preflight guard for local AI inference on Apple Silicon (github.com via hn) vllmollama 30w
Fleet Watch Process governance for AI workloads on a single machine. The Problem You're running MLX, Ollama, vLLM, Candle/Cake, experiment runners, and AI coding agents on the same machine.
-
Looking for a reliable browser use agent that handles most daily tasks. (www.reddit.com) ollamachatgptmcp 30w
I am open to any option whether it's local or service based. For online services I tried Chatgpt agent : it's almost the worst option ever.
-
Show HN: Scryptian – A lightweight, local AI bar (Python and Ollama) (github.com via hn) ollama 30w
Scryptian v0.1. (Proof of Concept) Local AI-powered command bar for Windows & Linux.
-
24/7 Headless AI Server on Xiaomi 12 Pro (Snapdragon 8 Gen 1 + Ollama/Gemma4) (www.reddit.com) ollama 30w
Turned a Xiaomi 12 Pro into a dedicated local AI node. Here is the technical setup: OS Optimization: Flashed LineageOS to strip the Android UI and background bloat, leaving ~9GB of RAM for LLM compute.
-
Which AI model is best for real data analysis? [benchmark] (www.reddit.com) ollamaglmgpt-5 30w
I created and run a benchmark for AI models in data analysis tasks. In contrary to other benchmarks, it is not one-prompt benchmark, but I tried to simulate the real work of data analyst.
-
AI Code Reviews for GitLab – custom agents – powered by Ollama (chromewebstore.google.com via hn) ollamacopilot 30w
ThinkReview: AI Code Review for GitLab, GitHub, Bitbucket & Azure DevOps Overview AI Copilot & AI Code Reviews for GitLab, GitHub, Bitbucket and Azure DevOps PRs - Ollama support 🌟 Now Open Source! View our code on GitHub: https://github.c…
-
Performance Benchmark - Qwen3.5 & Gemma4 on dual GPU setup (RTX 4070 + RTX 3060) (www.reddit.com) ollama 30w
Hi everyone, Been following a lot of local LLM talk in this forum lately—learned quite a bit from you all! This is my first post, hopefully not my last.
-
I spent about a week testing open-weight models for real work, comparing them against what I already know from ChatGPT, Gemini, and Claude. The gap between what benchmarks suggest and what happens when you give these models something to ve…
-
How are you feeding personal context to your local models? (www.reddit.com) mistralollamallama+2 30w
I've been running Mistral/Llama locally through Ollama for a while now and the thing that keeps bugging me is context. The model itself is fine for general stuff but the second I want it to know about my projects, my notes, or files it doe…
-
How do I use gemma4 on 5090 gpu for coding? (www.reddit.com) aiderclineollama+3 30w
I'm trying to replace openai codex which i used for development all the time, with gemma4 on 4090, small tasks it solves quite impressively, but i need to have some agent. So I tried to connect 31b to cline and to aider and it didn't reall…
-
What am I doing wrong here? I can't get models to follow my instructions, pretty much at all.
-
Mac Studio Performance Suggestion For minimax (www.reddit.com) ollamaminimaxqwen 30w
I need help. I want to self-contain my MiniMax 2.7 and Qwen 3.5 (122 billion parameter) models.
-
Hi everyone, I’m building a local AI pipeline on WSL2 (Ubuntu) specifically for Product Visualization. My goal is to orchestrate LLMs for scene generation and Stable Diffusion/ComfyUI for high-fidelity rendering, keeping my Windows host cl…
-
Vibecoded a small web app to turn my life into a Game (www.reddit.com) ollama 30w
I vibecoded a Flask app that acts as a Game Master for my day. I feed it my goals, and a local AI looks at my past history to generate new "quests".
-
Show HN: How to Use Google's Extreme AI Compression with Ollama and Llama.cpp (news.ycombinator.com) ollamallama 31w
The introduction of TurboQuant, PolarQuant, and QJL (Quantized Johnson-Lindenstrauss) by Google Research represents more than just a technical optimization. At Vucense, we view this as a landmark moment for Inference Sovereignty https://vu…
-
Made a browser agent extension, would love for people to try it out (www.reddit.com) ollamaopenaianthropic 31w
I have made a chrome extension that lets LLMs control your browser - clicking, typing, navigating, etc. supports ollama/openai/anthropic/google looking for people to try it out and let me know what breaks.
-
Going local with old GPUs (www.reddit.com) vllmollama 31w
I'm an ex crypto miner with remnant mining parts so I threw them together into a franken hydra case. I've been using claude oath previously, but they just shut that door last week or so.
-
Build a Sovereign Local AI Stack: Ollama and Open WebUI and Pgvector 2026 (news.ycombinator.com) ollama 31w
Deploy a complete local AI stack — Ollama 5.x, Open WebUI, and pgvector — on Ubuntu 24.04. Zero cloud.
-
Ollama Cloud Pro ($20/mo) vs OpenAI Plus ($23/mo). Which gives more tokens ? (www.reddit.com) ollamaglmopenclaw+1 31w
Hey everyone, I'm comparing these two plans side by side for running AI agents daily through OpenClaw (self-hosted AI agent platform): • Ollama Cloud Pro — $20/month • OpenAI Plus — €23/month (~$25) My setup: 3 agents running in parallel (…
-
Cursor Native tool calling with Gemma4 and Ollama: (www.reddit.com) ollamacursor 31w
I'm a beginner using local models, now I have a good GPU I installed ollama using docker. Pulled the Gemma4 weights and was able to add it to cursor using ngrok.
-
Ollama Cloud Max vs Claude Max for heavy AI-assisted coding? (www.reddit.com) ollamachatgpt 34w
Hi, I'm looking to replace my current 2x ChatGPT Plus subscriptions with one $100 subscription of either Ollama Cloud or Claude Max, and would appreciate some insights from people who have used these plans before. I've had 2 $20 ChatGPT su…