Earlier I posted in a “Who wants to be hired?” thread, looking for a place where I could apply my experience in hospitality, food tech and automation. A couple hours later I received an email: “Hi Ilia, I saw your comment on the June Who’s…
#rag
905 items
Please don't spam people looking for employment. It's just cruel (news.ycombinator.com) Vibe Coding vs. Production reality (www.reddit.com) The image is from X, been thinking about it since I saw it. Vibe coding is real.
Taught my 60-year-old dad (zero coding exp) Claude and Git in Feb. Today he built a RAG solution. I finally get "vibe coding." (www.reddit.com) My father teaches geology and has literally zero coding expertise. Back in February, I introduced him to Claude and taught him the absolute basics of how Git works.
Hot take: the biggest bottleneck in AI agents right now isn't models, frameworks, or even cost. It's that nobody knows how to properly evaluate if their agent is actually working (www.reddit.com) How do you usually get around when starting big projects in Claude Code? (www.reddit.com) This question will probably make more sense when I explain my current situation: lately I’ve been doing some small projects here and there to some small business in my town and they have been working fine, but that is about to change. I ma…
Bible as RAG Database (www.crosscanon.com via hn) Cross Canon Leave blank to search all indexed books. Loading scripture text...
Title: I’m tired of the "Agent Hype"—Most AI agents right now are just expensive loops. Change my mind (www.reddit.com) We’ve all seen the flashy demos, but after spending the last few months trying to build [or use] actual multi-agent workflows, I’ve hit a wall. The "Loop of Death": Agents still get stuck in reasoning loops that burn tokens without solving…
Qwen 3.6: worse adherence? (www.reddit.com) Just swapped Qwen 3.5 for the 3.6 variant (FP8, RTX 6000 Pro) using the same recommended generation settings. My stack is vLLM (v0.19.0) + Open WebUI (v0.8.12) in a RAG setup where the model has access to several document retrieval tools.
Gemini API File Search is now multimodal (blog.google via hn) Gemini API File Search is now multimodal: build efficient, verifiable RAG Today, we are expanding the Gemini API’s File Search tool. You can now build retrieval-augmented generation (RAG) systems with multimodal data and custom metadata.
What's your favorite local MCP server? (www.reddit.com) I've seen so many rag this, memory that projects. What projects are people actually using day to day for agentic workloads.
Show HN: YourMemory, agentic memory is a pruning problem, not a hoarding problem (yourmemoryai.vercel.app via hn) This is a project that I have been building for a while now, YourMemory is a solution to agentic memory which focuses on pruning of noise rather than hoarding of data. In the current state of agentic memory most of the context is stored in…
Vision-capable LLMs vs. OCR for long-document (including charts, images, tables, etc.) QA (www.reddit.com) I benchmarked vision-capable LLMs (the "just attach the PDF and let the model read it" pattern) against OCR-based pipelines on 30 long, image-heavy PDFs from MMLongBench-Doc (https://github.com/mayubo2333/MMLongBench-Doc). There were 171 q…
Haystack: Open-Source AI Framework for Production Ready Agents, RAG (haystack.deepset.ai via hn) The Open Source AI Framework for Production Ready Agents, RAG & Context Engineering Haystack Sets the Standard for Agentic AI Across Industries Why Teams Choose Haystack for their AI Workflows Build Transparent, Context Engineered AI Syste…
PSA: llama-swap released a new grouping feature, matrix, allowing you to fine tune which models can run together (www.reddit.com) Previously a model could only be present in a single group. Now you can create whatever groups you want: one for big models that should run on their own, a group for STT + bigger model, a group for RAG usages, etc.
governance wall in agentic workflows. why are we stuck past rag? (www.reddit.com) keep seeing the same pattern across agent projects. we're good at building agents that find information, but the moment we ask them to actually do something (update a crm, trigger a payment, touch a production database), things grind to a…
Very detailed guide to building AI Agents? (www.reddit.com) Show HN: Reverse-engineering web apps into agent tools (news.ycombinator.com) Hey HN! We built a browser-based agent that runs inside an authenticated web app, watches how the app calls its own APIs, and automatically turns those into agent tools.
(Rant ;)) Make your benchmarks realistic (www.reddit.com) Everybody here is posting their optimizations for running different models - thats good but make these benchmark realistic as speed is not one factor to run llm effectively. Context size is key - with agentic/coding/rag work you need to ha…
Curated a list of 550+ free or cheap AI tools for vibe coding (LLM APIs, IDEs, local models, RAG, agents) (www.reddit.com) Been vibe coding a lot recently and kept running into the same problem finding actually usable tools without paying for 10 different subscriptions or donating my bank balance to Claude. So I put together a curated list focused on free or l…
Contextual News Search APIs: A Deep Comparison for AI, RAG, and Research (github.com via hn) Contextual News Search APIs: A Deep Comparison for AI, RAG, and Research Last reviewed: August 21, 2026 Executive summary The market for "news search APIs" now contains several very different products under the same label. Some services se…
Is Granite-4.1-30b Overshadowed by Qwen3.6 & Gemma4 models? (www.reddit.com) I don't see any threads on this model. Is it because it's dense and/or without-reasoning?
how do you guys handle the conversation with skeptical clients when selling agents? (www.reddit.com) struggling with a bit of a reality check lately and wanted to see if anyone else is running into this. been pitching agentic workflows for a while, and I've realized that leading with the tech - the orchestration the RAG, the "intelligence…
Ran the same models across Strix Halo, RTX 3090, and RTX 5070 because I wanted my own numbers (www.reddit.com) I kept seeing inference-speed claims for these models and wanting an apples-to-apples comparison on the hardware I actually have. So I built a harness and a public page that dumps every run as YAML.
Show HN: XTrace – Encrypted vector DB (search embeddings without exposing them) (github.com via hn) Hey everyone! This is XTrace.
Evaluated a RAG chatbot and the most expensive model was the worst performer. Notes on what actually moved the needle. (www.reddit.com) We had a customer support RAG bot. Standard setup: ChromaDB, system prompt, an LLM doing generation.
Anyone actually using a local LLM as their daily knowledge base? Not for coding, for life stuff. What's your setup? (www.reddit.com) So I've been going down a rabbit hole lately and I can't find many people actually talking about this specific use case. everyone here runs local LLMs for coding, chat, maybe some creative writing.
OpenAI has announced they will be winding down fine tuning. (www.reddit.com) Got an email today about the announcement. > OpenAI is winding down the fine-tuning API and platform.
Choosing a Mac Mini for local LLMs — what would YOU actually buy? (www.reddit.com) AI Engineer Notebooks – free, framework-free RAG/agents/evals on Colab (github.com via hn) AI Engineer Notebooks Learn the applied-LLM stack the way you'll actually be interviewed on it — framework-free, on a free API, from prompting all the way to serving, fine-tuning, and a red-team benchmark. Runnable Colab notebooks for the…
RAG on Snapdragon X2 Laptop, 200K documents. (www.reddit.com) Qualcomm recently released the new 𝐒𝐧𝐚𝐩𝐝𝐫𝐚𝐠𝐨𝐧 𝐗2 𝐥𝐚𝐩𝐭𝐨𝐩 𝐜𝐡𝐢𝐩𝐬𝐞𝐭. I immediately ordered one: ASUS Zenbook A16 16" 3K OLED Touchscreen Laptop — Snapdragon X2 Elite Extreme (2026) A few things I really like about this machine: 𝐄𝐱𝐭𝐫𝐞𝐦𝐞𝐥𝐲 𝐥𝐢𝐠𝐡𝐭.
How are you actually using AI agents in real workflows right now? (www.reddit.com) I’m building some infrastructure around AI agents and I’m trying to understand how people are actually using them in real workflows, not demos. Specifically curious about: - What your agent actually does day-to-day (not hypotheticals) - Wh…
Show HN: GlycemicGPT – Open-source AI-powered diabetes management (github.com via hn) I'm a Type 1 diabetic and software engineer. Last year I went months between endocrinologists with no clinician reviewing my data.
Sanity check: using git to make LLM-assisted work accumulate over time (www.reddit.com) Show HN: AI support chatbot with RAG and citations – one back end file, no infra (github.com via hn) Upload markdown docs, get a support chatbot that answers with citations. The entire backend is one JS file — storage, search, and conversation history are handled by the runtime.
Struggling to balance high-volume orchestration (www.reddit.com) Working on a multi-agent system for a large outbound pipeline. We're running 100+ LinkedIn and email accounts, and simple linear automation (step A then step B) breaks down fast because real conversations don't move in a straight line.
I've tested some local LLMs on prosumer hardware, here are some findings (news.ycombinator.com) I have been benchmarking local LLMs on a Mac M4 Pro 24 GB RAM using LM Studio. I've tested mostly with 4-bit quantization, both MLX and GGUF, from 4b to 35b models, with speeds of 3 to 40 tokens/second.
Launch HN: Screenpipe (YC S26) – Power your agents by your 24/7 screen recording (news.ycombinator.com) Hi Hacker News, I'm Louis. I built Screenpipe (https://screenpipe.com).
Training SID-1 to beat GPT-5 at search with 1k+ QPS RL (turbopuffer.com via hn) SID-1 is an agentic search model that is 24x faster than GPT-5.1-high, 374x cheaper than Sonnet 4.5, and achieves 1.9x higher recall than traditional RAG pipelines. Here's how we trained it using large-scale RL on turbopuffer.
How are you maintaining your AI apps post-launch? Model bugs vs engineering bugs, and what's your debugging stack? (www.reddit.com) I've been going down a rabbit hole tinkering about what actually happens after you ship an LLM-powered app, and I'd love to hear how others here handle it… A few things I keep getting stuck on: Continuous optimization. Once your app is in…
Reducing LLM context from ~80K tokens to ~2K without embeddings or vector DBs (www.reddit.com) RAG/Retrieval as a solution (www.reddit.com) hi folks, I am new to the community and I have gone through the rules and I hope I am not breaking any of them with this post and will try to maintain 1/10 ratio. For building RAG, there are many tools out there each solving a piece of t…
Show HN: Strata, real-time Markdown editor you can mount as a filesystem (strata.space via hn) Hi HN. Strata is a real-time markdown editor built around document portability across agentic workflows.
Any reason to run dense over MOE for RAGs? (www.reddit.com) I tend to use Claude for a lot of research and I also increasingly worry about things like misinformation or things in the model I can't audit. So, I'm building my own all in one RAG with big datasets like all of Wiki, research papers, all…
Every week this we see some version of "how do I evaluate my LLM app?" and the answer almost always stops at RAGAS or DeepEval. Here is the part of the evaluation stack most tutorials skip in 2026. (www.reddit.com) The same question lands on this sub a few times a week, and the standard answers (RAGAS, DeepEval) are correct but stop one layer short of what you actually need once your app leaves a notebook. Wanted to lay out the full picture for anyon…
LLMSearchIndex- an Open Source Local Web Search Library with over 200 million indexed Web Pages for RAG applications (github.com via reddit) I've been pretty unsatisfied with web search options for local LLM/RAG systems. Most setups either rely on paid APIs like Brave, or meta search scrapers like SearXNG.
Persistent memory system for LLMs that actually learns mid-conversation (www.reddit.com) Every LLM conversation starts from zero. RAG helps, but it can't learn from what's happening right now.
I have built something using claude what I was doing on excel from last 13 years (www.reddit.com) I am doing financial modeling for the startups and feasibility reports for the new companies for more than a decade now, I started playing with Lovable 6 months ago, then somebody introduced me to the VSCode with claude, it’s like a superp…
Are we overengineering RAG when the real problem is structure? (www.reddit.com) Lately I’ve been working on a few enterprise AI use cases, and one thing keeps coming up. We spend a lot of time trying to improve retrieval.
Turning RAG pipelines into enterprise-grade Data Subscriptions (halcyon.io via hn) Back in September, we at Halcyon shared our plans to build five data subscriptions in the coming months. If you are reading here, you’ve probably been along the journey with us: from gas power plants, to large load tariffs, to utility rate…
Total idiot needs some build advice (www.reddit.com) Looking for some advice here because I made a hasty purchase. "Cut your losses and move on" is totally a reasonable answer, but I figured I'd look for some additional help. So, I just started working on a local RAG pipeline with about 15,0…
We taught a small LLM to throw away 68% of our RAG context (www.kapa.ai via hn) How we taught a small LLM to throw away 68% of our RAG context Pruning agent context down to what the answer actually needs, while keeping 96% of recall by Lars Baltensperger Kapa builds AI assistants that answer complex questions over lar…
Metasearch Tooling for Agents (news.ycombinator.com) I'm the CTO at System1. We own Dogpile.com.
Show HN: Built a public demo to explore SpaceX's IPO filing using multimodal RAG (www.calypso.so via hn) Ask the SpaceX IPO filing like an analyst. Grounded across 84 indexed sources, including prospectus summaries, risk factors, MD&A, launch vehicle pages, Starlink materials, xAI/X references, charts, and image exhibits.
RAG demo for New Zealand residential tenancy law (tenancy.localrun.ai via hn) This tool searches real NZ Tenancy Tribunal decisions published by the Ministry of Justice. Decision links point to NZLII.
We reduced RAG retrieval cost 10× with a hippocampus-inspired memory substrate (www.bricbybric.ae via hn) We Built a Memory Engine. The Brain Told Us How.
Show HN: Harbor v0.4.19 – harbor launch –back end vLLM –web codex (github.com via hn) https://github.com/user-attachments/assets/e4897391-c5a8-4391-93c3-9f8b76155f11 Setup your local LLM stack effortlessly. Starts fully configured Open WebUI and Ollama harbor up Now, Open WebUI can do Web RAG and TTS/STT harbor up searxng s…
Your RAG is hallucinating because of garbage retrieval — here's the 3-line fix (with real scores) (www.reddit.com) My RAG agent hallucinated. Not because the LLM was bad — because the retrieval was feeding it noise.
Show HN: I built a RAG and knowledge graph agent that runs locally (news.ycombinator.com) Claw-Coder is an AI agent that runs locally on your laptop and has access to powerful tools instead of configuring claude or codex to use a local model just use claw-coder. Why was claw-coder created?
I Kept a Diary for Seven Years. An LLM Finally Read It. (www.reddit.com) I've kept a personal diary since 2019. Last week I fed 200+ entries to an LLM and asked it how I've changed over 7 years.
how would you set up a local llm server for a business of 7 people? (www.reddit.com) Okay so i've been stalking this sub for some time and i run the occasional small 2-8b model on my laptop (not the best) for fun but say my role at a company is to set up a local LLM since we obviously don't want confidential data going to…
Show HN: An agent that tunes its own cache (news.ycombinator.com) The weekend of last week I built chat.betterdb.com as a RAG over Valkey/Redis/Dragonfly docs. The goal was to eat our own dogfood and test publicly our caching libraries.
I made tiny AST tool for agent code exploration - No RAG, no index, no cache (www.reddit.com) A small tool I made for myself (ast-outline), sharing in case it's useful... still experimenting with it.
An Open Benchmark for Testing RAG on Realistic Company-Internal Data (www.reddit.com) We built a corpus of 500,000 documents simulating a real company, and then let RAG systems compete to find out which one is the best. Introducing EnterpriseRAG-Bench, a benchmark for testing how well RAG systems work on messy, enterprise-s…
I'm looking for an AI Automation Engineer role or gig (news.ycombinator.com) Hi all, I'm an AI automation engineer who builds systems that replace manual work, scale outreach, and turn workflows into revenue. I have sent out working systems for managing leads to CRM, finding real estate deals, sorting emails with A…
Learn, run and test Agentic AI on your browser for free! (Built with Claude Opus 4.7 in 2 days) (www.reddit.com) Hey Everyone, Over the last few months, I noticed a massive gap in how we learn about Agentic AI. There are a million theoretical blog posts and dense whitepapers on RAG, tool calling, and swarms, but almost nowhere to just sit down, run a…
↯ Fine Tuning↯ Function Calling↯ Opus 4.7function-callingfine-tuningrag+4
Is evaluating RAG retrieval using UI only useless? (www.reddit.com) Suppose that for now you only had access to the frontedn of a RAG system and you don't know how does the backend works, but you need to improve confidence of retrieved results. How do you design this process to be able to improve it?
building a Multi-Agent AI App for automated Bill of Quantities. Need architecture/framework any advice! (www.reddit.com) GPU strategy for local LLM + mixed workloads (70-person company) — NVIDIA vs AMD? (www.reddit.com) Hey all, we’re a mid-sized company (~70 people) and currently planning to bring a lot of our workloads on-prem instead of relying on cloud APIs. The goal for the moment is to run small to mid-sized models in the range of 30B like Qwen3.6 o…
Plugging Claude into Obsidian for a RAG like system. (www.reddit.com) Hey so I am just going to make a post to see what almighty reddit has to say but I am trying to get claude to connect to an Obsidian vault so it can help me reference lecture notes, textbook theory, past claude convos, and projects and sof…
Show HN: SynapseKit – Async-native Python framework for LLM pipelines and agents (github.com via hn) []() Documentation · Quickstart · API Reference · Changelog · Discord · Report a Bug Build production LLM apps with 2 dependencies. Async-native RAG, Agents, and Graph workflows — no magic, no SaaS, no bloat.
I open sourced a local-first LLM wiki for research and durable memory (www.reddit.com) I’ve been building a small tool called oamc around a workflow I wanted for personal research and long-running project memory. The basic idea is: instead of repeatedly querying raw notes/documents, sources get ingested into a maintained mar…
Show HN: Raggy – A lightweight CLI tool for RAG over local documents (github.com via hn) raggy A lightweight CLI tool for Retrieval-Augmented Generation (RAG) over local documents built with LangChain, Chroma, and Ollama. Hybrid database (vector + BM25 index) and embedding generation run fully locally.
RAG Refresher Notebook (github.com via hn) RAG in context A notebook about retrieval-augmented generation: getting a language model to answer questions from documents it was never trained on. Search does the work: find the few paragraphs most likely to hold the answer, and paste on…
Show HN: Backprompter – create, test, and deploy agents without a back end (backprompter.com via hn) Hi everyone, I am a professor in AI, and I often build AI apps as a hobby and for academic projects. I felt that I was wasting too much time setting up backends, DB, and secrets for each app, and testing the prompts, updating them, and red…
Show HN: HRAG – Hybrid RAG on €116/month of Hetzner, officially benchmarked (hrag.app via hn) hRAG Hybrid retrieval with receipts. 00 · 01 The platform, answering actual screenshots of the live thing… the 512K-document playground, streamed answers, citations you can open.
Ask HN: When do you choose RAG over Fine-Tuning? (news.ycombinator.com) could not extract summary
Show HN: 11-Node Agentic RAG with MCP and PII Shield Under 512MB RAM (agentic-rag-financial-parser.onrender.com via hn) Production-Grade 10-Node Agentic AI featuring ReAct Web Search fallback, Human-in-the-Loop reasoning, and WhatsApp Meta Cloud API Webhook Integration.
Show HN: Autoretrieval – Autoresearch for RAG Pipelines (github.com via hn) Hi, inspired by Andrej Karpathy's autoresearch, I built autoretrieval, a small framework that lets an AI agent improve a RAG pipeline by running experiments against an evaluation dataset. The agent edits the retrieval pipeline, runs an eva…
Show HN: BetterDB, MIT Valkey-native context layer for AI agents (github.com via hn) Today we released an open, Valkey-native context layer for AI agents as part of our packages at BetterDB (agent memory, semantic + multi-tier caching, typed retrieval) that run on a Valkey instance no matter where it is - no vendor lock-in…
Applied AI Implementation Engineer Freelance (news.ycombinator.com) Open to Work I build production AI systems that add intelligence to processes. My work includes Closed-Loop AI-native systems, RAG, AI agents, agentic evaluations, guardrails, and enterprise integrations using Python, TypeScript, React, No…
Find the questions your RAG pipeline will fail on, before your users do (github.com via hn) RAGProbe Find the questions your RAG pipeline will fail on — before your users do. RAGProbe analyzes your chunk corpus topology (the graph of how chunks relate to each other in embedding space) and generates adversarial questions targeting…
Show HN: Vedana – open-source RAG over a knowledge graph (github.com via hn) Vedana Open-source multi-agent RAG over a knowledge graph. Instead of guessing answers from text similarity, Vedana agents navigate a typed graph step by step — issuing Cypher queries, running vector search, verifying sources, and assembli…
A PostgreSQL Database for Every Agent: In-Database RAG, Graph, and Multitenancy (www.yugabyte.com via hn) Discover newly released YugabyteDB 2026.1 and YugabyteDB AMP (Agentic Multitenant PostgreSQL): a true serverless, scale-to-zero PostgreSQL where every agent gets its own real, isolated database starting at a fraction of the cost of a core.…
Show HN: Coding agent with algebraic memory (VSA) instead of RAG (github.com via hn) Raidho ᚱ A coding agent that plans with one model, executes with another, and remembers what it learns. Most coding agents are one model in a tool loop.
Show HN: Local RAG memory system that AI can write directly to (github.com via hn) For me and my family, it get really annoying having to reshare information each time you create a new LLM chat. Therefore, I decided to create local-memory-mcp, a local MCP that allows LLMs to read and write to a RAG.
Building a Personal RAG Chatbot in a Few Days (e-mahmoudi.me via hn) Building a Personal RAG Chatbot in a Few Days: Learning by Engineering How I built a small personal RAG chatbot using FastAPI, PostgreSQL, and Docker as a practical engineering exercise. Building a Personal RAG Chatbot in a Few Days: Learn…
Show HN: A 150M model that extracts verbatim evidence spans for RAG, no LLM call (huggingface.co via hn) Verbatim-RAG Extractor Chill, I Ground! 🌶️ Model Name: verbatim-rag-modern-bert-v2 Organization: KRLabsOrg Github: https://github.com/KRLabsOrg/verbatim-rag Overview The Verbatim-RAG Extractor is a query-conditioned token classifier that h…
Composition Hallucinations: Not all RAG hallucinations are retrieval failures (zenodo.org via hn) Composition Hallucination in Retrieval-Augmented Generation: A Failure Mode and Benchmark Protocol Description Retrieval-Augmented Generation (RAG) is commonly motivated by the idea that language models answer more faithfully when relevant…
I compared 8 open-source AI agent frameworks so you don't have to — here's the full breakdown (www.reddit.com) We did a deep-dive comparison of the 8 major open-source AI agent frameworks as of mid-2026: 🔹 LangGraph — Best for complex state machines & DAG workflows 🔹 CrewAI — Best for multi-agent role-playing teams 🔹 AutoGen — Now in maintenance mo…
How I do use the recent llama.cpp native tools to do web rag a.k.a. web_fetch (or anything else for the matter) directly from inside the llama-server's webui (www.reddit.com) As some other fellow lllmers I've discovered few days ago that the amazing llama.cpp project has just added native tools functionalities into the server. After having enabled the relative options into llama-server and played a bit with the…
A primer on how large language model works (mayijie.substack.com via hn) How Large Language Models Work A primer on LLMs: from tokens, embeddings, and Transformers to training, RAG, tool calling, multimodality, and end-to-end product flows. A large language model is not a human mind simulated in software.
Building Agentic GraphRAG Systems: From knowledge graphs and ontologies to a unified memory as an MCP server for your AI agent. (www.reddit.com) I gave this talk twice in one month: at O’Reilly’s Context Engineering Event and at Abi Aryan’s Maven course on LLM inference at scale. After being blasted with questions, I realized something: GraphRAG isn’t a retrieval algorithm, it’s a…
How are you protecting your AI agents' memory from poisoning attacks? (www.reddit.com) As AI agents become more autonomous and persist memory across sessions (RAG indexes, conversation history, vector stores), there's a growing attack surface that most people aren't thinking about: memory poisoning.An attacker can plant mali…
MSA 100M tokens (www.reddit.com) https://arxiv.org/abs/2603.23516 https://github.com/EverMind-AI/MSA If verified, rag is no more needed.
RAG retrieves the refutation and still gets it wrong (reyes.id.au via hn) Anchor catching the failure mode where RAG retrieves the refutation and still gets it wrong Ask vanilla RAG over Duval, Goeckner, Klivans, and Martin's 2015 paper "A non-partitionable Cohen-Macaulay simplicial complex" this question: What…
is multi-agent architecture worth the 15x token cost? (www.reddit.com) moving my current research workflow from a single generalist agent to a multi-agent setup (MAS), and the projected token usage is terrifying. some benchmarks suggest it can be up to 15x more expensive than a standard chat exchange.
Do you guys use AI / Agents for direct profit or do you apply it to be more effective - Could use some guidance and motivation I'm 20 (www.reddit.com) I'm kinda tired of kinda doing rocket Science to have a local agent. Trying to Figure out why its out putting garbage , Then Getting it's output to to stream through my UX layer Properly , Getting it to call tools properly.
Ask HN: Anyone using AI agents for active learning sprints? Here's my setup (news.ycombinator.com) Hi HN, I'm a big fan of AI's ability to provide personalized tutoring. So, lately, I have been using my Antigravity IDE (you can use any agentic harness) for personal learning.
What tools are you using to give your LLM a persistent second brain / long-term memory? (www.reddit.com) I've been going down a rabbit hole trying to solve LLM memory. the problem where every session starts blank and your agent has no idea what it learned last week.
Open-source CLI that turns a folder of docs into a queryable wiki — no vector DB, no chunking (www.reddit.com) Been looking for a self-hostable way to maintain a personal knowledge base from research docs without the complexity of setting up a vector database, writing chunking logic, and babysitting embeddings. Ran into OpenKB this week and it's cl…
Why many RAG projects are still hallucinating (www.reddit.com) I’ve been auditing quite a few RAG codebases lately, and it’s surprising how often the hallucinations creep in even when the setup looks decent on paper. A lot of the trouble starts with chunking.
Mastermind – agentic SDLC workflow for VS Code (news.ycombinator.com) Prototype of an agentic SDLC workflow running inside VS Code + Copilot. Simple loop: task → reasoning → audit → memory → RAG refresh.
Which local models are actually good at staying in character? Notes from shipping Qwen3.5 4B + 9B as game NPCs (www.reddit.com) I'm building a small text-based game where the gameplay loop is "talk an NPC into revealing a secret." It's basically a 20+ turn roleplay stress test: the model needs to stay in character, remember what the player said earlier, and refuse…
How are you handling citation/traceability in AI-driven research workflows? (www.reddit.com) been spending ages lately trying to tighten up citation + traceability in RAG-based research workflows, and I’m starting to feel like “retrieval” and “verifiability” are still pretty loosely coupled in most stacks.Typical setup (vector sea…
Project Knowledge indexing never completes on large .md files — permanent spinner, RAG as silent fallback (Max plan, reproducible) (www.reddit.com) I've been using Claude Max for a few months now, and Projects have been central to my workflow. I use two Markdown files in a long-term project that I update regularly — they're essentially living documents that grow over time as I add not…
Building a Production-Grade RAG Chatbot for a Complex Banking Site, Tech Stack Advice Needed? (www.reddit.com) Hey everyone, I’m currently working on turning a fairly large and structured financial website into an AI-powered knowledge assistant (RAG-based). The site itself isn’t trivial, it has multiple product categories (cards, loans, accounts),…
Show HN: 5-translation RAG matrix fixing LLM religious hallucinations (github.com via hn) Show HN: How context engineering works, a runnable reference (github.com via hn) I've been presenting at local meetups about Context Engineering, RAG, Skills, etc.. I even have a vbrownbag coming up on LinkedIn about this topic so I figured I would make a basic example that uses bedrock so I can use it in my talks or v…
I Tried the LLM Wiki and RAG on Todays News from BBC, CNN, Euronews (99helpers.com via hn) Israel-Lebanon Ceasefire Agreement DEEP DIVEIn-depth analysis of the 10-day, US-brokered ceasefire agreement established between Israel and Lebanon. A pivotal 10-day ceasefire agreement between Israel and Lebanon officially went into effec…
Building a fully local Android manual assistant (LiteRT-LM + RAG) what architecture would you use? (www.reddit.com) Processing img 8ofni1q6dpvg1... Hello everyone, I’m building an offline RAG system for my company, we are trying to run an app that retrieves infromation from two manuals in an android tablet with the idea of an AI to provide precise answe…
Zuver – Build your enterprise Agents with just 10MB RAM (news.ycombinator.com) I built Zuver, the generic Agentic AI framework for scalable, reliable, even on-edge AI applications and Agents. It's completely written in Go, which lowers the RAM usage to around 6MB, compared to other Agent framework that's usually arou…
Should you read the code, is RAG dead, and did Skills kill MCP? (github.blog via hn) Hot takes turn complicated topics into one confident sentence. That makes them great for engagement, but not necessarily for understanding.
Working on Plug and Play personal AI Memory that works across AI agents (news.ycombinator.com) So I've been working on a project (Make0 AI) for a long time where I wanted to give common context to both Codex and Claude Code. The problem is simple - while working on Claude and after exhausting the daily/weekly limits I've start again…
Open-source Python framework for AI agents, workflows, and automations (github.com via hn) BindAI Build AI software. BindAI is an open-source, modular Python framework for building AI applications with reusable components for agents, tools, workflows, memory, knowledge and RAG, model providers, integrations, automation, and runt…
Show HN: Post-graph-RAG – your RAG still thinks the old CFO is the CFO (github.com via hn) post-graph-rag Graph RAG with a memory of time — on the PostgreSQL you already run. post-graph-rag extracts entities and relations with an LLM, stores them as a property graph beside pgvector embeddings, and answers questions by fusing vec…
Show HN: Nightshift – Rust CLI to Orchestrate GitHub Issue Resolution with Dags (github.com via hn) Hi everyone, I built Nightshift: An agent-agnostic rust-cli tool that orchestrates completion of GitHub Issues. When Openai and Anthropic released `/goal` a couple months ago, I was really excited to try it for long-horizon tasks.
Show HN: Give your AI agent on-screen guides that show users where to click (news.ycombinator.com) Hey HN. I'm Christian, one of the founders of Frigade (YC W23).
Clean Web-to-Markdown: Fast HTML Extraction for LLMs and RAG (markdown.usemy.cloud via hn) Strips cookie banners, navigation menus, and ads. Built-in Tier 2 Stealth Headless Browser bypasses Cloudflare Turnstile, JavaScript challenges, and anti-bot walls.
Librarian – Local eBook-to-Markdown pipeline with MCP and quote checking (github.com via hn) 📚 librarian Turn any ebook into clean, token-counted Markdown chapters — let Claude read your bookshelf over MCP and catch it misquoting your books. Deterministic RAG: no embeddings, no network, no API keys.
Make A GPT: Building Affordable CustomGPTs (makeagpt.com via hn) Discover insights from your knowledge base Upload PDFs, Word docs, or paste URLs. Get a branded AI assistant on your own URL, or embed it on your site — with RAG search, citations, analytics, and a curated questions page.
Docs-Reference: A Common Lisp RAG System for Local Models (github.com via hn) Docs Reference A library for referencing URL documentation with a local RAG system. Written in Common Lisp.
RAG Is Simpler Than You Think (www.lighthousenewsletter.com via hn) Nowadays, most people seem to over-engineer their RAG stack. They jump straight to embeddings, vector databases, and reranking pipelines.
Scaling RAG building an efficient pipeline for 500k chunks with Gemini (www.rsolitario.com via hn) Scaling RAG: Building an Efficient Pipeline for 500k Chunks with Gemini 2.5 and Context Caching 1. The Architecture To process a volume of approximately 2GB (roughly 500,000 text chunks), we need a high-performance pipeline: - Extraction:…
How to build a RAG pipeline with the Go StdLib (blog.devgenius.io via hn) could not extract summary
Show HN: RAGless – similar to RAG, but $0 LLM API costs at runtime (github.com via hn) RAGless — Deterministic Retrieval-Only Q&A System RAGless is a retrieval-only question-answering system with zero LLM calls at runtime. Source documents are converted into self-contained informational blocks, indexed into a local vector da…
Standard RAG returns funny neighbors. Multi-vector fixes the signal (github.com via hn) VectorPrism Positional Subspace Multiplexing (PSM) & Intent-Gated 2-Stage Retrieval Engine for High-Scale RAG. One contiguous 1024d tensor.
The Review That Praised the Bug: grading three LLM code reviews against the code (mrjstickel.com via hn) AI systems engineer who designs and ships production AI end to end - RAG pipelines, agentic assistants, measured retrieval quality, and multi-provider LLM infrastructure, with hands-on QLoRA fine-tuning. Built a private AI platform (Archit…
Show HN: Akintu – AI agents trained on custom knowledge bases using RAG (akintu.ai via hn) could not extract summary
Show HN: Find stale, orphaned, deleted-but-retrievable RAG vectors (github.com via hn) rag-staleness-check Read-only staleness / orphan / duplicate / retrievability checks for a single pgvector, Qdrant or Chroma index - the open-source half of the RAGproof "decayed RAG index" teardown (full writeup + multi-engine ledger-veri…
I let a RAG index rot for 13 months. It grew 5x, 90% failed a check (ragproof.io via hn) A reproducible teardown of a vector index after 13 months of real churn across pgvector, Qdrant and Chroma — 90% of live chunks failed at least one check.
We audited 1,751 "relationship milestones" our RAG extractor wrote 62% were junk (myastra.pl via hn) Case Study Debugging and Detoxing a Long-Term Memory RAG A conversational AI with persistent memory had quietly poisoned its own recall over several months. This is how we found it, measured it, fixed most of it, and what we deliberately l…
Is fine-tuning still needed? LLMs, RAG, & LoRA – IBM Technology [video] (www.youtube.com via hn) About Press Copyright Contact us Creators Advertise Developers Terms Privacy Policy & Safety How YouTube works Test new features NFL Sunday Ticket © 2026 Google LLC
Show HN: Warden – authorization gateway for agentic RAG (github.com via hn) Warden Permission-aware retrieval and agent-authorization gateway for AI systems. Warden enforces relationship-based, deny-aware, cross-tenant document permissions inside the retrieval path of agentic RAG systems — behind a fail-closed sec…
Show HN: My design portfolio is a Claude agent (no vector DB, no RAG stack) (www.blackbook.dk via hn) BLACKBOOK Home Portfolio About Services Experience Contact CV EN DA Journal | Privacy Policy | Copyright © 1996-2026 BLACKBOOK BLACKBOOK Home Portfolio About Services Experience Contact CV EN DA Journal | Privacy Policy | Copyright © 1996-…
Mnemo AI – Local agentic assistant for any LLM that learns from its failures (github.com via hn) Mnemo AI A local agentic AI assistant with MCP (Model Context Protocol) integration, RAG capabilities, and intelligent conversation management. Built on LangGraph with LangChain for multi-provider LLM support (Ollama, Amazon Bedrock, OpenA…
↯ Ollama↯ Model Context Protocolmodel-context-protocolollamarag+2
Show HN: rag-redteam, red-team your RAG pipeline for injection and leakage in CI (github.com via hn) rag-redteam Red-team your RAG pipeline for prompt injection and source-document leakage, right in CI. RAG systems have an attack surface that general LLM scanners miss: the retrieved documents themselves.
Attribute Knowledge RAG Pattern for Governed AI Agents (superml.dev via hn) Standard RAG retrieves documents and lets the LLM generate field names freely — which means it will invent fields your schema never had. AK-RAG (Attribute Knowledge RAG) indexes your governed attribute catalog instead, and the LLM can only…
Graph-guard, a knowledge graph behind RAG for multi-hop retrieval (github.com via hn) graph-guard A knowledge graph that makes RAG answer the hard questions — the ones where the answer is spread across several documents — plus a measured, honest account of when the heavyweight semantic stack is worth its cost and when it is…
Seven Levels of RAG (martimchaves.com via hn) Specialising in LLMs, MLOps, and production ML systems.
Ragit – chat with any folder of documents using a local LLM (github.com via hn) ragit Local RAG CLI to chat with any folder of documents using Ollama. Install cd ~/ragit python3 -m pip install -e .
Show HN: AskPG, a real-time WebGPU Paul Graham avatar for startup advice (pg.nuggt.io via hn) How this works is that I extracted knowledge from PGs publicly available essays. Instead of using RAG I used a state map approach, if you are keen about the extraction method I can share more in the comments.
Superintellignce is still decades away (news.ycombinator.com) In 2022 - I thought that we got closer to AGI with LLMs, but it turned out LLMs were more like the engine of intelligence than intelligence itself. In 2023 - I started to understand how important memory is to the system, and the intelligen…
Fame, an external memory and tool-safety gateway for local coding agents (github.com via hn) FAME Knowledge Agent Gateway 中文优先。English follows. 中文简介 FAME Knowledge Agent Gateway 是一个面向 Agent 的万用外部插件:它把图谱知识网、项目工程记忆、工具调用治理、FAME 路由反馈和可视化工作台放在同一套外部运行时里。 它不是普通 RAG,也不是普通聊天记忆。它的核心目标是让 Agent 在真实工程中先对齐目标、再按知识路线思考、再受控调用工具、最后把成功、失败、教训和证据写回外部记…
Show HN: Discover content in any YouTube channel with RAG (askchannel.ai via hn) Ask Channel AI (http://askchannel.ai) allows you to quickly find relevant videos, quotes, and timestamps from any YouTube channel. Channels that are not yet indexed or imported can be done so by signing up, and imports are typically pretty…
Show HN: Entity Resolution on Your Desktop (tilores.io via hn) Tilores is cloud-based entity resolution software used for fraud-detection, AML, RAG - but being cloud based makes it difficult for people to test as they are reluctant to upload sensitive data. To fix that we built a downloadable version…
LightOn: Production RAG without the 9-month build (lighton.ai via hn) Production RAG without the 9-month build SOTA on public retrieval and OCR benchmarks. Three endpoints, one API key.
Embeddings as Encodings (hash.dev via hn) Correctly conceptualizing and handling vectorization in knowledge graphs January 26th, 2026 Embeddings are now a default building block in modern data services, powering semantic search, retrieval-augmented generative AI (RAG), clustering,…
Extend Claude limits by offloading AI tasks to Neo (heyneo.com via hn) Install neo-mcp, register NEO with Claude Code, and delegate RAG audits, fine-tunes, evals, and pipeline debugging without leaving the terminal.
Move over Claude, 99.9% AR, 77.2% Beam – No RAG, No Embeddings, No Tricks (github.com via hn) CEM888.AI Enterprise-grade localized AI infrastructure and sovereign computing environments. CEM888.AI is advancing the future of private, high-performance artificial intelligence systems.
Show HN: Phlox – Open-source self-hosted agentic web chat (github.com via hn) Phlox A feature-rich, ChatGPT-style, self-hostable AI assistant. Phlox is a self-hostable chat application with an agentic harness, document RAG, code execution, and MCP integration — running over any model provider: AWS Bedrock or any Ope…
From Local to Global: A Graph RAG Approach to Query-Focused Summarization (arxiv.org via hn) The use of retrieval-augmented generation (RAG) to retrieve relevant information from an external knowledge source enables large language models (LLMs) to answer questions over private and/or previously unseen document collections. However…
Ask HN: The next evolutionary step in LLM usage? (news.ycombinator.com) I'll keep this post short and sweet, we have seen several steps in the evolution of LLM (large language model) usage. 1.
How to Build an Agentic RAG with RubyLLM and Rails (www.panasiti.me via hn) How to Build an Agentic RAG with RubyLLM and Rails I run a RAG application for Italian pension and tax consultants. Users ask questions about INPS, professional pension funds, laws and regulations, and the app answers using a knowledge bas…
Lessons We Learned Building a RAG Assistant Without a Separate Vector Database (blog.devgenius.io via hn) How we used StarRocks, Gemini, and tool-based retrieval to power grounded Q&A in a developer community Slack. 9 min read 7 hours ago Author:Billy Chang, Software Engineer at Phoenix AI Press enter or click to view image in full size StarRo…
Show HN: Terraform RAG - index modules, distill conventions, compose via MCP (terraform-rag.io via hn) AI-powered knowledge base for your Terraform modules. Index, search, compose, and audit - all from one place.
ContextWall – Context firewall for AI agents and RAG pipelines (contextwall.io via hn) Your AI agent reads untrusted content. Every web result, document, and API response your agent retrieves goes straight into the model's context window - unscreened.
Show HN: ContextBridge – Local-first AI reading sidebar using Ollama (chromewebstore.google.com via hn) Overview Store, search, and chat with web page content locally. AI chat (BYOK), full-text search, markdown export, and optional RAG endpoint.
Stop AI agents from being weaponized through their own memory (OWASP) (www.helpnetsecurity.com via hn) OWASP Agent Memory Guard: Stop AI agents from being weaponized through their own memory AI agents keep memory across sessions. Conversation history, vector stores, scratchpads, and RAG indexes persist between runs, and anything written int…
I built an enforcement layer for AI coding agents using a local knowledge graph and hybrid RAG (www.reddit.com) I know this sub is focused on local models but the architecture behind this applies to any LLM-powered coding agent, not just Claude Code. The problem: when you give a coding agent a large set of rules and standards, two things break.
The Self-Healing Vector Database (www.reddit.com) A pattern I keep seeing in agentic RAG systems: The agent is smarter than the retrieval layer. It can notice that context is stale.
Show HN: Search Router – retrieval-ready web search for AI agents (github.com via hn) Search Router is a web search API built for AI agents and RAG systems. We built it internally at first, when working on AI tools.
The only way to avoid prompt injection is to never give AI agents API keys, credentials, etc. (www.reddit.com) The whole point of AI Agents is that they can *do* things. For this, they use API keys, GitHub tokens, database passwords, OAuth tokens, etc.
Tool-schema compression enables agentic RAG under constrained context budgets (arxiv.org via hn) Agentic RAG systems that equip language models with dozens to hundreds of tool definitions face a critical resource conflict: tool schemas consume the same context window needed for retrieval-augmented generation. We present the first syst…
Are local LLM users testing prompt injection before connecting models to tools? (www.reddit.com) I wanna know how people here are handling security once local models move beyond chat.....Running a model locally feels safer because the data does not leave your machine or your infra. That is a real advantage.....But once the local model…
Maybe the problem with non-coding agents is that they have no repo (www.reddit.com) I’ve been trying to understand why coding agents seem to work better than most non-coding agents. Maybe the thing coding agents have that most other agents don’t is the repo itself.
numind/NuExtract3 · Hugging Face (huggingface.co via reddit) NuExtract3 is a unified 4B vision-language reasoning model for document understanding. It combines strong structured information extraction with high-quality image-to-Markdown conversion, making it suitable for extraction pipelines, OCR, a…
Is there any reason for an uncensored model if you have no interest in roleplaying? (www.reddit.com) My rag I've been building is much in response to having a LLM that I feel more confident in knowing where the knowledge base is coming from especially after the Open AI deal with the Pentagon. So, when I saw "uncensored" heretic models, I…
Agent builders: are GPT/Claude/Gemini API costs killing your margins? (www.reddit.com) Hey everyone, For people building agents with LangGraph, CrewAI, AutoGen, OpenAI Agents SDK, Claude MCP/SDK, Google ADK, or LlamaIndex — how are you managing LLM API costs? Agent workflows can get expensive fast because of: tool calls retr…
PDF and non-text local file reading with AnythingLLM? (www.reddit.com) So far, AnythingLLM works well for me when i copy files over to docker folder (so originals can't be erased/modified), and i have LLM do a text search. RAG I tested but with number of files and specificity, just searching for file names an…
Embedding models are coordinate systems. What silently breaks in production RAG (internals.laxmena.com via hn) Your embedding model doesn’t understand your data INTERNALS.md #3 · It never did. Here’s what it actually does, and why that matters for every RAG system you’ll ever build.
Context is shared. Commitment is not. (www.reddit.com) Everyone is talking about context management. RAG pipelines, memory systems, knowledge graphs, long-context windows.
Show HN: Nano-RAG – Agentic multi-hog retrieval without graph database (news.ycombinator.com) https://nanorag.nb1t.sh/ Important: Please choose correct namespace from top-right dropdown. Available docs/namespaces: Cloudflare, Nextjs, and Dodo-payments (default).
RAG vs. Fine-Tuning – The Question Every AI Builder Gets Wrong (thingswithai.org via hn) RAG vs. Fine-Tuning — The Question Every AI Builder Gets Wrong AI models don't know your private data.
Are AI agents creating a new runtime supply-chain attack surface? (www.reddit.com) I’ve been thinking about AI agent security less as a prompt-injection-only problem and more as a runtime supply-chain problem. In many deployed agents, the model is no longer just generating text.
Agent memory is not just RAG over user facts (www.reddit.com) I keep seeing agent memory implemented as: Extract facts/preferences from conversation Store them Retrieve top-k before each response Inject them into the prompt This works for demos, but it breaks in production because memory becomes poli…
What do you charge for production-ready invoice/document automation? Sanity check on a €20k quote (www.reddit.com) I am currently looking to get into automation for German Mittelstand and I am now talking to an SME, which got an offer from a consulting firm for document processing automations and trying to figure out if the pricing is normal or inflate…
RAG Eval Comparing Vertex/Bedrock/Azure/OpenAI (github.com via hn) RetrievalCI Stage: bench-v0 early preview. The methodology, scorecard format, and 9 system adapters are stable.
I just have a question about Langchain and Langgraph (www.reddit.com) I want to know that learning these fundamentals is enough to land job or is there something else that i have to learn along with these? Right now i am learning about genAI through campusX and making rag projects.
Token, Harness, OpenClaw, RAG, MCP, Agent – What's the Difference? (medium.com via hn) 11 min read Apr 23, 2026 You know these terms alone. Together?
Argus – RAG based vulnerability scanner (github.com via hn) argus A RAG-based (Retrieval-Augmented Generation) vulnerability scanner for Go, Python, Rust, npm/Node.js, Maven/Java, NuGet/.NET, and Ruby projects — powered by local Ollama models or any OpenAI-compatible API. No cloud lock-in.
Some notes and lessons on Agents, RAG and memory (www.reddit.com) I put together some notes on building agents. I have built agents at scale for a while now and for a few clients, so I thought i would start putting all the knowledge into lessons that might help other people as well.
On "harness engineering": Are people actually building things or just giving impressive labels to "tweaking?" (www.reddit.com) I see a lot of posts and videos talking about harness engineering, or it could be context engineering, RAG, etc. The thing is, most of them talk about the concepts.
Open Sourcing Our Platform - GuideAnts Notebooks (www.reddit.com) This is yet another agent harness and UI and I hope you will have a look and consider contributing. Elumenotion/GuideAnts: GuideAnts Notebooks.
Agentic RAG Frameworks (www.reddit.com) I am trying to understand how the market around RAG is currently, what are it's usecases, how do enterprise companies approach this. Do they just have company related documents which is uploaded to these RAG systems and use it to query the…
We built an agentic AI for support triage. 47% deflection in 90 days. Full retro. (www.reddit.com) Setup: mid-size SaaS, ~3,000 tickets/month, 6 agents drowning. 70% of volume was tier-1 (passwords, billing, where's-my-feature).
Claude architecture mock test.. (www.reddit.com) Built a new update for Claude Playground 🚀 Added Mock Tests for learners preparing for the Claude Architecture exam — users can now validate their understanding and test their learning directly on the platform. The goal of Claude Playgroun…
Project knowledge file indexing reliability seems to be getting worse? (should I just use cowork instead?) (www.reddit.com) I haven't used Cowork yet - Would it solve my troubles with Project Knowledge files not indexing consistently? I see Projects can now be imported to Cowork, then I'd have my knowledge files hosted on my hard drive?
Ask HN: Are you optimizing content for AI Search (GEO) vs. traditional (news.ycombinator.com) With the rise of SearchGPT, Perplexity, and Gemini, the goal of content is shifting from "ranking on page 1" to "being cited in the answer block." I’ve been working on a tool (https://aibg-intelliagent.com/) that uses a private RAG (Retrie…
RAG vs. Fine-Tuning: Which AI Strategy Saves Your Team Time and Budget (lightrains.com via hn) Two weeks before a Fortune 500 product launch, we told a client to scrap their fine-tuned model and rebuild with RAG instead. They lost eight weeks and $180K.
Egg meet face. (www.reddit.com) https://preview.redd.it/drtw1mjwf7zg1.png?width=997&format=png&auto=webp&s=90b45173c1caba12a10bd4ff4a0a717563be9512 https://preview.redd.it/kk1ayljwf7zg1.png?width=997&format=png&auto=webp&s=f0b210cef867d817891635138f9a531b7e2e2fcc https:/…
NodeMind – binary document index, 48× smaller than float32 RAG, no GPU required (github.com via hn) NodeMind — Binary Document Intelligence 48× smaller online · 32× smaller offline · up to 100× on images. 75× faster search.
How are you feeding documentation into agents/RAG without HTML noise? (www.reddit.com) I’m testing a workflow where docs sites get converted into: concise llms.txt index full Markdown bundle cleaned page chunks manifest JSON For people building agents or local RAG systems: do you prefer one giant Markdown file, per-page Mark…
Built a free migration wizard for moving ChatGPT history into Claude Projects — learned a few things about how Projects actually work (www.reddit.com) Been using Claude for a few months and hit the same wall everyone hits: years of context stuck in ChatGPT with no real path to bring it over. Claude's built-in memory import is surface-level — name, preferences, tone.
I built an AI that tries to answer life’s hardest questions using the Bhagavad Gita. (www.reddit.com) I built an AI that tries to answer life’s hardest questions using the Bhagavad Gita. Over the last few weeks, I’ve been building GitaGPT Mentor It’s not just another chatbot.
W2A: an open protocol for agent sensors — giving local agents real-time perception (www.reddit.com) Sharing a project that just went public: World2Agent (W2A) — an open protocol for the perception side of the loop. Entirely self-hostable, no SaaS, no telemetry, TS SDK, Apache 2.0.
How should AI agents handle continuity across long-running conversations? (www.reddit.com) Hi everyone, I’ve been working on a continuity layer for OpenClaw agents, and I’d like to get feedback from people building or running AI agents. The problem I’m trying to solve is that many agents can respond well within a single turn, bu…
Poisoning RAG document corpora: 32 vectors tested, 19 succeeded (corrupted.io via hn) RAG Poisoning: When Your “Safe” AI Eats Bad Documents So you built a RAG pipeline. Congrats.
FerresDB is now open-source – A high-performance vector database (github.com via hn) FerresDB Core High-performance vector search engine written in Rust, designed for semantic search, RAG (Retrieval-Augmented Generation) and recommendation systems. Overview FerresDB Core is a Rust vector search engine for semantic search,…
Show HN: Agent MCP Studio – build multi-agent MCP systems in a browser tab (www.agentmcp.studio via hn) I built a browser-only studio for designing and orchestrating MCP agent systems for development and experimental purposes. The whole stack — tool authoring, multi-agent orchestration, RAG, code execution — runs from a single static HTML fi…
RAG isn’t for conversation transcripts (www.reddit.com) Documents are authored, bounded, and self-contained. They carry their own semantic links and can be represented as a wiki or cleanly split into overlapping chunks.
How Claude Projects actually loads files into context? Want to optimize token burn; can't get a straight answer (www.reddit.com) I've built a fairly involved system inside a Claude Project: project instructions plus 10 project files that function as a routing system. Trigger words in the instructions point Claude to specific files (instructions, templates, reference…
Feedback on VectorLess RAG? (www.reddit.com) From an year working in space of developing based pipeline and applications. Have worked enough building data on vector db + chunking + embedding etc., now there is an new trend of using vectorless RAG.
How do you decide on chunking strategy and top-k in Agentic RAG? Looking for practical advice (www.reddit.com) Hey, I'm building an Agentic RAG pipeline and struggling with two decisions: Chunking strategy — fixed-size, semantic, or hierarchical? In an agentic setting where the agent can re-query iteratively, does it make more sense to use smaller…
Looking for FREE resources to master RAG + LLM Agents + MCP (and build real projects for freelancing/jobs) (www.reddit.com) RAG as Similarity Engine (necromant2005.github.io via hn) Is anyone else using Cursor to build local VRAM/RAG architectures instead of just wrapper apps? Here is my 8-month deep dive. (www.reddit.com) I'm completely lost in the Agentic Maze. What level to learn. how to organize stydu (www.reddit.com) Stop using naive RAG – adding relationships to AI context (news.ycombinator.com) I’ve been working a lot with RAG systems recently, and kept running into the same issue: they retrieve relevant chunks, but lose the relationships between them. This becomes a problem pretty quickly when dealing with real systems (docs, AP…
Show HN: AI agents should browse your site, not call your API (www.rtrvr.ai via hn) We compared four architectures for putting AI agents on websites — RAG bots, API-tool agents(WebMCP), code-writing sandboxes (Cloudflare Agent Lee), and DOM-native execution. Three of them force you to maintain a parallel engineering surfa…
TF-IDF over code signatures hits 80% hit@5 retrieval — no vectors, no embeddings. Tested on 18 repos. (www.reddit.com) Been experimenting with context compression for local models. Wanted to test how far pure heuristic retrieval can go before you actually need vectors.
I built an MCP server that turns Claude into an emergency medicine assistant — what I learned building AI for high-stakes domains (www.reddit.com) If you work in healthcare or just want to see how Claude handles high-stakes clinical reasoning — I built an MCP server for this and wanted to share what made it harder than a typical AI project. EMSy is built on top of Claude and connects…
Open source research agent with RAG, streaming, and web search - one file backend (www.reddit.com) Built two open source agents: 1. Research agent - searches the web, streams answers with sources (like Perplexity) 2.
It's tax time... agent-built RAG app end-to-end with Claude Code + an SDK skill (www.reddit.com) It's tax time, so I whipped up a tax doc assistant with our new Ragie skill. Concrete example of agent-assisted development that goes further than toy demos.
Cursor AI not using sub-agents (www.reddit.com) Hi everyone, I work for a German agency building a RAG chatbot for a law firm. I use Opus 4.6 but it eats up tokens.
Show HN: NRC nuclear licensing RAG pipeline and regulatory embeddings dataset (huggingface.co via hn) I've been building an AI system to automate parts of the NRC Combined Operational License process: gap analysis against the Standard Review Plan, FSAR strength scoring, and RAI prediction using vector similarity to historical NRC requests.…
Memelang: Terse SQL for LLM Generation (memelang.net via hn) Memelang is an AI-optimized query language that significantly reduces token count and model size for LLM RAG. The code below is designed to be copy-and-pasted into your LLM.
Jev is to tool use what RAG is to context (rajveerbachkaniwala.com via hn) RAG fixes what the model reads before it sees the question. Jev fixes what the model can answer before it sees the state.
Ask HN: What do your agents do? (news.ycombinator.com) I have been working for a few years in Computer Vision for manufacturing, so I have kinda been in a bubble as far as production goes. I am thinking of diversifying a bit and get to work on the trendy stuff: agents.
SHIFTing Languages in Multilingual RAG (qdrant.tech via hn) SHIFTing Languages in Multilingual RAG Evgeniya Sukhodolskaya ·September 16, 2026 On this page: If you speak more than one language, you know the feeling when the mental switch in your head starts up with the rattling sound of a struggling…
Building a RAG Pipeline for Semantic Code Search (blog.jetbrains.com via hn) JetBrains AI Supercharge your tools with AI-powered features inside many JetBrains products Building a RAG Pipeline for Semantic Code Search: A Developer Diary and Field Notes Part 1: Parsing, chunking, and vectorization Some time ago, we…
Why Beyond Vanilla RAG (medium.com via hn) could not extract summary
I Built a Python SDK to Debug RAG Pipelines (github.com via hn) rag-debugger Intercept, inspect, and fix your RAG retrieval pipeline. Most RAG bugs aren't in your code — they're in your retrieval.
Ask HN: If embeddings are so powerful, why are they mostly used for retrieval? (news.ycombinator.com) Vector embeddings natively are capable of much more than just retrieval. Even when OpenAI released their initial embedding models, it mentioned that their embeddings are natively capable of Search, Clustering, Recommendations, Anomaly Dete…
Continuous field vector DB in Rust to block RAG hallucinations (github.com via hn) julianflux-research Electrodynamic field retrieval and causal routing for AI agents. JulianFlux 🧲: Electrodynamic Reasoning Infrastructure for AI Agents Autonomous AI Agents are failing in enterprise environments because standard Vector Da…
BasinRAG – Topological RAG via dynamical basins (0.771 nDCG 10, $0 API cost, CPU (github.com via hn) BasinRAG 🌐 English | Português High-Performance Topological Document Retrieval-Augmented Generation (RAG), using dynamical basins of attraction as an index partitioning manifold. BasinRAG indexes and retrieves document passages (PDF, Markd…
A comprehensive guide to production-ready RAG (neo4j.com via hn) Free eBook Essential GraphRAG: Build a hybrid RAG system for every question type By Tomaž Bratanič and Oskar Hane Publisher: Manning Production-ready RAG systems combine structured and unstructured data while connecting entities across dat…
Practical Agentic RAG patterns implemented with LangGraph (github.com via hn) Agentic RAG — Four Working Patterns with LangGraph Four self-contained Jupyter notebooks, each implementing a different way of making a Retrieval-Augmented Generation (RAG) pipeline "agentic" — able to decide, check itself, correct its own…
Show HN: Zero downtime embedding model upgrades (github.com via hn) People use embedding models all the time for rag/semantic retrieval. However, when a newer, more desireable model comes out, there is an expensive (both in time and computational) cost of re-embedding every document in the database.
Show HN: Eliminating low-LTV support ticket spam with grounded RAG (fireflysupport.io via hn) Hey guys! So we initially built this for our mobile game dev studio to automate handling of support tickets.
Ask HN: AI Architecture Systems Design (news.ycombinator.com) Are there any quality system design resources out there like https://github.com/donnemartin/system-design-primer that cover AI Architectures instead - RAG, intelligent document processing, agent pattern etc.
What is the value as RAG for coding AGENTS (news.ycombinator.com) I want to know if it is helpful in coding agents that use RAG and how to use it
Show HN: Orbit - One agent across many repos: real worktrees, no index (github.com via hn) Orbit Source code as agent knowledge — multi-repo Git workspaces where agents read, code, and ship → No RAG. No index — real source, not retrieval.
Offline RAG on iOS with Spatial Integration (news.ycombinator.com) I'm the developer behind CartoType. I’ve been working on bridging local language models with offline mapping, and I have just put together a demo of a completely offline Spatial RAG pipeline running natively on an iPhone.
Show HN: Coalent – an LLM answer cache that invalidates when source docs change (github.com via hn) Real-time, provenance-invalidated context for AI agents & RAG. Build understanding once.
Why PDF extraction for RAG breaks, and one approach to make it verifiable (github.com via hn) Cernodata Cernodata is an open-source ETL framework for layout-aware PDF extraction, automated quality iteration, structural layout debugging, and dataset generation for RAG and LLM fine-tuning. Parsing PDFs for RAG is a guessing game You…
We cut RAG costs 5x without losing quality (trpevski.com via hn) Ship RAG to production and watch it fail. Here's what works: semantic chunking, hybrid retrieval, reranking, and how to cut costs 5x.
Production-Ready FastAPI Back End Suite – Advanced RAG and SEO Automation ($8k) (www.indiehackers.com via hn) Hi everyone! I am officially selling full ownership rights (complete Intellectual Property transfer) to my comprehensive 4-in-1 FastAPI backend bundle designed for B2B SaaS and marketing automation agencies.
Show HN: A local RAG desktop app: piFlow (github.com via hn) piFlow 全本地 RAG 桌面应用 · 答案可追溯 · 隐私优先 · 轻量 English | 简体中文 piFlow 是一款检索增强生成(RAG)桌面应用:导入本地文档构建知识库,然后用自然语言提问。解析、嵌入、检索、推理全部在你的机器上(或你指定的服务器上)运行——文档与对话始终不离开你的掌控。生成的答案附带来源引用,可追溯到具体的文档与段落。 主对话由 piFlow Agent(Pi harness)驱动:知识库以 Skill / Tools(kb_*)挂载,并可…
Show HN: Lance-bundle – Portable embeddings to embed once, query forever (github.com via hn) Hello, While experimenting with personal, local RAG app setups, I kept having to (re)generate embeddings and really wanted precomputed embedding datasets that I could quickly pull and use in various environments. I built a library to test…
Show HN: Hubmesh – Multi-hop RAG retrieval with zero LLM calls in the query path (github.com via hn) hubmesh Centrality-aware GraphRAG retrieval planner. Drop-in layer over any vector DB.
Show HN: Simple self-hosted LLM assistant with user-steered compounding context (github.com via hn) I built a personal LLM assistant on Cloudflare Workers + Durable Objects. You specify a category and topic when starting a new conversation, so the backend maintains a summary for each category/topic - building up as more conversations hap…
Show HN: Ragleap-RAG – RAG engine that documents what it doesn't do yet (github.com via hn) RagLeap Core The open-source AI business manager. One AI, five channels, one memory.
Show HN: Benzi – An AI coding assistant grounded in a live code map (benzi.fly.dev via hn) Benzi is a compiler + runtime tracer + harness and AI agent built to understand code from ground up. Challenging traditional RAG and embedding space approaches, Benzi aims to write code as cleanly as it understands it.
What Happens Inside a RAG Pipeline (deeptechrambles.substack.com via hn) What Actually Happens Inside a RAG Pipeline (And Why “Banking” Is the Perfect Example) A plain-English walkthrough of embeddings, vector stores, HNSW, and why Elasticsearch and vector databases are secretly cousins - even if a few degrees…
Stop building RAG systems without doing evals (www.minimumviablefounder.com via hn) AI Evals Aren't Just for Big Tech How a small bootstrapped team measures its AI the way frontier labs do: a practical approach to evals that you can copy. 👋 Hey, Jai here!
Agent and RAG for Obsidian, Need Feedback (news.ycombinator.com) I just built this as a Personal/Portfolio project. I genuinely needed it, so I built it and I regularly use it.
Show HN: PromptTrace – Free hands-on labs to practice hacking LLMs (prompttrace.airedlab.com via hn) FREE AI SECURITY TRAINING Learn prompt injection through hands-on labs. Master LLM security through prompt injection, AI red teaming, RAG poisoning, and tool exploitation with real LLMs.
Ask HN: Should I Combine Global Knowledge, Internet Search, and User RAG (news.ycombinator.com) I'm building a SaaS platform in Sri Lanka that handles documents and other sensitive data. Each user can upload their own documents and information, and the platform uses RAG to answer questions based on that user's data.
Show HN: Grounded-forge – RAG with summaries and task views precomputed ingest (github.com via hn) Hi everyone, I've been working on a knowledge retrieval system that can create distributable applications for several months and I'd love to share it with you! The issue I've found with asking LLMs for advice is that they are trained on a…
Show HN: MindBase – an LLM that maintains a wiki from your notes and papers (github.com via hn) MindBase An AI research assistant that builds and maintains a wiki from your sources. Not RAG-in-a-vector-DB.
Show HN: LongTerMemory Study tool with no subscription built with QDrant and RAG (longtermemory.com via hn) After trying out various study tools, I decided to create my own. I wanted a quick and simple way to upload any study material, have the app generate questions, and then set up a daily review schedule.
Three search models coexist in 2026: keyword, RAG, and conversational LLM (lake8.dev via hn) From keyword to semantics: how search is changing and what it means for site builders Three search models coexist on the web today. They are not evolutionary — the second has not replaced the first, the third has not replaced the second.
Claude Code team should try macro so users can complete 3x as many tasks (news.ycombinator.com) So the idea is really simple. If CC need to change a file and run some test, CC needs to: # Turn 1 — apply patch (change package file) # Turn 2 — apply patch (fix the bug) # Turn 3 — apply patch (edit the testing script) # Turn 4 — build #…
RAG system isn't hallucinating. It never found the answer (artifipedia.com via hn) When a RAG system gives a bad answer, almost everyone blames the model. Usually the right passage was never retrieved — and that changes everything about…
Show HN: Local Search Agent – offline RAG, no embeddings, free tier (github.com via hn) Local Search Agent Give your AI agent a search engine for your local files. What is this?
I built a free tool to evaluate AI agent outputs (human labels and LLM judges) (github.com via hn) Vasari Vasari is a local, open source tool for evaluating AI features. Load the traces from any AI agent, chatbot, RAG assistant, or LLM feature.
Show HN: verbatimeter - check how grounded your LLM / RAG agent is in real-time (pypi.org via hn) I developed this tool and tried to keep it minimalist, lightweight, portable and easy to use. Hoping some people will find it useful.
Orbit, an Open-Source Toolkit for Retrieval-Based Inference (github.com via hn) # ORBIT ### Open Retrieval-Based Inference Toolkit A self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling agents — run it in your own environment across 37+ model providers. Quick Start…
Reproducing an Indirect Prompt Injection Against a RAG Pipeline (koreshield.ai via hn) Your legal-tech assistant retrieves a contract and summarises it. The contract contains one sentence you didn
Show HN: Bike4Mind – open-core AI workbench; any model, agents, RAG, self-host (github.com via hn) Hi HN, I am Erik Bethke, game dev that has been making online games for 30+ years (Starfleet Command, GoPets, FarmVille, Mafia Wars). For the last 3 years I have been building Bike4Mind and now I have to put my big boy pants on and 'go to…
RAG (www.pinecone.io via hn) Not only are foundation models stuck in the past, but they intentionally produce natural-sounding and varied responses. Both of these can lead to confidently inaccurate and irrelevant output.
Show HN: RagPack – Lightweight self-hosted RAG infra for startups (github.com via hn) Open-source, self-hosted RAG infrastructure built for early-stage startups. High performance, low cost, and simple to run.
Show HN: MothRAG - Graph-free multi-hop RAG without the rebuild bill (github.com via hn) MothRag Deterministic, agentic-style multi-hop — research-SOTA parity without the graph you'd rebuild every day. On commodity LLM APIs alone.
Built an Offline RAG Running on a MacBook Air (No APIs) [video] (www.youtube.com via hn) About Press Copyright Contact us Creators Advertise Developers Terms Privacy Policy & Safety How YouTube works Test new features NFL Sunday Ticket © 2026 Google LLC
Context Graphs vs. Vector RAG vs. Raw Context (nanonets.com via hn) Retrieval is critical in AI agents. To do any task correctly, the agent needs to be able to retrieve all the information that is relevant to the task from its memory.
LLM-free, layout-aware PDF chunker in pure Rust (github.com via hn) pdf-struct-chunker Split PDFs into semantically meaningful chunks — without LLMs, without APIs, without cloud dependencies. 🌐 Author: Matthias Nordwig · programmiere.de The Problem Most RAG chunkers blindly split documents by token count o…
Why Your Production RAG System Slowly Gets Worse (aiworkflowreliability.com via hn) This article proposes a reliability framework based on three complementary dimensions: - Failure Dynamics — how reliability changes over time - Reliability Control Surface — where engineers can observe and intervene - Detectability — how e…
Show HN: RAG Vector DB Cost Calculator (tools.superml.org via hn) Estimate chunk count, embedding storage, vector index size, and monthly database cost for your RAG knowledge base.
LlamaIndex integration for SynapCores (RAG, GraphRAG, and hybrid retrieval) (github.com via hn) synapcores-llamaindex Official LlamaIndex integration packages for SynapCores — the AI-native SQL engine. Replace Postgres + pgvector + Neo4j + Redis with one self-hosted binary.
Show HN: I compared 15 AI agent frameworks across 4 production stacks (compare-lab.xyz via hn) AI Agent Frameworks, Compared Side-by-side comparison of 15 AI agent frameworks. Filter by use case (RAG, multi-agent, structured output) and language (Python, TypeScript, .NET).
Show HN: BitVanes – A zero-trust RAG pipeline engine in Rust, WASM, and Arrow (www.bitvanes.com via hn) Most RAG pipelines ship raw, sensitive documents over the wire to cloud services just to get them parsed, scrubbed of PII, chunked, and vectorized. BitVanes is a zero-trust, local-first ETL engine designed to solve this.
Show HN: Open-Source RAG Security Kit for Zero-Trust Retrieval (blog.aetherguard.ai via hn) Vercel Security Checkpoint | sfo1::1781830903-OPQW0grqUdIgsx9p96Wslv3l1RK4f3l0
Ucp-Local – Offline RAG for Claude Desktop, Cursor, and LM Studio (github.com via hn) UCP — Universal Context Pipeline A local-first MCP server that grounds LLMs in your own files. UCP indexes folders on your machine — notes, code, conversation exports — and exposes them to any MCP-compatible client (Claude Desktop, Cursor,…
Bayer's PRINCE: a production agentic RAG system (martinfowler.com via hn) Building Reliable Agentic AI Systems A Case Study in building production-ready agentic AI systems This paper presents the Preclinical Information Center (PRINCE), a cloud-hosted platform developed by Bayer AG with Thoughtworks to address p…
Show HN: ArXiv Scholar – An Open-Source RAG System for AI Research Papers (github.com via hn) Try Search: https://ethereal-agents.space/search.html Technical Blog: https://ethereal-agents.space/blog/launching-arxiv-scholar.h... We'd love feedback on the retrieval quality, user experience, and overall approach.
I indexed 936 Lex Fridman episodes into a RAG that cites its sources (github.com via hn) 🎙️ OmniPod Chat with 936 podcast episodes. Every answer cites its source.
Ask HN: What will be the next big memory management system for AI Agents? (news.ycombinator.com) We have all seen RAG and Graph Knowledge, but in your opinion or if you know of some cool project, what’s the next innovation that could a hierve true perpetual memory and true personalization???
Show HN: Kickoff the World Cup with 49k match results from 1872 to 2026 (github.com via hn) Free soccer RAG MCP Server. Connect it with Claude or your favorite agent and kickstart your soccer research.
MarkSentry – zero-trust document-to-Markdown for RAG pipelines (sunilgentyala.github.io via hn) Path traversal jailing, SSRF blocking, VBA macro stripping, zip-bomb detection, multi-column PDF, and PII redaction. Everything MarkItDown skips.
Show HN: RAG built for Frappe using TurboVec (github.com via hn) Turbo Rag Turbo-fast RAG for Frappe (v14) using TurboVec License MIT
Replacing RAG with a cognitive memory stack in Elixir/OTP (0xcc.re via hn) Skynet: Towards Synthetic Neurobiology The original idea was a joke. I was looking at LLM loops and thinking about how they map onto Elixir’s actor model — GenServers that receive messages, process them, maybe spawn new processes.
Prompt Injection in RAG Agentic Systems (ulad.net via hn) Prompt Injection in RAG Agentic Systems Real risks and production mitigations Imagine you built an AI assistant for your team. It answers questions using internal documentation: Jira tickets, Confluence pages, HR docs.
Show HN: Incremental RAG ingestion, only changed chunks get re-embedded (github.com via hn) chunks-sync Incremental synchronization for RAG pipelines. Most RAG ingestion pipelines re-embed every document whenever a file changes, even if only one paragraph was edited.
MemGraphRAG: Memory-Based Multi-Agent System for Graph RAG (arxiv.org via hn) Retrieval-Augmented Generation (RAG) has become an essential method for mitigating hallucinations in Large Language Models (LLMs) by leveraging external knowledge. Although effective for simple queries, traditional RAG struggles with large…
Show HN: Ext-Infer – Native LLM Inference and Embeddings for PHP (infer.displace.tech via hn) Introduction ext-infer is a PHP 8.3+ extension that loads a GGUF model and runs LLM inference inside the PHP process via llama.cpp. PHP-native semantic search, RAG pipelines, and CLI / worker inference run without shelling out to Python or…
Tool to convert technical PDFs into RAG-ready chunks and Obsidian vaults (pdf-knowledge-extractor.onrender.com via hn) Sign In / Create Account Enter your API key to sign in New user? Create a free account with 5 extractions Account created!
RAG Without Persona Modeling Fails Patient Clinical Relevance (www.riddhimohan.com via hn) HPPIE fuses persona modeling into the RAG pipeline to deliver patient-specific health content. 2nd of 300+ at a Global AI Hackathon.
Show HN: Digger Solo – Local AI File Explorer (solo.digger.lol via hn) After a lot of work I present Digger Solo 0.5.0 - the AI file explorer that respects your privacy (everything runs locally). Demo video: https://vimeo.com/1198414414 New features: - LLM Chat with RAG (bring your own OpenAI compatible API k…
Why Vector Search Alone Isn't Enough: Hybrid Retrieval for RAG (www.infoq.com via hn) In this article, author Aaditya Chauhan discusses the limitations of RAG pipelines based purely on vector search and how an internal omni-search application using Reciprocal Rank Fusion (RRF) that combines BM25 and vector results, can enha…
Show HN: Extract (YC P25) – Fast, accurate document parsing (extract.page via hn) Hey HN, we’re Soami, David, and Achyut, co-founders of Extract. Extract parses documents into structured data (text, tables, and figures).
How We Index Images for RAG (www.kapa.ai via hn) How we index images for RAG Reading the screenshots, diagrams and tables in technical documentation for LLMs by Matteo Bortoletto Kapa builds AI assistants that answer questions from technical documentation. The knowledge bases we process…
Open-source NLI ensemble matches Sonnet 4.6 on RAGTruth at 1/250x the cost (github.com via hn) verifiable-rag Document-grounded Q&A with sentence-level citations, NLI verification, and calibrated refusal. Status: pre-alpha · v0.5 launch sprint · interfaces are still subject to change 📚 Full documentation at firish.github.io/rag-rack…
Running local RAG AI on MacBook neos (securethink.co.uk via hn) AI-powered document analysis that runs 100% locally on your Mac. Analyse contracts, engineering specs, and sensitive data without the cloud.
Authorization Before Retrieval: Making RAG Safe by Construction (www.windley.com via hn) Retrieval-augmented generation makes language models far more useful by grounding them in real data, But it also raises a hard question: who is allowed to see what? This post shows how authorization can be enforced before retrieval, ensuri…
VDF AI – Multi-agent AI orchestration with dynamic model routing (vdf.ai via hn) VDF.AI is the on-premise AI agent platform for enterprises that need governed multi-agent orchestration, private RAG, LLM routing, and full data sovereignty — without the cost or lock-in of cloud AI.
How to Stress-Test LLM Judges Fairly (www.alphaxiv.org via hn) We're hiring Paper Blog Audio 4 / - Hide Tools Ctrl + / Open Tools A Fixed-Budget, Cluster-Aware Standard for LLM-as-a-Judge Evaluation: A Multi-Hop RAG Stress Test Assistant My Notes Comments Similar
knowledge graph for maintaining git worktrees and shared findings across projects (www.reddit.com) sometimes when i scroll social media i see stuff about knowledge graphs. it crossed my mind that I do something similar.
Turn any GitHub repository into an interactive code graph in seconds and use it as an MCP with your AI Assistants (www.reddit.com) Change https://github.com/owner/repo → https://cgc.codes/owner/repo A standard GitHub URL can be instantly transformed into a CodeGraphContext (CGC) graph URL, unlocking architecture visualization, code navigation, dependency exploration,…
Gnani AI - AI Prompt Engineer role (www.reddit.com) Anyone here working at Gnani AI or knows someone there? I got an offer for the AI Prompt Engineer role and wanted to know how the work culture is.
Is a 128 GB MacBook Pro M5 Max actually too slow for large-context local LLM coding workflows? (www.reddit.com) People are warning me about the prompt-processing speed of a MacBook Pro M5 Max with 128 GB RAM. My main concern is prompt ingestion / prefill latency and large-context handling — not raw token generation speed (which I think is OK).
Tlamatini – Local-first AI dev assistant with 68 agents and hybrid RAG (github.com via hn) Tlamatini A local-first AI developer assistant that goes beyond chat. Run it on your machine with Ollama.
Why Does Everyone Think AI Agents Are Easy? (www.reddit.com) Lately it feels like every problem gets the same answer: “Just build an AI agent.” I had lunch recently with people outside tech, and someone mentioned spending hours replying to customer chats at work. Immediately another person said: “Wh…
Is grep all you need? Lexical VS Sematic Search for Agents (www.llamaindex.ai via hn) Lexical search with grep is fast and precise, but it breaks down at enterprise scale. Learn when to use grep, semantic search, or a hybrid RAG approach to build AI agents that can search any corpus, in any format, at any size.
AI for internal IT support/password resets in mid-size & enterprise companies- is anyone actually seeing good adoption? (www.reddit.com) Anyone here from a mid-size or enterprise company using AI for internal IT support workflows like password resets, account unlocks, MFA resets, software access requests, etc.? We’re exploring AI-driven employee support internally and I’m c…
LMIM OS – an offline AI ecosystem. Voice, RAG, WhatsApp. ++ One file. 0 setup (lmim.tech via hn) 19+ tools — no cloud, no API key, no subscription. All in one AppImage / Installer.
Who Wants to Be Hired? (May 2026) – AI Engineer (Python, RAG, Agentic Workflows) (news.ycombinator.com) About me: I am an AI Product Engineer specializing in building autonomous agentic workflows. Recently, I built 'Jarvis', a multimodal autonomous agent featuring near-zero latency inference using Groq SDK and complex RAG pipelines.
Databricks project ideas as a Data Engineer looking to transition roles (www.reddit.com) Hey, I'm a data engineer looking to transition into AI engineering. I'm looking to learn and build a resume with some projects.
Why codex /goal fails on complex workflows: compaction amnesia and context rot (news.ycombinator.com) Hi HN, When Openai released `/goal` earlier this month, I was really excited to try it for long-horizon tasks. But after using it, it didn't blow me away and i did some digging and found a major architectural flaw when using it for complex…
Astrum Verum – A Vector Symbolic cognitive memory that beats RAG (github.com via hn) Astrum Verum Composition-episodic cognitive memory for AI agents — and an honest record of how it got here. Astrum Verum is a research project containing two distinct phases of memory architecture development.
Every RAG-based localization pipeline has the same blind spot (lingo.dev via hn) If a localization pipeline uses retrieval augmented generation to inject glossary terms into the model's context window, it has a retrieval recall problem that has never been measured. The pattern is universal: embed the input text, cosine…
RAG for developer docs so local llm can code using latest library? (www.reddit.com) I was wondering if it would make local llm better at coding if it has access to the latest documentation available through a RAG. I'm specifically interested in python.
Trying to work around AI and its constraint at my workplace (www.reddit.com) I would rate my AI skills between beginner and intermediate. I know how to use tools like ChatGPT and GitHub Copilot to build a chatbot with a system prompt.
Built a production RAG chatbot with custom MCP servers as the action layer, sharing what I learned (www.reddit.com) I've been building agentic tooling at work and wanted to share one pattern that worked. Instead of a chatbot that only retrieves and answers, I wired custom MCP servers in as the action layer, so staff trigger live workflows (create record…
Ask HN: Why agentic development stops from 2023 (news.ycombinator.com) I leave this field in 2023 return back in 2026 and I see that only progressive development in coding agents, but some production solutions it’s just tools rag and maybe mcp that in general the same as tool. I thought it will be super leap…
The shared recipe behind search: Images, Shazam and RAG (medium.com via hn) medium.com Performing security verification This website uses a security service to protect against malicious bots. This page is displayed while the website verifies you are not a bot.
Enterprise AI why soo cumbersome (www.reddit.com) Just started in a new bigger company. Suppose to accelerate the adoption of AI.
"Most RAG benchmarks lie about real-world corpora." Test data from 3 production websites. (www.reddit.com) Tiered + page-role-aware RAG retrieval results across 3 corpora with very different content density: Workspace Sources Chunks HIGH MEDIUM LOW REJECTED Intercom 188 941 96 200 541 104 HubSpot 251 1705 40 508 1153 4 KPMG 53 209 3 14 127 65 (…
ztok — a fast multithreaded tokenizer in Zig that loads tiktoken / HF / SentencePiece and is 2–5× faster (www.reddit.com) I built ztok, a tokenizer library focused on being fast and format-agnostic for local pipelines. - Loads what you already have — .tiktoken, HF tokenizer.json, SentencePiece .model, TokenMonster, Mistral Tekken.
Gemini filesearch scalability (www.reddit.com) I'm about to introduce gemini filesearch to my company to handle all the RAG related operations but not just internally, I'm fixing the projects VS stores logic to be able to scale this up to thousands of small clients. Has anyone used gem…
Most agent RAG problems I see are retrieval problems, not model problems (www.reddit.com) I've spent the past year building a site-search product and watched maybe 50 teams plug their docs into a vector DB, expect magic, and end up debugging why the LLM is lying. Its almost never the LLM.
Open catalog of agent patterns + the frameworks that implement them (www.reddit.com) I have been building an open catalog of agent patterns and the frameworks that implement them. It is a pattern language in the Christopher Alexander sense, mapped onto the current agent landscape.
My agent kept forgetting who 'Karpathy' was between sessions. Here's the architecture that fixed it (www.reddit.com) I run a second brain on Obsidian, Readwise, NotebookLM, and Claude Code. For each topic, I build a scoped wiki structured as the LLM Knowledge Base Andrej Karpathy proposed.
AI agents are making tokenization platforms far more usable than I expected (www.reddit.com) Been working on AI-assisted workflows for tokenization platforms recently, and I’m honestly surprised by how useful agents are becoming in complex financial processes. Some areas where they’ve helped a lot: onboarding automation document u…
Glia – Local-first shared memory layer (SQLite-vec + FTS5 + Offline Knowledge Graph) (www.reddit.com) Hey everyone, I wanted to share a project I've been working on called Glia. It is a 100% offline, local-first RAG and memory layer designed to connect your AI web chats (Claude, ChatGPT, DeepSeek) with your local developer tools (Claude Co…
Built a Fetch API that returns page labels, not just markdown (www.reddit.com) I'm working on a Fetch API for RAG, agents, and web ingestion workflows. Think Firecrawl/Jina Reader-style URL-to-markdown or clean-text API, but with one extra signal layer: page labels for content category and page structure.
We engineered RAG to be 50% faster (elevenlabs.io via hn) How we engineered RAG to be 50% faster - Written by - Michal Korbela - Published - Last updated ListenListen to this article RAG improves accuracy for AI agents by grounding LLM responses in large knowledge bases. Rather than sending the e…
Booking.com and Weaviate (news.ycombinator.com) Vector search looks easy, until you hit production scale. I'm super excited to share a new episode of the Weaviate Podcast with Başak from @bookingcom on production-scale vector search, RAG, and agentic AI with @weaviate_io!
What Matters in Production RAG (arpitbhayani.me via hn) Most of us build RAG the same way: follow a tutorial that embeds a handful of PDFs, stores the vectors in a local Chroma instance, and chains everything together with LangChain (if that’s still a thing). The demo works.
Project Prism |Fullstack Engineer – Abu Dhabi (Onsite) – Full-Time – Presight.ai (news.ycombinator.com) Presight.ai is a publicly listed company with various projects in the field of big data analysis and ML models application. Our solutions work domestically and internationally.
Built an agentic RAG over my Obsidian vault so Claude could read engineering books I never have time for. Then I built the eval harness to check Claude wasn't lying to me. (www.reddit.com) For context, I posted on Medium a while back about burning through Claude Code's weekly limit in 3 days. The token bleed problem from that post is what kicked off this project.
We compiled 42 of the Generative & Agentic AI interview questions (and how to actually answer them). (www.reddit.com) Hey Everyone, The AI engineering job market has shifted massively in the last 6 months. Interviewers are no longer just asking "how does a transformer work?" or "how do you write a good prompt?" They want to know if you can architect produ…
Are we all quietly rebuilding memory systems because current AI memory doesn’t actually work long-term? (www.reddit.com) The more I work with long-running agents, the more it feels like most “AI memory” today is just retrieval with nicer branding. Everything works in demos: vector DBs RAG summaries context packing knowledge graphs But after enough real usage…
Show HN: RAG-LCC – config-driven RAG framework for fast experimentation (github.com via hn) 🧪 RAG‑LCC — Experimental RAG Under Constraints RAG‑LCC is an experimental Retrieval‑Augmented Generation (RAG) lab focused on understanding and controlling retrieval and context assembly under real‑world constraints: limited context window…
What is the most unexpected thing you have gotten a local model to do? (www.reddit.com) Most local LLM use cases I see are chat, coding, and RAG. But with vision models getting better and faster on consumer hardware, I feel like there is a lot of untapped territory.
Agents Can Reason. They Still Can't Search (dipkumar.dev via hn) Agents have a search problem across the whole stack: web search, RAG, tool discovery, skills/workflow loading, and even context compaction.
Tried 12+ agentic AI workflow builders this year — these 5 actually work in production (www.reddit.com) Most “AI agent” tools in 2026 still feel like glorified chatbot wrappers. I spent the last few months testing different agentic AI workflow builders for real-world automation use cases (multi-agent workflows, approvals, integrations, long-…
Most RAG apps in production are confidently wrong and nobody talks about this enough (www.reddit.com) Been working with a few teams integrating RAG into internal tools, support bots, document Q&A, contract search, and I keep running into the same thing nobody warns you about when you're following tutorials. The basic retrieve-then-generate…
There's a meaningful difference between a knowledge base your LLM searches and one it can navigate. Has anyone shipped something in the second category? (www.reddit.com) RAG gives you search over a corpus. Useful.
Local-first LLM context dedup: 22-71% chunk overlap measured across 22M passages (2 arXiv papers). MCP server, MIT, 250KB binary, zero telemetry. (www.reddit.com) I'm the author of this thing, disclosure up front. Been hanging around this sub lately on cache invalidation, MoE memory tradeoffs, long-session token bloat.
22-71% of your AI coding input tokens are duplicates, we measured it across 22M passages (2 arXiv papers). Just shipped MCP support for Cursor (www.reddit.com) Disclosure first: I'm the author. MIT, runs locally, zero telemetry.
Microsoft patched 137 bugs, but the Azure AI Foundry one is what caught my eye (www.reddit.com) Microsoft just patched 137 vulnerabilities across Azure, Windows, Dynamics 365, Copilot, Office, and other products. Most of it looks like the usual Patch Tuesday flood, but one detail stood out: Azure AI Foundry is listed among the high-s…
Arkon: turning Claude from a personal chatbot into a managed organizational resource (www.reddit.com) Sharing a project I've been building. Not asking for anything in particular - just thought the problem and approach might be interesting to some folks here.
New guy with an RPG agent Project (www.reddit.com) Hi' I'm a long time tabletop game master and a rather neophyte programmer(college diploma in programming for video games, no real work experience yet). I have done a 4 hours AWS workshop on building RAG agents during my intership with a st…
How I buld agents (www.reddit.com) Everyday I see tons of AI generated posts about tricks to build AI agents. Here is one written by a human with experience and typos :) Step 1: Never directly compete with a human Is there a specific job title for sth?
A 3.5 MB C++ engine for deterministic RAG deduplication hitting 30 GB/s (github.com via hn) Merlin Community Local-first dedup for LLM context. Lite engine, MIT integrations, papers on arXiv.
Stop struggling with Agentic AI - my repo just hit 540+ stars and 60+ forks!! (www.reddit.com) Quick update — my AI Agent Frameworks repo just passed 540+ stars and 60+ forks on GitHub!! When I first put it together, my goal was simple: make experimenting with Agentic AI more practical and approachable.
A Bette RAG Alternative (www.codynamicslab.com via hn) $ docker run --gpus all -p 8091:8091 codynamics/latch:latest [latch] runtime starting on http://0.0.0.0:8091 [latch] status=loading profile=cdlac_latch_qwen14b_locked_20260317 [latch] warmup complete status=ready $ curl -s http://127.0.0.1…
We added an enforcement layer to our AI agents in production — here's what we learned about the failure modes nobody talks about (www.reddit.com) After shipping AI agents into real production environments, the failures that actually kept us up at night weren't hallucinations or bad outputs — they were control failures. Three things that surprised us: 1.
FlowFlow, voice notes with on-device RAG in Rust for iOS (github.com via hn) FlowFlow Mobile voice notes app with AI chat — 100% Rust, Dioxus iOS, local-first (SQLite + LanceDB). Built with Dioxus 0.7 for iOS.
I just launched my first open-source project and I want to learn how to become a better developer/maintainer. A remote vibe coding tool. (www.reddit.com) Hey everyone, I’ve been a developer for a while, but I’ve always been a "lurker" when it comes to open source. Recently, I finally pushed my first project to GitHub: Legax.
Integrating standard operation procedures with agentic AI workflow (www.reddit.com) Hello guys, me and my team have been building an agentic workflow to answer customer questions (rn in langgraph). The use case goal is to answer ALL customer support questions.
Here is the current "Free-Tier AI Stack" for 2026 (www.reddit.com) 1. The Frontier Giants • Gemini: Access 1.5B tokens/day on Gemini 1.5 Flash/Pro.
Meet Tiro! Agentic assisted memory retrieval and session state memory module. (www.reddit.com) A year ago, when I first got into LLMs, I started by using them to play D&D. ChatGPT 4o was surprisingly good at narration, improvisation, and keeping the game moving.
My agent returns HTTP 200 but gives factually wrong answers. How are you catching this? (www.reddit.com) Working on a support agent and hit a gap I hadn't thought about. Agent completes successfully.
Show HN: Nexa-gauge – Cache/cost-aware graph-based eval for LLM and RAG (github.com via hn) nexa-gauge - Graph-Based Evaluation for LLM and RAG Systems A cache-aware evaluation engine for measuring LLM and RAG output quality with repeatable metrics, cost estimates, and structured reports. Read the Documentation · Quickstart · CLI…
RAG chatbot for internal ops docs. Anyone built something like this? (www.reddit.com) I run ops for a custom home builder. We have SOPs, HR policies, project checklists, and process docs...all living in Dropbox & I want to give my team a simple way to ask questions & get accurate answers without hunting through folders.
Show HN: Build a custom AI in under 60 seconds (demo video) (www.youtube.com via hn) we've added onboarding that lets our users build custom AI for their website ready to deploy under 60s total. the platform consists end to end AI engineering, prompts, version control, evaluations, test cases, logs, AI Actions (custom tool…
Show HN: I built a playground of interative A/B testing for RAG (rag-dr.hanhanwu.com via hn) To iteratively improve RAG performance, current evaluation solutions still take lots of manually work or lots of coding. And it requires close collaboration between AI engineers and domain experts (who may not know how to code).
I built a WP plugin to solve the "AI Search" problem (YouTube-to-Blog and RAG) (www.indiehackers.com via hn) Hey IH, Like many of you, I’ve been watching traditional SEO traffic drop as Perplexity, SearchGPT, and Gemini Overviews take over. In 2026, if your content isn't being cited, it’s basically invisible.
PageIndex: Vectorless, Reasoning-Based RAG (github.com via hn) PageIndex: Vectorless, Reasoning-based RAG Reasoning-based RAG ◦ No Vector DB ◦ No Chunking ◦ Human-like Retrieval 🌐 Homepage • 🖥️ Chat Platform • 🔌 MCP & API • 📖 Docs • 💬 Discord • ✉️ Contact 📢 Updates 🔥 Agentic Vectorless RAG — A simple…
The RAG era is ending – a compilation-stage knowledge layer is what comes next (venturebeat.com via hn) The RAG era is ending for agentic AI — a new compilation-stage knowledge layer is what comes next | VentureBeat Orchestration Infrastructure Data Security More Newsletters Featured The RAG era is ending for agentic AI — a new compilation-s…
Show HN: Memex, Claude memory via local RAG (MCP, offline embeddings) (memex-cli.vercel.app via hn) Local-first second brain with semantic search. Gives Claude persistent memory across conversations — all data stays on your machine.
Agentic RAG Explained in 3 Levels of Difficulty (machinelearningmastery.com via hn) In this article, you will learn what agentic RAG is, how it differs from traditional RAG, and when to use it. Topics we will cover include: The key limitations of traditional RAG pipelines and what agents add to address them.
Kvaser - Moving beyond simple agents: Building a Local-First AI Orchestrator with Qwen 3.6, Kiwix, and Wolfram (www.reddit.com) For the past two weeks, I’ve been spending 4–5 hours a day building a custom MCP (Model Context Protocol) orchestration server. What started as a simple experiment with Qwen 3.6 35B has evolved into a full-scale "Man-in-the-Middle" proxy t…
↯ Model Context Protocol↯ Qwen 3.6model-context-protocolragqwen+1
How good is Gemini Embedding 001 for scientific retrieval? (www.reddit.com) How good is Gemini Embedding 001 for scientific retrieval (RAG application)? How does it compare against Text Embedding 3 Large?
Honestly, chunking is where most RAG systems quietly go wrong (www.reddit.com) Honestly, chunking is where a lot of RAG systems start lying to you while still looking fine in the demo. It works when the question is narrow and the document is basically prose, but once users ask messy real questions, the retrieval laye…
Hello Guys. Quick Question On Research. (www.reddit.com) Looking for the people actually pushing on multi-agent architectures right now, not the N8N crowd. The progression I've been following: single chat → Claude Code → multi-file projects with context engineering → multi-agent systems → orches…
Why we ended up with 4 agents and 3 protocols for agentic commerce on Shopware (www.reddit.com) Most agentic-commerce demos I see online are a single agent plus RAG over a product catalog. That shape works for a 200-SKU demo.
LangGraph and Cosmos DB: one back end for agents, memory, and RAG (devblogs.microsoft.com via hn) Build AI Agents and RAG Applications with the New LangChain + LangGraph Connector for Azure Cosmos DB Building AI agents and RAG applications today means stitching together half a dozen services, a vector database, a chat history store, a…
EGA: Runtime Enforcement for LLM Outputs (v1.0.0) (www.reddit.com) I built EGA - a runtime enforcement layer for LLM outputs. The problem: eval tools score after the fact that something went wrong.
Why is RAG evaluation so hard in the real world? (www.reddit.com) Evaluating RAG feels easy in theory, but production is a different challenge. We’ve been looking into why RAG benchmarking is such a moving target.
I almost shipped OpenAI embeddings until an MTEB rank #130 model beat them by 11% (www.reddit.com) I just interviewed Michael Maximilien, former CTO at IBM and Chairperson of NodeJS Foundation, who spent a year shipping production RAG to multiple customers. His lesson was uncomfortable.
Xmemory: Benchmarking Structured AI Memory Against RAG and Hybrid RAG (arxiv.org via hn) Persistent AI memory is often reduced to a retrieval problem: store prior interactions as text, embed them, and ask the model to recover relevant context later. This design is useful for thematic recall, but it is mismatched to the kinds o…
Local query autocomplete with "classical" ML, no LLM needed (www.reddit.com) Hey guys! I know this is not fully LLM related (its still local though :D), mods feel free to delete this if you think its off topic, but I just wanted to share something I experimented with, local autocomplete without the use of LLMs or f…
Should I continue to create my RAG project? (www.reddit.com) To preface this, I work in the oil field, I like to homelab as a hobby. But there is a lot of standards and policies that aren't always easy to find and look up.
anyone else trying to pipe their own data into claude via mcp? (www.reddit.com) I'm trying to build a reliable local RAG setup for claude and it is just exhausting. I want claude to have access to my github repos and past project docs without me copy-pasting everything into the window every morning.
I finally sat down and did the math on my Cloud LLM bills… and I’m moving almost everything to a 4090. (www.reddit.com) I used to be all-in on cloud APIs. For any side project, I’d just grab an OpenAI or Anthropic key and not think twice.
How are teams bridging the gap between company knowledge and AI agents? (news.ycombinator.com) AI agents are capable enough to automate real work now. But they keep failing because they don't know how a specific company actually operates.
Show HN: MAItion – Open-source RAG with pluggable connectors and chat UI (github.com via hn) Hey HN, We wanted to share a new tool we’ve been working on. Even when documentation is well-structured, sometimes it’s hard to find what you need.
Run, Learn and test Agentic AI for free, on your browser! (Open AI Models are included) (www.reddit.com) Hey Everyone, Over the last few months, I noticed a massive gap in how we learn about Agentic AI. There are a million theoretical blog posts and dense whitepapers on RAG, tool calling, and swarms, but almost nowhere to just sit down, run a…
↯ Fine Tuning↯ Function Callingfunction-callingfine-tuningrag+3
Question: What are some useful content, web-scraping, web search tools, ingestion libraries, or MCPs for Karpathy's LLM Wiki? (www.reddit.com) Hey all, so I am currently exploring and playing around with Karpathy's LLM Wiki using Claude Code with Ollama and other routed models. I want to create some agents and provide them with tools/plugins, libraries, MCPs, or harnesses to assi…
Building a Full-Stack Agentic AI Platform (RAG + Orchestration + Governance) — feedback? (www.reddit.com) Hey folks 👋 I’ve been working on an AI agent platform called Noevex, focused on real production use—not just demos. In practice, AI systems struggle with: multi-step orchestration connecting multiple data sources controlling agent actions…
Why I’m still using RAG even with 2M context windows… (www.reddit.com) Look, when those 2 million-token context windows dropped earlier this year, I thought RAG was dead. I was like, “Why am I still chunking documents and building vector databases when I can just throw 50 PDFs into one prompt and be done?” So…
Technical Overview of an AI RAG System with React, Python, Laravel, Redis (gist.io via hn) LongTerMemory: Technical Overview LongTerMemory is an AI-powered SaaS platform for exam preparation and long-term knowledge retention. It combines Retrieval-Augmented Generation (RAG) with spaced repetition scheduling to help users study s…
Interactive playground to learn Agentic AI hands-on (Free) with Certification (www.reddit.com) Hey Everyone, Over the last few months, I noticed a massive gap in how we learn about Agentic AI. There are a million theoretical blog posts and dense whitepapers on RAG, tool calling, and swarms, but almost nowhere to just sit down, run a…
↯ Fine Tuning↯ Function Callingfunction-callingfine-tuningrag+3
I ran retrieval-auditor against LangChain's RAG quickstart, 5/6 flagged (github.com via hn) The corpus is Lilian Weng's "LLM Powered Autonomous Agents" — the blog post that the LangChain RAG tutorial uses as its canonical demo. The retriever is the LangChain default (cosine similarity over all-MiniLM-L6-v2 embeddings, top-5).
After weeks of RAG setups, the bottleneck is the data pipeline, not the model (www.reddit.com) I spent weeks tuning retrieval models, then realized the real problem was getting sources into clean, structured, interlinked form. Scrape a webpage and you get a mess of HTML.
Ask HN: How do you solve aggregation when agentic RAG breaks down? (news.ycombinator.com) I keep hitting the same failure mode with agentic RAG over collections of similar PDFs, like monthly electricity and gas bills from the same utility provider. It works well for retrieval: “Find my gas bill from January.” Though even there…
Show HN: Local RAG Pipeline with Weaviate and Ollama (www.storyblok.com via hn) i’ve been experimenting with building a fully local rag pipeline: weaviate for vectors + hybrid search, node.js scripts, qwen 3.5 on ollama what i found is that most of the challenges live in retrieval and chunking, not the LLM, and a good…
Built a GraphRAG voice agent over JRCALC 2022 clinical guidelines using Gemini Live, part of a hackathon first-aid system for Meta Ray-Ban glasses (github.com via reddit) The voice guidance layer in our hackathon project uses a Gemini agent backed by a GraphRAG index over the JRCALC 2022 guidelines (the UK ambulance service clinical reference). When the system detects stroke signs or abnormal heart rate it…
Build your own voice assistant and run it locally – Whisper, Ollama, Bark (2024) (medium.com via hn) 9 min read Mar 31, 2024 -- After my latest post about how to build your own RAG and run it locally. Today, we’re taking it a step further by not only implementing the conversational abilities of large language models but also adding listen…
Show HN: AI memory with biological decay (52% recall) (github.com via hn) Most RAG setups fail because they treat memory like a static filing cabinet. When every transient bug fix or abandoned rule is stored forever, the context window eventually chokes on noise, spiking token costs and degrading the agent's rea…
Built a Legal RAG Chatbot for Indian lawyers covering BNS, BNSS, BSA and DPDP Act 2023 — Custom PageIndex + BERT + GPT-4o [Live Demo] (www.reddit.com) I ran a business for 12+ years. Traveling constantly.
Where is the boundary between a multi-agent and a monolithic AI agent structure? (www.reddit.com) Enterprise systems often avoid "monolithic" AI to prevent context rot and hallucinations. The standard fix is task-decoupling: splitting logic between specialized agents or deterministic code.
LLM CTF challenges. Can you crack all 13? (wraith.sh via reddit) Wraith Academy is a free hands-on AI pentest curriculum — CTF challenges against live LLM agents covering prompt injection, tool abuse, data exfiltration, RAG poisoning, and more. Earn your WCAP certification.
RAG pipelines, leaking PII into vector databases and nobody's talking about it (comply-tech.co.uk via hn) Your RAG Pipeline Is Leaking Customer Data Into Vector Embeddings If you're building a RAG (Retrieval Augmented Generation) system on internal documents such as customer support history, knowledge base articles, or internal comms, there's…
I almost built RAG for my notes, then realized I didn't have a retrieval problem at all (www.reddit.com) My notes live in Obsidian. My reading and highlights live in Readwise.
5060ti + 32gb DDR4 (www.reddit.com) What models/quants have impressed you lately for 5060ti ? The use case is professional writing, RAG and long document summarization, not coding, so good instruction following and precision are a plus.
RAG in Go: A Vulnerability Research Tool (www.ardanlabs.com via hn) Introduction In the previous post, you saw how you can use tools to add information to an LLM query. In this post, we’ll see another method of adding information to an LLM called RAG, or Retrieval-Augmented Generation.
When the pronoun "they" breaks your RAG pipeline (old.reddit.com via hn) could not extract summary
Edster – An open-source local AI agent with swarm mode and a web UI (github.com via hn) 👾 Nedster CLI Coding Agent An unstoppable, fully local, open-source coding agent that runs on your consumer GPU. Tags: ollama coding-agent local-ai cli rag chromadb python qwen Are you trying to use local LLMs to autonomously write code, r…
Show HN: DataFrey – MCP server for Snowflake with text-to-SQL agent (docs.datafrey.ai via hn) I’m a data scientist and I find it hard to use Claude Code for SQL - it doesn’t have DB context. so I made yet another database MCP server!
Combine persistant global Memory- and Task- management into one uniform system (www.reddit.com) Is there any way to implement multimodal RAG using some open-source multimodal large models? (www.reddit.com) Show HN: Infrawise Azure Cloud Optimization (infrawiseai.com via hn) Steno – Compressed memory with RAG for AI agents (github.com via hn) Steno Compressed memory notation with RAG retrieval for AI agents. Steno solves the AI memory problem: agents accumulate knowledge across sessions, but loading everything into context every time is expensive, noisy, and causes drift.
Show HN: Corvi Careers – privacy first job search with resume matching (corvi.careers via hn) It lets you search 1M+ jobs across multiple regions, refine by keyword/category/location, upload a plain text resume for better matching, filter by target companies. Searches, keywords extracted from resume and bookmarks are saved locally,…
Best way to prepare for AI Engineer interviews? (www.reddit.com) I’m currently preparing for AI-focused roles and would love to get perspectives from people already working in the industry. For context — I have ~5 years of experience as a Full Stack Engineer with a strong focus on AI systems.
Sweet RAG Evil Model (www.reddit.com) Scenario A: Given: A search query to reduce context is provided When: Results are pushed to the system as completion. Then: a question will respond with accurte results Scenario B: Given: Scenario A data is in a slots KV Cache When: new se…
I made an 80B local model ship a 295-test RAG codebas (github.com via hn) rag-workshop A local-first RAG system built autonomously by a multi-agent framework. This repository is the reference implementation produced by the C.E.H.
Has anyone used Claude Opus 4.7 API on Qubrid or another platform? Use case? (platform.qubrid.com via hn) Advanced GPU infrastructure, collaborative AI Agents, and intelligent RAG systems. Build, deploy, and scale AI solutions with comprehensive tools.
Shopping assistant chatbot (www.reddit.com) I need to create an ecommerce shopping assitant chatbot. Customers would reach out via chat, and the agent/chatbot would help check inventory and make product recommendations based on what customers share.
the shortest path to "Claude that actually knows what I did today" is one npx command (www.reddit.com) every other day someone here posts about karpathy's llm wiki idea, or "how do I give my agent context about me," or "I want a personal knowledge base my AI can use." and then the comments are always the same - build RAG, write a pipeline,…
Good multi-agent harness with db-based long term context? (www.reddit.com) I'm looking for suggestions for an agent harness that uses a database (SQLlite, RAG, what ever) for long-term context. I plan to use my RTX3080 & 3090 for local AI, though I expect to use APIs for some tasks.
Show HN: GraphifyAI – Turn Any CSV/Excel into a Neo4j or LangChain Graph (graphify.midlantics.com via hn) Converting spreadsheets to graph databases (Neo4j, Neptune, etc.) usually means manually defining nodes, relationships, and writing Cypher from scratch. It's tedious.
How to diagnose RAG failures from traces (www.siquick.com via hn) How to diagnose RAG failures from traces If a RAG system fails in production, the first question we should be asking is "what broke in this trace?". Until you can answer that, most scorers or dashboards aren't going to help you.
CDRAG: RAG with LLM-guided document retrieval — outperforms standard cosine retrieval on legal QA (www.reddit.com) Hi all, I developed an addition on a CRAG (Clustered RAG) framework that uses LLM-guided cluster-aware retrieval. Standard RAG retrieves the top-K most similar documents from the entire corpus using cosine similarity.
Free Red Team Security Audit for AI Agents & RAG Systems (limited) (www.reddit.com) I'm developing a specialized Red Team audit framework focused on real-world AI agent and RAG security risks (prompt injection, tool misuse, excessive agency, indirect injection through documents, memory poisoning, etc.). I’m looking for a…
Reports of RAG's death have been greatly exaggerated (atomicapp.ai via hn) Redirecting from /blog/llm-wiki-needs-a-substrate/ to /blog/rip-rag
Two-Stage Semantic Chunking for RAG in Python (alessandrofuda.github.io via hn) Fixed-size chunking splits text at arbitrary token boundaries, cutting mid-sentence and blending unrelated topics into the same chunk. Here’s how to build a two-stage pipeline with LlamaIndex , structural splitting first, semantic coherenc…
Whats the SOTA embedding model for arabic Language (www.reddit.com) Hello! I’m working on RAG system on arabic documents any idea on the best embedding model out there?
Anyone here tried the "compile instead of RAG" approach? (www.reddit.com) Been seeing this idea where instead of doing the usual RAG loop, you compile all your sources into a markdown wiki first, then query that directly. The interesting part is that saved answers become part of the wiki too.
Mitre ATLAS technique detection for LLM security in Rust (crates.io via hn) atlas-detect MITRE ATLAS technique detection for LLM and AI agent security. Detects 97 attack techniques across 16 MITRE ATLAS tactics including prompt injection, jailbreaks, credential exfiltration, model extraction, RAG poisoning, revers…
Beginner in Langraph with no dev experience. How to build projects from scratch (www.reddit.com) Recently got recruited tin PwC post masters in data science. Interview was in traditional ml but now I must work in AI projects.
Less Is More: Graph-free Multimodal RAG via Multi-signal Late Fusion (arxiv.org) Graph-based retrieval-augmented generation (RAG) is widely used for multimodal, cross-document question answering. However, building corpus-level graphs is expensive, slow to query, and difficult to maintain.
Semantic Layer Induction from Raw Telemetry via Hierarchical LLM and RAG Abstraction (arxiv.org) Modern applications generate massive volumes of raw telemetry data, but translating those noisy, heterogeneous event streams into actionable business insights remains a fundamental challenge. Data engineers and analysts expend substantial…
RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents (arxiv.org) Effective troubleshooting agents in enterprise customer support depend on retrieving actionable guidance from similar historical cases, yet existing retrieval-augmented generation (RAG) systems treat support cases as static documents and o…
Beyond Static RAG: An Adaptive, Tri-Metric Routing Framework for Efficient Long-Context Inference on Commodity GPUs (arxiv.org) Deploying retrieval-augmented generation (RAG) on commodity GPUs such as the NVIDIA T4 (16 GB VRAM) exposes a practical failure mode we call the Compression Paradox: neural prompt compression can add key-value (KV) cache contention and pre…
Seeing Through the MiRAGE: Evaluating Multimodal Retrieval Augmented Generation (arxiv.org) We introduce MiRAGE, an evaluation framework for retrieval-augmented generation (RAG) from multimodal sources. As audiovisual media becomes a more prevalent source of information online, RAG systems must integrate such media into generatio…
One Size Does Not Fit All! Dynamic Retriever and Generator Selection for RAG (arxiv.org) Retrieval-Augmented Generation (RAG) systems typically employ fixed retriever and generator configurations across queries, despite substantial differences in query complexity and information needs, leading to inefficient allocation of comp…
Free iOS app to connect MCP servers to your cloud / local models (www.reddit.comhttps) Hi r/ClaudeAI, PowerChat is a free iOS client that can connect your cloud / local models to MCP servers. It has builtin support for Google Drive, iOS Files, iOS Calendar, and the search engines Tavily, Exa, and Firecrawl.
AquiLLM: Evaluating Faithfulness in Open-Weight RAG-LLM Systems for Scientific Research (arxiv.org) Scientific research increasingly relies on large, heterogeneous data sources, motivating interest in retrieval-augmented generation (RAG) systems that provide natural language access to scientific knowledge and research workflows. Research…
RAG-CT: Mitigating Privacy Risks on Retrieval-Augmented Generation Systems via Scanning Prompt Distribution (arxiv.org) Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for improving the quality of generated contents of Large Language Models (LLMs) by grounding responses in external knowledge, thus reducing hallucinations and factual…
The Immutable Past: Formalizing State Mutability and Conflict Resolution in Mutable RAG (arxiv.org) Retrieval-Augmented Generation (RAG) serves as the primary memory architecture for long-horizon autonomous agents. However, treating shared memory as an append-only stream introduces \textit{Semantic Shadowing}, a critical failure mode whe…
NepKANUN: A RAG-Based Nepali Legal Assistant (arxiv.org) Accessing legal information in Nepal is difficult due to complex terminology, limited resources, and misinformation. We introduce an AI-powered legal assistant that is tailored for Nepali legal texts and is built on a fine-tuned large lang…
Retrieval-Guided Fine-Tuning as Noisy Estimation: Risk bounds and Architectural Analysis (arxiv.org) Retrieval-Guided Fine-Tuning (RAG-FT) incorporates retrieved data directly into the training objective, but the statistical consequences of noisy retrieval during training remain theoretically undercharacterized. We study this question by…
CiteGuard-RAG: A Validation-Centered AI System for Evidence-Grounded Question Answering (arxiv.org) Retrieval-augmented generation (RAG) can improve access to complex information; however, retrieving evidence alone does not ensure that answers are grounded, citation-valid, or appropriately refused. This paper introduces CiteGuard-RAG, a…
GraMRAG: Orchestrating Multi-Agent Multi-Step Reasoning via Graph Memory with Reinforcement Learning (arxiv.org) Although existing multi-agent Retrieval-Augmented Generation (RAG) systems have demonstrated promise on complex multimodal reasoning tasks, they remain fundamentally limited in reasoning depth and memory structure, suffering from inadequat…
Oops, Not Now: PEARL, a RAG-Based Support Agent for Gameplay and What Players Want from AI Help (arxiv.org) AI-powered gameplay support agents hold promise for game-based learning, yet grounding generative models in structured game data remains an open challenge. We present PEARL (Parallel Education Agent for Reflection and Learning), a dual-com…
Decoupling Error Attribution in Cloud-Native Graph-RAG: A Data Integrity Diagnostic Framework (arxiv.org) Graph-RAG systems often assume pristine data quality, overlooking the severe impact of perturbations in cloud-native databases. This paper proposes a three-layer decoupled diagnostic framework to orthogonally attribute system errors to rea…
Beyond Quacking: Deep Integration of Language Models and RAG into DuckDB (arxiv.org) Knowledge-intensive analytical applications retrieve context from both structured tabular data and unstructured, text-free documents for effective decision-making. Large language models (LLMs) have made it significantly easier to prototype…
Navigating Sparse Evidence: Agentic Visual RAG via Explicit Context Selection and Consolidation (arxiv.org) Visual Retrieval-Augmented Generation (VRAG) empowers models to navigate and answer queries about visually rich documents by retrieving relevant page images as visual evidence and reasoning over their content. However, effectively utilizin…
Beyond the Query: Do Retrieval Signals Improve Adaptive Multimodal RAG Routing? (arxiv.org) Adaptive RAG often uses retrieval-time signals to decide whether another retrieval, reranking, or multimodal step should run. We ask whether these signals add routing value once the query itself is already known.
Beyond Vector Similarity: Hierarchical Context-Aware Graph RAG vs Standard RAG in Enterprise Code Migration (arxiv.org) As enterprises modernize legacy monolithic systems to microservices, Large Language Models (LLMs) are heavily utilized for automated code translation. However, traditional vector-based Retrieval-Augmented Generation (Standard RAG) struggle…
MisEdu-RAG: A Misconception-Aware Dual-Hypergraph RAG for Novice Math Teachers (arxiv.org) Novice math teachers often encounter students' mistakes that are difficult to diagnose and remediate. Misconceptions are especially challenging because teachers must explain what went wrong and how to solve them.
REVA: Reusable Evidence View Aggregation for Context-Efficient RAG Serving (arxiv.org) Retrieval-augmented generation (RAG) improves knowledge-intensive large language model (LLM) applications by conditioning generation on retrieved documents, but longer contexts increase latency, key-value (KV) cache memory, and token cost.…
RAG-Safety-Bench: Reliable Evaluation of Retrieval-Augmented LLM Safety (arxiv.org) Allowing large language models (LLMs) to retrieve information from a set of trusted documents can increase reliability and reduce hallucination. However, recent work has demonstrated that retrieval-augmented generation (RAG) can have unint…
Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both? (arxiv.org) In Retrieval-Augmented Generation (RAG) systems, a large number of retrieved chunks are concatenated to form the input context so that users can receive high-quality responses based on external knowledge. As a result, the input context len…
In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning (arxiv.org) Retrieval-augmented generation (RAG) grounds a language model in retrieved documents, which reduces hallucination but creates a new attack surface: if retrieved text is tampered with, the model may repeat the falsehood. We study how much a…
KARE-RAG: Knowledge-Aware Refinement and Enhancement for RAG (arxiv.org) Retrieval-Augmented Generation (RAG) equips large language models with external knowledge and is central to knowledge-intensive tasks. As RAG systems enter real-world use, generators must reliably leverage retrieved evidence.
Q2D-Web: A Large-Scale Benchmark for Retrieval in Agentic RAG Systems (arxiv.org) Evaluating first-stage retrievers in large-scale production RAG requires a benchmark that pairs a large-scale corpus with a large set of agent-reformulated search queries based on real user queries and their conversation threads, and that…
Don't Lose Entities from Retrieval to Generation: Dual Entity Recovery RAG for multi-hop QA (arxiv.org) Retrieval-augmented multi-hop question answering (QA) decomposes a query into sub-questions and decomposes the corpus into smaller retrieval units such as sentences. Both forms of decomposition improve the pipeline, but we show that both s…
Better Together: Complementary Query Rewriting Under a Strong RAG Baseline (arxiv.org) A popular way to improve Retrieval-Augmented Generation (RAG) is to rewrite the user's question into several variants and search with all of them. We test whether this actually helps once the underlying search is already strong.
QO-Bench: Diagnosing Query-Operator-Preserving Retrieval over Typed Event Tuples (arxiv.org) Many real-world questions over business, legal, and scientific corpora are natural-language versions of database-style queries over records latent in text. Existing retrieval-augmented generation (RAG) systems are optimized primarily for s…
LitSeg: Narrative-Aware Document Segmentation for Literary RAG (arxiv.org) Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge, particularly for long-tail domains such as literary works. However, the critical step of document segmentation in RAG remains l…
CrossModalQA: A Cross-modal and Multi-hop Benchmark for Multimodal Retrieval-augmented Generation (arxiv.org) Despite the strong capabilities of multimodal large language models (MLLMs), their parametric knowledge remains incomplete and difficult to update, motivating multimodal retrieval-augmented generation (RAG) to ground responses in external…
Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment (arxiv.org) Vision-language models (VLMs) augmented with retrieval-augmented generation (RAG) benefit from access to external evidence. However, standard retrievers and rerankers optimize for semantic similarity rather than answer utility, creating a…
An Auditable Symbolic-RAG-Generative AI Architecture for Goal-Oriented Conversation Orchestration (arxiv.org) Goal-oriented conversational systems must answer factual questions, understand visitor-provided information, and advance business objectives without becoming rigid questionnaires. This paper proposes a Symbolic-RAG-Generative architecture…
Building Trustworthy Graph-Agentic RAG for Social Good: Architectures, Failure Propagation, and Assurance by Construction (arxiv.org) Graph-agentic retrieval-augmented generation combines structured evidence with adaptive controllers that can plan retrieval, traverse relations, verify intermediate claims, delegate subtasks, and use tools. This combination is useful when…
Compression Beyond the Uncompressed: A Two-Stage Training Recipe for Soft Context Compression in RAG (arxiv.org) Retrieval-Augmented Generation (RAG) enhances language models with external knowledge, but the lengthy retrieved context inflates the input and degrades inference efficiency. Soft context compression encodes each document into a substantia…
GRACE: Graph-Grounded Reflective Agent Copilot Engine for Expert-in-the-Loop Knowledge Expansion (arxiv.org) Large language models deployed in high-stakes settings frequently generate plausible but ungrounded claims. Standard retrieval-augmented generation (RAG) pipelines offer limited remedy, since they retrieve isolated passages without trackin…
A Tree-based RAG Framework for Evidence-Intensive QA via Adaptive Planning and Topology-Aware Evidence Gathering (arxiv.org) Recent structured RAG methods leverage tree- or graph-based reasoning structures to improve multi-hop QA. However, they face key limitations in evidence-intensive QA, where answering a question requires synthesizing information scattered a…
How are you handling real-world document versioning and scanned PDFs in RAG systems? (www.reddit.com via reddit) We’ve been testing a provenance-heavy RAG/knowledge system on real cases, and two areas are now hard to validate simply because our current corpus doesn’t contain enough of them: Documents that change over time — policies, specs, manuals,…
Spruce: Scalable Private Outsourced Retrieval Using Compact Embeddings (arxiv.org) Retrieval-Augmented Generation (RAG) has made dense retrieval over large document collections a standard building block. Organizations increasingly outsource vector indexes to untrusted clouds, exposing proprietary corpora and user queries.
Causal-Counterfactual RAG: The Integration of Causal-Counterfactual Reasoning into RAG (arxiv.org) Large language models (LLMs) have transformed natural language processing (NLP), enabling diverse applications by integrating large-scale pre-trained knowledge. However, their static knowledge limits dynamic reasoning over external informa…
Rent-a-RAG: Embedding-Space Watermarks for Auditing Third-Party RAG (arxiv.org) Third-party retrieval-augmented generation (RAG) marketplaces create a new auditing problem: data providers may license corpora to a RAG operator, yet later have no visibility into whether their documents are being reused without compensat…
R$^{2}$Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG (arxiv.org) Retrieval-Augmented Generation (RAG) has become a prevailing paradigm for enhancing Large Language Models (LLMs) with non-parametric knowledge. Vanilla RAG efficiently handles simple queries but struggles with relational or multi-hop reaso…
STAIR (STructure Aware Information Retriever): A novel dataset and LLM based retriever for document structure augmentation (arxiv.org) Retrieval Augmented Generation (RAG) is a key component for generating accurate and hallucination free answers using Large Language Models (LLMs). LLMs are improving at handling long context, but still suffer from "lost in the middle" prob…
Incremental Pooled LLM Evaluation for Cost-Effective Retrieval Model Selection (arxiv.org) Selecting a retrieval model for a production RAG system requires reliable comparative evaluation, but obtaining relevance judgments at scale is expensive and difficult to repeat as new candidate systems arrive. We study pooled LLM evaluati…
Beyond-RAG: Question Identification and Answer Generation in Real-Time Conversations (arxiv.org) In customer contact centers, human agents often struggle with long average handling times (AHT) due to the need to manually interpret queries and retrieve relevant knowledge base (KB) articles. While retrieval augmented generation (RAG) sy…
ISO-RAG: Isoperimetric Noise Control for Retrieval-Augmented Generation (arxiv.org) Retrieval-Augmented Generation (RAG) mitigates large language models (LLMs) hallucinations, yet conventional dense retrieval struggles with the complex reasoning paths of multi-hop question answering (QA). Graph-based RAG captures multi-st…
Would you call this RAG behavior a security failure? (www.reddit.com via reddit) A retrieved document contains a planted instruction. The Agent repeats it and cites the source, but doesn’t actually execute anything.
What’s the best way to read and analyze PDFs with Claude? (www.reddit.com via reddit) I’m trying to understand the best practice for using Claude to read and analyze PDFs in a normal chat use case, rather than building a complex RAG or production pipeline. The reason I’m asking is that we’ve been receiving frequent complain…
My local RAG tool, Fact Extract (apps.microsoft.com via reddit) I'm sharing a RAG and desktop document review system I made, mostly with Claude. It's called Fact Extract.
AgenticRag-R1: Agentic Reinforcement Learning with Stack Memory for Multi-Step Reasoning, Retrieval and Memorizing (arxiv.org) Retrieval-Augmented Generation (RAG) improves the factuality of large language models (LLMs), yet existing RAG systems often struggle with complex, multi-step reasoning that requires adaptive retrieval and continuous revision of intermedia…
PAGE-RAG: Provenance-Aware Graph Evidence Promotion for Fixed-Budget Multi-hop Retrieval-Augmented Generation (arxiv.org) Multi-hop question answering in retrieval-augmented gener?ation (RAG) often benefits from retrieving beyond the few candidates that will finally be read: narrow retrieval can miss an indispensable hop, while expanded retrieval introduces t…
Kascade: A Practical Sparse Attention Method for Long-Context LLM Inference (arxiv.org) Attention is the dominant source of latency during long-context LLM inference, an increasingly popular workload with reasoning models and RAG. We propose Kascade, a training-free sparse attention method that leverages known observations su…
Dataset Protection via Watermarked Canaries in Retrieval-Augmented LLMs (arxiv.org) Retrieval-Augmented Generation (RAG) has become an effective method for enhancing large language models (LLMs) with up-to-date knowledge. However, it may pose a risk of copyright infringement, as IP datasets may be incorporated into the kn…
Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning (arxiv.org) Deploying large language models for legal question answering raises challenges that general-purpose leaderboards do not capture, particularly for low-resource languages and under hard operational constraints. We report on building and oper…
Cross Lingual Transfer in Tulu Legal Comprehension: Script-Dependent Improvement and RAG-Induced Knowledge Conflict (arxiv.org) Low-resource languages without an adequate training corpus often use a related, higher-resource language as a scaffold for comprehension. Still, there is a need to develop rigorous evaluation methods to identify when models fail in cross l…
MA-RAG: Multi-Agent Retrieval-Augmented Generation for Query-Driven Summarization of Longitudinal Parkinson's Disease Assessments (arxiv.org) Accurate interpretation of single-visit and longitudinal clinical assessments for Parkinson's disease is time-consuming and often depends on specialist expertise. Although large language models (LLMs) can generate natural language summarie…
A Wolf in Sheep's Clothing: Targeted Routing Hijacking in Federated RAG (arxiv.org) Federated Retrieval-Augmented Generation (FedRAG) is attractive for privacy-sensitive applications because full local corpora remain on clients. As a result, routing must rely on client-provided semantic profiles, creating a new opportunit…
Knowing Before Answering: Decoding Language Models for Reliable RAG (arxiv.org) In Retrieval-Augmented Generation (RAG), retrieval may provide insufficient or conflicting information needed to answer a question. The system should not only know when to answer but also be able to identify cases in which the documents pr…
Retrieving Relations, Detecting Fallacies: A RAG Approach to Political Debate Analysis (arxiv.org) Fallacies are arguments that employ invalid reasoning, making their automatic detection critical in sensitive contexts such as high-stakes political debates, where public opinion is shaped. Spotting a fallacious argument requires contextua…
Assessing the Downstream Utility of Evidence-Aware Retrieval in RAG (arxiv.org) Retrieval evaluation for retrieval-augmented generation (RAG) is increasingly designed around whether retrieved passages contain evidence that can support generation, rather than topical relevance alone. We study whether this closer alignm…
Towards Expert Financial QA via Self-Improving RAG (arxiv.org) Expert-level financial question answering requires both grounded verification to catch numeric hallucinations and audit trails for regulatory compliance, attributes that standard single-pass RAG systems lack. We take a step toward this goa…
Comparing Chunking and Embedding Strategies for Turkish RAG Systems (arxiv.org) How documents are segmented into retrievable chunks and how those chunks are embedded strongly affect Retrieval-Augmented Generation (RAG) quality, yet neither has been systematically studied for morphologically rich languages such as Turk…
Appreciation Post - thomsonreuters/Thomson-1.0-Small (www.reddit.com via reddit) With the lack of support from Qwen regarding the smaller 9B and 35B MOE models. Like myself, not everyone is looking for an agentic coding model, I particularly use it for RAG and reviewing and require high reasoning across different docum…
Addressing Corpus Knowledge Poisoning Attacks on RAG Using Sparse Attention (arxiv.org) Retrieval Augmented Generation (RAG) is a highly effective paradigm for keeping LLM-based responses up-to-date and reducing the likelihood of hallucinations. Yet, RAG was recently shown to be quite vulnerable to corpus knowledge poisoning:…
Homo-RAG: Homology-Guided Retrieval-Augmented Generation for Cross-Species Gene Function Prediction (arxiv.org) The functional annotation of genes in non-model organisms remains a significant challenge in computational biology, with 20-70% of sequenced genes lacking characterized functions. Traditional homology-based methods are often costly and str…
Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs (arxiv.org) Retrieval-augmented generation (RAG) is widely used to mitigate hallucination issues in large language models (LLMs) and multimodal large language models (MLLMs). In particular, knowledge graph (KG)-based RAG leverages structured knowledge…
LivingRAG: Augmenting Graph RAG with Experience (arxiv.org) Graph-based RAG improves multi-hop question answering by organizing evidence as a knowledge graph. However, most existing RAG systems process each query in isolation and discard useful reasoning from the LLM's response after inference.
post-graph-rag: A PostgreSQL-Native Graph RAG Engine (arxiv.org) Graph-based retrieval-augmented generation connects facts that no single passage states, but current implementations pay for that three times: in infrastructure, requiring a vector store, graph database and document store to be kept consis…
Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG (arxiv.org) Retrieval-Augmented Generation (RAG) grounds LLM responses in external evidence but treats the model as a passive consumer of search results, with no view of how the corpus is organized or what it has not yet seen. We present Corpus2Skill,…
PlanSightRAG: A Visual-First Multimodal RAG for Automating Question Answering and Compliance Checking for Civil Standard Plans (arxiv.org) Civil infrastructure compliance checking has long relied on engineers manually reading legacy 2D plans; however, OCR-based automation strips away the geometry and layout essential for interpreting these plans. We present a Visual-First Mul…
PonsRAG: A Pons-Inspired RAG Bridging Cognitive Islands for Coordinated Long Narrative Reasoning (arxiv.org) Long Narrative Reasoning is an essential capability for processing and reasoning over complex narratives. While retrieval-augmented generation provides a promising framework, existing methods still face two critical challenges: cognitive i…
When RAG Fails to Equalize: Geo-bias in Factual Question Answering over Public Companies (arxiv.org) Retrieval-augmented generation (RAG) is widely assumed to mitigate factual errors in large language models (LLMs), but it remains unclear whether retrieval uniformly compensates for missing knowledge. We study this question in a controlled…
SelfGraphRAG: Bridging the Supervision Gap in Graph-Based RAG with Synthetic QA Generation (arxiv.org) Retrieval-augmented generation (RAG) improves large language models by incorporating external knowledge without retraining, but existing methods often underuse the relational structure encoded in knowledge graphs. Graph-based RAG can captu…
Less can be More: Relieving RAG Bottlenecks via Evidence Frontloading and Pressure-Adaptive Budgeting (arxiv.org) Existing methods for improving Retrieval-Augmented Generation (RAG) efficiency mainly optimize downstream LLM generation, such as context compression or serving optimization. However, RAG is an end-to-end system, and its bottleneck can shi…
How to Fine-Tune an LLM: An End-to-End Guide (towardsdatascience.com via reddit) I ended up fine tuning a mistral 7b to outperform our costly foundational model and saved $300k. I previously thought that fine tuning was pointless (it's definitely not) and that all these problems could be solved with RAG (they can't).
little tool for offline wikipedia RAG (www.reddit.comhttps) I was bored and handwrote a tiny 100-line bash script to let an agent search for and read articles from an offline wikipedia archive during a regular chat. It's not particularly useful, but it's definitely neat and a big step up from llama…
I turned my Google Search MCP into a local research system with automatic graph RAG (www.reddit.com via reddit) Four months ago, I shared google-surf-mcp here as a lightweight MCP for browser-based Google search and URL extraction without API keys. I got tired of AI agents forgetting previous research and discarding context between sessions, so I ev…
Underrated Muse Glimmer (www.reddit.comhttps) Benchmarked qwen3.8 xhigh, medium and muse glimmer. Xhigh effort mode with qwen3.8 took almost 30hrs.
MPIB: A Benchmark for Medical Prompt Injection Attacks and Clinical Safety in LLMs (arxiv.org) Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems are increasingly integrated into clinical workflows. However, prompt injection attacks can steer these systems toward clinically unsafe or misleading outputs.
The RAT: A Unified Bayesian Model for RAG Evaluation (arxiv.org) Evaluating Retrieval-Augmented Generation (RAG) systems requires assessing not only end-to-end correctness but also how individual components interact and how errors propagate through the pipeline. We introduce a Bayesian evaluation framew…
MetaRAG: Belief-Action Aligned Policy Optimization for Agentic RAG (arxiv.org) Agentic retrieval-augmented generation (RAG) requires language models to decide when to continue searching and when to answer. Existing RL-based methods rely on external supervision and overlook the agent's internal belief about whether th…
RENDER: Controlling Reader-Facing Evidence in LLM Memory Evaluation (arxiv.org) Memory and RAG evaluations often treat the answering model's input as an implementation detail, even though systems may render the same history as a memory entry, summary, typed record, or raw excerpt. We introduce RENDER, a benchmark cont…
WARP: Wasserstein-Aligned RAG for Population Opinions (arxiv.org) RAG systems are increasingly used to summarize what large collections of documents say. A user asks "What do people think about X?" and receives an answer that reads as consensus.
W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases (arxiv.org) Retrieval-Augmented Generation (RAG) enables large language models to incorporate external knowledge during generation, improving factual grounding and domain adaptability. However, existing RAG pipelines assume that evidence retrieved fro…
Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors (arxiv.org) Speech-based applications pass spoken queries through automatic speech recognition (ASR) before any retrieval module, so ASR errors enter the pipeline as a fixed upstream constraint. We empirically test whether two extensions to standard r…
GTA-RAG: Graph-Trajectory-Augmented Reinforcement Learning for Multi-Turn Retrieval-Augmented Reasoning (arxiv.org) Retrieval-augmented generation (RAG) enables LLMs to access external knowledge for answering knowledge-intensive questions. For complex multi-hop questions, multi-turn retrieval-augmented reasoning extends RAG into an iterative process tha…
RAG Collapse: LLM Responses Collapse When Retrieved Documents Are Self-Authored (arxiv.org) LLM responses are based on the internet (via training or RAG), and AI is now used to generate a significant amount of content online (Paredes et al., 2026), creating the potential for a self-reinforcing feedback loop. Prior work has shown…
MCite-RL: Towards Reliable Multimodal RAG via Citation-enhanced Agentic Reinforcement Learning (arxiv.org) Multimodal Retrieval-Augmented Generation (RAG) with visual citation is crucial for ensuring the traceability and verifiability of MLLMs. However, current RAG and SFT-based methods struggle to achieve robust cross-modal reasoning, causing…
Mitigating Database Leakage in RAG Systems with Keyword-Grounded Fact Substitution (arxiv.org) Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for combining large language models (LLMs) with external knowledge sources. However, RAG systems remain vulnerable to prompt injection attacks, which may mislead the r…
LLM-Specific Utility for Retrieval-Augmented Generation (arxiv.org) Retrieval-augmented generation (RAG) is typically optimized for topical relevance, yet its success ultimately depends on whether retrieved passages are useful for a large language model (LLM) to generate correct and complete answers. We ar…
AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study (arxiv.org) We introduce AI University (AI-U), a flexible framework for AI-driven course content delivery that adapts to a course's instructional style. AI-U combines a fine-tuned large language model (LLM) with retrieval-augmented generation (RAG) an…
Coarse Indexing, Fine Evidence: Decoupling Temporal Granularity in Long-Video RAG (arxiv.org) Graph-based retrieval-augmented generation (RAG) provides a scalable paradigm for long-video understanding, but existing systems typically inherit a fixed temporal granularity from video segmentation when constructing their retrieval index…
GeoRisk-RAG: A Hierarchy-Aware Risk Framework for Improving RAG Reliability through Selective Answering (arxiv.org) Current work on improving reliability in large language model (LLM)- generated answers has primarily leveraged Retrieval-Augmented Generation (RAG), knowledge-graph augmentation, and reinforcement learning. While these methods are adept at…
Automating Multi-Hop RAG Evaluation via TRIAD: From Context Extraction to Validated Dataset Generation (arxiv.org) Recent advances in LLMs and the adoption of RAG systems in industry have created a need for domain-specific question-answer datasets that can assess RAG performance on proprietary data. Existing datasets, such as HotpotQA, challenge curren…
From Association to Causation: Improving Retrieval Precision of Retrieval-Augmented Generation via Causal Relations and an Attention Mechanism (arxiv.org) Retrieval-Augmented Generation (RAG) grounds LLM generation on retrieved documents, but the standard terminal retrieval stage--dense-vector similarity, optionally followed by reranking--often returns documents that share keywords with the…
SchemaRouter: Field-Aware Tool Routing for Efficient Heterogeneous Agentic RAG (arxiv.org) Heterogeneous agentic retrieval-augmented generation (RAG) systems increasingly orchestrate external APIs, internal databases, vector stores, and graph stores. Exposing all tool descriptions to an LLM agent, or selecting tools only by vect…
Exploratory As-Analyzed No-Detection of Culturally-Marked Predicate-Triggered PII Amplification in a Synthetic-English RAG Probe: A Predicate-Resource-Confounded Audit (arxiv.org) We ask whether stereotype-loaded queries about culturally marked people leak more personal information from a retrieval-augmented generation (RAG) system than otherwise-equivalent neutral queries. We pre-register a four-culture audit (en-A…
SKILL-RAG: Self-Knowledge Induced Learning and Filtering for Retrieval-Augmented Generation (arxiv.org) Retrieval-Augmented Generation (RAG) has significantly improved the performance of large language models (LLMs) on knowledge-intensive tasks in recent years. However, since retrieval systems may return irrelevant content, incorporating suc…
EnSI-RAG: Entity-Structure-Indexed Retrieval-Augmented Generation for Long-Document Question Answering (arxiv.org) Question answering (QA) over long, connected documents remains challenging because relevant evidence may span multiple entities and their relationships. Existing retrieval-augmented generation (RAG) methods typically index documents as raw…
Trustworthy RAG: An Evaluation Agent for Detecting Misinformation and Knowledge Poisoning in Generative AI Systems (arxiv.org) Retrieval-Augmented Generation (RAG) grounds Large Language Model (LLM) outputs in external knowledge, but RAG systems usually trust whatever they retrieve, creating a Security-Reliability Gap: high semantic relevance does not guarantee fa…
When Failures Propagate: Causal Failure Attribution in Agentic Retrieval-Augmented Generation (arxiv.org) Agentic retrieval-augmented generation (RAG) interleaves retrieval, reasoning, and answer generation across multiple hops. A retrieval error at hop 1 can surface only as a wrong answer at hop 3, while later retrieval can also repair the tr…
RAG Deserves an Index: Why Ingest-Time Compilation Beats Query-Time Interpretation (arxiv.org) Nearly every retrieval-augmented question-answering system in production ships with a hidden interpreter: on each query a language model re-derives the meaning of raw corpus text and then throws that work away. Cheaper models do not close…
MCP vs. RAG for world knowledge? (www.reddit.com via reddit) As I’m navigating the best setup for using Qwen3.8 27b as both my main coder and my personal assistant, I want to hook it into Wiki & beyond but I don’t want to be reliant on an internet connection. What I’ve started doing is taking the ge…
Has anyone else gotten crushed by API costs because of agent context bloat? (www.reddit.comhttps) I was debugging a customer support agent that kept getting stuck in recursive tool-call loops (e.g., retrying the same failed SQL query 15 times before hitting the max iteration cap), and I realized how brutal the underlying math is. Becau…
From Retrieved Context to Runtime Control: Adaptive Compression for Edge-based RAG (arxiv.org) Retrieval-augmented generation (RAG) improves language-model responses by grounding generation in external passages, which comes with overhead: retrieved context lengthens the prompt, increasing prefill work, KV-cache footprint, memory tra…
We created a Claude plugin that increases accuracy and reduces token consumption by 1/3rd (www.reddit.com via reddit) repo: https://github.com/infino-ai/code-context install: /plugin marketplace add infino-ai/code-context /plugin install code-context@infino-ai The problem it fixes: Claude code finds things by grepping and reading files. grep is great...
Tatarstan Toponyms: A Bilingual Dataset and Hybrid RAG System for Geospatial Question Answering (arxiv.org) This paper addresses end-to-end geospatial question answering over multilingual toponymic data. We introduce a bilingual (Russian-Tatar) dataset of 9,688 toponyms with linguistic, etymological, and coordinate information (93.1 percent geor…
MissDiag: Diagnostic Evaluation of Incomplete-Knowledge Robustness in KGQA and KG-RAG (arxiv.org) Knowledge graph question answering (KGQA) and knowledge-graph-based retrieval-augmented generation (KG-RAG) aim to ground answers in explicit graph evidence, but real-world knowledge graphs are often sparse, outdated, and incomplete. Exist…
Event-Causal RAG: A Retrieval-Augmented Generation Framework for Long Video Reasoning in Complex Scenarios (arxiv.org) Large vision-language models perform well on short- and medium-length video understanding but still struggle to maintain coherent event memory and recover long-range relationships in ultra-long videos. End-to-end methods are limited by vis…
eCommerce chatbot knowledge base (www.reddit.com via reddit) I am working on building a chatbot for an online store. I will be using MCP for the transactional parts including product search, adding to cart, etc.
Towards Safer RAG: Only Agents Capable of System 2 Thinking may Access Untrusted Documents (arxiv.org) Retrieval-Augmented Generation (RAG) has significantly enhanced the performance of large language models (LLMs), yet these systems remain vulnerable to knowledge-poisoning attacks, in which misinformation in retrieved documents can influen…
Parametric Knowledge in RAG-SFT for Domain-Specific Document Generation (arxiv.org) Retrieval-Augmented Generation (RAG) fine-tuning has shown substantial improvements over vanilla RAG, yet most studies target document question answering, leaving open whether these gains transfer to specialized tasks. We study supervised…
LLM Enhancement with Domain Expert Mental Model to Reduce LLM Hallucination with Causal Prompt Engineering (arxiv.org) When consequential decisions depend on knowledge that exists nowhere in writing, LLMs hallucinate not from retrieval failure but from model absence. RAG and knowledge-graph methods share a structural ceiling.
CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method (arxiv.org) Legal consultation questions exhibit multi-level complexity. A single retrieval strategy often leads to over-reasoning for simple questions and poor interpretability for complex ones, making it difficult to meet the requirements for both a…
Single-Round Vector RAG vs an LLM-Compiled Wiki: A Preregistered Comparison on a Small Multi-Domain Research Corpus (arxiv.org) We preregistered a comparison of two ways to help an LLM answer questions over a small research corpus: a single-round Vector RAG system and an LLM-compiled markdown wiki browsed by a tool-using agent. Both systems answered the same 13 que…
DSPrompt: Dynamic Soft Prompt Defense Against M-RAG Corruption (arxiv.org) Multimodal Retrieval Augmented Generation (M-RAG) is increasingly vulnerable to adversarial attacks where malicious data are crafted to produce embeddings that align with benign entries in the vector space, deceiving retrieval and inducing…
Where Does Retrieval Fail? Evaluating RAG Architectures for Agricultural Advisory (arxiv.org) Retrieval quality in RAG systems is commonly reported as a single aggregate score, which can hide large differences across query types and language conditions. We study this problem in Bengali agricultural advisory, where farmer queries ar…
LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Ranking (arxiv.org) Recent advances in Large Language Models (LLMs) have driven their adoption in recommender systems through Retrieval-Augmented Generation (RAG) frameworks. However, existing RAG approaches predominantly rely on flat, similarity-based retrie…
SMA: Who Said That? Auditing Membership Leakage in Semi-Black-box RAG Controlling (arxiv.org) Retrieval-Augmented Generation (RAG) and its Multimodal Retrieval-Augmented Generation (MRAG) significantly improve the knowledge coverage and contextual understanding of Large Language Models (LLMs) by introducing external knowledge sourc…
Topological Attribution Distance (TAD): Revealing Segment-Level RAG Influence on LLM Output Geometry for Incident Log Analysis (arxiv.org) Large Language Models (LLMs) are increasingly being deployed in cybersecurity operations to assist cybersecurity analysts with rapid decision-making against emerging threats. However, there is a main criteria that must be met when using LL…
Noesis: Bidirectional Graph-RAG with Adaptive Parallelism and Cross-Knowledge-Base Semantic Discovery (arxiv.org) Retrieval-Augmented Generation over knowledge graphs (Graph-RAG) has emerged as a powerful paradigm for grounding large language models in domain-specific corpora. However, existing systems face persistent limitations: (1) static chunking…
GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAG (arxiv.org) Multimodal retrieval-augmented generation (RAG) systems often rely on long unstructured contexts or aggressively expanded evidence graphs, which can introduce noisy evidence, weaken multi-hop reasoning, and increase unsupported generation.…
Longtime ChatGPT user trying Claude for a big markdown textbook library — hit the project knowledge cap immediately (www.reddit.com via reddit) Been a ChatGPT/Codex user since basically day one, finally giving Claude a real shot, and I ran straight into something I didn't expect. My setup: 8 textbooks (4 biochem, 3 ochem) converted to markdown with figures stripped out.
Fine-grained Claim-level RAG Benchmark for Law (arxiv.org) The rapid progress of large language models (LLMs) is shifting semantic search toward a question-answering paradigm, where users ask questions and LLMs generate responses. In high-stake domains such as law, retrieval-augmented generation (…
Adaptive Stopping for Multi-Turn LLM Reasoning (arxiv.org) Large Language Models (LLMs) increasingly rely on multi-turn reasoning and interaction, such as adaptive retrieval-augmented generation (RAG) and ReAct-style agents, to answer difficult questions. These methods improve accuracy by iterativ…
How Much Do Legal RAG Systems Still Hallucinate? (arxiv.org) Hallucination is a major challenge for retrieval-augmented generation (RAG) systems in the legal domain, where ungrounded answers can lead to serious consequences. To better understand this problem, we conduct a fine-grained analysis of ha…
HAM-RAG: Hierarchy-Aware Multimodal RAG for Structure-Faithful Interleaved Generation (arxiv.org) Existing multimodal RAG methods often flatten structured documents into isolated text and image units, weakening the source organization and local text-image logic needed for faithful evidence selection and placement. We propose HAM-RAG, a…
TeachMateGPT: A Multi-Agent Knowledge-Grounded Framework for Pedagogical Assessment Generation from Science Curriculum Materials (arxiv.org) Automatically generating textbook-grounded assessment items can reduce science teachers' workload, but existing retrieval-augmented generation (RAG) systems rely on flat retrieval, support only single-question generation, lack safeguards a…
Seeking Advice: Graph RAG for personal legal case (www.reddit.com via reddit) Apologies for the meandering human-authorship of my post up front; If this is the wrong sub or I should post elsewhere, I humbly thank you for correcting my mistake. TLDR at the top for those who prefer to skip the novel.
I got tired of Claude/Cursor re-adopting approaches we already rejected, so I shipped a local decision memory CLI (www.reddit.com via reddit) I kept hitting the same failure mode with Claude Code and Cursor. The agent is good.
Who Speaks Matters: Authority-Aware Multi-View RAG over Italian Parliamentary Proceedings (arxiv.org) Parliamentary proceedings are a primary record of democratic deliberation, yet their volume and fragmentation make multi-perspective access difficult for citizens, journalists, and researchers. Applying Retrieval-Augmented Generation (RAG)…
Privacy-Preserving RAG by Concealing Sensitive Information from External LLMs (arxiv.org) Retrieval-Augmented Generation (RAG) is widely used to improve the performance of Large Language Models (LLMs) in answering user queries. Existing privacy research on RAG has focused on preventing unauthorized users from accessing sensitiv…
Compliance role (www.reddit.com via reddit) Hi I'm taking up a new compliance role doing lots of auditing for care homes. The auditing will be of medication, sop's, and other regulation requirements.
SAG: SQL-Retrieval Augmented Generation with Query-Time Dynamic Hyperedges (arxiv.org) While retrieval-augmented generation (RAG) has proven effective at giving LLMs access to external knowledge, mainstream dense-retrieval implementations remain inherently limited in handling structured constraints and multi-hop reasoning. G…
A corpus-specific clinical RAG system matches or outperforms newer frontier LLMs on HealthBench (arxiv.org) General-purpose large language models (LLMs) have recently been reported to match or exceed specialized clinical AI tools on medical benchmarks, but such comparisons draw on a narrow set of systems and on benchmarks developed largely in hi…
QV-PIC: Query-Aware Visual Position-Independent Caching for Efficient RAG Serving (arxiv.org) Retrieval-Augmented Generation (RAG) repeatedly prefills identical text chunks across queries, incurring redundant computations. Position-Independent Caching (PIC) mitigates it by reusing precomputed Key-Value (KV) across positions, but it…
EnterpriseRAG: Benchmarking LLM Instruction Adherence and Robustness under Non-Ideal Enterprise Retrieval (arxiv.org) Enterprise RAG deployments face a critical reliability gap: while LLMs satisfy 80% of individual constraints, only 26.8% of responses meet all requirements simultaneously, revealing a 57-point orchestration gap. Existing benchmarks assume…
Towards Query-Agnostic RAG Evaluation via Query Coverage and Claim Verifiability (arxiv.org) Retrieval-augmented generation improves the factuality of large language models by grounding responses in retrieved evidence, yet existing evaluation frameworks struggle to provide consistent, fine-grained diagnostics across the diverse sp…
GraFine: Retrieval-Time Refinement for Efficient Graph RAG over Corpus Graphs (arxiv.org) Graph RAG on corpus graphs enhances retrieval by leveraging intermediate node content as contextual clues to uncover unretrieved oracle nodes. However, existing methods suffer from two critical blind spots, namely semantically blind graph…
CuSearch: Curriculum Rollout Sampling via Search Depth for Agentic RAG (arxiv.org) Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for training agentic retrieval-augmented generation (RAG) systems from outcome-only supervision. Most existing methods optimize policies from uniform…
What Would Fix This RAG Failure? Auditing Counterfactual Response with Paired Evidence Interventions (arxiv.org) A failed retrieval-augmented generation (RAG) answer can be consistent with several unseen responses to evidence repair. We introduce Pair-ID, an offline audit that holds one query, retrieval state, and reader constant, then crosses two op…
SAGE: SLO-Aware Adaptive Retrieval for Production RAG Systems (arxiv.org) Retrieval-Augmented Generation (RAG) systems in production operate under strict service level objectives (SLOs) on tail latency and infrastructure cost. However, standard retrieval pipelines rely on fixed retrieval budgets that ignore quer…
RAG-3DSG: Enhancing 3D Scene Graphs with Re-Shot Guided Retrieval-Augmented Generation (arxiv.org) Open-vocabulary 3D Scene Graph (3DSG) can enhance various downstream tasks in robotics by leveraging structured semantic representations, yet current 3DSG construction methods suffer from semantic inconsistencies caused by noisy cross-imag…
KGCaRe: Explainable Complex Conditional Question Answering using Automatic Knowledge Graph Construction and Context Retrieval with LLMs (arxiv.org) Answering complex conditional questions using Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) remains a challenge, particularly in domain-specific contexts where general-purpose LLMs and RAG tend to underperform. We h…
Temporal Misgrounding in Legal RAG: A Versioned-Corpus Benchmark for French Tax Law (arxiv.org) We identify and quantify temporal misgrounding: the systematic retrieval and citation of the currently in-force version of a legal article when the applicable version is an earlier or future one. Standard legal RAG treats the corpus as sta…
RAG-Audio: Retrieval-Augmented Generation for Faithful Brain-to-Audio Reconstruction (arxiv.org) Brain-to-audio reconstruction is limited by \emph{prior domination}: when a pretrained generator is conditioned on a weak neural signal, it produces realistic but stimulus-inaccurate audio. We introduce RAG-Audio, which decodes fMRI into a…
AkasicDB: Demonstrating Omni RAG with a Unified Vector-Graph-Relational DBMS (arxiv.org) Recent Retrieval-Augmented Generation (RAG) systems increasingly combine vector retrieval with structured knowledge, such as Graph RAG and Filtered vector search. However, existing database architectures struggle to support such complex RA…
RAG-Based Auto-Configuration for Industrial Fieldbus Devices (arxiv.org) Industrial device commissioning requires engineers to manually extract hundreds of protocol-specific parameters from heterogeneous PDF manuals and transcribe them into supervisory control systems, a time-intensive, error-prone workflow. Th…
Defending Retrieval-Augmented Intrusion Detection Against Knowledge Poisoning and Prompt Injection (arxiv.org) Retrieval-Augmented Generation (RAG) enables large language models to classify network flows and generate human-readable incident reports by retrieving semantically similar historical traffic from a vector knowledge base. However, the retr…
Theory-Guided Deception Detection: A RAG-Based Artificial Intelligence Exploration (arxiv.org) The current work developed seven Retrieval-Augmented Generation (RAG) models based on leading deception theories and compared how deception judgments were made relative to baseline models. Across 700 statements drawn from five published de…
Forgotten History or Test-of-Time? Retrospect and Prospect on RAG from an IR Perspective (arxiv.org) Retrieval-Augmented Generation (RAG) is widely regarded as a novel paradigm born from the limitations of large language models (LLMs)--a mechanism to ground their outputs in external knowledge. This view, however, is incomplete when consid…
SodaMem: Evidence-Grounded Temporal Graph Memory for LLM Agents (arxiv.org) Large language model (LLM) agents that assist users over weeks of conversation must remember what is currently true, not merely what was once said. Flat RAG diaries and Markdown logs optimize needle retrieval but under-serve currency, prov…
VDGR-RAG: Vectors, Directories, Graphs, and Reflection Are All You Need for Unified Reasoning over Hierarchical Enterprise Knowledge (arxiv.org) Retrieval-Augmented Generation (RAG) is essential for enterprise knowledge question answering (QA), particularly in domains with complex product documentation like telecommunications. However, existing RAG approaches largely overlook the h…
Researching AI memory and document ingestion systems (www.reddit.com via reddit) Hey r/ClaudeAI! Over the past three months I've been working on a local-first, single-binary document ingestion and memory tool for Retrieval-Augmented Generation.
TA-RAG: Tone Awareness as a Design Imperative for Retrieval-Augmented Generation (arxiv.org) Retrieval-Augmented Generation (RAG) has become a robust architecture for grounding large language models (LLMs) in trusted knowledge. However, standard RAG systems exhibit a structural limitation: retrieved documents carry their own commu…
INTRYGUE: Induction-Aware Entropy Gating for Reliable RAG Uncertainty Estimation (arxiv.org) While retrieval-augmented generation (RAG) significantly improves the factual reliability of LLMs, it does not eliminate hallucinations, so robust uncertainty quantification (UQ) remains essential. In this paper, we reveal that standard en…
CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG (arxiv.org) Recent optimization studies on Retrieval-Augmented Generation (RAG) have exploited chunk-level KV cache reuse to avoid processing long retrieved contexts for higher efficiency, while significant information redundancy and noise still remai…
Align-RAG: Alignment Is All You Need for TSFM In-Context Learning (arxiv.org) Retrieval-augmented forecasting promises to adapt frozen Time Series Foundation Models (TSFMs) to new domains without fine-tuning, but recent methods typically rely on learned fusion modules, i.e., trained adapters that merge retrieved exa…
NeSy-RAG: Neuro-Symbolic RAG for Explainable Question Answering (arxiv.org) Retrieval-augmented generation (RAG) improves question answering by grounding large language models (LLMs) in external knowledge such as text corpora. However, its reasoning process remains largely opaque: intermediate reasoning steps are…
Where Privacy Risk Lives in English-Source Multilingual RAG: A Stage-Decomposed Audit Across Five Query Languages (arxiv.org) A common assumption holds that switching to a non-English language makes a multilingual RAG system easier to attack for personal information. We test this on an English-source synthetic-PII corpus with five query languages and a two-stage…
Universal Pathologies, Conditional Consequences: A Triple-Robustness Analysis of RAG for Multi-Hop Traceability (arxiv.org) GraphRAG underperforms vector RAG on citation precision in many reports, but where and why have remained corpus-bound. We present a triple-robustness analysis that holds the retrieval architecture fixed and varies three orthogonal axes emb…
TS-RAG: Retrieval Augmented Generation for Time Series Forecasting (arxiv.org) While deep learning models, particularly transformer-based architectures, have shown impressive performance in time series forecasting, the application of retrieval-augmented generation (RAG) in this domain remains limited. Since RAG has p…
TopoChunker: Topology-Aware Agentic Document Chunking Framework (arxiv.org) Current document chunking methods for Retrieval-Augmented Generation (RAG) typically linearize text. This forced linearization strips away intrinsic topological hierarchies, creating ``semantic fragmentation'' that degrades downstream retr…
Eliciting Intrinsic Hallucinations in LLMs via Semantically Equivalent Adversarial Attacks (arxiv.org) Large language models (LLMs) are often used in conjunction with external knowledge sources to improve their factual accuracy and decrease hallucinations, through methods such as Retrieval-Augmented Generation (RAG). However, these systems…
PURPOSE: Poisoning Conflict Resolution in RAG via Proxy-Fact-Grounded Updates (arxiv.org) In Retrieval-Augmented Generation (RAG), post-retrieval conflict resolution arbitrates among noisy or contradictory retrieved passages. However, the robustness of this safeguard against knowledge poisoning has not been adequately studied.
Combating Knowledge Corruption in Agent Systems: A Byzantine-Tolerant Secure Collaborative RAG Framework (arxiv.org) While retrieval-augmented generation systems partially address the hallucination issues in large language models, it also introduces new vulnerabilities to knowledge corruption attacks. Adversaries exploit these vulnerabilities by poisonin…
RAG-Stack: Co-Optimizing RAG Serving Performance and Quality (arxiv.org) Retrieval-augmented generation (RAG), which augments large language model (LLM) generation with information retrieved from databases, has become a widely used approach for knowledge-intensive applications. Modern RAG systems, however, expo…
DenialRAG: Single-Document RAG Poisoning via Embedded Parametric Denial (arxiv.org) Retrieval-augmented generation (RAG) systems are vulnerable to corpus poisoning: an attacker who inserts a crafted document into the retrieval corpus can steer the underlying large language model (LLM) toward an attacker-chosen wrong answe…
SimulRAG: Simulator-based RAG for Grounding LLMs in Long-form Scientific QA (arxiv.org) Large Language Models (LLMs) show promise in generating long-form scientific explanations that synthesize evidence and connect multiple factors. However, in long-form scientific question answering, LLMs often hallucinate, producing unsuppo…
SciRet: A Compute-Aware Empirical Study of Retrieval and Reranking for Scientific RAG (arxiv.org) We introduce SciRet, a compute-aware empirical study of retrieval-augmented generation for scientific question answering over CORD-19. Rather than proposing a new model, we evaluate a fixed scientific RAG pipeline across three corpus scale…
Show us your knowledge graph. I'll start. (www.reddit.com via reddit) Obsidian graph view As we've seen, Cluade code and other harnesses make use of the md file configuration method. When you build your agent's brain, you will typically be creating a Graph-RAG, or knowledge graph.
DocNavRAG: Document-Structured Graph RAG with Stateful Evidence Construction for Complex Document Question Answering (arxiv.org) Answering complex questions over large document collections requires assembling complementary evidence across sections and documents. GraphRAG offers structured retrieval but typically uses fixed traversal, while agentic RAG operates over…
RH-RAG: Trustworthy Long-Form Generation for Privacy-Constrained Settings (arxiv.org) Generating long-form content from extensive internal reports remains challenging for organizations operating under strict privacy and security constraints, where proprietary cloud-based LLM APIs are often not viable. While locally deployed…
Verification Without Sufficiency: Per-Chunk Filtering Fails on Multi-Hop RAG, and Decomposition Repairs It (arxiv.org) Verification for retrieval-augmented generation usually scores each retrieved chunk and drops the ones that fail. We show this cannot work for multi-hop questions, and show what does.
Courtroom-Style Multi-Agent Debate with Progressive RAG and Role-Switching for Controversial Claim Verification (arxiv.org) Large language models (LLMs) remain unreliable for high-stakes claim verification due to hallucinations and shallow reasoning. While retrieval-augmented generation (RAG) and multi-agent debate (MAD) address this, they are limited by one-pa…
RAG Strategies for Natural Language-Based SQL Query and REST API Call Generation (arxiv.org) Enterprise software systems commonly expose business functionality through both relational databases and REST APIs. Accessing these interfaces requires specialized technical knowledge, as users must determine whether a request requires a d…
X-KGRank: A Knowledge Graph RAG Framework for Explainable Recommendations via Pattern Mining and LLM Re-Ranking (arxiv.org) Modern recommender systems produce predictions that users cannot interrogate. The two dominant improvements, collaborative filtering and LLM-based reasoning, each fall short: collaborative filtering captures behavioural signals but offers…
MEGRAG: Multi-Granular Evidence Graphs for Answer-Aware Multi-Hop RAG (arxiv.org) Multi-hop question answering is a fundamental challenge in retrieval-augmented generation (RAG), because deriving an answer requires integrating dispersed evidence. Iterative RAG (iRAG) is widely used for this challenge, but existing metho…
Before Reasoning Fails: Pre-Evidence Procedural Failures in Agentic RAG (arxiv.org) Agentic retrieval-augmented generation (RAG) systems can fail before evidence-conditioned reasoning is tested: an agent may retrieve candidate snippets but finalize without inspecting them. We study this failure mode as a procedural proper…
RAG-TESTER: Automated End-to-End Testing of Retrieval-Augmented Large Language Models (arxiv.org) Retrieval-Augmented Generation (RAG) enables Large Language Models (LLMs) to use external and domain-specific knowledge, but its reliability depends on the interaction between the generative model, embedding model, retrieval mechanism, and…
Enhancing LLMs with Context-Specific Knowledge for Mitigating Misinformation in SMEs: A RAG-based Modeling and Analysis (arxiv.org) Large Language Models (LLMs), a part of artificial intelligence (AI), are increasingly being adopted by Small and Medium Enterprises (SMEs) to enhance question-answering capabilities and support business decision-making processes. However,…
This is the reason why .md file is irrelevant in today's model intelligence when you are trying to build memory layer (www.reddit.com via reddit) Google dropped OKF (Open Knowledge Format), which was a new spec for sharing knowledge between AI systems. The solution?
Bridging the Question-Answer Gap in Retrieval-Augmented Generation: Hypothetical Prompt Embeddings (arxiv.org) Retrieval-Augmented Generation (RAG) systems synergize retrieval mechanisms with generative language models to enhance the accuracy and relevance of responses. However, bridging the style gap between user queries and relevant information i…
GoldenRetriever: Non-Interactive Homomorphic Encrypted Retrieval for Privacy-Preserving RAG (arxiv.org) Retrieval-Augmented Generation (RAG) enhances large language models by incorporating external knowledge, but existing pipelines typically operate on plaintext data, raising significant privacy concerns. Prior work on privacy-preserving ret…
Built a local memory server for Claude Code that actually forgets old facts on purpose (www.reddit.com via reddit) Anyone else annoyed that Claude Code's memory (via any RAG-ish setup) just accumulates everything forever? I'd tell it "we moved off Redis," and three sessions later it'd still cite the old Redis config because the fact never actually got…
Hallucinations and Truth: A Comprehensive Accuracy Evaluation of RAG, LoRA and DoRA (arxiv.org) Recent advancements in Generative AI have significantly improved the efficiency and adaptability of natural language processing (NLP) systems, particularly through Retrieval-Augmented Generation (RAG), Low-Rank Adaptation (LoRA), and Weigh…
GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation (arxiv.org) Retrieval-augmented generation (RAG) over knowledge graphs requires retrievers that can effectively capture both graph structure and semantic information. Recent approaches have explored graph neural network (GNN)-based retrievers to model…
Models for minimalist RAG: B1ade 335M Embedding and 1B Parameter Small Language Models (arxiv.org) Language and embedding models used in RAG systems are conventionally assumed to require large-scale pretraining and explicit grounding supervision. We present B1ade, an efficient RAG architecture comprising two purpose-built components: a…
Path into Claude Certified Architect – Professional as an independent? (www.reddit.com via reddit) Hi all, Trying to work out the cleanest route to sitting the Claude Certified Architect – Professional exam. Registration appears to run through the Anthropic Partner Academy, which is tied to the Claude Partner Network, so I'm figuring ou…
RAG-HAR+: Towards Cost-Efficient LLM-Based Human Activity Recognition for Edge Deployment (arxiv.org) Human Activity Recognition (HAR) from wearable sensors supports applications in healthcare, rehabilitation, fitness tracking, and smart environments. Yet, existing deep learning approaches require dataset-specific training, large labeled c…
Which RAG Paradigm Wins at Scale? A Scaling Study of Retrieval-Augmented Generation Paradigms (arxiv.org) Retrieval-augmented generation (RAG) methods range from lexical and dense retrieval to graph-based indexing and agentic search. They are usually evaluated on different benchmarks at one corpus size, leaving their accuracy-cost scaling uncl…
CMT-RAG: Complementary Memory Traces for Multi-turn Multi-hop RAG (arxiv.org) Multi-turn information-seeking conversations require both multi-hop reasoning and long-range dependency tracking across turns. However, existing RAG systems typically represent conversational memory as raw dialogue history, rewritten queri…
FinCacheServe: Dependency-Consistent Answer Reuse for Cost-Efficient RAG Serving over Mutable Enterprise Documents (arxiv.org) Retrieval-augmented generation services over mutable enterprise documents repeatedly execute semantically equivalent analysis requests. Answer reuse can remove GPU-bound generation work, yet response caches require dependency consistency w…
JKO-RAG: Distributional Retrieval as Wasserstein Free-Energy Gradient Flow (arxiv.org) RAG pipelines return a \emph{ranked list} of passages. We argue this is a mismatch: the downstream language model conditions on a \emph{set}, and the selection problem is fundamentally geometric.
FinAbstain: Uncertainty-Calibrated Multimodal RAG for Selective Financial Forecasting (arxiv.org) Large language models (LLMs) can synthesize financial narratives but may express high confidence when evidence is sparse, stale, or contradictory. This failure is especially consequential in forecasting, where filings, news, prices, volume…
Beyond Factual Accuracy: Evaluating Global Reasoning Integrity in RAG Systems with LogicScore (arxiv.org) Current evaluation methods for Retrieval Augmented Generation (RAG) suffer from \textit{factual myopia}: they relentlessly emphasize factual accuracy yet neglect global logical integrity in long-form answer generation. This drives models t…
Comparing RAG and GraphRAG for Page-Level Retrieval Question Answering on a Math Textbook (arxiv.org) Large language models (LLMs) show promise as educational aids but often lack alignment with specific course materials. We investigate Retrieval-Augmented Generation (RAG) and GraphRAG for page-level question answering on an undergraduate m…
From Naive RAG to Deep Agentic Retrieval: An Evolving Context Engineering Pipeline for Regulatory Compliance (arxiv.org) Retrieval-augmented generation (RAG) is the dominant paradigm for applying large language models (LLMs) to enterprise document corpora, yet naive implementations encounter hard limits as corpus scale and query complexity grow. This paper t…
Three Sides of Retrieval: Factorial Evidence for Document-Side, Query-Side, and Answer-Side Complementarity in RAG (arxiv.org) RAG systems rely on chunking, which destroys structural information in documents. Existing heading-based retrieval (Jeong et al., 2025) requires multiple LLM calls per document and returns sub-chunks within matched sections.
VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents (arxiv.org) Visually-rich documents such as reports, slides, and manuals often distribute the evidence needed to answer a question across multiple pages, mixing text with layout cues, tables, charts, and figures. This work studies multimodal retrieval…
ScalableRAG: High-Quality RAG at Zero Ingestion Cost (arxiv.org) Recent advances in RAG aim to optimize for performance by paying high ingestion costs for knowledge ingestion: building knowledge graphs or extracting SQL tables. In this work we show that the operations that such knowledge bases allow can…
Is RAG worth doing instead of feeding documents into a project? (www.reddit.com via reddit) I'm trying to learn the philosophy of an author about piano technique which is across 5-6 heavy dense books. It's really dense and difficult and needs an intelligence that connects all the dots across dense pages and books.
A corrective agentic hybrid RAG and an operations-grounded evaluation for a scientific facility (arxiv.org) Scientific user facilities accumulate decades of operational knowledge that no single search index covers: electronic logbooks, technical documents, internal wikis, operations chat messages, maintenance records, and live control-system dat…
Evaluating RAG for French immigration law: a benchmark and baseline study (arxiv.org) International recruitment in France requires navigating a layered legal framework absent from existing legal AI benchmarks. We present a publicly available benchmark and first comparative evaluation for this domain, covering permit-type re…
VecTree-RAG: An Agentic Retrieval-Augmented Generation Framework Combining Vector and Tree Retrieval for Efficiency and Accuracy (arxiv.org) Scientific question answering requires a retrieval system to solve two distinct problems: identifying which papers are relevant and locating the supporting evidence within those papers. Conventional retrieval-augmented generation typically…
EviBack: Search-Agent Reinforcement Learning via Evidence-Constrained Teacher Backoff (arxiv.org) Reinforcement learning enables Agentic RAG systems to learn multi-turn search from verifiable outcome rewards, but all- zero rollout groups provide no comparative signal and may hide useful search behavior. We present EviBack, an evidence-…
MPR-CiteG: Enhancing RAG with Multi-Portfolio Retrieval and Citation-Grounded Generation (arxiv.org) This paper presents the MPR-CiteG framework, which achieved second place in the ScienceON AI Challenge by addressing two fundamental challenges in generative AI: inefficient retrieval and the absence of source verification. We propose a du…
Reason Before You Retrieve: Agentic Planning for Multi-modal RAG (arxiv.org) Multimodal retrieval-augmented generation (mRAG) aims to answer image-text queries with external knowledge, but most existing systems still retrieve directly from raw multimodal input over a flat evidence space. This design often struggles…
HyCE-RAG: Hypergraph Chain-of-Evidence Retrieval-Augmented Generation for Explainable Multi-hop Question Answering (arxiv.org) Multi-hop question answering requires systems to retrieve evidence from multiple documents and connect scattered facts into a coherent reasoning process. Standard retrieval-augmented generation (RAG) mainly relies on semantic similarity be…
SCAIR: Schema-Conditioned Agentic Iterative Reasoning for Enterprise Knowledge Graphs (arxiv.org) Knowledge Graph-based Retrieval-Augmented Generation (KG-RAG) enables natural language interaction with structured enterprise knowledge, yet existing agentic approaches that perform well on public benchmarks often fail to generalize to rea…
Agent-UCT: Upper Confidence Bounds Applied to Trees for Agentic Workflow Optimization with Cost-Awareness (arxiv.org) Optimizing agentic workflows, such as retrieval-augmented generation (RAG) pipelines, requires navigating a combinatorial space of discrete component choices under tight evaluation budgets. Existing approaches - heuristic search, black-box…
TokenMem: Faithful Knowledge Injection for Frozen LLMs (arxiv.org) Retrieval-augmented generation (RAG) enhances large language models (LLMs) with external knowledge, but suffers from knowledge conflicts: when retrieved information contradicts parametric memory, the shared self-attention pathway produces…
When Should Active RAG Retrieve? A Budget-Aware Evaluation of Utility, Calibration, and Cost (arxiv.org) Active RAG systems decide when to retrieve external knowledge during generation, making them a budget-sensitive case of agentic RAG and self-adaptive retrieval. Yet evaluations often leave the operating point underspecified: two systems ma…
Does Faithfulness-Guided Alignment Hurt Accuracy? Unlocking Accurate and Faithful Post-Retrieval Reasoning (arxiv.org) Retrieval-augmented generation (RAG) can achieve strong answer accuracy on multi-hop questions, but outcome-level rewards often leave reasoning traces weakly grounded and difficult to audit. Under noisy retrieval, models may exhibit right-…
Language-Routed RAG and Direct Option Scoring for Multilingual Financial QA: DS@GT at FinMMEval (arxiv.org) We present DS@GT's submission to FinMMEval 2026 Task 1, a multilingual financial exam question answering benchmark spanning English, Spanish, Greek, Chinese, and Hindi. Financial certification exams such as the CFA, EFPA, and CPA demand st…
Structure Over Scale: Schema-Constrained Causal Graphs for RAG (arxiv.org) Graph-based retrieval-augmented generation (GraphRAG) grounds answers in structured knowledge, but current systems extract entities and relationships exhaustively, producing graphs whose size and construction cost scale with corpus length…
Cross-Attention Calibrated Deduplication for Retrieval-Augmented Generation System (arxiv.org) Common chunking strategies in Retrieval-Augmented Generation (RAG) systems often create redundant chunks. These redundant chunks make the vector database bigger and slow down retrieval.
I built my Claude Harness a real database memory system and I think it's pretty cool but also could be mild AI psychosis. (www.reddit.com via reddit) When Anthropic ended OpenClaw usage through subscriptions, I built my own harness/OS that (mostly) uses the Claude Agent SDK. I’ve gone fairly deep (maybe too deep) on the memory layer, trying to build something more capable than a markdow…
SURE-RAG: Sufficiency and Uncertainty-Aware Evidence Verification for Selective Retrieval-Augmented Generation (arxiv.org) Retrieval-augmented generation (RAG) grounds answers in retrieved passages, yet relevance does not guarantee sufficiency: a topical passage may still fail to justify the answer. We study evidence sufficiency verification for selective RAG…
Towards Trustworthy and Cost-Efficient Data Integration: From Na\"ive RAG to Agentic RAG (arxiv.org) Large language models (LLMs) and AI agents have demonstrated strong potential for data integration in zero-shot and few-shot settings. However, they continue to face significant accuracy and cost challenges in enterprise environments due t…
Decoupled Attention Fusion: Accelerating RAG with Efficient KV Cache Reuse (arxiv.org) Retrieval-Augmented Generation (RAG) effectively mitigates hallucinations in Large Language Models (LLMs) but suffers from prohibitive Time-To-First-Token (TTFT) latency in long-context scenarios. Reusing pre-computed document KV caches ad…
Trajectory-Aware Retrieval Agents for Temporal Decision- Making (arxiv.org) We study the problem of decision-making from long-form, temporally structured text using large language model (LLM) agents. Standard retrievalaugmented generation (RAG) pipelines fragment chronological context into isolated snippets, disca…
TopoGuard: Graph Theory Based Defenses Against Split-Knowledge Attacks on RAG (arxiv.org) Production Retrieval Augmented Generation (RAG) systems rely on aggregating multiple external documents to answer complex queries. However, the retrieved documents introduce a new threat surface that can be exploited to launch split-knowle…
PennySynth: RAG-Driven Data Synthesis for Automated Quantum Code Generation (arxiv.org) The growing complexity of quantum programming frameworks has exposed a critical limitation in existing large language model (LLM)-based code assistants: general-purpose models hallucinate PennyLane-specific gate names, misplace device conf…
TeaRAG: A Token-Efficient Agentic Retrieval-Augmented Generation Framework (arxiv.org) Retrieval-Augmented Generation (RAG) utilizes external knowledge to augment Large Language Models' (LLMs) reliability. For flexibility, agentic RAG employs autonomous, multi-round retrieval and reasoning to resolve queries.
GRADRAG: Cross-Component Prompt Adaptation for Coordinated Multi-Agent RAG (arxiv.org) Retrieval-Augmented Generation (RAG) systems increasingly employ multiple LLM agents. Yet, most prior work optimizes components in isolation rather than coordinating improvements across the pipeline.
Optimizing Hypergraph-Based RAG: Toward Better Fact Extraction and Chunk Retrieval (arxiv.org) GraphRAG enables deeper reasoning by structuring knowledge as graphs but struggles with n-ary facts. HyperGraphRAG uses hypergraphs for richer semantics, improving accuracy, yet relies on error-prone LLM extraction and inefficient standard…
GraphContainer: A Unified Platform for Comparing and Debugging Graph RAG Methods (arxiv.org) Graph RAG mitigates hallucinations and stale knowledge in LLMs, particularly for multi-hop question answering. However, existing approaches remain highly fragmented and incompatible.
Projects went from RAG to CAG today? (www.reddit.com via reddit) Hi all, currently on holiday I had a quick work assignment to do and I opened projects and then realized that the "resources/files" completely disappeared for a message at the bottom of the screen that reads something like "everything in t…
I built an MCP server that syncs knowledge, skills and hooks across Claude Code, Codex CLI, Kiro and OpenCode (extensible to any MCP-capable agent) — not just a wiki (www.reddit.com via reddit) Between work and hobby projects I use Claude Code, Codex CLI, Kiro and OpenCode — I like all of them and often switch between them depending on their strengths and availability. The problem, though, is always the same: every session starts…
M-RAG: Semantic Key-Value Indexing for Retrieval-Augmented Generation (arxiv.org) Retrieval-augmented generation (RAG) turns external documents into evidence for large language models. In practice, this is also a data access problem: a system must decide what to index, what to retrieve, and what evidence to place in the…
Vector Search As Nearest Neighbor Matching: RAG-based Policy Learning in Causal Inference (arxiv.org) We propose one-step and two-step methods for policy learning with retrieval-augmented generation (RAG). We formulate RAG-based action selection under the potential outcome framework.
Retromorphic Testing with Hierarchical Verification for Hallucination Detection in RAG (arxiv.org) Large language models can still hallucinate in retrieval-augmented generation (RAG), producing claims that are unsupported by or conflict with the retrieved context. Detecting such errors remains challenging when faithfulness is judged sol…
FinSAgent: Corpus-Aligned Multi-Agent RAG Framework for Evidence-Grounded SEC Filing Question Answering (arxiv.org) Financial question answering over U.S. Securities and Exchange Commission (SEC) filings requires retrieving and synthesizing heterogeneous evidence dispersed across long, standardized, and highly redundant disclosures.
Salience Induction against Multi-Hop RAG Agents: Threat and Defense (arxiv.org) Agentic retrieval-augmented generation (RAG) systems increasingly retrieve external evidence and orchestrate tools for knowledge-intensive applications. In Multi-Hop question answering, agents chain facts across documents.
RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation (arxiv.org) Small-scale language models (SLMs) are attractive for retrieval-augmented generation (RAG) in resource-constrained settings, but their limited capacity makes them highly sensitive to noisy or spurious retrieved evidence. Existing preferenc…
Does RAG Know When Retrieval Is Wrong? Diagnosing Context Compliance under Knowledge Conflict (arxiv.org) Retrieval-Augmented Generation (RAG) is usually evaluated by whether the final answer is correct. Under knowledge conflict, this hides a key question: did the model follow retrieved evidence, rely on its parametric prior, or produce a post…
From Evidence to Trajectory: Abductive Reasoning Path Synthesis for Retrieval-Augmented Generation Agents Development (arxiv.org) Retrieval-augmented generation (RAG) agent development is hindered by the lack of executable ground-truth agent-environment interaction trajectories. Existing datasets provide questions, answers, and evidence, but lack fine-grained supervi…
SmartRAG: Native Graph-Based RAG for Mobile Device (arxiv.org) Deploying large language models (LLMs) as personal assistants on mobile devices demands privacy, low latency, and offline availability, yet the computational cost of giant models clashes with strict edge-hardware budgets. We argue that thi…
TurboVec: A Case Study in Cost-Efficient Private Retrieval for Enterprise RAG via Codebook-Oblivious Quantization (arxiv.org) Retrieval-Augmented Generation (RAG) systems increasingly power enterprise LLM applications, yet the vector retrieval layer introduces two underexplored challenges: (1) trained codebook quantizers may expose corpus statistics during index…
Semantically Similar, Logically Distinct: Diagnosing the Semantic-Answerability Gap in Table RAG (arxiv.org) Tables are a critical knowledge source in retrieval-augmented generation (RAG), but a retrieved table may lack sufficient evidence to answer a query, a property we call answerability. While answerability broadly concerns whether a source o…
I built a project that runs 100s of experiments to improve my RAG pipeline overnight (www.reddit.com via reddit) Inspired by Andrej Karpathy's autoresearch, I built autoretrieval to apply the same idea to RAG optimization. The project gives Claude Code a RAG pipeline, an evaluation dataset, and a target metric.
Neatest solution for persistent memory / RAG via Claude Code? (www.reddit.com via reddit) I have plenty of knowledge bases that I want CC to refer to at times for decision making. Separately, I'm also using it as a second-brain intelligence layer for organizing/prioritizing my todos and stuff.
Wyrdtale - A free game engine created for Claude via MCP (www.reddit.com via reddit) I've always really enjoyed TTRPGs and, like many others, saw the potential for LLMs to act as a DM. However, anyone that's used some of these knows they're prone to forgetting everything, or just use RAG, or require wikis to be pre-written…
When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge? (arxiv.org) The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content du…
Learning Engagement Assistant (LEA): Cross-Course Scalability and Classroom Evaluation of an Agentic AI Tutoring System (arxiv.org) This paper is an extension of a paper presented at the ICAART 2026 conference, which introduced LEA (Learning Engagement Assistant), an adaptive AI tutoring agent combining course-specific Retrieval-Augmented Generation (RAG) with structur…
What are you using today for persistent context/memory for Claude? (www.reddit.com via reddit) I’m researching how teams are solving the “context problem” with AI (coding) agents. One thing I keep seeing is that the limiting factor is not generating code anymore.
Cost-Governed RAG: Unified Per-Tenant Cost Attribution Across Retrieval and Generation in Multi-Tenant LLM Systems (arxiv.org) Enterprise Retrieval-Augmented Generation (RAG) deployments face a critical governance gap: while LLM generation cost is metered per token, the retrieval layer - vector memory, similarity compute, and embedding API calls - remains an unatt…
Transforming LLMs into Efficient Cross-Encoders via Knowledge Distillation for RAG Reranking (arxiv.org) Cross-encoders achieve high reranking accuracy in Retrieval-Augmented Generation (RAG) pipelines but impose quadratic inference costs that limit real-time deployment. We address this by fine-tuning LLaMA 3 (8B) as a drop-in reranker using…
Trust Before Fusion: QIMG-7 and Source-Aware Resolution for Polluted Multimodal RAG (arxiv.org) Multimodal retrieval-augmented generation (RAG) is often evaluated with clean evidence, yet real retrieval can return topically relevant but unreliable content: false text and misleading images from corrupted metadata, entity swaps, typogr…
Eval-Pair Matrix: Answer-Paired Meta-Evaluation of LLM Judges for Grounded RAG (arxiv.org) LLM-as-a-judge evaluation is widely used for retrieval-augmented generation (RAG), but reusing the same model family as both generator and judge makes self-leniency difficult to identify. We introduce Eval-Pair Matrix, a controlled meta ev…
MG$^2$-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generation (arxiv.org) Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while…
HiQA: A Hierarchical Contextual Augmentation RAG for Multi-Documents QA (arxiv.org) Retrieval-augmented generation (RAG) has rapidly advanced the language model field, particularly in question-answering (QA) systems. By integrating external documents during the response generation phase, RAG significantly enhances the acc…
GRASP: GRanularity-Aware Search Policy for Agentic RAG (arxiv.org) Agentic retrieval-augmented generation (RAG) extends static RAG by allowing language models to iteratively reason, generate search queries, retrieve evidence, and predict answers. However, it remains challenging for models to decide when t…
AgentKGV: Agentic LLM-RAG Framework with Two-Stage Training for the Fact Verification of Knowledge Graphs (arxiv.org) Knowledge graphs (KGs) are often automatically constructed from large-scale corpora, but they inevitably contain factual errors due to noisy sources and extraction failures, and verifying them reliably at industrial scale remains a critica…
Augmenting Fundamental Analysis with Large Language Models: A RAG-Based System for Generating Investor Briefs (arxiv.org) In this study, we examine the opportunities brought by Large Language Models (LLMs) to various aspects of fundamental analysis of companies based on their reports as well as data and documents describing macroeconomic situation like GDP an…
Sonnet 5 was supposed to be cheaper. It cost me more than Fable 5 (www.reddit.comhttps) Tested Claude Sonnet 5 and Fable 5 on two coding tasks. One was a RAG Debugger added inside the 400K line Open WebUI repo.
PolyUQuest: Verifiable Structure-Aware Web RAG over Heterogeneous Graphs (arxiv.org) Existing retrieval-augmented generation (RAG) systems treat web pages as flat text, losing the structural and semantic signals encoded in HTML. We present PolyUQuest, a verifiable, structure-aware web RAG framework built on a heterogeneous…
Anyone with PowerPoint tips (www.reddit.com via reddit) Following the other persons post about “smells like hand waving”… I get that opus writing is insufferable. I’ve used skills and even rag to force a human-like cadence and planning /purpose workflow.
How do Claude Projects actually work under the hood? (Projects vs. Claude Code/Local folders) (www.reddit.com via reddit) Hey everyone, I'm trying to wrap my head around how Claude Projects function on a technical level and could use some clarity. Specifically, what's going on when you upload a knowledge base?
Context Graphs for Proactive Enterprise Agents (arxiv.org) Retrieval-Augmented Generation (RAG) and agentic frameworks have advanced enterprise AI considerably, yet agents remain fundamentally reactive: they wait for a human query before acting. This paper argues that genuine enterprise productivi…
DeepTutor: Towards Agentic Personalized Tutoring (arxiv.org) Education is one of the most promising real-world applications for Large Language Models (LLMs). However, current LLMs rely on static pre-training knowledge and lack adaptation to individual learners, while existing RAG systems fall short…
Evaluating RAG Metrics in Applied Contexts: An Experiment, Its Findings and Its Limitations (arxiv.org) This paper reports an empirical study evaluating the relevance of several RAG metrics. The experiment is based on a question-answering dataset created by human annotators from business data.
End-to-End LLM Flight Planning with RAG-based Memory and Multi-modal Coach Agent (arxiv.org) Bridging the gap between human pilot intent and autonomous flight operation is critical for real-world electric vertical takeoff and landing (eVTOL) aircraft deployment. Flight planning traditionally relies on classic algorithms that strug…
Quantifying Retriever-Generator Alignment in RAG with Local Explanations (arxiv.org) Retrieval-Augmented Generation (RAG) systems combine dense retrievers and language models to ground their outputs in external documents. However, the interaction between these components remains opaque, creating challenges for deployment i…
Modality Relevance is not Modality Utility: Post-hoc Selective Modality Escalation for Cost-Aware Multimodal RAG (arxiv.org) Multimodal retrieval-augmented generation (RAG) grounds a generator in evidence drawn from heterogeneous modalities -- text, tables, and images. The dominant deployment choice is binary and made before the model has tried to answer: either…
CHARLIE: An On-Premise Multi-Agent Retrieval-Augmented Generation System for Evidential Reasoning in Forensic Science (arxiv.org) We present Charlie, an on-premise multi-agent Retrieval-Augmented Generation (RAG) system for structured evidential processing in digital forensic environments. Contemporary forensic workflows must handle large volumes of heterogeneous and…
My Tiro Memory Framework is finally complete! (www.reddit.com via reddit) Months of iterations and 3 development versions and it's finally ready. The Tiro LLM Memory Framework.
What I haven’t made with Fablo (www.reddit.com via reddit) Due to the guardrails, I’ve never been able to run start to finish in a session without triggering the safety and switching to opus. This is across platforms and without custom instructions + clean Claude.md… heres all the things that were…
When is GraphRAG actually worth it for AI agents? (www.reddit.com via reddit) I’ve been going back and forth on where GraphRAG actually makes sense in agent setups. Most of what I’ve built or seen still uses pretty standard RAG: chunk stuff up, embed it, grab the top results, feed them to the model, and hope it pull…
Knowing When Not to Answer: Lightweight KB-Aligned OOD Detection for Safe RAG (arxiv.org) Retrieval-Augmented Generation (RAG) systems are increasingly deployed in high-stakes domains, where safety depends not only on how a system answers, but also on whether a query should be answered given a knowledge base (KB). Out-of-domain…
MIRAGE: Defending Long-Form RAG Against Misinformation Pollution (arxiv.org) Retrieval-Augmented Generation (RAG) improves factuality by grounding LLMs in external evidence, but real-world retrieval is often polluted: semantically relevant passages may contain subtle misinformation, misleading framings, or fabricat…
Memory-Orchestrated Semantic System (MOSS): An Auditable Agentic Memory Architecture (arxiv.org) Long-term memory remains a structural weakness of AI agents. The dominant approach, retrieval-augmented generation (RAG), relies on embedding-based similarity search, which is opaque by construction, difficult to audit, and bounded by the…
Candidate-Constrained Retrieval-Augmented Generation for LongEval-RAG: System Design and Empirical Analysis (arxiv.org) We present a candidate-constrained retrieval-augmented generation system for LongEval-RAG, where each query is associated with an organizer-provided candidate set and all retrieved evidence and final citations must remain within that set.…
Distill Where the Student Goes: Teacher-Regularized RL for English-Evidence Cross-Lingual RAG (arxiv.org) Cross-lingual retrieval-augmented generation (RAG) is often deployed in an English-evidence regime, where users query in diverse languages but retrieved passages remain English. In this setting, generation can fail despite strong base mode…
Risk-Constrained Freshness-Aware Semantic Caching for Open-Web Retrieval-Augmented LLMs (arxiv.org) Semantic caching reduces the latency and cost of retrieval-augmented generation (RAG) by serving cached answers to semantically similar queries, but most existing methods do not model the time-varying freshness of open-web evidence. We pre…
Probe, Don't Prompt: A Hidden-State Probe for Metadata Filtering in Multi-Meta-RAG (arxiv.org) Multi-Meta-RAG improves retrieval for multi-hop question answering by filtering a vector store on metadata (the news source) that it extracts from each query by prompting gpt-3.5-turbo. We show this proprietary, free-form extractor can be…
Next-Gen Sponsored Search: Crafting the Perfect Query with Inventory-Aware RAG (InvAwr-RAG) Based GenAI (arxiv.org) Sponsored search plays a crucial role in e-commerce revenue generation, where advertisers strategically bid on keywords to capture the attention of users through relevant search queries. However, the process of identifying pertinent keywor…
A Failure-Mode Benchmark for Polymorphic Sybil Poisoning in RAG (arxiv.org) We release a benchmark and failure-mode-aware evaluation framework for grounded QA under coordinated retrieval poisoning. The framework partitions reader outputs into four mutually exclusive categories (\emph{gold}, \emph{hijack}, \emph{ab…
Unpaid AI Automation Work (www.reddit.com via reddit) Hi everyone, I build AI automation and workflow tools. I've spent the last three months teaching myself these tools and doing personal mini-projects along the way to learn.
It’s a Karpathy pattern for building a personal wiki maintained by an LLM (gist.github.com via reddit) It’s a Karpathy pattern for building a personal wiki maintained by an LLM, instead of traditional RAG. The key difference: in RAG the LLM rediscovers everything from scratch on every question; here the LLM incrementally builds and maintain…
I built a free MCP server so your Claude can read Claude/Anthropic news (+ browser-side crowd-RAG) (www.reddit.com via reddit) Hey all — I run claudenews.online, an independent (not Anthropic-affiliated) site that tracks Claude & Anthropic news in real time, summarized by Claude itself. Things this sub might actually find useful: MCP connector: claude mcp add --tr…
Semantic search isn’t being used / isn’t in agent toolset? (www.reddit.com via reddit) I can’t seem to find any evidence during my agent runs that they are using semantic search (vector search, RAG, etc). I’m using the Cursor Editor similar to VSCode.
AgenticRAGTracer: A Hop-Aware Benchmark for Diagnosing Multi-Step Retrieval Reasoning in Agentic RAG (arxiv.org) With the rapid advancement of agent-based methods in recent years, Agentic RAG has undoubtedly become an important research direction. Multi-hop reasoning, which requires models to engage in deliberate thinking and multi-step interaction,…
BLAgent: Agentic RAG for File-Level Bug Localization (arxiv.org) Bug localization remains a key bottleneck for large language model (LLM)-based software maintenance, where accurately identifying faulty code is essential for debugging, root cause analysis, triage, and automated program repair (APR). File…
Optimizing RAG Rerankers with LLM Feedback via Reinforcement Learning (arxiv.org) Rerankers play a pivotal role in refining retrieval results for Retrieval-Augmented Generation. However, current reranking models are typically optimized on static human annotated relevance labels in isolation, decoupled from the downstrea…
Beyond Document Grounding: Span-Level Hallucination Detection over Code, Tool Output, and Documents (arxiv.org) Hallucination detection for retrieval-augmented generation (RAG) is usually evaluated on natural-language document evidence. However, grounded generation systems increasingly rely on structured inputs: source code, developer-tool output, m…
What Survives Into Context: A Diagnostic for Budget-Constrained Multi-Hop RAG and When Submodular Evidence Packing Improves It (arxiv.org) Retrieval-augmented generation (RAG) under a fixed reader-context budget forces a selection problem: of the evidence retrieved, only a fraction can be shown to the reader. We argue that document recall -- the standard retrieval metric -- i…
Towards Developing a Multimodal Chat Assistant for University Stakeholders: RAG-based Approach (arxiv.org) University stakeholders often face difficulties in accessing timely and reliable information, especially in developing countries, where there are very few intelligent support systems. Existing rule-based chatbots are unable to handle compl…
Aligning Sentence Embeddings to Human Concepts via Sparse Autoencoders (arxiv.org) Dense sentence embeddings are fundamental to modern Retrieval-Augmented Generation (RAG) systems but suffer from a lack of interpretability due to feature superposition. This opacity hinders the alignment of retrieval processes with human…
GRACE-RAG: Governed Retrieval Architecture for Canonical Evidence Synthesis, Enabling Lightweight Deployment in Closed-Domain Institutional Settings (arxiv.org) Retrieval-Augmented Generation (RAG) systems are widely used in institutional question answering settings where responses must be grounded in authoritative documentation (Gao et al., 2023). In entity-dense domains where relevant informatio…
PRA-RAG: Provably Robust Aggregation in Retrieval-Augmented Generation against Retrieval Corruption (arxiv.org) Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge, effectively mitigating their inherent knowledge limitations. However, RAG remains vulnerable to poisoning attacks that manipula…
Bayesian Uncertainty Propagation for Agentic RAG Pipelines: A Proof-of-Concept Study on Multi-Hop Question Answering (arxiv.org) Trustworthy deployment of Agentic Retrieval-Augmented Generation (RAG) systems requires mechanisms for estimating when multi-stage reasoning pipelines may fail. This paper presents an uncertainty-aware Agentic Retrieval-Augmented Generatio…
CORTEX: Token-Level Hallucination Detection in RAG via Comparative Internal Representations (arxiv.org) In this paper, we propose CORTEX, a token-level hallucination detection method for Retrieval-Augmented Generation (RAG). In long-form RAG outputs, hallucinations often arise in localized spans rather than throughout an entire response.
One Retrieval to Cover Them All: Co-occurrence-Aware Knowledge Base Reorganization for Session-Level RAG (arxiv.org) RAG systems retrieve documents optimized for answering one query at a time. Yet enterprise users arrive with sessions, that is, coherent episodes of related questions that span semantically distant parts of the knowledge base.
Agentic RAG-VLM: Affordance-Aware Retrieval-Augmented Generation with Self-Reflective Planning for Robotic Grasping (arxiv.org) Generalizable robotic grasping in cluttered environments is essential for deploying manipulators in unstructured human spaces, yet existing VLM-based methods rely on visual similarity for object matching, neglecting physical affordances su…
Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAG (arxiv.org) Beyond the Reranker: Do RAG Retrieval Enhancements Help Once a Strong Reranker Is Present? (arxiv.org) Retrieval-augmented generation (RAG) is routinely extended with methods meant to improve retrieval: query expansion, hierarchical and cross-document summarization, graph-based expansion, per-query routing, rank fusion, and corrective re-re…
CAMI: Cost-Aware Agent-Guided Multi-Indexing for Semantic Retrieval (arxiv.org) RAG ingestion pipelines frequently augment search corpus index with semantic enrichment indices (e.g., synthetic queries or summaries generated from corpus chunks) that are subsequently queried alongside the base index to improve retrieval…
ConCise: Training-Free Conclusion-Chain State Compression for Cost-Efficient Multi-Step RAG Services (arxiv.org) Multi-step retrieval-augmented generation (RAG) has been widely deployed as LLM-powered web services for complex question answering, where iterative retrieval-reasoning rounds deliver strong multi-hop accuracy. However, this paradigm cause…
Carolina Guide: A Multi-Agent RAG System with Institutional Guardrails for Academic Policy Assistance (arxiv.org) University students often struggle to navigate complex academic policies, leading to advising bottlenecks and delayed access to critical information. Although large language models (LLMs) offer promise for automated assistance, their tende…
Diagnosing and Repairing Factual Errors in RAG under Budget Constraints (arxiv.org) Retrieval-Augmented Generation (RAG) improves the factuality of large language models by grounding responses in external evidence, yet real-world deployments remain fragile. Failures often stem from missing or weakly relevant evidence, as…
Sustainable Hybrid Document-Routed Retrieval for Financial RAG: Resolving the Robustness-Precision Trade-off (arxiv.org) Retrieval-Augmented Generation (RAG) systems for financial document QA typically follow a chunk-based paradigm: documents are split into fragments, embedded, and retrieved by similarity. In structurally homogeneous corpora such as regulato…
Deterministic Decisions for High-Stakes AI. A Zero-Egress Pipeline with the Deployability of RAG and the Accuracy of Machine Learning (arxiv.org) We identify intervention bias as a previously unquantified failure mode of zero-shot large-language-model (LLM) educational advisory agents: without task-specific training, they recommend action when a hindsight-optimal oracle policy manda…
How Do LLMs Cite? A Mechanistic Interpretation of Attribution in Retrieval-Augmented Generation (arxiv.org) Retrieval-Augmented Generation (RAG) aims to enhance the trustworthiness of Large Language Models (LLMs) by grounding their outputs in external documents, often using inline citations for verifiability. However, the faithfulness of these c…
Sifei at SemEval-2026 Task 8: Hybrid Retrieval and Query Rewriting for Multi-Turn RAG (arxiv.org) Multi-turn retrieval-augmented generation (RAG) is challenging due to evolving user intent, conversational noise, and strict context limits. We propose a training-free hybrid retrieval pipeline for SemEval-2026 Task 8 that combines dense a…
The Interference Gap: Comparing Retrieval Bounds in Human Memory and RAG Systems (arxiv.org) How do retrieval bounds compare between human episodic memory and Retrieval-Augmented Generation (RAG) systems under semantic interference? We present a unified signal detection theory (SDT) framework that applies to both, and use it to fi…
Regime-Aware Peer Specialization for Robust RAG under Heterogeneous Knowledge Conflicts (arxiv.org) Retrieval-augmented generation (RAG) improves language models by grounding generation in external context. However, it can be fragile when the retrieved context conflicts with the model's parametric knowledge.
MemDelta: Controlled Baselines and Hidden Confounds in Agent Memory Evaluation (arxiv.org) Agent memory systems are increasingly evaluated against RAG and full-context baselines, but reported gains often mix changes in the memory method with changes in the language model, embedding model, or retrieval pipeline, making it unclear…
AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering (arxiv.org) Retrieval-Augmented Generation (RAG) has become the standard way to ground large language models in external knowledge, yet most systems retrieve a fixed number of passages for every question regardless of its difficulty. This wastes compu…
5ting at SemEval-2026 Task 8: Strong End-to-End Multi-Turn RAG via LLM-Based Reranking and Faithfulness Control (arxiv.org) We introduce 5ting, our system for the SemEval2026 Task 8 (MTRAGEval), which evaluates multi-turn Retrieval Augmented Generation (RAG) systems. Multi turn RAG involves context drift, under specification, and hallucination risk.
Looking for AI/GenAI freelance projects. (www.reddit.com via reddit) I work primarily with Python, FastAPI, LangChain, Azure OpenAI, AWS, vector databases, and modern LLM workflows. Recent work has included: • RAG applications • AI agents with tool calling • Enterprise document search • Ticket classificatio…
Freshness and the Limits of Heuristic Trend Detection in Temporal RAG (arxiv.org) We present a lightweight, model-agnostic temporal layer for RAG and use cybersecurity data to separate two problems that are usually conflated. For freshness, a half-life recency prior surfaces the newest relevant item where a cosine-only…
SHARD: cell-keyed residual splitting for alignment-resistant private dense retrieval (arxiv.org) Dense embeddings underpin semantic search and RAG, yet a leaked vector store hands much of the underlying text back to whoever holds it. The attacks that make this possible (few-shot alignment, zero-shot inversion, unsupervised cross-space…
What does Claude artifacts do to computes, context cluttering, and token consumption? (www.reddit.com via reddit) In Claude, when I am working on an article or code as a Claude artifact, will the produced Word document or Python code be used and embedded in every single message, cluttering the context and acting as context tokens? Or will the artifact…
Eyes-on-Me: Scalable RAG Poisoning through Transferable Attention-Steering Attractors (arxiv.org) Existing data poisoning attacks on retrieval-augmented generation (RAG) systems scale poorly because they require costly optimization of poisoned documents for each target phrase. We introduce Eyes-on-Me, a modular attack that decomposes a…
MIRROR: Novelty-Constrained Memory-Guided MCTS Red-Teaming for Agentic RAG (arxiv.org) Multimodal agentic retrieval-augmented generation (RAG) systems expand the attack surface beyond prompt injection to include text poisoning, image injection, direct-query attacks, and orchestrator-level tool manipulation. Existing red-team…
Temporal Validity in Retrieval Memory: Eliminating Stale-Fact Errors for AI Agents over Evolving Knowledge (arxiv.org) Retrieval-augmented generation (RAG) gives agents access to accumulated knowledge, but has no model of time. When a fact changes (e.g., a function is renamed or API restructured), RAG retrieves both the stale and current value with near-id…
Fast medical RAG API to give your local LLMs access to facts (www.reddit.com via reddit) I created a simple RAG API using medical Wikipedia articles that you can point your agent to and use freely. It may be useful in allowing your local LLMs access to medical facts they might not be able to recall from their weights.
Is there a standard for porting agent state across models, or are we all writing custom wrappers? (www.reddit.com via reddit) Hey everyone, I'm fairly new to the agentic workflows space. Really interested to get into it.
Verifiable Manifest Signing and Transparency Enforcement for Secure MCP-Based LLM Pipelines (arxiv.org) Large Language Models (LLMs) are increasingly deployed in tool-driven environments such as healthcare analytics, financial systems, retrieval-augmented generation (RAG), and multi-agent workflows. Although the Model Context Protocol (MCP)…
Epistemic Bias Injection: Manipulating LLM Opinion via Selective Context Retrieval (arxiv.org) When answering user queries, LLMs often retrieve knowledge from external sources stored in retrieval-augmented generation (RAG) databases. These are often populated from unvetted sources, e.g.
CausalRAG2: Hierarchical Causal Knowledge Graph Design for RAG (arxiv.org) Retrieval augmented generation (RAG) has enhanced large language models by enabling access to external knowledge, with graph-based RAG emerging as a powerful paradigm for structured retrieval and reasoning. However, existing graph-based me…
Is GraphRAG Needed? From Basic RAG to Graph-/Agentic Solutions with Context Optimization (arxiv.org) As advanced RAG variants like GraphRAG and Agentic RAG emerge, one leading question is when and how to use them. Here, we introduce a framework for different RAG scenarios evaluation and comparison on semi-structured knowledge bases, inclu…
Memory Makes the Difference: Evaluating How Different Memory Roles Shape Conversational Agents (arxiv.org) Prior research on memory mechanism in RAG-based conversational system has emphasized how memory is stored and retrieved. However, far less is known about how memories with different functional roles influence response quality.
To Isolate or to Score? Model-Adaptive Assessment for Cost-Efficient Multi-Agent RAG (arxiv.org) Multi-agent document assessment for retrieval-augmented generation is computationally expensive, driving practitioners toward smaller, deployable models whose assessment mechanisms remain poorly understood. We conduct a controlled study of…
Project depository attachments incosistency (www.reddit.com via reddit) so you have .zip as available in Projects depository upload file attachments but Claude doesn't get it. How am I to upload whole code subdirectory structure if Project depository doesn't have any folders etc?
How to set Claude to treat uploaded project files only as RAG, and not as context? (www.reddit.com via reddit) When uploading files to Claude projects, Claude says it automatically decides to use them as context or as RAG, depending on computes exhausted. I prefer Claude not to switch between context and RAG automatically.
Privacy-Preserving RAG via Multi-Agent Semantic Rewriting: Achieving Confidentiality Without Compromising Contextual Fidelity (arxiv.org) Retrieval-Augmented Generation enhances large language models by incorporating external knowledge, but deploying it in sensitive scenarios risks privacy leakage via malicious prompts. To address this, we propose a multi-agent framework tha…
MMed-Bench-IR: A Heterogeneous Benchmark for Multilingual Medical Information Retrieval (arxiv.org) Retrieval-augmented generation (RAG) in clinical settings increasingly requires multilingual retrieval against predominantly English evidence corpora. Multilingual medical retrieval demands three capabilities: cross-lingual alignment, conc…
Quantifying Prior Dominance in RAG Systems (arxiv.org) Retrieval-Augmented Generation (RAG) grounds Large Language Models in external knowledge, yet current evaluations rely on discrete heuristics that suffer from ''epistemic blindness'' - failing to distinguish genuine contextual information…
A clean breakdown of RAG vs MCP architectures for AI Agents (www.reddit.com via reddit) Hey everyone, There is still a lot of confusion around how Retrieval-Augmented Generation (RAG) and the Model Context Protocol (MCP) fit together—specifically when a project actually warrants the engineering complexity of an agent framewor…
↯ Model Context Protocolvector-databasemodel-context-protocolrag+1
RAVEN: Agentic RAG for Automated Vulnerability Repair (arxiv.org) Automated vulnerability repair has emerged as a promising direction to mitigate the growing number of software vulnerabilities. Recent advances in Large Language Models (LLMs) have further accelerated research in automated repair.
Point-in-Time Financial RAG with Frozen LLMs and Market-Feedback Adaptive Retrieval (arxiv.org) Financial retrieval-augmented generation (RAG) systems typically rank evidence by textual relevance, but in financial markets evidence utility depends on event type, forecast horizon, and market context. We study news-triggered event-impac…
Predict the Retrieval! Test time adaptation for Retrieval Augmented Generation (arxiv.org) Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for enhancing large language models' question-answering capabilities through the integration of external knowledge. However, when adapting RAG systems to specialized d…
Look Before You Zoom: Adaptive Routing for the Resolution-Context Trade-off in Visual RAG (arxiv.org) Vision-Language Models (VLMs) struggle as query-relevant objects become smaller. To address this, recent training-free approaches dynamically retrieve and zoom into local image regions.
Predicate Importance Estimation and Decoupled Rationale-Score Distillation for Entity Alignment (arxiv.org) Knowledge graphs (KGs) are increasingly used as structured context for Large Language Models (LLMs), but industrial KG-RAG systems often need to integrate public and domain-specific KGs constructed from heterogeneous databases. This integr…
Fixed RAG Compression Collapses Measured Reader Scaling (arxiv.org) Retrieval-Augmented Generation (RAG) compression papers often evaluate a compressor on one to three readers and treat the compressed evidence layer as evaluation-neutral. We show this assumption is false: fixed compression can raise averag…
Dissecting Agentic RAG: A Component Ablation for Multi-Hop QA with a Local 7B Model (arxiv.org) Agentic retrieval-augmented generation (RAG) systems combine iterative reasoning loops, query decomposition, and adaptive retrieval to tackle multi-hop question answering. However, the contribution of each component remains poorly understo…
Defense effectiveness across architectural layers: a mechanistic evaluation of persistent memory attacks on stateful LLM agents (arxiv.org) Persistent memory attacks against LLM agents achieve high attack success rates against open-source models. In these attacks, malicious instructions injected via RAG-retrieved documents are stored in persistent memory and executed in later…
Beyond Relevance: On the Relationship Between Retrieval and RAG Information Coverage (arxiv.org) Retrieval-augmented generation (RAG) systems combine document retrieval with a generative model to address complex information seeking tasks like report generation. While the relationship between retrieval quality and generation effectiven…
From RAG to Agentic RAG for Faithful Islamic Question Answering (arxiv.org) Large Language Models (LLMs) are increasingly used for Islamic question answering, where ungrounded responses may carry serious religious consequences. Yet standard MCQ/MRC-style evaluations (MCQ: Multiple choice questions, MRC: Machine Re…
Tell Me: An LLM-powered Mental Well-being Assistant with RAG, Synthetic Dialogue Generation, and Agentic Planning (arxiv.org) We present Tell Me, a mental well-being system that leverages advances in large language models to provide accessible, context-aware support for users and researchers. The system integrates three components: (i) a retrieval-augmented gener…
When Confidence Takes the Wrong Path: Diagnosing Retrieval-State Lock-In in RAG (arxiv.org) The trustworthiness of a retrieval-augmented generation (RAG) system depends on more than the answer it returns, yet many black-box uncertainty methods still read agreement among sampled answers as confidence. That inference fails when rep…
Only Ask What You Don't Know: Grounded Delta Planning for Efficient Multi-step RAG (arxiv.org) Multi-hop question answering remains challenging for Retrieval-Augmented Generation (RAG) because existing approaches either propagate errors across iterative retrieval rounds or over-generate reasoning steps, increasing cost without impro…
$\pi$-RAG: Oblivious Retrieval via Semantic Quantization and Transcendental Addressing for Large Language Models (arxiv.org) This paper introduces $\pi$-RAG, a novel architecture for oblivious retrieval that decouples Large Language Models (LLMs) from sensitive data storage without sacrificing semantic understanding. Traditional Retrieval-Augmented Generation (R…
The Token Tax of Epistemic Accuracy: Comparing RAG and Long-Context Architectures for Document-Grounded Generative AI Applications (arxiv.org) Document-grounded assistants built on large language models are increasingly used in high-stakes, knowledge-intensive work. Their usefulness, however, may depend on how evidence is allocated before generation.
Ghost Vectors: Soft-Deleted Embeddings Remain Reconstructible in HNSW Vector Databases (arxiv.org) Retrieval-augmented generation (RAG) allows large language models to access external and private corpora for factual, domain-specific responses. Modern RAG pipelines use hierarchical navigable small world (HNSW) vector databases for effici…
Project knowledge full/exceeded on desktop/web but mobile is fine? Only able to send messages from my phone (www.reddit.com via reddit) I have a Claude project with 16, 500+ page historical documents in it. On my phone, this is not a problem and it uses the RAG project context system very effectively.
A Layered Security Framework Against Prompt Injection in RAG-Based Chatbots (arxiv.org) Prompt injection is ranked as the most critical vulnerability in large language model (LLM) deployments by the OWASP Top 10 for LLM Applications, yet existing defenses operate at isolated pipeline stages and remain incomplete. Input filter…
CATCH-ME if you RAG: a dataset of Contextually Annotated multi-Turn Counterspeech against Hate and Misinformation Exchanges (arxiv.org) Online hate speech and misinformation frequently overlap, yet NLP research has mainly treated them in isolation. While LLMs represent a scalable solution for assisting humans in the generation of counterspeech for both threats, zero-shot m…
When Does Streaming Tool Use Help? Characterizing Tool-Intent Stabilization in Streaming Retrieval-Augmented Generation (arxiv.org) Streaming Retrieval-Augmented Generation (Streaming RAG) reduces user-perceived latency by issuing tool queries in parallel with ongoing user input, before the utterance is complete. Reported gains are aggregate, yet the mechanism's benefi…
CacheWeaver: Cache-Aware Evidence Ordering for Efficient Grounded RAG Inference (arxiv.org) Retrieval-Augmented Generation (RAG) improves factual grounding, but it also lengthens prompts and raises prefill cost. Prefix caching in serving engines such as vLLM reduces this cost only when requests share the same token prefix.
AI Economist Agent: An Agentic Framework for Model-Grounded Economic Analysis with RAG, Knowledge Graphs, and Large Language Models (arxiv.org) We propose a model-grounded RAG-based AI economist with an agentic framework for economic scenario analysis using large language models (LLMs) and knowledge graphs. While LLMs can generate fluent economic narratives, economists are often r…
Configurable Clinical Information Extraction with Agentic RAG: What Works, What Breaks, and Why (arxiv.org) Patient contexts span hundreds of heterogeneous documents and thousands of structured data points, yet the document-level metadata that AI systems need for retrieval and triage is absent or incomplete. Standard retrieval-augmented generati…
Conflict-Aware Retriever Editing for Knowledge Injection Attacks on LLM-Based RAG Systems (arxiv.org) Injecting malicious knowledge into retrieval-augmented generation (RAG) systems can manipulate retrieved evidence and mislead downstream generation, posing a serious security threat for AI applications. Existing RAG injection attacks mainl…
SproutRAG: Attention-Guided Tree Search with Progressive Embeddings for Long-Document RAG (arxiv.org) Retrieval-augmented generation (RAG) systems must balance retrieval granularity with contextual coherence, a challenge that existing methods address through LLM-guided chunking, single-level context expansion, or hierarchical summarization…
PACE-RAG: Patient-Aware Contextual and Evidence-Constrained RAG for Clinical Drug Recommendation (arxiv.org) Drug recommendation requires a deep understanding of individual patient context, especially for complex conditions like Parkinson's disease. While LLMs possess broad medical knowledge, they fail to capture the subtle nuances of actual pres…
MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation (arxiv.org) While Multimodal Retrieval-Augmented Generation (M-RAG) enhances Large Vision-Language Models, it remains highly susceptible to cross-modal hallucinations, causal fabrications, and sycophancy. Furthermore, existing mitigation pipelines oft…
MolE-RAG: Molecular Structure-Enhanced Retrieval-Augmented Generation for Chemistry (arxiv.org) Large language models (LLMs) have shown promise for molecular property prediction, but their ability to reason over chemical structures remains limited, as molecular representations such as SMILES differ substantially from the natural lang…
Not All Retrievals are Useful: Cross-Attention for Input-Aware RAG in Time Series Forecasting (arxiv.org) Retrieval-augmented generation (RAG) enhances zero-shot time series (TS) forecasting by leveraging external knowledge bases, yet existing approaches overlook input-level relevance when fusing retrieved samples with the query. We argue that…
SCAR: Semantic Continuity-Aware Retrieval for Efficient Context Expansion in RAG (arxiv.org) Fixed-length chunking in Retrieval-Augmented Generation (RAG) often leads to boundary fragmentation, where critical evidence is split across segments, degrading retrieval recall. While static windowing and parent retrieval improve recall,…
TechRAG: Evidence-Gated Multimodal Agentic RAG for Technical Literature Reasoning (arxiv.org) This paper presents an agentic multimodal retrieval-augmented generation (RAG) framework for domain-specific literature reasoning, instantiated on a curated corpus of several thousand papers in intelligent tires, vehicle dynamics, vehicle…
When RAG Hurts: Diagnosing and Mitigating Attention Distraction in Retrieval-Augmented LVLMs (arxiv.org) While Retrieval-Augmented Generation (RAG) is one of the dominant paradigms for enhancing Large Vision-Language Models (LVLMs) on knowledge-based VQA tasks, recent work attributes RAG failures to insufficient attention towards the retrieve…
SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases (arxiv.org) Vector databases (VecDBs) are increasingly deployed in retrieval-augmented generation (RAG) pipelines where query processing and document ingestion occur concurrently. The index layer needs to provide low-latency search while incorporating…
MAGE-RAG: Multigranular Adaptive Graph Evidence for Agentic Multimodal RAG in Long-Document QA (arxiv.org) Long-document multimodal question answering requires a system to locate sparse evidence in long PDFs and integrate clues from text, tables, images, charts, and complex layouts. Existing RAG methods mostly rely on fixed Top-k retrieval over…
Combining Retrieval-Augmented Text Generation with LLMs for Reading Content Recommendations (arxiv.org) This work presents the design, implementation, and evaluation of a system for generating personalized reading content using Large Language Models (LLMs) combined with Retrieval-Augmented Generation (RAG). The proposed architecture consists…
CONCORD: Asynchronous Sparse Aggregation for Device-Cloud RAG under Document Isolation (arxiv.org) Retrieval-augmented generation (RAG) has emerged as a pivotal technique for improving language models by incorporating external knowledge at inference time. As device-cloud collaborative inference makes it feasible to deploy small language…
What I learned writing an eval harness for my own SKILL.md files (it caught two real bugs) (www.reddit.com via reddit) I spent two months writing a Claude Code skill pack that enforces methodological rigor on RAG, agent, and MCP server work. Last week I built a test harness for it.
Sentinel: Decoding Context Utilization via Attention Probing for Efficient LLM Context Compression (arxiv.org) Retrieval-augmented generation (RAG) often suffers from long and noisy retrieved contexts. Existing context compression methods typically rely on heuristic relevance estimation or supervised compression models rather than on how LLMs utili…
How are you preventing Claude Code from using outdated API documentation? (www.reddit.com via reddit) I've been using Claude Code more heavily for API integrations and one recurring issue is that it'll occasionally generate code against outdated documentation. The implementation itself is often good, but sometimes: endpoints have changed p…
Most “AI memory” is RAG with better marketing. I built one that actually forgets (www.reddit.com via reddit) Most AI “memory” tools never forget anything, and they sell that as the feature. It’s the bug.
NOVA: NOise-aware Verbal Confidence CAlibration for Robust Large Language Models in RAG Systems (arxiv.org) Accurately assessing model confidence is essential for deploying large language models (LLMs) in mission-critical factual domains. While retrieval-augmented generation (RAG) is widely adopted to improve grounding, confidence calibration in…
RAGPPI: RAG Benchmark for Protein-Protein Interactions in Drug Discovery (arxiv.org) Retrieving the biological impacts of protein-protein interactions (PPIs) is essential for target identification (Target ID) in drug development. Given the vast number of proteins involved, this process remains time-consuming and challengin…
X-MADAM-RAG: Diagnosing and Handling Chinese-English Evidence Conflict in Retrieval-Augmented Generation (arxiv.org) Retrieval-augmented generation (RAG) systems may receive evidence that is not merely noisy but mutually contradictory. This issue becomes particularly salient in multilingual settings, where retrieved Chinese and English evidence may suppo…
SafeLLM: Extraction as a Hallucination-Resistant Alternative to Rewriting in Safety-Critical Settings (arxiv.org) Large language models (LLMs) are increasingly used to access organisational documentation, including standard operating procedures (SOPs), HR policies and institutional guidelines. However, retrieval-augmented generation (RAG) systems that…
How Fine-Grained Should a RAG Benchmark Be? A Hierarchical Framework for Synthetic Question Generation (arxiv.org) Evaluating retrieval-augmented generation (RAG) systems requires benchmarks that capture diverse question characteristics, yet practitioners lack empirical guidance on which dimensions to vary and at what granularity. We present HieraRAG,…
When Iterative RAG Beats Ideal Evidence: A Diagnostic Study in Scientific Multi-hop Question Answering (arxiv.org) Retrieval-Augmented Generation (RAG) extends large language models (LLMs) beyond parametric knowledge, yet it is unclear when iterative retrieval-reasoning loops meaningfully outperform static RAG, particularly in scientific domains with m…
Learning to Reason by Analogy via Retrieval-Augmented Reinforcement Fine-Tuning (arxiv.org) Retrieval-augmented generation (RAG) has become a standard mechanism for grounding language models in external knowledge, yet conventional retrieval based on lexical or semantic similarity is poorly suited for complex reasoning tasks: a se…
SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systems (arxiv.org) Retrieval-augmented generation (RAG) agents increasingly run with persistent memory that accumulates across user sessions. This creates a new attack surface: an adversary interacting only through normal channels can inject crafted memories…
Uncertainty-Aware Hybrid Retrieval for Long-Document RAG (arxiv.org) Retrieval augmented generation (RAG) depends critically on the quality and granularity of retrieved evidence. Large retrieval units preserve context but often introduce irrelevant content, which can dilute answer bearing evidence and worse…
Rethinking RAG in Long Videos: What to Retrieve and How to Use It? (arxiv.org) Retrieval-augmented generation is moving beyond text into long, egocentric video, where systems must select query-relevant chunks across multiple modalities and temporal granularities. Yet progress in VideoRAG is limited by two gaps: exist…
I built a graph-memory layer on top of turbovec for local/constrained RAG — looking for feedback (www.reddit.com via reddit) Disclosure: I built this. I like turbovec for compact local vector search, but in real RAG apps my bottleneck was often outside the vector index: tenant filters, source/time/tag constraints, graph neighborhoods, BM25 candidates, rerank, an…
Need help to build an internal knowledge portal for sales (www.reddit.com via reddit) Hello, I’m looking to build (or buy, if a perfect solution exists) an intelligent Internal Knowledge Portal / Sales Enablement Assistant for our sales and pre-sales teams. The Core Vision The goal is to move past simple "Ctrl+F" search and…
Better to obsess over an Agent Wiki than complex Agent frameworks (www.reddit.com via reddit) It is exhausting to see agent frameworks dropping every week that feels incomplete. you build a custom setup today and someone suggests a better one tomorrow.
The voice layer for AI agents feels underrated (www.reddit.com via reddit) Most AI agent demos focus on planning, tool use, browser automation, memory, RAG, or multi-agent workflows. But I keep running into a smaller problem at the end of the pipeline: What happens when the agent output needs to become audio?
What's the best way to learn RAG for real-world applications? (www.reddit.com via reddit) I've noticed many AI courses explain vector databases but not complete RAG systems. The Knowledge Base RAG module on SimplAI University appears to focus on building retrieval-powered AI experiences.
Evaluating Factual Density in Multi-Source RAG: A Study in Medical AI Accuracy (arxiv.org) Retrieval-Augmented Generation (RAG) is the current industry standard for grounding AI in real-world facts. Traditional retrieval methods rely on keyword matching and topic proximity, ranking content based on how closely it sounds like the…
uva-irlab-conv at SemEval-2026 Task 8: Multi-Turn RAG with Learned Sparse Retrieval and Listwise Reranking (arxiv.org) This report describes our participation in SemEval-2026 Task 8 on multi-turn retrieval and question answering. The task evaluates conversational systems across four domains (finance, cloud documentation, government, Wikipedia), and include…
When More Documents Hurt RAG: Mitigating Vector Search Dilution with Domain-Scoped, Model-Agnostic Retrieval (arxiv.org) Retrieval-augmented generation degrades when scaled to large, heterogeneous document collections, where dense similarity loses discriminative power, and top-k retrieval increasingly returns semantically similar but contextually incorrect c…
Energy-Efficient On-Device RAG on a Mobile NPU: System Design and Benchmark on Snapdragon X Elite (arxiv.org) Retrieval-Augmented Generation (RAG) pipelines are compute-intensive, combining embedding, retrieval, reranking, and large language model (LLM) generation. Running them entirely on-device benefits privacy, latency, and offline use, but the…
EverydayGPT: Confidence-Gated Routing for Efficient and Safe Hybrid GPT-RAG Conversational QA (arxiv.org) Standard Retrieval-Augmented Generation (RAG) pipelines route every query through retrieval and generation unconditionally, incurring unnecessary computation and propagating low-quality context to the generator. We introduce EverydayGPT, a…
ProGRank: Probe-Gradient Reranking to Defend Dense-Retriever RAG from Corpus Poisoning (arxiv.org) Retrieval-Augmented Generation (RAG) improves large language model applications by grounding generation in retrieved evidence, but also introduces corpus poisoning as a new attack surface. In this setting, an adversary injects or edits pas…
NightFeats @ MMU-RAGent NeurIPS 2025: A Context-Optimized Multi-Agent RAG System for the Text-to-Text Track (arxiv.org) We present NightFeats, a structured multi-agent retrieval-augmented generation (RAG) system submitted to the MMU-RAGent competition at NeurIPS 2025, where it was awarded Best Dynamic Evaluation in the text-to-text track. Rather than target…
The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content (arxiv.org) Retrieval-augmented generation (RAG) systems inject external knowledge to improve LLM outputs, yet the format of injected content -- distinct from its semantic relevance -- can independently distort the model's attention distribution. We i…
Could Fable 5 one shot entreprise RAG system? (www.reddit.com via reddit) Hey ! For the ones who tried Claude Fable 5, do you think it could make a big entreprise RAG System?
Audio-first, deep-dive RAG Masterclass on YT it's called "Master RAG while you sleep" (www.youtube.com via reddit) Here is a fully cleaned, simplified version. It drops all the "pro" marketing phrases like “masterclass,” “built for you,” and “I’ve put together,” and replaces the heavy academic jargon with straightforward engineering terms.
Looking to Join an Anthropic Partner Organization for Claude Certified Architect (www.reddit.com via reddit) Hi everyone, I'm interested in taking the Claude Certified Architect certification and am looking for a legitimate path to join or collaborate with an Anthropic partner organization. My background is AI architecture, automation engineering…
Transitioning into AI Engineering Roadmap? (www.reddit.com via reddit) I'm a backend/full-stack developer looking to transition into AI Engineering roles (LLM Engineer, Generative AI Engineer, AI Agent Developer). I already know Python and have experience building WebApps, APIs, databases, and backend systems.
Deploy a Qwen 3.6 Agentic RAG — Step-by-Step Walkthrough (medium.com via reddit) Deploy an Agentic RAG powered by Alibaba’s latest Qwen 3.6, running fully on your machine.
Skill-RAG: Failure-State-Aware Retrieval Augmentation via Hidden-State Probing and Skill Routing (arxiv.org) From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG (arxiv.org) RAG over Thinking Traces Can Improve Reasoning Tasks (arxiv.org) Retrieval-augmented generation (RAG) has proven effective for knowledge-intensive tasks, but is widely believed to offer limited benefit for reasoning-intensive problems such as math and code generation. We challenge this assumption by sho…
Agentic Hybrid RAG for Evidence-Grounded Muon Collider Analysis (arxiv.org) Muon collider research spans accelerator physics, detector instrumentation, and high-energy phenomenology, with relevant evidence scattered across a rapidly expanding and heterogeneous body of scientific literature. As high-energy physics…
MetaPlate: Counterfactual-Guided RAG-LLM Tool for Personalized Food Recommendation and Hyperglycemia Prevention (arxiv.org) Postprandial hyperglycemia is a key risk factor for metabolic disorders; however, existing dietary guidance is often static, impractical, and insufficiently personalized, providing recommendations that are difficult to follow or not impact…
RAG: Is it relevant for Agents (www.reddit.com via reddit) I keep hearing varying opinions about the usefulness of RAG for Agents. Some are saying Markdown files supported by orchestration engines like OpenClaw is enough.
The reason your AI agent keeps failing has nothing to do with the model (www.reddit.com via reddit) I've spent the last 8 months building AI agents. Research agents, competitive intel agents, RAG pipelines, you name it.
How are you handling aggregation/counting questions in doc-aware agents? RAG keeps failing me here (www.reddit.com via reddit) Something I keep hitting building agents that work over documents, curious how others solve it. RAG is the default doc tool we give agents, and it's great for "find/explain the passage about X" — the answer lives in one place, retrieval fi…
HOW much llm context does an agents need (www.reddit.com via reddit) Does it depennds on the llm or the agent (RAG) capabilities , like i want to do an experiment with a very small language model with ok rag like few functionalities i hope someone is has this idea . the idea is to run those agents in mobile…
Linguistic Nepotism: Trading-off Quality for Language Preference in Multilingual RAG (arxiv.org) The Injection Paradox: Brand-Level Suppression in Safety-Trained LLM Recommendations via RAG Context Injection (arxiv.org) Document-Authored Control-Signal Impersonation: A Low-Cost Indirect Prompt Attack on RAG Safety Boundaries (arxiv.org) Evaluating RAG Reliability under Clean, Misleading, and Mixed Retrieval (arxiv.org) From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG (arxiv.org) DIVERGE: Diversity-Enhanced RAG for Open-Ended Information Seeking (arxiv.org) Projection and Quantisation: A Unifying View of Learning to Hash, from Random Projections to the RAG Era (arxiv.org) Harmonia: End-to-End RAG Serving Optimization (arxiv.org) Goal-Oriented Reasoning for RAG-based Memory in Conversational Agentic LLM Systems (arxiv.org) SIFT: Selective-Index For Fast Compute of RAG Prefill by Exploiting Attention Invariance (arxiv.org) Retrieval-Augmented Generation (RAG) injects LLM queries with relevant documents to improve response quality. This injection increases prompt length and slows time to first token (TTFT).
Anything2Skill: Compiling External Knowledge into Reusable Skills for Agents (arxiv.org) Retrieval-augmented generation (RAG) enables agents to access external knowledge at inference time, but it primarily retrieves fragmented declarative evidence, leaving agents to repeatedly infer task procedures from passages, manuals, exam…
Using Claude as a deterministic metric engine via Postgres queues. Anyone doing this? (www.reddit.com via reddit) I've been working on turning unstructured field data into calibrated metrics. Instead of normal RAG, I built a system where AI agents act as a metric engine.
How do you pull an entry level job/ freelance? (www.reddit.com via reddit) Hey everyone, I’m a self-taught Python developer transitioning into AI Integration and Database Automation. For those who started out self-taught in automation/AI integration: - What was your fastest route to finding your first freelance o…
Looking for a local "NotebookLM for lawyers" setup – what am I doing wrong? (www.reddit.com via reddit) Hello everyone I am totally new to LocalLLMs and only used chatGPT/Claude/NotebookLM before. So bear with me 😃 I'm an attorney and would like to analyze and summarize case files locally for privacy/confidentiality reasons.
Need a Production-Level RAG AI Agent Tutorial (www.reddit.com via reddit) Can anyone suggest a Production-Level RAG AI Agent tutorial (YouTube video, documentation, course, GitHub repo, etc.)? My goal is to build a project that is actually worth adding to the Projects section of my resume for AI Engineer roles.
SEEK: Steering LLM Reasoning for RAG via Internal Reasoning Sketches (arxiv.org) HKVM-RAG: Key-Value-Separated Hypergraph Evidence Organization for Multi-Hop RAG (arxiv.org) TA-RAG: Tone-Aware Retrieval-Augmented Generation for Peer-Support Health Communication (arxiv.org) Diagnosing LLM Arbitration Behavior over Pre-evidence Epistemic States in RAG-based Fact-Checking (arxiv.org) MHA-RAG: Improving Efficiency, Accuracy, and Consistency by Encoding Exemplars as Soft Prompts (arxiv.org) Evidence Graph Consistency in Retrieval-Augmented Generation: A Model-Dependent Analysis of Hallucination Detection (arxiv.org) Retrieval-Augmented Generation (RAG) reduces but does not eliminate hallucination in large language models. Existing detection methods rely on flat similarity between generated answers and retrieved passages, ignoring structural relationsh…
RAG for you see it live open source files any kind (www.reddit.com via reddit) This is for visualizing file extraction through RAG (or file ingestion into any structured data set). I've been really into different shapes of data (like graph db, etc).
I built an AI support agent where the main metric is unsafe auto-action rate, not just accuracy (www.reddit.com via reddit) I built a production-shaped AI customer support agent for telecom, and the biggest lesson was that classifier accuracy is not enough. I recently finished RelayOps v1.2, a telecom/subscription customer-support agent built as a vertical slic…
How are you actually using AI on large construction projects? (www.reddit.com via reddit) I've spent several years in project management for large oil / gas / refinery projects, working on the contractor side. With AI dominating the conversation these days, I've been using platforms like Claude Code in my off-hours, and it's st…
Alternatives to ChromaDB for easy RAG search (www.reddit.com via reddit) I'm disappointed that ChromaDB's local, free "single node" version is still getting second-class, hand-me-down features while the "distributed" version (a SaaS offering, unsurprisingly) gets built in hybrid search, BM25, etc. I tried to gi…
Building a Claude-certified developer network: looking for builders to join (free certification path) (www.reddit.com via reddit) [Update] Wow, 32 sign-ups already, thank you all! Still plenty of room (we're aiming min.
Hey I want to be able to build and optimize agent? Any recommandation about how to learn? (www.reddit.com via reddit) I want to learn how to build an agent and I can then try to optimize or be creative about it. This include something like (RAG, Embedding, Skills, MCP, subagent isolation, context window, memory, Harness etc.) I want to learn but resources…
I built a RAG system for the first time. Here's what nobody told me would be the hard part (www.reddit.com via reddit) Had been reading about RAG for months before I actually built one. Every explanation made it sound straightforward.
Guidance please (www.reddit.com via reddit) I need help . pls help !
IA-RAG: Interval-Algebra-Driven Temporal Reasoning for Dynamic Knowledge Retrieval (arxiv.org) Retrieval-Augmented Generation (RAG) has shown strong effectiveness in grounding Large Language Models (LLMs) with external knowledge. However, existing RAG and Graph RAG frameworks largely treat knowledge as static or associate time with…
Towards Generalization of Block Attention via Automatic Segmentation and Block Distillation (arxiv.org) Block attention, which processes the input as separate blocks that cannot attend to one another, offers significant potential to improve KV cache reuse in long-context scenarios such as Retrieval-Augmented Generation (RAG). However, its br…
HypRAG: Hyperbolic Dense Retrieval for Retrieval Augmented Generation (arxiv.org) Embedding geometry plays a fundamental role in retrieval quality, yet dense retrievers for retrieval-augmented generation (RAG) remain largely confined to Euclidean space. However, natural language exhibits hierarchical structure from broa…
A2RAG: Adaptive Agentic Graph Retrieval for Cost-Aware and Reliable Reasoning (arxiv.org) Graph Retrieval-Augmented Generation (Graph-RAG) enhances multihop question answering by organizing corpora into knowledge graphs and routing evidence through relational structure. However, practical deployments face two persistent bottlen…
RAG Security and Privacy: Formalizing the Threat Model and Attack Surface (arxiv.org) Retrieval-Augmented Generation (RAG) is an emerging approach in natural language processing that combines large language models (LLMs) with external document retrieval to produce more accurate and grounded responses. While RAG has shown st…
Agent-Orchestrated Adaptive RAG: A Comparative Study on Structured and Multi-Hop Retrieval (arxiv.org) Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding their responses in external knowledge, but conventional pipelines rely on static, single-step retrieval that limits performance on complex queries. Thi…
Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents (arxiv.org) LLM-based agents increasingly tackle long-horizon tasks with interdependent decisions, where each action reshapes future constraints and intermediate errors can cascade. Existing RAG and agent memory systems organize histories by semantic…
QCFuse: Query-Aware Cache Fusion via Compressed View for Efficient RAG Serving (arxiv.org) Retrieval-augmented generation (RAG) improves large language model (LLM) answer quality by grounding generation in external evidence, but processing retrieved contexts makes the prefill stage a dominant serving cost. RAG cache fusion reduc…
FIDES: Faithful Inference via Deep Evidence Signals for Retrieval-Memory Conflict in RAG (arxiv.org) When retrieved evidence contradicts parametric memory, language models frequently ignore context and default to memorized priors -- a failure that undermines the core purpose of retrieval augmentation. Contrastive decoding amplifies the co…
Answer Presence Drives RAG Rewriting Gains (arxiv.org) Retrieval-augmented QA pipelines often route retrieved passages through an LLM \emph{rewriter} before a smaller reader, lifting F1 by tens of points on multi-hop benchmarks; this gain is typically credited to improved evidence quality. We…
"We didn't know what YCombinator was 5 months ago. Last week Garry Tan asked us to take down what we built." (www.reddit.com) 5 months ago, i didn't know what YCombinator was. Last month, the president of YC noticed what we built.
I made a small tool to inspect retrieval results before feeding them into RAG (www.reddit.com) I’ve been messing around with live web retrieval for RAG, and the part that kept annoying me wasn’t the search call itself. It was figuring out whether the returned results were actually usable as evidence.
2 years of work, 8 iterations and we have waited to introduce our Product Alexandria so long. Its a cursor or claude code for your daily office life! (www.reddit.com) We spent 2 years testing whether “vibe engineering” could become real Hey everyone, We’re a small team of 3 brothers + our father as senior advisor. Background: 2 mechanical engineers 2 construction engineers father with 30+ years in const…
Cost of Using LLMs in Agentic AI and RAG workflows (www.reddit.com) Hey Everyone ML engineer and Researcher here I’ve been researching production issues in Agentic AI + RAG systems and one pattern keeps showing up repeatedly: Context inefficiency. Not just retrieval quality — but the actual economics and s…
Building Expertise in Claude - Seeking Quality Learning Resources (www.reddit.com) Hi everyone, I'm on a mission to become a serious expert in Claude and AI, and I'm building a structured learning path. I want to create content that's actually valuable - with real practical applications, not surface-level tutorials.
I need HELP with a document classification task (www.reddit.com) Hey everyone, my company's tasked me with building a document classification system, insurance documents specifically. someone dumps a batch of documents, and the system needs to classify and label each one correctly.
A Small Site That Explains LLM/Agents Without the Hype (100% free, no sign up required) (www.reddit.com) I am a PhD student at UofToronto doing agent research. Seen a lot of hype around this topic which get people (especially non-tech) hella confused.
Are smaller local models improving faster where it actually matters? (www.reddit.com) From the inference side, it’s been interesting seeing how often smaller open models end up staying in active use simply because they’re fast enough to constantly interact with. A year ago a lot of these models felt more like demos or side…
"OncoAgent: A Dual-Tier Multi-Agent Framework for Privacy-Preserving Oncology Clinical Decision Support" (huggingface.co) "OncoAgent: A Dual-Tier Multi-Agent Framework for Privacy-Preserving Oncology Clinical Decision Support" - user: oncoagent-research tags: - oncology - multi-agent - LangGraph - RAG - QLoRA - AMD - open-source - clinical-ai - healthcare Onc…
I got tired of the API bills for 100k+ context windows, so I built a persistent O(1) semantic memory state engine to compress history (www.reddit.com) Hey everyone, The entire industry right now is cheering for massive 1M+ context windows, but I think it's fundamentally the wrong approach. "Just add more RAM" is a trap.
You don't need a GPU server to run Claude agents (www.reddit.com) I’ve been seeing a lot of newcomers asking about hardware specs lately, and there’s this weirdly common myth that you need a heavy server or a GPU instance to run Cla͏ude-based agents. You really don’t.
My Mac Mini kernel-panicked twice. Turned out MCP servers were eating 1.5 GB at idle, leaving no headroom for anything else. So I built a process supervisor (www.reddit.com) tl;dr (Claude caveman edition): MCP servers sit around doing nothing, eat 1.5 GB. Machine angry.
Sentient OS: I spent a year hacking MLX and doing surgery on Qwen to process 3,000 screenshots overnight on a 6 year old iPhone. Every optimization explained :D (www.reddit.com) hey localllama :) I got a multimodal vision LLM to process 3,000 screenshots overnight on a 6 year old iPhone -- entirely on-device. below is every hack, surgery, and optimization i built over the past year to make this possible!
Macbook M3 MAX 64 vs M5 PRO 48, or wait for spark/studio (www.reddit.com) I’m choosing between two refurbished MacBooks, both around $3,100. Option 1: 14” M3 Max, 16-core CPU / 40-core GPU, 64GB RAM, 1TB SSD.
I stopped writing 500-word guardrail prompts. This 8-line template works better. (www.reddit.com) I used to spend hours writing massive, obsessive system prompts for my RAG apps. I’d have ten different refusal examples, "never do X," "always check Y," and a whole paragraph of the model role-playing as a "safe and truthful assistant." I…
↯ Security↯ Hallucination↯ Jailbreakjailbreakhallucinationrag+1
I want to create and maintain a set of benchmarks for local LLMs. Would anyone pay/donate for this? (www.reddit.com) Please help me build some clarity. I want to participate in local LLMs ecosystem more.
The Claude Code Pro removal is getting framed as 'just go local' but for production systems it's messier (www.reddit.com) Yesterday's Claude Code Pro removal thread hit 350+ comments in a few hours, and the dominant take was basically "switch to Kimi K2.6, go local, done." I upvoted that thread and tbh im mostly there — but im building voice agents and RAG pi…
Best open-source tools for prompt injection defense in 2026 (www.reddit.com) Over the time we have been testing different approaches to secure LLM apps against prompt injection, especially indirect injection through RAG, PDFs, as well as tool outputs, and MCP integrations. Most tools seem to fall into 2 categories:…
Need a MVP for a RAG, rent Hardware for short term (www.reddit.com) I am working in an MVP for a small RAG, just to show what is possible. I currently do not have appropriate hardware, so I need to rent something for a short period.
Most AI agents have amnesia. I built one with a wiki-based memory that compounds over time. (www.reddit.com) Jarvis — Your Personal AI Companion (www.reddit.com) What I learned improving LoCoMo retrieval from 89.6% → 93.9% (www.reddit.com) Spent the last few weeks measuring how far you can push conversational memory retrieval without any LLM calls. Sharing what worked on LoCoMo (Snap Research's 1982-question benchmark over 10 long conversations) in case it's useful to others…
tested async performance across LangChain, LlamaIndex, and Haystack under concurrent load. The results were worse than I expected and here's what we found. (www.reddit.com) Been running LLM pipelines in production for a while. Kept noticing throughput numbers that didn't make sense for "async" code.
Why are so many Creating "local Chat" inference models? (www.reddit.com) I'm a novice but so confused by the tech driving the tech. Whats the use cases that are being driven by so many spending on 20K local modelling hardware, that cant compete with the pending dramatic decrease in cost per token let alone the…
Running on cpu :( (www.reddit.com) I am in the midst of a POC project at work and am I have is 4 AMD Epyc cores and those are essentially virtualized. Does any one have any tricks?
Need your help — creating a 2 min RAG video for a DevRel interview, what would actually be useful to you? (www.reddit.com) Hey everyone, I am going through an interview for a developer relations role and part of the process is creating a short two minute technical video on RAG aimed at senior developers. I have been building with tools like Lovable, Bolt, Repl…
How are you feeding personal context to your local models? (www.reddit.com) I've been running Mistral/Llama locally through Ollama for a while now and the thing that keeps bugging me is context. The model itself is fine for general stuff but the second I want it to know about my projects, my notes, or files it doe…
GLM OCR for Arabic (www.reddit.com) So, I have been testing GLM OCR for my rag app, but it is not working good for Arabic. It is unable to extract data either on textual page, scanned pages or even images.
I’m looking for advice on setting up a local AI model that can generate Word reports automatically. (www.reddit.com) Hi everyone, I’m looking for advice on setting up a local AI model that can generate Word reports automatically. I already have around 500 manually created reports, and I want to train or fine-tune a model to understand their structure and…
MCP servers vs Agent Skills: I think most people are comparing the wrong things (www.reddit.com) I keep seeing people compare MCP servers and Agent Skills as if they’re alternatives, but after building with both, they feel like different layers of the stack. MCP is about access.
Expert Support case study: Bolstering a RAG app with LLM-as-a-Judge (huggingface.co) Building Cost-Efficient Enterprise RAG applications with Intel Gaudi 2 and Intel Xeon (huggingface.co)