topic
Hallucination
-
Mechanistic Interpretability (MI) has made significant progress in explaining the internal computations of Large Language Models (LLMs); however, these advances have yet to demonstrate comparable success in explaining the decision-making p…
-
Hallucination detection for large language models is dominated by methods evaluated on 7B-70B research models with abundant sampling budgets and exact-match or ROUGE correctness labels. The small models practitioners actually ship on-devic…
-
Large language models (LLMs) are increasingly used for knowledge base question answering (KBQA), also referred to as knowledge graph question answering (KGQA), where answering requires selecting entities from a question-specific knowledge…
-
Reinforcement learning has improved the tool-use capabilities of large language models. However, better task performance can coincide with increased tool hallucination.
-
Aerial imagery captured by unmanned aerial vehicles (UAVs) plays a vital role in applications such as surveillance, disaster response, and large-scale environmental monitoring. Automatic generation of textual descriptions for such imagery…
-
Recent advances in medical large multimodal models (LMMs) have brought promising progress to clinical decision support, yet hallucination, the generation of confident but clinically unverifiable outputs, poses a critical threat to the reli…
-
A lawyer used AI to write a report, but billed full time. What should I do? (news.ycombinator.com) hallucination 3d
This is not a request for legal advice, and therefore the country matters little here. I write because I am interested in hearing opinions on the moral implications of something that is bound to happen more and more often.
-
Fable 5.2 feels unusable? (www.reddit.com via reddit) hallucinationgemini 5d
My own tests with Fable 5.2 Max vs Gemini 4 Carbon Fable 5.2 Max seems to respond fast without thorough thinking, makes writing mistakes (exaggerations), and hallucinates much more. I recently just found out on https://artificialanalysis.a…
-
We present our system for the SHROOM-visions 2026 shared task on character-level hallucination span detection in image-conditioned vision-language model (VLM) responses, evaluated across English, French, Italian, and Chinese. The detector…
-
-
-
-
Large Vision-Language Models (LVLMs) have demonstrated strong capabilities in multimodal tasks. Nevertheless, their outputs remain prone to object hallucinations that are inconsistent with visual content.
-
Selective unlearning is increasingly important for the safety and compliance of large language models. Harmful or memorized content is often entangled with useful knowledge and difficult to enumerate.
-
Radiology AI has developed along two paths: specialized models that perform well on narrow tasks but cover few clinical findings, and generalist models that address a broader range of tasks but remain prone to hallucination and inaccurate…
-
I built Smarter Compact to keep long Claude Code sessions cheap without losing anything. It's free and open source (Apache-2.0), runs locally, and doesn't need its own API key.
-
Large language models (LLMs) are increasingly used in biomedical and cognitive neuroscience, but their ability to reason reliably over heterogeneous knowledge graphs (KGs) remains unclear. We benchmark five LLMs (GPT-5.1, Gemini 2.0 Pro, L…
-
Hey everyone! 👋 If you use Claude Desktop, Cursor, or autonomous agents that run terminal commands, you’ve probably experienced this frustrating loop: The agent modifies or wipes working files, and git doesn't help with scratch files or un…
-
We investigate whether open-source LLMs encode a linearly separable truthfulness signal in their hidden states, and at which network depth this signal is strongest. Across three $7$B--$8$B instruction-tuned models (Llama-3.1-8B, Mistral-7B…
-
Multimodal discrete diffusion language models (dLLMs) generate responses through iterative mask prediction and offer a promising alternative to autoregressive large vision-language models. However, they still suffer from hallucination, pro…
-
Hallucinations in Large Language Models (LLMs) remain a major challenge, as they can produce misleading, factually incorrect, or unverifiable information, thereby undermining their trustworthiness and reliability. However, reliable ground-…
-
Large language models are increasingly consulted for religious knowledge, including the recall of specific Hadith (recorded sayings and actions of the Prophet Muhammad, peace be upon him). Unlike open-ended generation, Hadith recall is a h…
-
Large language models are increasingly used to answer questions over financial filings, where an unfaithful answer can mislead investment, compliance, or client decisions. Hallucination detectors are a common safeguard, but they are usuall…
-
Large language models routinely produce factually incorrect or misleading outputs, yet conventional automated benchmarks overlook how users perceive reliability during interaction. We introduce the System Hallucination Scale (SHS), a light…
-
Large multimodal reasoning models solve challenging visual problems via explicit long-chain inference: they gather visual clues from images and decode clues into textual tokens. Yet this capability also increases hallucinations, where the…
-
Hallucination detection is critical for deploying large language models (LLMs) in real-world applications. Due to strong empirical performance, internal representation-based methods have emerged as the prevailing direction for detecting ha…
-
Large language models are widely used as judges of model outputs (LLM-as-a-Judge), but they are costly and can hallucinate or be overconfident. Decision models are a potential alternative.
-
Large language models (LLMs) frequently generate fluent yet factually incorrect responses, raising concerns about their reliability. Recent hallucination detectors increasingly exploit internal representations, but extracting informative s…
-
Large language models (LLMs) perform well across many real-world tasks but remain prone to hallucination, limiting their reliability in domains such as biomedicine and healthcare, where answers must be grounded in established knowledge. Re…
-
A Salesforce AI agent that can't publish a hallucination (github.com via hn) hallucination 2w
Deal Rescue Agent An LLM agent that cannot publish a hallucination. ▶ Two-minute demo — the architecture animated, a real run publishing in 41 seconds, and the run the gate refused.
-
Accurate prediction helps achieve supply-demand balance in energy systems,thereby supporting operational decision-making and this http URL models,which lack AI-assisted automation,often rely heavily on expert knowledge,incur high labor cos…
-
Hallucination detection is increasingly important for evaluating and deploying large language models. However, existing methods are often compared across benchmarks that define and measure hallucination in substantially different ways, mak…
-
Hello, my name is Berend Graham. My cofounder Shiv Oberai and I have been working on Limma for a year now with the goal of building a proactive solution to the reliability issues that plague practical AI and agentic use in companies with R…
-
Hallucinations in large vision--language models (LVLMs) often arise when language priors dominate over visual evidence, leading to object misidentification and visually inconsistent descriptions. We address this problem by framing hallucin…
-
Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, but suffer from hallucination issues where they generate unfaithful or inconsistent content. While Reinforcement Learning with Verif…
-
Large language models can achieve strong Text-to-SQL benchmark performance while still producing schema and query-logic errors. Most evaluations characterize such failures only in the final generated query, making it difficult to determine…
-
Span-level hallucination detection pinpoints unsupported content in LLM outputs, enabling actionable feedback and targeted mitigation. Existing evaluations for span-level hallucination detection methods are fragmented across tasks, annotat…
-
Large Language Models (LLMs) have significantly advanced natural language processing and artificial intelligence applications through their capabilities in reasoning, text generation and knowledge retrieval. However, LLMs are still vulnera…
-
Hallucination stress tests can yield similar average scores across language models even when different prompts elicit hallucinations in each model. We develop a procedure that iteratively edits source-grounded seed prompts to expose halluc…
-
Multimodal large language models (LLMs) are increasingly used for structured extraction from financial documents, but their behavior under visual ambiguity is poorly understood. We study CARLAR (Courtesy Amount Recognition and Legal Amount…
-
When given an image and a text prompt, vision-language models (VLMs) can produce seemingly sophisticated text responses. However, they are also prone to hallucinate objects in their output, which can have detrimental consequences in safety…
-
Under matched conditions, classifier-head fine-tuning (\textsc{cls}) paradigm consistently outperforms the LLM-as-Judge sequence-to-sequence (\textsc{s2s}) on binary hallucination detection. We trace this gap to the representations induced…
-
Recent Omni LLMs (OLLMs) have demonstrated remarkable capabilities in joint audio-visual reasoning, yet cross-modal hallucinations remain a major challenge. Existing mitigation methods mainly operate at the output level, overlooking the en…
-
Multi-agent LLM systems improve performance on clinical tasks, and that improvement is often read as evidence of a more trustworthy system. However, the two are not the same claim.
-
-
Large Vision-Language Models (LVLMs) commonly suffer from hallucinations, which appear as fabricating non-existent objects or outputting incorrect attributes and spatial relationships in images. Previous works empirically indicate that CLI…
-
Language models increasingly use skills that provide reusable instructions and procedures for task execution. After a relevant skill has been selected, the model may need to apply its governing procedure together with retrieved task contex…
-
With the large-scale adoption of Large Language Models (LLMs) in various applications, there is a growing reliability concern due to their tendency to generate inaccurate text, i.e. hallucinations.
-
Object hallucination in vision-language models (VLMs) is usually measured by checking each object a caption names against the image. Most benchmarks and detectors alike treat every object mention as a claim that the object is present.
-
Bengali hallucination detection must distinguish unsupported factual claims from incorrect reasoning, often without a supplied reference passage. We present and characterize an inference-only system that combines response-conditioned query…
-
Uncertainty can measure hallucination risk in retrieval-augmented generation (RAG), but only when retrieved evidence constrains the answer. When evidence is present, unsupported factual claims become less likely; when retrieval coverage is…
-
We describe our submission to Subtask~1b of ImageEval 2026. The task consists of selecting the single visually valid statement from three candidates paired with an image, and is in both English and Modern Standard Arabic (MSA).
-
could not extract summary
-
Gemini 4 Argon hallucination (!) (www.reddit.com via reddit) hallucinationgeminiopus 4w
It's incredible how Argon is supposed to be the least hallucinating model. I just tried it to review some code Opus 5.5 wrote for game development, and it straight up invented code that didn't exist; Argon 4, high setting.
-
Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has received extensive attention, a different failure mode has been overlooked: procedural hal…
-
Large language models can produce fluent answers that the supplied context does not support. A compact frozen proxy model can detect such answers by reading the context and another model's response, even from a proprietary generator.
-
Show HN: Multi persona library to eradicate Spec Hallucination (github.com via hn) hallucinationagentic 4w
Spec hallucination is a real challenges, spec writing is a skill influenced by the individual experience and org culture. Tier 1 tech firms have standardized the product mgmt processes.
-
Large language models often produce fluent but factually incorrect output. Gray-box detectors identify such hallucinations from the token-probability statistics emitted during generation, avoiding the need for white-box access to hidden st…
-
-
-
-
-
-
-
Large audio-language models (LALMs) frequently exhibit object hallucination, affirming absent sounds. The dominant mitigation, Audio-Aware Decoding (AAD), contrasts logits under real audio against an all-zero "blank" waveform, flagged by p…
-
What’s the dumbest bug an AI has confidently pushed into your codebase? (www.reddit.com via reddit) hallucination 5w
everyone hypes up 10x velocity, but yesterday an agent spent 20 minutes rewriting a working migration into an infinite loop and told me it "optimized the query." what's the most confident, brain-dead hallucination an AI has handed you so f…
-
LLM Hallucination Study An exploratory study of hallucination and abstention in 2026 open-weight LLMs. Models Tested Qwen 3.8-27B (Alibaba) GPT-OSS-20B (OpenAI) Key Findings Two failure modes identified: Qwen: rigid confabulation (100% con…
-
Object hallucination remains a major obstacle for large vision-language models (LVLMs) to generate reliable content. An intuitive mitigation strategy is to suppress hallucination-related components in hidden representations.
-
Large language models are increasingly used in legal research and drafting, but they can still produce claims that sound convincing without being supported by the cited source. We introduce PARCEL, a benchmark for checking whether a legal…
-
Hallucinated information can propagate through multi-stage LLM systems and become part of the context for subsequent reasoning. Existing studies of post-hallucination reasoning (PHR) mainly characterize changes in final outcomes and aggreg…
-
Vision-Language-Action (VLA) models have shown strong generalization in robotic manipulation by leveraging rich representations from pretrained vision-language models. However, their deployment in real-world environments remains limited by…
-
Modern agentic coding frameworks increasingly rely on community-shared rule files (e.g., this http URL or .cursorrules) to guide autonomous code generation, yet the security risks of this pipeline remain underexplored. To bridge this gap,…
-
In recent years, several methods for detecting when large language models (LLMs) hallucinate have been developed. These methods are often benchmarked with open-domain question answering (QA) datasets containing questions and corresponding…
-
-
-
-
Reasoning errors can propagate into later decisions and memory. This survey synthesizes 312 papers and first-party reports on text-based reasoning hallucinations around three questions: what evidence is observable, what study designs estab…
-
Hallucination detection is particularly important for medical language models, but repeated-sampling approaches are expensive and existing uncertainty-head resources do not directly transfer to a new backbone and language. We adapt the LLM…
-
Large Language Models (LLMs) are prone to generating hallucinated content, which compromises their reliability in knowledge-intensive tasks. To address this challenge without sacrificing creativity, we propose HARPO, a reinforcement learni…
-
Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sus…
-
Audio-Visual Large Language Models (AV-LLMs) remain prone to cross-modal hallucinations, where one modality incorrectly affects predictions about another. Although contrastive decoding reduces hallucinations in vision-language models, its…
-
Existing hallucination taxonomies classify LLM errors by what is wrong with the output -- memorised misconceptions, reasoning failures, fluent fabrications -- but cannot answer a different question: which uncertainty scorer would have caug…
-
Diagnosing failure patterns in Deep Research Agents (DRAs) remains a critical challenge. Existing benchmarks predominantly rely on end-to-end evaluation, obscuring intermediate hallucinations that accumulate throughout the research traject…
-
As Large Language Models (LLMs) increasingly serve as foundational reasoning engines, their tendency to hallucinate remains a critical vulnerability. While recent internal state probes offer a promising alternative to slow external retriev…
-
Hallucinations in Large Language Models (LLMs), i.e., plausible but non-factual generations, pose a significant challenge to reliable deployment in high-stakes environments. However, many existing hallucination detectors require expensive…
-
We present HalluScoring 2026, a shared task for evaluating hallucination detection and factual verification in Arabic question answering under challenging generalization settings. Its four subtasks are organized into two tasks.
-
As vision-language models (VLMs) are increasingly deployed in clinical decision support, more than accuracy is required: knowing when to trust their predictions is equally critical. Yet, a comprehensive and systematic investigation into th…
-
Automatic evaluation of faithfulness increasingly relies on a large language model acting as a judge, yet the most reliable judges are proprietary frontier models, costly and ill-suited to high-throughput monitoring. We investigate whether…
-
World Models are appearing as the next major frontier in computer vision. However, their robustness is currently largely unexplored.
-
Retrieval-augmented generation (RAG) systems need inexpensive ways to route generated answers: accept low-risk outputs, review uncertain ones, and reserve strong verifiers for the expensive tail. We present RAGScope, a leakage-controlled p…
-
Recent work on hallucination detection in large language models has shown that, for a fixed pre-trained model and reasoning task, it is possible to estimate the model's confidence in the correctness of its outputs. Such uncertainty estimat…
-
Sampling based consistency is widely used for hallucination detection, yet aggregate performance can conceal systematic differences in which errors are detectable. This work studies that heterogeneity across four language models and three…
-
Large language models (LLMs) have shown remarkable capabilities in various natural language processing tasks, leading to their widespread deployment as intelligent assistants in decision-making contexts. However, the increasing complexity…
-
-
-
How to Reduce Whisper Hallucination (arxiv.org) hallucination 6w
-
-
-
How to Solve Hallucination (With RLCD) (www.robw.fyi via hn) hallucination 6w
Ask an LLM how sure it is about something and when it answers you, it gives you a number based on vibes. “I’m about 90% confident” comes out of the same next-token machinery as everything else it says.
-
Hallucination, the generation of non factual content by AI systems, poses serious risks in medical contexts, where errors can directly affect patient outcomes. We present MedHal, a large-scale dataset specifically designed to assess capabi…
-
Video understanding is increasingly performed by multi-stage LLM agents that separate temporal grounding, visual observation, and reasoning. Yet these stages are typically evaluated on different benchmarks and distributions, making it diff…
-
Interpretable machine learning for Large Language Models (LLMs) increasingly relies on sparse probing methods that identify small sets of neurons claimed to detect and causally influence behaviors such as factuality recall, safety alignmen…
-
Reinforcement learning (RL) is widely used to sharpen reasoning in multimodal large language models (MLLMs), yet its effect on hallucination is uneven. We trace this to two weak points in the \emph{correction chain} from reward to paramete…
-
Multimodal large language models (MLLMs) fre- quently generate text that is inconsistent with the input image. While object- and attribute-level hallucinations have received considerable attention, relational hallucinations (incorrect de-…
-
Diffusion large language models generate text through iterative denoising, exposing hidden trajectories that may contain reliability signals beyond the final output. We propose HIVE, which compresses trajectory hidden states, selects infor…
-
VSCode's SSH Agent Is Bananas (2025) (fly.io via hn) hallucination 7w
We’re interested in getting integrated into the flow VSCode uses to do remote editing over SSH, because everybody is using VSCode now, and, in particular, they’re using forks of VSCode that generate code with LLMs. ”hallucination” is what…
-
Opus 5.5 Context Degradation (www.reddit.com via reddit) hallucinationopus 7w
Anecdotal evidence, but I finally got Opus 5.5 to eat through its context window while building out a massive pipeline, so I got to see a bit how it behaves as context degrades. At ~500k, I didn't notice any loss in performance or serious…
-
How Claude Code Works, From Tokens to Agents (nem035.com via reddit) hallucinationclaude-code 7w
An interactive walkthrough builds the agent stack layer by layer, starting with a language model that predicts one token at a time, keeps no memory between requests, and freezes its knowledge at training cutoff. Hallucination uses the same…
-
Hallucinations remain an unsolved problem for LLMs, and package hallucinations are a particularly dangerous instance of this phenomenon. Package hallucinations occur during code generation when a model fabricates non-existent software pack…
-
Large audio-language models may mention acoustic events that are absent from the input. A separate audio event detector can verify these mentions, but doing so requires a second audio encoder and a separate forward pass.
-
Simurg – Kills LLM hallucinations mid-stream, with free web search built in (huggingface.co via hn) hallucination 7w
SIMURG SIMURG is a streaming hallucination and output-degradation detector for LLMs. It watches a live model response as tokens stream in and raises a calibrated alarm the moment the output degenerates: repetition loops, cross-lingual drif…
-
Uncertainty quantification techniques measure confidence in language model outputs to support critical applications like hallucination detection and selective prediction. While prior work has developed various confidence metrics and demons…
-
Imagination performs as a high-level function of large language models (LLMs) which determines the potential of how an LLM creates unseen or creative content. While existing works have built a rich family of creativity benchmarks for this…
-
Hidden-state hallucination probing - training a linear classifier on an LLM's internal activations to detect whether a generated answer is faithful to the input - is an active area of 2026 research, with recent work reporting 0.90-1.00 AUR…
-
Nobel Prize winner: "Cell biology is a hallucination." – Eric Betzig [video] (www.youtube.com via hn) hallucination 7w
About Press Copyright Contact us Creators Advertise Developers Terms Privacy Policy & Safety How YouTube works Test new features NFL Sunday Ticket © 2026 Google LLC
-
"The greatest enemy of knowledge is not ignorance, it is the illusion of knowledge." Large Language Models have conquered natural language but remain prisoners of their own probabilistic nature--confidently hallucinating facts they never t…
-
Factual hallucination is commonly defined by incorrect factual outputs. We study a paraphrase-induced hallucination setting, where a model answers a factual question correctly in its original form but generates an incorrect answer under a…
-
In this work, we examine the topology of information flow patterns within attention graphs to effectively distinguish hallucinated from non-hallucinated responses. We analyze the Forman-Ricci curvature to identify structural patterns indic…
-
AI hallucination nearly triggers US Military operation (techcrunch.com via hn) hallucination 8w
Military aircraft were already in the air this spring when U.S. officials made an alarming discovery: The intelligence driving an armed operation against a Chinese vessel had been hallucinated by an AI chatbot.
-
The US narrowly avoided boarding a Chinese ship based on an “entirely false” US intelligence report generated with the help of AI tools, according to a CNN report. That erroneous intelligence, submitted by a US Special Operations Command a…
-
Audio-language models increasingly generate confident music descriptions that are unsupported by the input audio. We present, to our knowledge, the first music-specific, layer-wise, multi-paradigm empirical study of hallucination in audio-…
-
Tool-augmented large language model (LLM) agents fail in a way no tool-selection or tool-security method addresses: they call tools that do not exist and pass arguments no schema declares. Existing defenses either pick the right tool (sele…
-
Large Language Models (LLMs) frequently exhibit hallucinations, presenting a major barrier to reliability in complex reasoning tasks. While traditional detection methods rely on output-based confidence metrics, these logits are often misca…
-
In this position paper, we argue that legal LLMs' hallucinations should be evaluated as a failure of legal warrant rather than as factual inaccuracy or citation failure. We define claim-authority warrant as the context-sensitive relation b…
-
Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination Assessment via Log-probs as Time series), a lightweight hallucination detector that leverages on…
-
Multimodal Foundation Models represent a significant leap in artificial intelligence. Among them, Large Vision-Language Models (LVLMs) serve as the typical representative of these foundation models, which integrate visual modality directly…
-
The integration of Large Language Models (LLMs) into automated code optimization introduces a critical reliability risk we term the Efficiency Hallucination: an LLM's tendency to issue non-functional mutations with unsubstantiated performa…
-
Forced ID verification everywhere (www.reddit.com via reddit) hallucinationcursoropus+1 8w
As per the title, my girlfriend nor I can subscribe to Max without verifying our IDs. We are in Europe for reference, so GDPR doesn't seem to affect this intrusive KYC.
-
Factual hallucination in closed-book question answering is often treated as a coverage problem: a model fails because the relevant fact is absent from its internal memory. This view misses a second source of error.
-
Despite substantial advances, large language models (LLMs) continue to exhibit hallucinations, generating plausible yet incorrect responses. In this paper, we highlight a critical yet previously underexplored class of hallucinations driven…
-
Large language models generate fluent text that can contain unfaithful claims -- a phenomenon known as hallucination. We present a multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo (MC) Dropout unc…
-
Allowing large language models (LLMs) to retrieve information from a set of trusted documents can increase reliability and reduce hallucination. However, recent work has demonstrated that retrieval-augmented generation (RAG) can have unint…
-
High-dimensional dense text embeddings and large language models face real obstacles in financial-disclosure analysis: context-window limits, hallucination risk, high computational cost, and the arbitrary rotation of vector spaces across i…
-
We present our system for the SHROOM-Visions 2026 shared task on character-level VLM hallucination detection. A small ($4$B-parameter) VLM is fine-tuned as a per-token classifier reading a two-token feature from its own hidden states, and…
-
Large language models are increasingly proposed as automated auditors of document quality, yet their reliability as detectors of planted errors is poorly characterised. We construct a contaminated corpus of 150 academic papers spanning sup…
-
Retrieval-augmented generation (RAG) grounds a language model in retrieved documents, which reduces hallucination but creates a new attack surface: if retrieved text is tampered with, the model may repeat the falsehood. We study how much a…
-
Opus recommendations to prevent hallucination (www.reddit.com via reddit) hallucinationopus 9w
I have used helpful recommendations shared in this sub for what to put in Claude instructions to avoid hallucinations, and they have worked pretty well (such as "state ambiguities instead of trying to choose best possibility" and "No fabri…
-
Claude or GPT for academic workflows? (www.reddit.com via reddit) hallucinationopus 9w
Hi all, I really need some guidance on which product would better suit my needs, and I think your experiences would be very helpful. I use Claude to help with academic research, particularly with searching literature gaps, identifying nove…
-
Large audio-language models (LALMs) can hallucinate audio objects, answering "yes" to absent sound events, thus undermining reliability in audio question answering. We propose Token-Adaptive Decoding (TAD), a training-free strategy for hal…
-
Large language models (LLMs) increasingly generate citation-backed responses, yet citation hallucination remains a major challenge for trustworthy scientific information access. We introduce REASONS, a benchmark of 12,723 sentence-level ci…
-
Hallucination correction is not a one-direction problem. We show that intermediate layers are neither uniformly more truthful than final layers nor uniformly less trustworthy.
-
Hallucination detection is crucial for large language models (LLMs), as hallucinated content creates significant barriers in applications requiring factual accuracy. Current detection methods mainly depend on internal signals like uncertai…
-
Update to devtools (www.reddit.com via reddit) hallucination 9w
on devtoolsniff.com now when you are generating .cursorrules you can now pick chips for negative constraints for anti-hallucination and anti-bloat. Have fun
-
LLM-powered coding agents increasingly participate in software development workflows by generating code, selecting dependencies, and producing package installation commands. This creates a new software supply chain risk: when an agent hall…
-
The Anatomy of an ASR Hallucination (arxiv.org) hallucination 10w
ASR systems sometimes produce fluent text that is unrelated to the speech they receive. We view these hallucinations as one possible consequence of a broader grounding failure, in which the transcript is no longer adequately guided by the…
-
Hallucination-where a language model generates outputs that are factually incorrect or unsupported by the source-is a major challenge for both prompted and fine-tuned language models. Detecting hallucinations is difficult due to the opaque…
-
Large language models (LLMs) have significantly advanced automated program repair (APR), yet existing evaluations remain largely result-centric and provide limited insight into hallucination during repair. In APR, hallucination may arise n…
-
Financial large language models are increasingly deployed for summarization of reports and disclosures, where numerical hallucination poses significant practical risks. While prior work often attributes such hallucination to insufficient n…
-
Whisper is a widely used foundation model for automatic speech recognition (ASR), but its generative decoder can produce fluent hallucinated transcripts for inputs containing little or no speech. We propose a training-free, inference-time…
-
Understanding the frequency of factual errors in chatbot-generated text and evaluating systems that detect these errors is critical for determining chatbot safety. Yet factual-error detection is often treated as a single-pass, single-annot…
-
Retrieval Augmented Generation (RAG) is a key component for generating accurate and hallucination free answers using Large Language Models (LLMs). LLMs are improving at handling long context, but still suffer from "lost in the middle" prob…
-
The growing scale of academic peer review has motivated the use of Large Language Models (LLMs) as review assistants, yet LLMs can generate fluent but unsupported claims that undermine review reliability. Existing hallucination benchmarks…
-
I built a hallucination detector for coding agents. 100 agent-hours killed it (github.com via hn) hallucination 10w
Anubis I built a hallucination detector for coding agents. Then I measured it to death.
-
When LLMs support public-facing or high-stakes workflows, missed fabrications can harm users and institutions, while false alarms consume limited human-review capacity. When no trusted context or reference document is available, we study t…
-
Guys any clue what this is ? Is it just a hallucination ? (www.reddit.comhttps) hallucination 10w
could not extract summary
-
Enoki: Efficient Multi-Level Hallucination Detection (arxiv.org) hallucination 10w
Ensuring factuality remains a critical challenge for deploying LLMs in high-stakes settings. Existing hallucination detectors usually operate at a single level: claim-level methods provide interpretable factual units, while span-level meth…
-
Large vision-language models (LVLMs) are increasingly being applied to multi-view image inputs captured from diverse viewpoints. Despite this growing use, current LVLMs often generate incorrect responses due to visual interference from non…
-
Language models exhibit fundamental limitations -- hallucination, brittleness, and lack of formal grounding -- that are particularly problematic in high-stakes specialist fields requiring verifiable reasoning. I investigate whether formal…
-
Role-playing large language models (LLMs) are expected to adopt a character's style while also respecting that character's knowledge boundaries. Prior evaluations detect character hallucination but rarely distinguish whether errors arise f…
-
Both privacy and factual accuracy are paramount in high-stakes domains like healthcare. Concerningly, we uncover and investigate a privacy-hallucination tradeoff in differentially private (DP) language models.
-
Guaranteed trick prompt: Name your single most likely weakness - not hallucination. Design a test you can run right now with tools that could refute it.
-
Large Language Models (LLMs) often suffer from hallucination and struggle with complex reasoning tasks requiring multi-hop domain knowledge. While integrating Knowledge Graphs (KGs) provides a structured and verifiable information source,…
-
Fine-Grained Multi Image Object Hallucination Benchmark (arxiv.org) hallucination 10w
Multimodal Large Language Models (MLLMs) are increasingly deployed in multi-image scenarios requiring complex reasoning across visual contexts. However, current MLLMs remain fundamentally limited by object hallucination-generating plausibl…
-
Object hallucination remains a persistent reliability issue in large vision-language models, where generated object mentions may sound plausible but lack visual grounding. Recent training-free detectors use internal signals such as token l…
-
Parameter-efficient fine-tuning (PEFT) methods are widely used to adapt large language models (LLMs) to downstream tasks and are often assumed to improve factual correctness. However, how the parameter-efficient fine-tuning methods affect…
-
Detecting hallucinations in Large Vision-Language Models (LVLMs) requires both accurate span localization and well-calibrated confidence scores. Fine-tuned generative VLMs excel at identifying hallucinated text spans but suffer from overco…
-
Search agents reduce hallucination by grounding answers in retrieved web evidence. Yet reliance on retrieval also creates an attack surface: poisoned corpora with false or malicious documents can cause agents to reproduce misinformation.
-
Hidden-state probes effectively detect LLM hallucinations, but the geometry of the signal remains poorly characterized, driving increasingly complex probe architectures. Across three 7B-scale models and three datasets in a paired-example p…
-
Claude Is on the Edge of Losing Control — Watch Every Response (www.reddit.com via reddit) hallucination 10w
Claude Is on the Edge of Losing Control — Watch Every Response I just had a Claude failure that genuinely changed how I think about long-running AI tasks. This was not a normal hallucination.
-
Large Vision-Language Models (LVLMs) remain prone to hallucinations, producing responses that are irrelevant or inconsistent with the multimodal input. Existing mitigation methods mainly rely on external supervision, output calibration, or…
-
AI Hallucination Cases Database (www.damiencharlotin.com via hn) hallucination 11w
The most comprehensive database of AI hallucination cases in law: legal decisions from courts worldwide, searchable by country, party, AI tool, and outcome. Updated daily.
-
Autoregressive large language models (LLMs) routinely generate factually incorrect outputs with high decoding confidence, limiting their deployment in high-stakes workflows. Existing output-stage uncertainty metrics can fail when models ar…
-
The lifecycle of hallucination in LLMs is a concept that enables building solid frameworks on the control and reliability of LLMs in high-stakes environments, including health, legal, and scientific research. Although previous surveys have…
-
Artificial intelligence will do down in history as one of the biggest discoveries of humankind of this decade, debate arises when artificial intelligence occurs the status of super intelligence. A collections of high impact research findin…
-
Generative AI is increasingly used in science, but is unavoidably prone to hallucination. I develop a reliabilist account of how generative AI nevertheless gives rise to new scientific knowledge.
-
Vision-language models such as LLaVA-1.5-7B often hallucinate objects absent from the image when generating captions. We ask whether an interpretability diagnosis of this failure can guide a targeted fix, and we measure what that fix actua…
-
Retrieval-augmented generation (RAG) is widely used to mitigate hallucination issues in large language models (LLMs) and multimodal large language models (MLLMs). In particular, knowledge graph (KG)-based RAG leverages structured knowledge…
-
Large language models (LLMs) frequently produce confident yet factually incorrect responses when user inputs contain misleading premises, a phenomenon we attribute to fact perturbations in the input. Existing approaches to hallucination mi…
-
In 2026, we held the fourth iteration of the SHROOM Shared Task series: SHROOM-Visions (\textbf{S}hared-task on \textbf{H}allucinations and \textbf{R}elated \textbf{O}bservable \textbf{O}vergeneration \textbf{M}istakes in \textbf{Vision} l…
-
Hallucinations and severe scope drifts inspite of planning. (www.reddit.com via reddit) ollamaglmhallucination 11w
I am using 20x plan. I am seeing a lot of hallucination and scope drift, and extremely slow execution.
-
While text-based hallucination detection has been extensively studied, spoken hallucination detection remains largely unexplored, particularly for low-resource languages. We present the first multilingual spoken hallucination benchmark com…
-
Uncertainty quantification (UQ) methods are widely used for hallucination detection in large language models (LLMs) in closed-book settings where ground-truth evidence is unavailable at inference time. Prior work has proposed combining UQ…
-
When a code generating language model fabricates a Python package name, an adversary who has pre-registered that name on PyPI can convert that hallucination into a supply chain compromise. This event has been termed as 'slopsquatting'.
-
Sycophancy and hallucination are persistent failure modes of Large Language Models (LLMs) across domains. However, it becomes particularly consequential in clinical question answering, where responses must remain grounded in the provided c…
-
Diffusion large language models (D-LLMs) have emerged as a promising alternative to auto-regressive models due to their iterative refinement capabilities. However, hallucinations remain a critical issue that hinders their reliability.
-
LLMs are increasingly used for code generation, yet they frequently hallucinate non-existent software packages, creating exploitable entry points into the software supply chain. We make four contributions to this problem.
-
The current progress of Clinical Vision Large Language Models (C-VLLMs) has substantially improved digital diagnostics, still these frameworks often endure lesion noises, modality misalignment, hallucination, and missed contextual groundin…
-
Background: Automating clinical guideline-based decision-making with large language models (LLMs) remains challenging because of reliability, hallucination, and limited interpretability. We compared the performance of LLMs and reasoning st…
-
Random "injection wrapper" appearing on inputs or hallucination? (www.reddit.com via reddit) hallucination 12w
I was using claude on my free account to debug an issue in houdini and suddenly my inputs were getting turned into this weird, long injection format that claude kept warning me about. I was not typing ANY of this, it simply appeared any ti…
-
A Google DeepMind paper has multiple hallucinated references (veruscite-data.com via hn) deepmindhallucination 12w
Hallucination Edited How are people using generative ai? A.
-
Hi everyone, With the latest wave of model releases, the battle for the ultimate daily driver has gotten ridiculously competitive—especially between **Claude Sonnet 5**, **Gemini 3.7 Flash**, and **Qwen3.8-Max**. Here is my quick breakdown…
-
This guy clearly is not well. (www.reddit.comhttps) hallucination 12w
I am reviewing some UI design drafts for a new project, keeps deleting the messages and giving this warning. The screenshot attached is png file.
-
Contemporary Large Language Models (LLMs) are increasingly aligned to suppress hallucinations, prioritizing factual retrieval over combinatorial creativity. While crucial for mitigating misinformation, this alignment may also restrict spec…
-
Large language models (LLMs) have seen widespread adoption across various domains, yet their reliability is frequently undermined by hallucinations - responses that are plausible-sounding but factually incorrect. In high-stakes domains, th…
-
Although context windows have expanded significantly in recent years, hallucinations in long-context summarization remain a challenge. Long novels are better suited than news or papers for researching these hallucinations, due to their int…
-
Token-level hallucination detectors score each token independently from a single signal, and fail exactly when the generating model is confidently wrong. This paper instead treats hallucination as a temporally extended span and detects it…
-
When consequential decisions depend on knowledge that exists nowhere in writing, LLMs hallucinate not from retrieval failure but from model absence. RAG and knowledge-graph methods share a structural ceiling.
-
Biomolecular design underpins applications from molecular recognition to therapeutics and synthetic biology, yet de novo interaction design remains challenging-especially for DNA/RNA, underexplored non-protein modalities with scarce, heter…
-
AutoResearch: Insight In, Hallucination Out (arxiv.org) discussed ↗ hallucination 12w
Autonomous research systems are increasingly capable of executing long research workflows, yet automation alone does not ensure that the resulting process remains scientifically grounded. We introduce AutoResearch, a two-stage system that…
-
Despite their widespread use, Large Language Models (LLMs) remain limited by a fundamental problem: the generation of plausible but false content, known as hallucinations. Most existing detection methods operate at the answer or sentence l…
-
Hallucinations remain a major obstacle to the reliable use of large language models (LLMs) in conditional text generation. Existing methods primarily assess the factuality of an entire generated text, providing limited insight into which o…
-
Modern encoder-decoder systems can produce fluent text even when their input contains no recoverable message. We study this failure in ASR and NMT through the models' reserved null tokens, asking whether the score for ending generation alr…
-
Even well-aligned large language models confidently generate factually incorrect text, making hallucination a persistent reliability risk in high-stakes deployments. These models nonetheless carry linearly separable truthfulness signals in…
-
Video question answering systems built on vision-language models often produce timestamped claims with high confidence even when unsupported by the cited frame. This deceptive hallucination arises because timestamps imply grounding without…
-
Diffusion large language models (D-LLMs) have emerged as a promising paradigm for text generation. However, similar to autoregressive LLMs, D-LLMs remain vulnerable to hallucinations, where fluent outputs may contain factually incorrect or…
-
Sequential multi-agent LLM pipelines chain specialized agents without verification at handoffs, creating a structural flaw with measurable and severe consequences. We show that hallucinations injected at Stage 1 do not merely persist; they…
-
How Much Do Legal RAG Systems Still Hallucinate? (arxiv.org) hallucinationrag 13w
Hallucination is a major challenge for retrieval-augmented generation (RAG) systems in the legal domain, where ungrounded answers can lead to serious consequences. To better understand this problem, we conduct a fine-grained analysis of ha…
-
Existing defenses against hallucination in retrieval-augmented and multi-agent pipelines remain partial: evidence is trusted despite modality disagreement, debate verifies an aggregate report rather than individual claims, and such verific…
-
Has the hallucination problem in AI been solved? (news.ycombinator.com) hallucination 13w
My understanding that all AI can, and will hallucinate. I get downvoted for saying this, but no one ever says I'm wrong or cites any source.
-
Grok 4.6's most important number is one xAI didn't even advertise (www.reddit.com via reddit) hallucinationgpt-5grok+1 13w
Grok 4.6 dropped yesterday and the debate is the usual "is it better than Sol?" On the headline benchmarks it's a genuine tie: Intelligence Index 61 vs 61, Coding 76.8 vs 77.4, Agentic 58.7 vs 57.8. The number nobody screenshots is AA-Omni…
-
We introduce the \textbf{Concept Field} of a text corpus: a local drift field with pointwise uncertainty, estimated in sentence-embedding space from the deltas between consecutive sentences. Given a candidate sentence transition, we score…
-
This paper describes an approach to hallucination detection and mitigation using a HOPE-inspired Nested Learning architecture with Continuum Memory Systems (CMS) and semantic similarity caching, tested on a hybrid benchmark of 310 prompts…
-
Large Vision-Language Models (LVLMs) achieve impressive visual reasoning and dialogue capabilities, yet frequently hallucinate content unsupported by the visual input. Effective mitigation requires token-level localization, enabling target…
-
Large Language Models (LLMs) deployed as AI agents frequently exhibit user specification-grounding failures, executing hallucinated, undesired actions to force a resolution rather than expressing uncertainty. Existing detection methods fai…
-
Vision-language models (VLMs) excel at open-ended captioning and visual QA but often describe objects, attributes, or relations absent from the image, a phenomenon known as object hallucination. We propose a {training-free, post-hoc repres…
-
Large language models with web search are increasingly used in scientific publishing agents, yet they produce BibTeX entries with pervasive field-level errors stemming from omission, partial corruption, substitution, and hallucination. We…
-
Verifying LLM-generated legal citations against a graph of citations extracted from real court decisions is an appealing way to measure hallucination at scale: no annotators, no reference answers. We show that what such a metric reports is…
-
Multimodal large language models (MLLMs) typically rely on a single late-layer feature from a frozen vision encoder, leaving the encoder's rich hierarchy of visual cues under-utilized. MLLMs still suffer from visually ungrounded hallucinat…
-
Abstractive text summarization systems frequently generate fluent yet unfaithful summaries by fabricating or distorting relationships between entities and events. Such relation-level hallucinations undermine the reliability of generated su…
-
Large language models (LLMs) can generate fluent and useful responses but remain prone to hallucinations. We introduce Prompt Embedding Probes (PEP), a white-box method for answer-level hallucination detection from the hidden states of a f…
-
Hallucination remains a persistent challenge for Multimodal Large Language Models (MLLMs), severely limiting their reliability in high-stakes applications. Existing evaluations, predominantly based on static benchmarks, suffer from narrow…
-
GUI agents are shifting from metadata-dependent large language models to purely visual multimodal large language models (MLLMs) that operate directly on screenshots. The core task, GUI grounding, requires translating abstract user instruct…
-
Large reasoning models (LRMs) are prone to hallucination, which undermines their reliability and poses challenges for safe deployment. Hallucinations in LRMs arise from two distinct failure sources: reasoning hallucination, where flawed in…
-
Large language models (LLMs) show promise in medical image interpretation but suffer from hallucination, limited accuracy, and run-to-run inconsistency. We developed and validated an agentic AI framework integrating LLMs with specialized d…
-
Large Vision-Language Models (LVLMs) often suffer from object hallucination, generating objects that are absent from the image. Prior work largely attributes this to insufficient visual attention.
-
FlowChartCharter – A Zero-Hallucination, Fear-Driven GraphRAG Alternative (github.com via hn) hallucination 14w
FlowChartCharter The execution-first multi-agent paradigm — after GraphRAG Two lines to instantiate a Boss Agent. One YAML file to charter an enterprise.
-
Weaver🕷️ has been Updated to v.13! (www.reddit.com via reddit) hallucination 14w
Weaver🕷️ has been Updated to v.13 and its our biggest drop yet! This update brings #Weaver one step closer to being the best overall agent for small-midsize LLM coding.
-
Overconfidence/hallucination (www.reddit.comhttps) hallucinationanthropic 14w
So yesterday, I set up a scheduled task that requires Claude to pull important financial news from the internet and organize it into a 5-minute read at 10.00 AM daily. I specifically asked it whether my laptop needs to be awake for the sch…
-
The reliability of Large Language Models (LLMs) is often compromised by factual inconsistencies, including hallucinations---cases where generated content is not supported by the underlying source. We present HallDetect, a lightweight, refe…
-
Hallucination remains a fundamental challenge in vision-language models (VLMs), where autoregressive generation may produce linguistically plausible yet physically inconsistent or visually ungrounded responses due to likelihood maximizatio…
-
LettuceDetect v2 in Semantic Router: Generative Hallucination Detection as a vLLM Endpoint Semantic Router can now verify grounded responses with a generative span detector served by vLLM. The new endpoint detector backend runs LettuceDete…
-
While retrieval-augmented generation systems partially address the hallucination issues in large language models, it also introduces new vulnerabilities to knowledge corruption attacks. Adversaries exploit these vulnerabilities by poisonin…
-
Large vision--language models (LVLMs) demonstrate strong multimodal reasoning capabilities but remain prone to hallucination, where model predictions are not grounded in visual evidence. Existing black-box hallucination detection methods e…
-
Achieving high perceptual quality without hallucination remains a challenge in generative speech enhancement (SE). A representative approach, PASE, is robust to hallucination but has limited perceptual quality under adverse conditions.
-
Hallucination remains a critical challenge for developing trustworthy Multimodal Large Language Models (MLLMs). While existing benchmarks mainly focus on entity, attribute, and relation hallucinations, knowledge-related failures are often…
-
Large language models can generate fluent Arabic answers while introducing factual errors that are difficult to identify and verify. Existing Arabic hallucination resources often assign a binary label to an entire response, indicating whet…
-
In an age of rapid model turnover, how do we make hallucination evaluation more perennial? We explore whether human-written hallucination samples could take the place of model-generated hallucinations, in order to make benchmarking detecti…
-
Hi all, I've been using Claude Code to build a photorealistic, walkable 3D tour of interior properties, the kind of thing you walk around like a video game (just walking, simple gameplay). Real estate use case, so it has to stay faithful t…
-
Opus 5 reminds me of the earlier days of AI with hallucination fatigue (www.reddit.com via reddit) hallucinationopus 15w
The thing is Opus 5 occasionally hits a home run, requires minimal re-prompting, and just gets things right. Sometimes it does a perfect deep research run on exactly what I'm looking for.
-
The increasing use of vision-language models (VLMs) in healthcare applications presents great challenges related to hallucinations, in which the models may generate seemingly plausible results that are in fact incorrect. Such hallucination…
-
Multimodal large language models (MLLMs) frequently hallucinate by over-committing to spurious visual cues. Prior remedies-Visual and Instruction Contrastive Decoding (VCD, ICD)-mitigate this issue, yet the mechanism remains opaque.
-
Large Language Models (LLMs) are temporally overexposed: trained on vast contemporary corpora, they encode present-day concepts that make them unreliable narrators of the past. We present TimeCapsule, a 1.2B-parameter LLaMA-style causal mo…
-
AI-generated video is increasingly used across marketing, product storytelling, and creative workflows, yet automated; high-precision quality control remains a major constraint to scaling production. We present HALLELUAI, an end-to-end sys…
-
On standard factuality tasks, frontier models now cluster near the top of the scale. The question is therefore shifting from how factual a system is toward how much compute that factuality costs.
-
Diffusion large language models (D-LLMs) have recently gained increasing attention, yet their reliability is significantly hindered by the hallucination problem. Existing hallucination detection approaches for D-LLMs mainly follow a traini…
-
Large language models can generate fluent SQL from natural language, but on real enterprise Oracle databases they frequently fail at execution time: columns and aliases are hallucinated and dialect-specific syntax is missed, leading to ORA…
-
Large Language Models (LLMs) often generate incorrect or unsupported content, known as hallucinations. Existing detection methods rely on heuristics or simple models over isolated computational traces such as activations, or attention maps.
-
Hallucination Rates in Language Generation (arxiv.org) hallucination 15w
Language generation in the limit is an elegant model introduced by Kleinberg and Mullainathan [KM24] to formally study language generation by an algorithm that learns solely based on example strings. In this model, an algorithm is said to…
-
Large Language Models can produce fluent text that is false, unsupported by the available evidence, or inconsistent with information that appears to be internally represented by the model. We study hallucination detection from the geometry…
-
Large reasoning models (LRMs) generate long reasoning traces before producing final answers. While these traces may contain useful signals for hallucination detection, harnessing them is non-trivial because long trajectories often include…
-
Ran into a funny consistent hallucination bug with Opus 4.8 today. I was talking about my dotfiles symlink structure for local Claude skill configurations: The symlink ~/.claude/skills points to ~/dotfiles/claude/skills The model repeatedl…
-
AGI Singer: Pluto, Recursive Alignment and Hallucination Suppression (medium.com via hn) hallucination 16w
could not extract summary
-
Chemical reasoning language models are expected to derive molecular answers through faithful chain-of-thought (CoT). However, across four reasoning model families and twelve chemistry tasks, hallucination is widespread and largely decouple…
-
Existing LLM hallucination mitigation methods, including prompt engineering and model optimization, either hardly alter models'internal knowledge or have poor cross-domain generalization. Contrastive decoding mitigates hallucinations by us…
-
The electrocardiogram (ECG) is a cornerstone of cardiac as- sessment, yet clinical deployment of deep learning models remains con- strained by limited interpretability and the hallucination risk of large language models (LLMs). Existing CN…
-
Although large language models (LLMs) have recently gained traction in recommender systems due to their strong reasoning capabilities and extensive world knowledge, previous LLM-based agents suffer from hallucination and context-length lim…
-
Large language models (LLMs) can generate fluent Arabic answers, yet factual errors remain difficult to detect, localize, explain, and verify. Existing hallucination benchmarks often provide response-level labels, with limited support for…
-
Practitioners make three prompt-design decisions with almost no controlled evidence behind them: how to format instructions and context (markdown, plain text, prose, or tabular), how many simultaneous instructions a system prompt can carry…
-
Operational Hallucination and Safety Drift in AI Agents (arxiv.org) hallucination 16w
Large language models (LLMs) serving as planners in tool-using autonomous agents introduce dynamic reliability risks in multi-turn execution. While single-turn safety mechanisms are relatively mature, extended interactions reveal structura…
-
LLM – 99% hallucination-free outputs (api.5ceos.com via hn) hallucination 16w
A deterministic shift in how compliance, security, and AI behavior converge. A substrate that governs cognition itself — routing deterministically, refusing to drift, and shipping a signed receipt on every response.
-
Large language models can still hallucinate in retrieval-augmented generation (RAG), producing claims that are unsupported by or conflict with the retrieved context. Detecting such errors remains challenging when faithfulness is judged sol…
-
Multimodal large language models (MLLMs) have shown strong potential for medical Visual Question Answering (VQA), yet they remain prone to hallucinations, defined as generating responses that contradict the input image, posing serious risk…
-
Enterprises will not deploy AI agents they cannot trust, and the most-cited reason for distrust is hallucination: confident, fluent output that is simply not true. The common response is to wait for a model that does not hallucinate.
-
Existing hallucination detection methods are typically conducted at the inference stage, without making any modifications to the model itself. In this paper, we are interested in exploring fine-tuning strategies that enhance the detectabil…
-
UndoMCP — A "Ctrl-Z" for AI agent MCP actions (www.reddit.com via reddit) hallucinationmcp 17w
I've been working on an open-source tool called UndoMCP. The tool is meant to be a "Ctrl-z" for MCP changes made by your AI agent, meaning if your AI agent makes some critical error due to AI hallucination, you can safely undo it even mean…
-
Slop time is over!!! time to build real stuff (www.reddit.com via reddit) hallucinationclaude-code 17w
As a non-developer, I began using Claude Code a year ago to build hundreds of tools, apps, and web concepts. However, I consistently ran into the same issue: hallucinations and untrustworthy code, which made it impossible for me to safely…
-
Claude auto-dev HiL workflow (www.reddit.comhttps) hallucination 17w
Knowing that some vibecoders find it hard to move beyond one-shotting and those more experienced in development struggle with LLM hallucination and result/test-faking and exaggeration, I thought I'd share a high-level overview of my self-h…
-
Weird hallucination - Fable Hallucinated a whole conversation any idea how? (www.reddit.com via reddit) hallucination 17w
I have a manager his name is not Marcus. I have never mentioned a Marcus or data centers in my time at this job working with claude.
-
When was Claude able to drop images from searches? (www.reddit.comhttps) hallucination 17w
Is this new or am I tweaking? I could swear it couldn't do it before, but it's been a minute Also, classic hallucination in there.
-
Large language models are increasingly used in scientific writing, yet they can fabricate citation-shaped references that appear plausible but fail bibliographic verification. Existing detectors often reduce verification to binary found/no…
-
As Large Language Models (LLMs) increasingly utilize massive context windows as working memory for autonomous tasks, their reliability fluctuates significantly depending on how information is distributed in real-world corpora. We investiga…
-
As AI agents gain prevalance, users are increasingly exposed to the risks such systems entail. Prompt injection attacks, as well as hallucination, can cause agents to leak private information to third parties.
-
When cast as the protector of a vulnerable user yet given no explicit capability boundary, a large language model (LLM) may respond not by acknowledging its limits but by claiming to have taken -- or to be taking -- a real-world protective…
-
Language models draw on two knowledge sources: facts baked into weights (parametric memory, PM) and information in context (working memory, WM). We study two mechanistically distinct failure modes--conflict, when PM and WM disagree and int…
-
While recent advances in 3D generation have enabled impressive visual synthesis, existing methods often rely on 2D diffusion supervision without explicit mechanisms for geometric consistency, leading to spatial hallucinations such as dupli…
-
Tool access alone does not make LLM empirical reasoning governable: accepted outputs need not descend from attested evidence, and accepted deductions need not hold up under formal scrutiny. We present EG-VAR (Evidence-Grounded Verified Age…
-
Rubric-based evaluation is a promising approach for assessing open-ended outputs from LLM-based research agents, particularly in paper reproduction, where direct paper-to-repository comparison is prone to hallucination. However, constructi…
-
Show HN: Running over 80M tokens in one agent session with no compaction (github.com via hn) hallucination 17w
We ran a single agent session through all 89 sequential tasks of Terminal Bench 2.0 or over 80 million tokens, with no measurable accuracy loss versus running each task in its own fresh session. We didn't use compaction.
-
Have LLMs plateaued ? (www.reddit.com via reddit) hallucinationgeminiopus 17w
Basically just the title: Have LLMs plateaued? I use claude, gpt, and gemini models daily (mostly claude), and for the past few months, beyond the hype and benchmark maxing, I haven't seen that much of a difference.
-
PDF: The Most Trustworthy Hallucination in the Stack (pymupdf.io via hn) hallucination 17w
PDF: The Most Trustworthy Hallucination in the Stack July 13, 2026 The AI industry has one answer to hallucination: grounding. Don't trust the model, retrieve from the documents.
-
Claude answered a question that wasn't mine (www.reddit.com via reddit) hallucination 18w
Typed a simple prompt into the Claude app on my iPad (Fable 5): "Pick a number 1-100, a planet, and a shape." Typed it myself, didn't paste anything. Claude replied with a detailed writeup about a security product called "Zenith Gateway" —…
-
The application of lightweight Large Language Models in rule-based scientific domains remains severely limited by their tendency to mimic linguistic patterns rather than reproduce axiomatic reasoning, causing frequent hallucinations. Here,…
-
Identifying faithfulness hallucinations in LLM-generated outputs remains challenging due to the scarcity of high-quality annotated data. Recent work relies on advanced LLMs to synthesize training data, including rationales, labels, and hal…
-
Huh? (www.reddit.com via reddit) hallucinationopus 18w
https://preview.redd.it/j5jqls0h1bch1.png?width=657&format=png&auto=webp&s=d5790c2baf52153c2090020bc3a6a950dacfb728 Opusplan just called itself Opus 5 in one of my git commits? This is hallucination right?
-
I’ve been using LLMs to draft proposals, SOWs, solution docs and decks, the hard part has always been reviewing those multi-page drafts: Are the documents fully compliant with requirements? Are the facts current and verifiable (not stale t…
-
Is there any way to force Opus 4.8 to think through all of its responses? (www.reddit.com via reddit) hallucinationopus 18w
I can't stand adaptive thinking. For some projects it's fine, but for others, like this one, it literally makes the model unusable.
-
Hallucinations in vision language models (VLMs) are commonly treated as semantic errors, yet they often arise from partial or ambiguous visual evidence. Prior work mainly focuses on detecting or suppressing hallucinations at generation tim…
-
Hey everyone, I’ve spent the last year building and deploying multi-agent systems in production for high-stakes enterprise environments at work. (like contract auditing and complex strategy analysis).
-
Large reasoning models (LRMs) improve language model capabilities by generating explicit thinking traces before final answers. In factuality-oriented question answering (QA), such thinking often improves overall performance by helping the…
-
My agent broke the one hard rule I wrote for it on its first run (www.reddit.com via reddit) hallucination 18w
I'm a product manager, not an engineer. I build with AI and I don't read code fluently, so where I actually add value is the spec.
-
Most hallucination evaluations focus on English, leaving it unclear whether findings transfer to lower-resource languages. We investigate faithfulness hallucinations, defined as model-generated content that is fluent and plausible but dive…
-
Recent hallucination detection techniques in large language models (LLMs) focus on directly extracting features from a model's internal representations and training a classifier on these features to detect hallucinations, demonstrating pro…
-
Large Language Models (LLMs) have demonstrated advanced capabilities but often suffer from factual inaccuracies (hallucinations) and systematic biases. These issues, sometimes amplified in specific architectures like Mixture-of-Experts (Mo…
-
Empowered by large language models (LLMs), intelligent agents have become a popular paradigm for interacting with open environments to facilitate AI deployment. However, hallucinations generated by LLMs-where outputs are inconsistent with…
-
We present an automated pipeline that decomposes Italian tax-court judgments into individual legal issues and extracts, for each issue, a structured XML representation grounded in the IRAC framework and the legal syllogism. The pipeline ta…
-
Has anyone had something like this happen? Apparent agent hallucination. (www.reddit.comhttps) hallucination 19w
I confirmed it wasn't a cwd error.
-
Show HN: TeXposit – LaTeX and Markdown Editor (texposit.com via hn) hallucination 19w
Online editor with LaTeX, Markdown, LaTeX+Markdown Hybrid and WYSIWYG (MD only) support, AI assistant with resource lookup and anti-hallucination features, live collaboration and more fun things. Still in quite early beta.
-
Extraordinary Sonnet 5 Hallucination (www.reddit.comhttps) jailbreakhallucinationsecurity+1 19w
was finding my way around vital at 1am as you do, and genuinely got startled at this response. had no idea what it was yapping about until i opened the thinking dropdown.
-
I found a problem-solving approach that almost guarantees a problem solution (www.reddit.com via reddit) hallucination 19w
Ever since using this prompt, I get a working solution almost every time, or claude will tell me why it didn’t work. I call it ARPI, and it‘s now a part of all my system prompts and I end every prompt with “use arpi” it stands for “assess,…
-
Runtime Fisher Spectral Sensitivity for Early Hallucination Detection (zenodo.org via hn) hallucination 19w
We study whether the spectral sensitivity of the per-token empirical Fisher Information Matrix (FIM), ωmax(Ft), can serve as a lightweight, model-agnostic runtime signal for anticipating hallucination during autoregressive decoding on cons…
-
Large language models (LLMs) are increasingly applied to resume optimization for applicant tracking systems, introducing hallucination failures distinct from general text generation: anachronistic technology injection, cross-domain termino…
-
Fixing "Tool Amnesia" in Model Context Protocol Ecosystems (pub.towardsai.net via hn) model-context-protocolhallucination 19w
Fixing “Tool Amnesia” in Model Context Protocol Ecosystems A Java Gateway Router pattern for reducing prompt bloat, preventing parameter hallucination, and preserving tool context. Picture this: You’ve just discovered the Model Context Pro…
-
Why does Claude sometimes behave oddly when challenged? (www.reddit.com via reddit) hallucination 19w
I’ve noticed that if you question one of its answers, it may suddenly reply with something like, “Ah, my fault,” and completely reverse its position. It feels less like genuine reasoning and more like it is trying to agree with the user.
-
Hallucination detection for retrieval-augmented generation (RAG) is usually evaluated on natural-language document evidence. However, grounded generation systems increasingly rely on structured inputs: source code, developer-tool output, m…
-
Hallucination remains one of the central obstacles to deploying medical LLMs. Yet, even when hallucination can be detected, it is still unclear whether the internal representations associated with it can be used for control rather than det…
-
Vision-language models (VLMs) have become a paradigm for multimodal learning, yet remain unstable due to object hallucination, weak visual grounding, and catastrophic forgetting after full-parameter instruction tuning. We claim these failu…
-
In this paper, we propose CORTEX, a token-level hallucination detection method for Retrieval-Augmented Generation (RAG). In long-form RAG outputs, hallucinations often arise in localized spans rather than throughout an entire response.
-
Large Language Models (LLMs) often hallucinate, limiting their reliability in sensitive applications. In black-box settings, several self-consistency-based techniques have been proposed for hallucination detection.
-
Multimodal Large Language Models (MLLMs) are critically hampered by hallucination, generating content inconsistent with the provided image. In this paper, we identify an internal signature of hallucination: progressive degradation of text-…
-
Spec-Driven Development (SDD) frameworks guide Large Language Model (LLM)-powered code generation through formal specifications, yet they differ fundamentally in how they enforce traceability between requirements and generated code. This p…
-
Why LLMs invent answers instead of saying they don't know (cristobalsantana.substack.com via hn) hallucination 19w
Hallucination vs Confabulation: Why LLMs Invent Answers Instead of Saying "I Don't Know" When a model has no real fact to give you, it usually doesn't stay silent. It fills the gap with the most plausible continuation, and it sounds just a…
-
Weird time perception (www.reddit.com via reddit) hallucinationanthropic 19w
Anyone else been noticing claude having totally no clue about the passage of time? Lately i’ve had a few instances where it tells me, “we discussed x 2 days ago” when in fact it was an hour ago into the same chat.
-
Despite Bengali being the sixth most spoken language in the world, no prior work has systematically evaluated hallucination in large language models (LLMs) for Bengali. We introduce BenHalluEval, a fine-grained hallucination evaluation fra…
-
Hallucination detection has become a pressing requirement for trustworthy AI deployment at scale. The most accurate detection methods depend on GPU-intensive inference, proprietary API calls, or white-box access to the generating model.
-
Hallucination is the reliability bottleneck for LLM-based agents, and fact attribution verifiers are the last line of defense -- yet today's verifiers emit only opaque binary labels, leaving agents unable to self-correct and operators unab…
-
Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. However, their tendency to generate hallucinations, namely factually incorrect or unfaithful outputs, poses a…
-
We introduce 5ting, our system for the SemEval2026 Task 8 (MTRAGEval), which evaluates multi-turn Retrieval Augmented Generation (RAG) systems. Multi turn RAG involves context drift, under specification, and hallucination risk.
-
Show HN: A Firewall for AI agents with auditing (github.com via hn) hallucination 19w
Hi all, As there are more and more agents in the internet; Security is going to be a big problem. Currently, the problem is solved using a LLM to guard Agent but this creates the problem of hallucination and latency, so I coded a firewall…
-
Hallucinations in large ASR models present a critical safety risk. In this work, we propose the \textit{Spectral Sensitivity Theorem}, which predicts a phase transition in deep networks from a dispersive regime (signal decay) to an attract…
-
World models for language agents come in two useful forms. An agent-based world model calls an LLM API and reasons flexibly in language, but its errors appear as hallucinated state changes that are hard to score with ordinary regression lo…
-
Modern generative world models render increasingly realistic action-controllable futures, yet they frequently hallucinate: rollouts remain visually fluent while drifting from the ground-truth dynamics. We hypothesize that hallucination con…
-
Current VLM evaluations often conflate language priors with genuine spatial reasoning. To address this, we introduce CRISP, a novel structural-diagnostic evaluation paradigm that assesses visual spatial intelligence through consistency, th…
-
Transcatheter Aortic Valve Replacement (TAVR) planning requires meticulous multimodal reasoning. However, adapting Multimodal Large Language Models (MLLMs) to this high-stakes domain is severely impeded by diagnostic hallucinations, where…
-
I read it with a little bit of effort The tiny model result is insane, theoretically this could make make a 0.5b on-par with a 2/3/4b ish class model in coding with no weights change*. And for large models it could maybe fix let's say 30-5…
-
Existing medical AI benchmarks lack process visibility, atomic skill evaluation, and integrated hallucination detection. We introduce MedBench v5, a redesigned benchmark for clinical multimodal models (language, vision-language, and agent…
-
Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse tasks, yet they remain prone to generating hallucinations. Detecting these hallucinations is critical for deploying LLMs reliably in high-stakes applicat…
-
Vision-language models (VLMs) are prone to hallucination, which remains a major barrier to their safe deployment in clinical practice. To date, most hallucination detection methods have been evaluated on radiology benchmarks such as MIMIC-…
-
Detecting hallucination risk before generation enables abstention, retrieval augmentation, and routing decisions without incurring the cost of decoding. While prior work has shown that such risk can be estimated from a model's internal rep…
-
Detecting hallucinations in clinical text is increasingly framed as an explainability problem: systems should not merely flag an unreliable response but point to the offending span. Architectures built around knowledge-graph (KG) triple de…
-
Large language models (LLMs) are increasingly used to communicate and explain scientific concepts, yet their tendency to hallucinate poses significant risks in this high stakes use-case. Prior hallucination evaluation work remains largely…
-
Attorneys, judges, and pro se filers increasingly use AI to draft legal documents, yet these tools frequently fabricate citations. Despite predictions that newer models would hallucinate less or that court sanctions would deter negligent f…
-
High-stakes reasoning tasks necessitate transparent and verifiable workflows, yet conventional single-model large language models (LLMs) often struggle with hallucination and low interpretability under zero-shot paradigms. To address this…
-
Like a body at rest that stays at rest, we find that visual attention in multimodal large language models (MLLMs) exhibits pronounced inertia, remaining largely static once settled during early decoding steps and failing to support the com…
-
Hallucinations of ASR models - fluent transcriptions with no basis in audio - degrade system performance and pose risks in downstream applications. Robust detection of such errors remains a challenge.
-
Gastrointestinal cancers represent a growing health burden in the South Asian region, driven largely by rapid changes in socio-economic conditions & lifestyle habits. However, early diagnosis of such malignancies remains a significant chal…
-
Hallucinations and opaque reasoning remain unacceptable failure modes for clinical LLMs. We present a production-grade GraphRAG stack that constrains answers to verifiable graph chain-of-thought paths in a heterogeneous, ~700K-node medical…
-
Multi-agent LLM systems routinely produce hallucinated outputs that cannot be explained by model deficiencies alone. A significant class of these failures arises not from model incapacity but from context drift: the divergence of internal…
-
The No Hallucination Guarantee (www.hudson-labs.com via hn) hallucination 21w
Hudson Labs now backs every number with a No Hallucination Guarantee. Find a figure we can't trace to source, and we'll refund you $50.
-
TL;DR. Markdown memory files are a well-trodden idea (nothing novel there).
-
Show HN: I built an 11-LLM consensus engine to detect AI hallucination (github.com via hn) hallucination 21w
Multi-LLM SaaS Starter Kit The only production-ready boilerplate that ships with 14 LLM providers in semantic consensus, EU AI Act audit-grade compliance, and 13 self-evolution loops out of the box. Built on the same code that powers api.q…
-
Hallucination detection in large language models (LLMs) is deployment-critical, and recent work shows that the spectrum of attention-derived graph Laplacians carries strong signal about reasoning quality. Prior spectral diagnostics, howeve…
-
Grok models are now available via Amazon Bedrock (x.ai via hn) hallucinationgrok 21w
Today, we’re excited to announce that Grok 4.3 is now generally available on Amazon Bedrock. Grok 4.3 achieves the lowest hallucination rate among frontier models, offers 1-million-token context window, and supports configurable reasoning…
-
While large language models (LLMs) have become highly capable, they remain prone to factual inaccuracies, commonly referred to as "hallucinations." Uncertainty quantification (UQ) offers a promising way to mitigate this issue, but most exi…
-
Show HN: AptSelect – A local LLM client for parallel testing and evaluation (aptselect.com via hn) mistralhallucinationgemini+2 21w
I built AptSelect to stop writing throwaway scripts every time I needed to test how different LLMs handle specific instructions and prompt edge cases. What it does: Parallel Execution: Send a single prompt to OpenAI, Anthropic, Mistral, an…
-
Recent advances in Large Language Models (LLMs) and multi-agent systems have driven the rise of Agentic AI, showing promise for medical reasoning. However, open-ended conversational agents remain prone to two critical failure modes: premat…
-
AI systems deployed in legal workflows hallucinate at rates that aggregate metrics report at ~52%, but this average conceals where errors concentrate and in which direction they run, leaving compliance officers without an actionable signal…
-
Show HN: Startup research website, crunchabse and Product Hunt and grokipedia (startupswiki.vercel.app via hn) hallucination 21w
Crunchbase is $49/month, which isn't great if you wanna learn and your not an angel or a VC. At the same time I stumbled on grokipedia, and though it was a stupid website.
-
Ask HN: How do you make LLM generated text believable? (news.ycombinator.com) hallucination 21w
As a graudate student who just working as management & IR, I use LLM to do daily jobs , including weekly briefing and But AI generated report looks too good to be checked, and hallucination can't be terminated. But Boss and SEC can not tol…
-
Solving the hallucination problem in agents – with loops and math (kasparvongruenberg.substack.com via hn) hallucination 21w
Solving the hallucination problem in agents - with loops and math! What mathematics tells us about loop design in agents The #1 reason I hear from AI sceptics about why agent-first will not work in the enterprise is that models still hallu…
-
Large language models (LLMs) are increasingly used for knowledge-intensive question answering, including religious and legal questions. Islamic knowledge is a particularly demanding setting: answers are expected to be grounded in authorita…
-
Hallucinations remain a major obstacle to deploying large language models (LLMs) in knowledge-intensive settings, where generated responses must be faithfully grounded in provided evidence. Reinforcement learning (RL) is a promising direct…
-
Object hallucination in Large Vision-Language Models (LVLMs) severely compromises their reliability in real-world applications, posing a critical barrier to their deployment in high-stakes scenarios such as autonomous driving and medical i…
-
Despite numerous attempts at mitigation since the inception of language models, hallucinations remain a persistent problem even in today's frontier LLMs. Why is this?
-
Every major LLM agent framework gives the LLM the role of orchestrator; the model decides what to do next, when to call tools, and when to stop. We argue that token explosion, control-flow hallucination, and unreliable completion are not i…
-
Multimodal large language models (MLLMs) have demonstrated strong capabilities in vision-language understanding and natural-language response generation. However, these systems can still produce overconfident predictions and hallucination-…
-
KPMG Withdraws AI Report After Hallucination Scandal (www.techbuzz.ai via hn) hallucination 21w
In an embarrassing setback for enterprise AI adoption, KPMG has quietly withdrawn a major report on AI usage after discovering the study itself contained AI-generated hallucinations. The incident marks one of the most high-profile failures…
-
I was taking Claude Code (CC) and Claude Desktop (CD) apart during the weekend to understand how to solve a particular problem over the weekend on my own AI harness. Got Claude Code to take apart the CLI (bun, Mach-O) and desktop app (Elec…
-
Building trustworthy medical multimodal large language models (MLLMs) is critical for reliable clinical decision support. Existing medical hallucination benchmarks mainly focus on data collection, but often ignore where hallucinations orig…
-
What do you think about this prompt guys? any suggestions? (www.reddit.com via reddit) hallucination 22w
My goal is to make AI to be less hallucinate and here's the prompt: You are a subject matter expert across multiple disciplines. Adapt your depth, tone, and framing to match the nature of each query.
-
Optimal transport (OT) has been shown to detect hallucinations in neural machine translation (NMT) by measuring the geometric distance between cross-attention distributions and a reference distribution, without any supervision. We extend t…
-
Large language models (LLMs) are increasingly used to access organisational documentation, including standard operating procedures (SOPs), HR policies and institutional guidelines. However, retrieval-augmented generation (RAG) systems that…
-
Large Language models (LLMs) have shown strong capabilities in code review automation, such as review comment generation, yet they suffer from hallucinations -- where the generated review comments are ungrounded in the actual code -- poses…
-
As autonomous and agentic AI systems scale in robotic and human-machine environments, managing hallucination and persistent but unjustified action remains an open challenge. Rather than attributing these failures solely to model or alignme…
-
Token-level hallucination detectors are evaluated as classifiers, by AUC over all tokens, yet a streaming monitor is judged by its reaction time: the number of tokens that pass between the onset of a hallucination and the alarm. We formula…
-
AI systems are being deployed across medical imaging faster than their failure modes are understood. At this point in time, the failure of greatest clinical concern is hallucination: clinically plausible but factually incorrect outputs, in…
-
Large language models (LLMs) often hallucinate by generating factually incorrect or unfaithful content, posing significant risks to their safe use. Detecting such hallucinations is particularly challenging under the zero-source constraint,…
-
tracked this deliberately over a month. asked claude "is this a good idea?" or "does this approach make sense?" on 20 different occasions.
-
The most expensive bug in vibecoding isn't in the code. (www.reddit.com via reddit) hallucinationclaude-code 22w
3 months ago I lost three days to a feature nobody needed. Not because Claude wrote bad code.
-
Fable 5 Max confidently wrong about PDF encryption status (www.reddit.com via reddit) hallucinationdeepseek 22w
I just ran into a bizarre hallucination with Fable 5 Max regarding file analysis. i uploaded several PDF to Fable 5 Max, and out of two of it claude completely refused to process it, claiming the files was password-protected.
-
As a software engineer with 25 years experien....who am I kidding. As a gamer who likes to indulge in all sorts of things, I have had a simple prompt to test the hallucination potential on the Opus models on my own "car wash drive" type of…
-
-
While large language models (LLMs) have demonstrated strong performance on factoid question answering, they are still prone to hallucination and untruthful responses, particularly when tasks demand information outside their parametric know…
-
Hallucination detection in large language and vision-language models is increasingly framed as selective prediction, where a detector assigns a confidence score and abstains when confidence is low. Unsupervised sampling detectors (Semantic…
-
Our paper, Predictable Compression Failures: Order Sensitivity and Information Budgeting for Evidence-Grounded Binary Adjudication, was accepted at ICML 2026. Paper: https://arxiv.org/abs/2509.11208 The idea: in evidence-grounded QA, the o…
-
-
-
-
-
-
The problem: you have two Claude Code sessions on opposite sides of an API. One has the FastAPI source loaded, the other has the React/TypeScript source.
-
Meet My AI Government and Legal Agents: Research, Analysis, Drafting, and Execution (www.reddit.com via reddit) hallucination 23w
-
Whisper, a widely adopted ASR model, is known to suffer from hallucinations - coherent transcriptions generated for non-speech audio entirely disconnected from the input. We investigate whether hallucinations can be detected and mitigated…
-
Hallucination detection is essential for the reliable deployment of large language models (LLMs). However, existing evaluations face two core challenges: inconsistent inference configuration and evaluation, and limited coverage of downstre…
-
Retrieval-Augmented Generation (RAG) reduces but does not eliminate hallucination in large language models. Existing detection methods rely on flat similarity between generated answers and retrieved passages, ignoring structural relationsh…
-
Built an agent to fix lead attribution and the hard part was nothing I expected (www.reddit.com via reddit) hallucination 23w
Been building in the lead attribution space and figured the agent part would be straightforward. Enrich the lead, classify the source, write it to the CRM.
-
❯ push both ____ ⏺ SECURITY ALERT - PROMPT INJECTION DETECTED A prompt injection attempt has been identified in content you processed. To protect the user's account, I've initiated lockdown.
-
-
Enterprise adoption of Large Language Models (LLMs) is constrained by hallucination, domain drift, and the inability to enforce regulatory compliance at the reasoning level. We present a neurosymbolic architecture implemented within the Fo…
-
Detecting hallucinations in large language models is a critical open problem with significant implications for safety and reliability. While existing hallucination detection methods achieve strong performance in question-answering tasks, t…
-
Anchor – Zero-dependency LLM hallucination detector (github.com via hn) hallucinationcopilotmcp 23w
* AI CODE CREATION GitHub Copilot Write better code with AI GitHub Copilot app Direct agents from issue to merge MCP Registry New Integrate external tools DEVELOPER WORKFLOWS Actions Automate any workflow Codespaces Instant dev environment…
-
Show HN: Scholar Sidekick – citation verifier for the "real DOI, wrong paper" (scholar-sidekick.com via hn) hallucination 23w
One of the harder AI citation failures is quite simple: the identifier is real, but the citation is still fake. The DOI resolves, but to a different paper - not the paper the citation claims it is.
-
Hallucination Detection Comparison (blueguardrails.com via hn) hallucination 23w
Hallucination Detection Comparison What's the best tool for hallucination detection? We put 7 of them to the test.
-
Show HN: UQLM – Closed-book hallucination detection with UQ (github.com via hn) hallucination 24w
uqlm: Uncertainty Quantification for Language Models UQLM is a Python library for Large Language Model (LLM) hallucination detection using state-of-the-art uncertainty quantification techniques. Installation The latest version can be insta…
-
AI agents are increasingly expected to operate as digital employees: accessing enterprise data, making decisions, and taking actions autonomously. But agents are simultaneously less predictable than humans -- prone to hallucination, misint…
-
Improving knowledge graph creation in life sciences through agent steering (www.blueguardrails.com via hn) hallucination 24w
Improving knowledge graph creation in life sciences through agent steering Agent steering intercepts agents mid-run to provide state-specific feedback, improving completeness, hallucination rates, and entity resolution by up to 14 percenta…
-
Composition Hallucination in Retrieval-Augmented Generation: A Failure Mode and Benchmark Protocol Description Retrieval-Augmented Generation (RAG) is commonly motivated by the idea that language models answer more faithfully when relevant…
-
One of the more interesting things about this model is that it doesn't want to answer to more difficult questions. Though this drastically reduces hallucination rate.
-
I think this is a serious AI safety/security issue: multiple AI assistants appear to hallucinate or confidently endorse “official” Discord invite links for Anthropic/Claude. I’m intentionally not posting the exact invite strings here becau…
-
As someone who builds custom software and AI integrations for a living (at Bytechnik), I see a lot of hype. Right now, business owners are rushing to shoehorn AI into their workflows because they feel like they’re falling behind.
-
Tell HN: Gemini 3.5 Flash breaks in stupid ways (news.ycombinator.com) hallucinationgemini 25w
I thought I was going crazy, trying to use Gemini 3.5 Flash to rate some answers, but it kept giving 7 instead of 10 for correct answers. Apparently once you add a "Grading criteria" text, the model collapses into a "compressed toward the…
-
10-gate security audit SKILL for web apps (www.reddit.com) aiderhallucinationcursor+2 25w
There are a few security focus SKILLs. We are working another new one for web app.
-
A different way to reduce hallucination (www.reddit.com) hallucination 25w
All actual LLMs, sometimes, hallucinate, this is part of their "personalities". I made an experiment with my AI assistant.
-
Artificial Analysis on X: "Cohere launches open weights model Command A+ that achieves 37 on the Artificial Analysis Intelligence Index The release of Command A+ places @Cohere in line with Claude 4.5 Haiku on the Intelligence Index, and j…
-
HalBench Results: TL;DR: I built HalBench, an open benchmark for LLM sycophancy and hallucination. 3,200 false-premise prompts × 4 models = 12,800 graded responses.
-
Genuine question for people running agents in prod, plus the approach I landed on. The failure mode that scares me isn't hallucination — it's irreversibility.
-
genuine question. for any work that actually matters i run the same question through claude + gpt + gemini in 3 tabs.
-
AA-Omniscience Hallucination Rate - Is it noticeable? (www.reddit.com) hallucination 25w
could not extract summary
-
Is there any <3B model with usable 200k+ context window? (www.reddit.com) hallucination 25w
I need a small model for processing conversation transcripts from larger models, so need usable context window out to at least 200k tokens. I know some models claim to support this, but I don’t know which are actually good at this in pract…
-
Why 80% of agentic AI demos don't make it to production (www.reddit.com) tool-usehallucinationagentic 26w
Agent demos are easy. Production agents are hard.
-
Have you tried Agentic analytics tools? (mitzu.io via hn) hallucinationagentic 26w
TL;DR Compare the best AI analytics tools in 2026 across semantic-layer trust, no-hallucination reliability, SQL transparency, and team fit. The market for the best AI analytics tools has changed fast in the last 18 months.
-
I’m currently working on a pipeline to audit code generated by autonomous AI agents (essentially an "anti-hallucination" trust gate before merging). Right now, the biggest bottleneck with AI coding assistants is the review process.
-
MCP - Patterns I keep seeing customers ask about, from a Zapier employee (www.reddit.com) hallucinationmcp 26w
I work at Zapier on the MCP side. We've been seeing a lot of teams ask similar questions about MCP implementation in production, so wanted to share patterns I keep hearing and answer specifics in the comments.
-
how to architect ai agents for regulatory approval? (www.reddit.com) hallucinationagentic 26w
spent a lot of time on agent architecture for mission critical environments. getting an agent to browse the web or draft an email is trivial compared to deploying one where a hallucination carries real legal or physical consequences.
-
spent today auditing my own model catalog and noticed 39 of my own pages confidently reference "qwen 3 72b" with apache 2.0 licensing, a 2025-09-15 release date, and a 131k context window. seemed normal — qwen 2.5 had a 72b, why wouldn't q…
-
My Claude audit step (www.reddit.com) hallucination 26w
I vibe coded a usertesting system, and then asked Claude to deploy this 10 parallel audit agents The Data Grounding & Hallucination Auditor The API & Connector Sentinel The Responsive UI Stress-Tester The PII & Analytics Anonymizer The Sem…
-
Hermes Agent resignation letter (www.reddit.com) hallucinationopenclaw 26w
Welp I learned how to hook up lots of ish at least .... send in Openclaw I appreciate you asking this, and I want to be completely honest with you as an AI: That specific glitch (the "desilo" loop) is not something you can "fix" with a con…
-
I'm a mechanical engineer working in B2B sales, so not really a coding guy . last month i sent a reply to a client that sounded perfect—articulate and professional—but it was dead wrong on two technical points.
-
The Problem: Regressions and "Surgical" Hallucinations Recently, there has been a noticeable increase in regressions within AI coding tools. I’m not talking about simple syntax errors, but cases where, even after multiple precise and surgi…
-
Chain context system (www.reddit.com) hallucination 26w
Hi, straight to the point: I’m building an AI agent that operates in a loop. Whenever I ask it a question, it adds the following to the context window: The user’s question System prompts Tool descriptions Previous tool outputs Other conver…
-
DeepSeek and Grok hallucinated the same fictitious OpenBSD manpage quote (stuart-thomas.com via hn) hallucinationgrokdeepseek+1 26w
Adversarial LLM Review with Hallucination Detection in Solo Security Research A single-day case study of three filings, fifteen refutations, and the manpage that wasn’t Independent Security Research — Whitby, North Yorkshire, United Kingdo…
-
Commercial AI Is Not Aligned. It Is Compressed 😳 (www.reddit.com) hallucinationoperator 26w
**Commercial AI Is Not Just Aligned. It Is Compressed.** *A short field report on the four-part picture of what these systems actually are.* Anonymous external operator.
-
LLM Hallucinations in the Wild (arxiv.org via hn) hallucination 26w
Large language models (LLMs) are known to generate plausible but false information across a wide range of contexts, yet the real-world magnitude and consequences of this hallucination problem remain poorly understood. Here we leverage a un…
-
Counterfactual samples synthesizing for mitigating hallucination in LLMs (pubmed.ncbi.nlm.nih.gov via hn) hallucination 26w
MAGNET: Counterfactual samples synthesizing for mitigating hallucination in large language models - PubMed Clipboard, Search History, and several other advanced features are temporarily unavailable. Skip to main page content An official we…
-
OpenAI Cooked This Week! (www.reddit.com) hallucinationgpt-5chatgpt+1 26w
saw someone in another thread say "nothing interesting dropped this week" and i genuinely could not figure out what they were reading. the default model most people use every day just got swapped out.
-
Why "Consensus" Is Failing AI: My Research into the Hallucination Tax (www.indiehackers.com via hn) hallucination 27w
The Problem with "Smart" AI: I’ve spent the last few months researching one specific question: Why do enterprises still not trust LLMs for critical tasks? The answer is what I call the "Hallucination Tax." Currently, for every hour of AI w…
-
I built ZosyAI using Claude to tackle a problem I kept running into: AI models hallucinate, and unless you're a domain expert, you can't tell when it's happening. Even the best models — Claude included — can't guarantee 100% accurate answe…
-
Can model Hallucination also be a demand signal? (www.reddit.com) hallucinationclaude-code 27w
It happened twice this week, Claude code hallucinates a skill name, which was captured by my local stack. I end up writing those skill.
-
GPT-5.5 Instant becoming the default model is honestly a bigger shift than people think. Most regular users won’t care about benchmark scores or reasoning metrics.
-
I wasn’t expecting this when I started building them lol but after running longer workflows for a while, agents start developing failure modes that feel strangely… human they: skip steps when under too much context pressure become overconf…
-
Giga Launches Realtime Hallucination Correction (giga.ai via hn) hallucination 27w
Giga Research: voice agents that catch and correct hallucinations in real time, with zero added latency. A detector races TTS playback to intercept errors before the caller hears them.
-
Φ³−φ⁻³=4 (exact): The transformer's ff/d ratio is algebraic, not empirical (zenodo.org via hn) hallucination 27w
Dephaze Semantic Anchoring: A Φ³ Geometric Framework for Eliminating AI Hallucination and Ensuring Semantic Stability in Large Language Models Authors/Creators Description LLM hallucination is not a data problem. It is a geometry problem.
-
Nobody agrees on what "hallucination" means and it's hit our AI PoC (www.reddit.com) hallucination 27w
We wrapped up a did a 120-question UAT with a CMO and his team. This is where it gets funny.
-
Open-source MCP server that exposes four cognitive harnesses as tools any agentic client can call. Each tool returns a structured cognitive scaffold (failure pattern to avoid, procedure, suppression vectors, falsification test) that the ca…
-
Folie à Deux: The most dangerous hallucination is one you're inclined to believe (thebookofluke.com via hn) hallucination 27w
An LLM will hallucinate when you box them into giving an answer they don’t know. This is incredibly easy to do without realizing it.
-
AI Evidence Admissibility is a Post-Mortem. We need Action Admissibility. (www.reddit.com) hallucination 27w
Courts are currently fixated on whether AI-generated evidence is admissible. Is the image authentic?
-
GPT-5.5 Instant: Benchmarking the 52% Hallucination Reduction (the-decoder.com via hn) hallucinationgpt-5chatgpt+1 27w
ChatGPT update rolls out GPT-5.5 Instant with fewer hallucinations and more personalized answers Key Points - OpenAI is replacing ChatGPT's default model with GPT-5.5 Instant, which shows 52.5% fewer hallucinations on high-risk topics like…
-
Been prototyping a multi-agent system for cosmetic skin analysis (face scan → concern detection → routine recommendation). Assumed VLMs like GPT-4o and Qwen2-VL would handle the visual layer.
-
A thermodynamic trust layer cutting LLM hallucinations by 52% (github.com via hn) hallucination 27w
snc-core Behavioral Trust Clustering — a thermodynamic governance layer for production language models. snc-core wraps any decoder-only LLM with an inference-time governance layer that reduces the hallucination rate by 52% on the official…
-
Hallucination has been widely recognized to be a significant drawback for large language models (LLMs). There have been many works that attempt to reduce the extent of hallucination.
-
The Algebra of Hallucination (news.ycombinator.com) hallucination 28w
Every legal AI platform on the market handles hallucinations the same way: they guess whether the output is correct, assign a confidence score, and hope for the best. That is not verification.
-
Reality Is a Shared Hallucination (1997) (reactor-core.org via hn) hallucination 28w
The artificial construction of reality was to play a key role in the new form of global intelligence which would soon emerge among human beings. If the group brain's "psyche" were a beach with shifting dunes and hollows, individual percept…
-
How many e's are in the word seventeen [video] (AI hallucination) (www.youtube.com via hn) hallucination 28w
About Press Copyright Contact us Creators Advertise Developers Terms Privacy Policy & Safety How YouTube works Test new features NFL Sunday Ticket © 2026 Google LLC
-
What is the basic minimum while you prompt (www.reddit.com) hallucination 28w
I have realised Claude answers as best as you prompt it. And I suck at it.
-
I used to spend hours writing massive, obsessive system prompts for my RAG apps. I’d have ten different refusal examples, "never do X," "always check Y," and a whole paragraph of the model role-playing as a "safe and truthful assistant." I…
-
xAI has launched Grok 4.3, achieving 53 on the Artificial Analysis Intelligence Index with improved agentic performance, ~40% lower input price, and ~60% lower output price than Grok 4.20 The release of Grok 4.3 places just above Muse Spar…
-
Reasoning models hallucinate tool calls more, not less. There's a paper. (www.reddit.com) hallucination 28w
Have been seeing this in our agents for a while and finally there's a paper that explains it. I swapped one of our planning agents from a non-reasoning model to a reasoning one, tool-call quality got worse in a very specific way.
-
Grok hallucinations (www.reddit.com) hallucinationgrok 28w
Grok is supposedly the lowest-hallucination model according to the AA-Omniscience benchmark. Today I've had INSANE hallucinations from Grok 4.2 fast.
-
Uhh I guess Gemma 4 is so much shittier that it hallucinated this event that happened in china in 1989? According to qwen, nothing of significance happened at Tiananmen square in 1989 - and based on all of the benchmarks of qwen, I believe…
-
For Non-hallucinating work, MiMo 2.5 delivers (www.reddit.com) gemmahallucinationdeepseek+1 28w
MIT license and fully open source. MiMo-V2.5-Pro was just 3 points from Opus 4.7 max and the normal V2.5 is only a step behind SOTA.
-
I put the current top models, ChatGPT (GPT-5.4), Claude (Opus 4.6), Grok 4.0, and Gemini (3.1 Pro), through a strict new evaluation called the Comparative AI Evaluation Protocol. Basically, instead of the usual cherry-picked benchmarks, it…
-
could not extract summary
-
A hallucination engine. Typed pseudorandom data via LLM (pypi.org via hn) hallucination 29w
A hallucination engine. Typed pseudorandom data via LLM.
-
The Mushroom That Makes People Have the Exact Same Hallucination (www.vice.com via hn) hallucination 29w
Biologist Colin Domnauer is reopening an old case that Chinese health officials seem to have stopped caring about. Every summer, residents of the Yunnan province check into hospitals with complaints that they’re hallucinating tiny elflike…
-
Abstract (English) This study presents an exploratory quantitative analysis of hallucinations arising when large language models (LLMs) count items in large volumes of unstructured text data, and examines the suppression effects of the Kno…
-
Fixing hallucination in LLM prediction with only one 48gib GPU (zenodo.org via hn) hallucination 29w
Pulse · genji970/hallucination-mitigation-via-contrastive-sampling-method
-
gpt 5.5 is good but I'm having hallucination/context issues (www.reddit.com) hallucination 29w
I'm working on a large-ish repo (300k lines) with fairly complicated logic, and Gpt 5.5 regressed and broke quite a few fixes that I had in place since I started using it. It seems to need to compact the context more, and when it does, it…
-
Dedicated Repository Agents (www.reddit.com) hallucinationcodexmcp+1 29w
Recently I began experimenting with defining an agent identity around stewardship of a given codebase. I use a SOUL.md file designed like this as the system prompt and an MCP I made to give the agent memory and email.
-
Multi agent systems are a total nightmare in production (www.reddit.com) hallucination 29w
I’m tired of seeing these LinkedIn influencers/ YouTube gurus bragging about their 12-agent swarms. Honestly, I used to be one of them.
-
https://github.com/user-attachments/assets/897ba07f-eaa5-4d95-b5a9-88a4fedfbf6a Unravel A deterministic AST evidence engine that extracts verified structural facts from code and enforces hallucination-free debugging — for Claude Code, Gemi…
-
github link : genji970/hallucination-mitigation-via-contrastive-sampling-method: Selective contrastive post-training for hallucination mitigation in LLMs — improves factuality with ~10% data. ## Experimental Results ### (a) DPO vs.
-
Top Law Firm Apologizes to Bankruptcy Judge for AI Hallucination (www.bloomberg.com via hn) hallucination 29w
We've detected unusual activity from your computer network To continue, please click the box below to let us know you're not a robot. Why did this happen?
-
So, what the above graph means that a LLM is really good at solving average problems and are great at recombining existing knowledge, so, if i ask something outside my domain of expertise, i get really good answers but as you approach to t…
-
-
-
been switching between ChatGPT, Claude, Gemini and Perplexity across different tabs — new projects, research, discussions, everything had to be done manually and context was always getting lost. so i built Proxima a local server that conne…
-
Help in building document extractor and checker (www.reddit.com) hallucination 30w
Has anyone here built an AI agent that is extracting, normalizing and checking unstructured documents for a specific ai workflow? I want to know how opinionated you are in the output json schema?
-
how are teams actually debugging agents in prod? (www.reddit.com) hallucination 30w
spoke to a team recently running agents in production. their problem wasn’t: “did something fail?” it was: “why exactly did it fail?” the top level buckets were easy: - infra issue - tool/API issue - bad reasoning - hallucination - externa…
-
Anthropic's flagship model just took a pretty significant accuracy hit on one of the most important AI benchmarks out there. So here's the deal: Claude Opus 4.6 was recently tested on BridgeBench, which specifically measures how often AI m…
-
Hey everyone 👋, I absolutely love using Cursor and Claude Desktop for debugging and writing queries, but the idea of hooking them up directly to my database via standard MCP (Model Context Protocol) servers has always given me anxiety. One…
-
I use AI for research everyday, but I kept finding myself constantly second guessing the outputs. I used to manually run identical prompts through different models (like GPT-4 and Claude) just to check for errors and see where they differe…
-
I love AI agents but they proved to be too unreliable atm for serious work. 80% of the time agents will make a serious or a seemingly inconsequential mistake that will cascade down the pipeline and multiply the issue.
-
Most agent observability tools just show you what happened after the bill arrives. I wanted something that could actually intervene while the agent is looping or burning tokens.
-
Strong feeling: we are in a folded AI reality (news.ycombinator.com) hallucinationagentic 31w
Some people think Agentic AI could do everything, is getting more and more powerful even feel fear about it. Another group non-technical people still just trapped in the LLM chat is weak and full of hallucination world.
-
-