By on
Reality Check: How to Navigate AI Hallucinations
Unless you’ve been under a rock the last two years, it’s hard to escape news about generative AI hallucination horror stories in the legal industry. And perhaps none have been more widely reported than the troubles of the attorneys in New York and Boston who relied on ChatGPT for legal research, only to learn that the judges in their respective cases couldn’t find some of the caselaw – because it didn’t exist.
The AI, in short, had hallucinated.
As generative artificial intelligence (generative AI, or GenAI) becomes increasingly integrated into our daily lives and workflows, follow these tips to spot AI hallucinations and ensure the information you receive from GenAI is reliable and trustworthy.
Contents
- Different types of AI
- What is a GenAI hallucination?
- Types of GenAI hallucinations
- What causes GenAI hallucinations?
- 10 tips to combat GenAI hallucinations
- What to look for in vetting GenAI tools
Laying the table: different types of AI
GenAI has become a bit of a catch-all term, but it’s really the latest in a series of types of AI, including a couple we’re all so familiar with in the legal and ediscovery industries we probably don’t even think of them as AI:
- Unsupervised learning: analyzes text to determine what concepts are similar or linked together. Seen in analytics and topic clustering functions.
- Supervised learning: analyzes context and metadata to make “if this, then that” statements. Seen in TAR 1.0 (so-called “predictive coding”) and TAR 2.0 (or continuous learning-based workflows).
- Generative AI (GenAI): creates new content based on a data set and leverages large language models (LLM). Seen in ChatGPT.
This is by no means an exhaustive list of the different kinds of AI, but for purposes of this blog post, we’ll focus on GenAI – as uniquely susceptible to the challenge of hallucinations.
What is a GenAI hallucination?
Because LLMs are designed to produce fluent, coherent text, when a tool perceives nonexistent patterns, it provides answers that can appear plausible, but might well be untrue – and even complete nonsense. These can range from minor inconsistencies to completely fabricated information, and are referred to as AI hallucinations.
The term “hallucination” was first applied to AI systems in the late 2010s, and gained wider recognition during the AI boom of the early 2020s when Meta warned that algorithms are prone to hallucinate, i.e., “confidently state information that isn’t correct.”
Types of GenAI hallucinations
There are several types of hallucinations, including the following examples.
Sentence contradiction
This is when an LLM generates a sentence that contradicts a previous sentence. For example:
Prompt: “Write a description of a landscape in four-word sentences.”
Output: “The grass was green. The mountains were blue. The river was purple. The grass was brown.”
Prompt contradiction
This is when the response may be technically accurate, but does not correctly answer the prompt. For example:
Prompt: “Write a birthday card for my niece.”
Output: “Happy anniversary, Mom and Dad!”
Factual contradiction
This is when the AI generates fictitious information and presents it as a fact – such as the AI-hallucinated caselaw I referenced in the introduction. For example:
Prompt: “Name three cities in the United States.”
Output: “New York, Los Angeles, Toronto.”
Irrelevant or random hallucinations
This is when random information with no pertinence to the output or input is generated, or where a relevant piece of information is twinned with an irrelevant one.
Prompt: “Describe London to me.”
Output: “London is a city in England. Cats need to be fed at least once a day.”
What causes GenAI hallucinations?
GenAI uses large language models (LLMs), which are machine learning models that can process and generate text in human language – conveying the powerful (and very useful!) impression that something like a ChatGPT is able to understand your questions, and can give you a response in plain English (or another language).
Those responses are often very useful, but note that what ChatGPT is doing is not “understanding the question” in the way you’d expect a human listener or reader to do. Rather, ChatGPT is processing an incredible amount of data – the “large” in “large language model” – to calculate probabilities and construct an answer that has the highest likelihood of being true.
Conversely, precisely because LLMs make predictions by finding patterns in the data, if the training data is incomplete or biased, the model may learn incorrect patterns and generate incorrect predictions, aka, hallucinations.
Stated differently, a GenAI hallucination isn’t just wrong information – it is information that has some probability of being true (but isn’t in fact true!). And because LLMs are designed to produce fluent, coherent text, when a tool perceives nonexistent patterns, it creates outcomes that can range from minor inconsistencies to complete nonsense, but yet appear plausible.
How to prevent GenAI hallucinations: 10 tips
LLMs are not capable of determining accuracy; they only predict what ordering of words will have the highest probability of success.
As a user, there are some steps you can take to mitigate the risk of hallucinations when using GenAI tools.
1. Refine results with multiple prompts
Multiple prompts help at two levels:
First, you are able to break complex requests down into individual steps that you can fact-check at each stage, helping eliminate the opportunity for error.
Second, framing multiple prompts takes into account the nature of GenAI – as a calculator of probabilities and not a dispenser of truth. Think of this as a feature, not a bug. The process of trying to get answers should reflect that.
For example:
Prompt 1: Read the report, attached.* Please provide a 20-30 word summary of each section.
Prompt 2: Condense each summarized section into 1-2 high-level bullet points of 5-10 words each.
Prompt 3: Draft an email I can share with my boss, the CFO of a large automotive company, briefly introducing the report and containing a list of these bullet points. The language should be formal and brief.
*Did you know? With Cecilia doc summaries and other AI tools, you can upload a document, table, or PDF, and the generative AI tool will read it in seconds.
2. Be specific with your GenAI prompts
When requesting an ask from a GenAI tool, specificity is key.
Providing clear and detailed instructions can guide the AI toward generating the desired output without leaving too much room for interpretation. This means specifying context, desired details, and even citing sources.
Good prompt: Detail the diplomatic tensions that led to Napoleon’s conflict in the Battle of Waterloo.
Bad prompt: Tell me about Napoleon’s last war.
3. If you are unsure about a fact, don’t assume or guess – just ask
Guessing can lead to what we call “false premise fallacy,” i.e., the assumption of facts.
Read more at
https://csdisco.com/blog/reality-check-how-to-navigate-ai-hallucinations
