In the innovative world of AI, generative AI tools like ChatGPT have the problem of hallucinating and yielding the wrong output: In the emerging, innovative world of AI, a constant issue is that AI might confidently generate wrong information—a situation known as “hallucination “ Recent AI hallucinations include Air Canada implementing the wrong discount-based on ChatGPT’s output and Google’s AI stating that ingesting rocks is safe.
Sebastian Farquhar, an author of the study, is a senior research fellow and research scientist on Google DeepMind’s safety team “I hope that this opens up ways for large language models to be deployed where they can’t currently be deployed—where a little bit more reliability than is currently available is needed,” says at Oxford University’s department of computer science.
Though a recent advancement holds prospects for resolving this question, in a work that was published in Nature Scientific magazine, the researchers have discovered a new way of identifying the presence of AI hallucinations. This approach is designed to ask a question, and then analyze both the question and the AI-generated correct answer to determine if the student’s answer is correct or not; It can work with approximately 79 % accuracy, which is higher than current solutions. This may only address one of the causes of the AI hallucinations and the new approach demands more computations but this development may lead to more accurate AI systems in the future.
The research team chose to investigate one form of hallucination known as “confabulations,” which is a phenomenon in which an AI model generates inaccurate and inconsistent responses to well-defined questions. Through such confabulations, the researchers hope to enhance the correctness or fitness of the AI-derived responses.
Procedure
The method used in the study involves creating multiple responses to a specific question by a chatbot, and then using an LM to group the responses into equivalent meanings. To measure the relatedness of the meanings of string vectors, researchers use a concept called semantic entropy. For generating a high semantic entropy score, the model is considered to be confabulating, while a low score means that the answer decided has been consistent, and hence, it’s less probable that it is a hallucination.
Despite these challenges, the development of a method to detect AI hallucinations is a significant step forward in more accurate and reliable AI systems. As AI continues to permeate various aspects of our lives, the importance of ensuring that these tools provide accurate and trustworthy information cannot be overstated. This groundbreaking research brings us one step closer to a future where AI can be relied upon to deliver consistently.
Automated Evaluation Method for Assessing Hallucination in RAG Models
