about
Verif.ai: Open-Source Generative Q&A System with Referenced Answers (arxiv.org)
2 points by nikolamilosevic on Jul 6, 2024 | hide | past | pdf | discuss on HN

In plain words: A free tool answers science questions by searching PubMed papers, then having a language model write an answer that cites the papers it drew from. A separate checker compares each claim against its source to flag made-up content, unlike usual chatbots that answer without checking.

Abstract · Verif.ai: Towards an Open-Source Scientific Generative Question-Answering System with Referenced and Verifiable Answers

In this paper, we present the current progress of the project Verif.ai, an open-source scientific generative question-answering system with referenced and verified answers. The components of the system are (1) an information retrieval system combining semantic and lexical search techniques over scientific papers (PubMed), (2) a fine-tuned generative model (Mistral 7B) taking top answers and generating answers with references to the papers from which the claim was derived, and (3) a verification engine that cross-checks the generated claim and the abstract or paper from which the claim was derived, verifying whether there may have been any hallucinations in generating the claim. We are reinforcing the generative model by providing the abstract in context, but in addition, an independent set of methods and models are verifying the answer and checking for hallucinations. Therefore, we believe that by using our method, we can make scientists more productive, while building trust in the use of generative language models in scientific environments, where hallucinations and misinformation cannot be tolerated.

Miloš Košprdić, Adela Ljajić, Bojana Bašaragin, Darija Medvecki, Nikola Milošević
arXiv:2402.18589 · cs.IR, cs.AI, cs.CL, cs.LG · submitted Feb 9, 2024
abstract · pdf · html · Accepted as a short paper at The Sixteenth International Conference on Evolving Internet (INTERNET 2024)

add comment on HN