In plain words: ChatGPT was tested on seven tasks that pull facts from text, checking its accuracy, explanations, confidence, and faithfulness to the source. It struggled with fixed-format extraction but handled open-ended ones well, gave trustworthy explanations, and usually stayed faithful, though often overconfident.
Abstract · Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness
The capability of Large Language Models (LLMs) like ChatGPT to comprehend user intent and provide reasonable responses has made them extremely popular lately. In this paper, we focus on assessing the overall ability of ChatGPT using 7 fine-grained information extraction (IE) tasks. Specially, we present the systematically analysis by measuring ChatGPT's performance, explainability, calibration, and faithfulness, and resulting in 15 keys from either the ChatGPT or domain experts. Our findings reveal that ChatGPT's performance in Standard-IE setting is poor, but it surprisingly exhibits excellent performance in the OpenIE setting, as evidenced by human evaluation. In addition, our research indicates that ChatGPT provides high-quality and trustworthy explanations for its decisions. However, there is an issue of ChatGPT being overconfident in its predictions, which resulting in low calibration. Furthermore, ChatGPT demonstrates a high level of faithfulness to the original text in the majority of cases. We manually annotate and release the test sets of 7 fine-grained IE tasks contains 14 datasets to further promote the research. The datasets and code are available at https://github.com/pkuserc/ChatGPT_for_IE.
Bo Li, Gexiang Fang, Yang Yang, Quansen Wang, Wei Ye, Wen Zhao, Shikun Zhang
arXiv:2304.11633 · cs.CL · submitted Apr 23, 2023
abstract · pdf · html
- "ChatGPT’s performance in Standard-IE settings is not as good as BERT-based models in most cases. However, ChatGPT achieved excellent accuracy scores in the OpenIE setting, as evaluated by human annotators."
- "ChatGPT could provide high-quality and trustworthy explanations for its predictions. One of the key issues is its tendency towards overconfidence, resulting in low calibration."
- "ChatGPT exhibits a high level of faithfulness to the original text, indicating that its predictions are grounded in the input text."