about
AviationGPT: A Large Language Model for the Aviation Domain (arxiv.org)
1 point by belter on Nov 30, 2023 | hide | past | pdf | discuss on HN

In plain words: A chatbot made by continuing to train open, general-purpose language models on aviation text, so it understands airline jargon and can answer questions, summarize documents, and extract information. In tested cases it improved performance by over 40% compared with general-purpose chatbots.

Abstract

The advent of ChatGPT and GPT-4 has captivated the world with large language models (LLMs), demonstrating exceptional performance in question-answering, summarization, and content generation. The aviation industry is characterized by an abundance of complex, unstructured text data, replete with technical jargon and specialized terminology. Moreover, labeled data for model building are scarce in this domain, resulting in low usage of aviation text data. The emergence of LLMs presents an opportunity to transform this situation, but there is a lack of LLMs specifically designed for the aviation domain. To address this gap, we propose AviationGPT, which is built on open-source LLaMA-2 and Mistral architectures and continuously trained on a wealth of carefully curated aviation datasets. Experimental results reveal that AviationGPT offers users multiple advantages, including the versatility to tackle diverse natural language processing (NLP) problems (e.g., question-answering, summarization, document writing, information extraction, report querying, data cleaning, and interactive data exploration). It also provides accurate and contextually relevant responses within the aviation domain and significantly improves performance (e.g., over a 40% performance gain in tested cases). With AviationGPT, the aviation industry is better equipped to address more complex research problems and enhance the efficiency and safety of National Airspace System (NAS) operations.

Liya Wang, Jason Chou, Xin Zhou, Alex Tien, Diane M Baumgartner
arXiv:2311.17686 · cs.CL, cs.AI · submitted Nov 29, 2023
abstract · pdf

add comment on HN