about
Smart Expert System: Large Language Models as Text Classifiers (arxiv.org)
3 points by PaulHoule on May 28, 2024 | hide | past | pdf | discuss on HN

In plain words: Instead of training a separate classifier with heavy preprocessing and domain expertise, this system feeds text straight to a large language model to label it. On four datasets, some language models beat traditional methods, and one further trained on examples was best everywhere.

Abstract · Adaptable and Reliable Text Classification using Large Language Models

Text classification is fundamental in Natural Language Processing (NLP), and the advent of Large Language Models (LLMs) has revolutionized the field. This paper introduces an adaptable and reliable text classification paradigm, which leverages LLMs as the core component to address text classification tasks. Our system simplifies the traditional text classification workflows, reducing the need for extensive preprocessing and domain-specific expertise to deliver adaptable and reliable text classification results. We evaluated the performance of several LLMs, machine learning algorithms, and neural network-based architectures on four diverse datasets. Results demonstrate that certain LLMs surpass traditional methods in sentiment analysis, spam SMS detection, and multi-label classification. Furthermore, it is shown that the system's performance can be further enhanced through few-shot or fine-tuning strategies, making the fine-tuned model the top performer across all datasets. Source code and datasets are available in this GitHub repository: https://github.com/yeyimilk/llm-zero-shot-classifiers.

Zhiqiang Wang, Yiran Pang, Yanbin Lin, Xingquan Zhu
arXiv:2405.10523 · cs.CL · submitted May 17, 2024 · updated Dec 7, 2024
abstract · pdf · html · ICDM Workshop ARRL 2024

add comment on HN