about
Multi-Lingual Intent Detection and Slot Filling in a Joint Bert-Based Model (arxiv.org)
3 points by sel1 on Jul 9, 2019 | hide | past | pdf | discuss on HN

In plain words: A model reads a sentence all at once to work out what the user wants and pull out the details, instead of processing words one by one. It did well on English tests with little labeled data, and matched that on an Italian set.

Abstract · Multi-lingual Intent Detection and Slot Filling in a Joint BERT-based Model

Intent Detection and Slot Filling are two pillar tasks in Spoken Natural Language Understanding. Common approaches adopt joint Deep Learning architectures in attention-based recurrent frameworks. In this work, we aim at exploiting the success of "recurrence-less" models for these tasks. We introduce Bert-Joint, i.e., a multi-lingual joint text classification and sequence labeling framework. The experimental evaluation over two well-known English benchmarks demonstrates the strong performances that can be obtained with this model, even when few annotated data is available. Moreover, we annotated a new dataset for the Italian language, and we observed similar performances without the need for changing the model.

Giuseppe Castellucci, Valentina Bellomaria, Andrea Favalli, Raniero Romagnoli
arXiv:1907.02884 · cs.CL, cs.LG · submitted Jul 5, 2019
abstract · pdf · html

add comment on HN