about
Dialog Intent Induction with Deep Multi-View Clustering (arxiv.org)
1 point by sel1 on Sep 3, 2019 | hide | past | pdf | discuss on HN

In plain words: A system groups customer-support messages into user intents without labels by reading both the customer's question and the rest of the conversation, then nudging the two readings toward the same grouping. It sorted intents more accurately than standard unsupervised grouping methods on two datasets.

Abstract

We introduce the dialog intent induction task and present a novel deep multi-view clustering approach to tackle the problem. Dialog intent induction aims at discovering user intents from user query utterances in human-human conversations such as dialogs between customer support agents and customers. Motivated by the intuition that a dialog intent is not only expressed in the user query utterance but also captured in the rest of the dialog, we split a conversation into two independent views and exploit multi-view clustering techniques for inducing the dialog intent. In particular, we propose alternating-view k-means (AV-KMEANS) for joint multi-view representation learning and clustering analysis. The key innovation is that the instance-view representations are updated iteratively by predicting the cluster assignment obtained from the alternative view, so that the multi-view representations of the instances lead to similar cluster assignments. Experiments on two public datasets show that AV-KMEANS can induce better dialog intent clusters than state-of-the-art unsupervised representation learning methods and standard multi-view clustering approaches.

Hugh Perkins, Yi Yang
arXiv:1908.11487 · cs.CL · submitted Aug 30, 2019 · updated Sep 15, 2020
abstract · pdf · html · Original version appeared in EMNLP 2020. We have added an appendix which includes experiments on a slightly larger AskUbuntu dataset, and incorporating several post-publication code bug-fixes

add comment on HN