about
Geo-Entity Linking for Noisy Multilingual User Input (arxiv.org)
1 point by PaulHoule on May 1, 2024 | hide | past | pdf | discuss on HN

In plain words: It matches messy, multilingual place names in social posts to real locations by averaging the word patterns of known names for each place, then guessing only when confident. This beat the usual rule-based and costly AI tools on a worldwide social media set.

Abstract · Where on Earth Do Users Say They Are?: Geo-Entity Linking for Noisy Multilingual User Input

Geo-entity linking is the task of linking a location mention to the real-world geographic location. In this paper we explore the challenging task of geo-entity linking for noisy, multilingual social media data. There are few open-source multilingual geo-entity linking tools available and existing ones are often rule-based, which break easily in social media settings, or LLM-based, which are too expensive for large-scale datasets. We present a method which represents real-world locations as averaged embeddings from labeled user-input location names and allows for selective prediction via an interpretable confidence score. We show that our approach improves geo-entity linking on a global and multilingual social media dataset, and discuss progress and problems with evaluating at different geographic granularities.

Tessa Masis, Brendan O'Connor
arXiv:2404.18784 · cs.CL, cs.AI · submitted Apr 29, 2024
abstract · pdf · html · NLP+CSS workshop at NAACL 2024

add comment on HN