about
NSTM: Real-Time Query-Driven News Overview Composition at Bloomberg (arxiv.org)
50 points by ArtWomb on Jun 2, 2020 | hide | past | pdf | 2 comments on HN

In plain words: Bloomberg built a tool that takes thousands of news articles matching a search, drops duplicates and noise, groups them into themes, and writes short points. It runs live for hundreds of thousands of readers, answering thousands of queries daily in under a second.

Abstract

Millions of news articles from hundreds of thousands of sources around the globe appear in news aggregators every day. Consuming such a volume of news presents an almost insurmountable challenge. For example, a reader searching on Bloomberg's system for news about the U.K. would find 10,000 articles on a typical day. Apple Inc., the world's most journalistically covered company, garners around 1,800 news articles a day. We realized that a new kind of summarization engine was needed, one that would condense large volumes of news into short, easy to absorb points. The system would filter out noise and duplicates to identify and summarize key news about companies, countries or markets. When given a user query, Bloomberg's solution, Key News Themes (or NSTM), leverages state-of-the-art semantic clustering techniques and novel summarization methods to produce comprehensive, yet concise, digests to dramatically simplify the news consumption process. NSTM is available to hundreds of thousands of readers around the world and serves thousands of requests daily with sub-second latency. At ACL 2020, we will present a demo of NSTM.

Joshua Bambrick, Minjie Xu, Andy Almonte, Igor Malioutov, Guim Perarnau, Vittorio Selo, Iat Chong Chan
arXiv:2006.01117 · cs.CL · submitted Jun 1, 2020
abstract · pdf · html · To be presented at ACL 2020 (System Demonstration track)

add comment on HN

From the moment that I tried my hand at making a queryable summarizer (https://github.com/Hellisotherpeople/CX_DB8) I've been obsessed with the field and love to see innovation like this happening.

They found a way to get grammatically correct, queryable sentence based summarization out of any article. That's very impressive to me.

If you're on a phone, here's a responsive HTML version: https://www.arxiv-vanity.com/papers/2006.01117/