about
Enriching Bert with Knowledge Graph Embeddings for Document Classification (arxiv.org)
9 points by malteos on Oct 11, 2019 | hide | past | pdf | discuss on HN

In plain words: A book classifier reads the cover blurb with a language model, then mixes in metadata and a knowledge-graph embedding that captures facts about the author. This beat the text-only version, scoring 87.20 on the F1 quality measure (0–100) for eight categories.

Abstract · Enriching BERT with Knowledge Graph Embeddings for Document Classification

In this paper, we focus on the classification of books using short descriptive texts (cover blurbs) and additional metadata. Building upon BERT, a deep neural language model, we demonstrate how to combine text representations with metadata and knowledge graph embeddings, which encode author information. Compared to the standard BERT approach we achieve considerably better results for the classification task. For a more coarse-grained classification using eight labels we achieve an F1- score of 87.20, while a detailed classification using 343 labels yields an F1-score of 64.70. We make the source code and trained models of our experiments publicly available

Malte Ostendorff, Peter Bourgonje, Maria Berger, Julian Moreno-Schneider, Georg Rehm, Bela Gipp
arXiv:1909.08402 · cs.CL, cs.IR, cs.LG · submitted Sep 18, 2019
abstract · pdf · html

add comment on HN