In plain words: A free tool turns a Wikipedia dump into number lists that capture the meaning of words and Wikipedia pages, using one command, and offers a web viewer to explore them. It ranked best on a standard test of judging which pages are related, and matched top results elsewhere.
Abstract · Wikipedia2Vec: An Efficient Toolkit for Learning and Visualizing the Embeddings of Words and Entities from Wikipedia
The embeddings of entities in a large knowledge base (e.g., Wikipedia) are highly beneficial for solving various natural language tasks that involve real world knowledge. In this paper, we present Wikipedia2Vec, a Python-based open-source tool for learning the embeddings of words and entities from Wikipedia. The proposed tool enables users to learn the embeddings efficiently by issuing a single command with a Wikipedia dump file as an argument. We also introduce a web-based demonstration of our tool that allows users to visualize and explore the learned embeddings. In our experiments, our tool achieved a state-of-the-art result on the KORE entity relatedness dataset, and competitive results on various standard benchmark datasets. Furthermore, our tool has been used as a key component in various recent studies. We publicize the source code, demonstration, and the pretrained embeddings for 12 languages at https://wikipedia2vec.github.io.
Ikuya Yamada, Akari Asai, Jin Sakuma, Hiroyuki Shindo, Hideaki Takeda, Yoshiyasu Takefuji, Yuji Matsumoto
arXiv:1812.06280 · cs.CL, cs.LG · submitted Dec 15, 2018 · updated Sep 26, 2020
abstract · pdf · html · EMNLP 2020 (system demonstration)
I recommend to use T-SNE instead of PCA, which can be selected by the button at the bottom left.