about
Arctic-Embed 2.0: Multilingual Retrieval Without Compromise (arxiv.org)
2 points by fzliu on Dec 10, 2024 | hide | past | pdf | discuss on HN

In plain words: These open-source text-embedding models turn text into number lists so search can match queries to documents across languages. They keep English search quality as strong as multilingual search, and their vectors can be shrunk for storage with far less accuracy loss than other options.

Abstract

This paper presents the training methodology of Arctic-Embed 2.0, a set of open-source text embedding models built for accurate and efficient multilingual retrieval. While prior works have suffered from degraded English retrieval quality, Arctic-Embed 2.0 delivers competitive retrieval quality on multilingual and English-only benchmarks, and supports Matryoshka Representation Learning (MRL) for efficient embedding storage with significantly lower compressed quality degradation compared to alternatives. We detail the design and implementation, presenting several important open research questions that arose during model development. We conduct experiments exploring these research questions and include extensive discussion aimed at fostering further discussion in this field.

Puxuan Yu, Luke Merrick, Gaurav Nuti, Daniel Campos
arXiv:2412.04506 · cs.CL, cs.IR, cs.LG · submitted Dec 3, 2024 · updated Dec 14, 2024
abstract · pdf · html · 10 pages, 5 figures, 3 tables

add comment on HN