In plain words: This survey sorts through the ways people invent and filter training examples for coding AI, grouping them into a clear map of techniques and how each works. It lays out the biggest remaining problems and gives newcomers practical advice on which tricks fit which situations.
Abstract
Large language models (LLMs) have shown impressive performance in \emph{code} understanding and generation, making coding tasks a key focus for researchers due to their practical applications and value as a testbed for LLM evaluation. Data synthesis and filtering techniques have been widely adopted and shown to be highly effective in this context. In this paper, we present a focused survey and taxonomy of these techniques, emphasizing recent advancements. We highlight key challenges, explore future research directions, and offer practical guidance for new researchers entering the field.
Meng Chen, Philip Arthur, Qianyu Feng, Cong Duy Vu Hoang, Yu-Heng Hong, Mahdi Kazemi Moghaddam, Omid Nezami, Thien Nguyen, Gioacchino Tangari, Duy Vu, Thanh Vu, Mark Johnson, et al.
arXiv:2411.00005 · cs.SE, cs.AI · submitted Oct 16, 2024 · updated Feb 7, 2025
abstract · pdf · html · Accepted at NAACL 2025