about
Code-to-Metric Regression: Predicting Numeric Outcomes of Code Executions (arxiv.org)
2 points by chabad360 362 days ago | hide | past | pdf | discuss on HN

In plain words: A single model reads raw code text and predicts numbers like memory use, speed, and accuracy, replacing the hand-built code features older approaches need. A small version orders competitive-programming submissions by memory use nearly as well as the real measurements, scoring over 0.9.

Abstract · Regression Language Models for Code

We study code-to-metric regression: predicting numeric outcomes of code executions, a challenging task due to the open-ended nature of programming languages. While prior methods have resorted to heavy and domain-specific feature engineering, we show that a single unified Regression Language Model (RLM) using a frozen LLM encoder can simultaneously predict directly from text, (i) the memory footprint of code across multiple high-level languages such as Python and C++, (ii) the latency of Triton GPU kernels, and (iii) the accuracy and speed of trained neural networks represented in ONNX. In particular, a relatively small 300M parameter RLM based on T5Gemma, obtains >0.9 Spearman-rank on competitive programming submissions from APPS, and a single unified model achieves >0.5 average Spearman-rank across 24 different programming languages from CodeNet. Furthermore, the RLM can obtain the highest average Kendall-Tau of 0.46 on five classic NAS design spaces previously dominated by graph neural networks, and simultaneously predict architecture latencies on numerous hardware platforms.

Yash Akhauri, Xingyou Song, Arissa Wongpanich, Bryan Lewandowski, Mohamed S. Abdelfattah
arXiv:2509.26476 · cs.CL, cs.AI, cs.LG, cs.PF, cs.SE · submitted Sep 30, 2025 · updated Jun 16, 2026
abstract · pdf · html · Published in International Conference on Machine Learning (ICML) 2026

add comment on HN