about
191. Shuffling Is Not Enough: Breaking Permutation-Based Model Confidentiality (arxiv.org)
Systems that hide a model by shuffling and noising layer outputs can be broken: one query more than the layer has inputs reveals it exactly. The attack rebuilt a ResNet-20's layers with zero error using 5,712 queries, and also worked on large image models.
1 point by sbulaev 20 days ago | hide | past | pdf | discuss
192. Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning (arxiv.org)
A time-free flow whose map pushes any starting point straight to a finished word sequence in one step, trained from data without a teacher model. It generates in one or a few steps and beats discrete diffusion and continuous flow baselines on language and reasoning tasks.
1 point by E-Reverance 20 days ago | hide | past | pdf | discuss
193. Signing the Transaction but Not the Decision: Whisper Attacks and a Binding (arxiv.org)
Hidden text in a product listing can trick a shopping agent into buying something other than asked, yet still pass signature checks. Success rates reached 90%; a fix tying each purchase to the user's request blocked the traceable ones with no false alarms.
1 point by sbulaev 22 days ago | hide | past | pdf | discuss
194. CascadeLUT: Info.-Ordered Streaming Inference for Bandwidth-Constrained FPGAs (arxiv.org)
Instead of waiting for a whole input, this design splits features into ordered groups and refines its prediction as each group arrives, so data streams in without stalling. It cut latency 4 to 12.5 times versus earlier lookup-table chips, using more table logic.
1 point by matt_d 23 days ago | hide | past | pdf | discuss
195. You Only Cache Once: Decoder-Decoder Architectures for Language Models (2024) (arxiv.org)
The model splits in two: the lower half builds the key-value memory attention layers store, and the upper half reuses it instead of caching its own. It matched Transformers while cutting memory and prefill time by orders of magnitude, and handled 1M-token contexts with near-perfect retrieval.
1 point by theanonymousone 24 days ago | hide | past | pdf | discuss
196. Cross-Lingual Alignment Without Joint Training (arxiv.org)
Separately trained monolingual models were compared to see if their representations line up without shared data or training. They do: one rotation maps internal states between models, and swapping in a rotated English state makes a German model answer with the English model's capital.
1 point by codelion 24 days ago | hide | past | pdf | discuss
197. What Makes Rotary Positional Encodings Useful? (arxiv.org)
Rotary encodings spin the vectors a model compares by how far apart words are; tracing a trained Gemma model shows they are not mainly for fading distant words. Fastest spins build position patterns while slowest carry meaning; fixing the slow ones improves performance.
1 point by sonabinu 25 days ago | hide | past | pdf | 1 comment
198. Limits and opportunities of AI reviewers: Reviewing the reviews of Nature papers (arxiv.org)
Forty-five scientists rated 2,960 criticisms from human and AI reviews of 82 Nature-family papers on accuracy, importance, and evidence. The strongest AI beat each paper's best human (60% vs 48%), but AI reviews overlapped more and shared 16 blind spots, so they complement humans.
1 point by marojejian 25 days ago | hide | past | pdf | 1 comment
199. Efficient Exploration Is Enough (arxiv.org)
An agent with no outside rewards explores by seeking experience that helps it build models that predict and adapt anywhere in its world. Theory says the best agents visit the most informative, learnable spots first, and in practice this alone grows more complex behaviors.
1 point by E-Reverance 26 days ago | hide | past | pdf | discuss
200. Performance Foundations of Parallel and Distributed Reasoning Language Models (arxiv.org)
Training reasoning AIs with trial-and-error feedback eats huge computing power, so this study maps where the time and hardware go and sorts the ways to spread that work across many chips. It turns those patterns into practical rules for building such systems faster and cheaper.
1 point by matt_d 26 days ago | hide | past | pdf | discuss