In plain words: A network that learns how PDEs turn inputs into solutions is trained on one equation, then adapted to a new one with few examples. Rescaling each neuron's output beat the usual approach of adjusting every weight when only a few examples were available.
Abstract
Convolutional neural operator is a CNN-based architecture recently proposed to enforce structure-preserving continuous-discrete equivalence and enable the genuine, alias-free learning of solution operators of PDEs. This neural operator was demonstrated to outperform for certain cases some baseline models such as DeepONet, Fourier neural operator, and Galerkin transformer in terms of surrogate accuracy. The convolutional neural operator, however, seems not to be validated for few-shot learning. We extend the model to few-shot learning scenarios by first pre-training a convolutional neural operator using a source dataset and then adjusting the parameters of the trained neural operator using only a small target dataset. We investigate three strategies for adjusting the parameters of a trained neural operator, including fine-tuning, low-rank adaption, and neuron linear transformation, and find that the neuron linear transformation strategy enjoys the highest surrogate accuracy in solving PDEs such as Kuramoto-Sivashinsky equation, Brusselator diffusion-reaction system, and Navier-Stokes equations.
Peng Fan, Guofei Pang
arXiv:2512.17969 · cs.LG, cs.AI, math-ph · submitted Dec 19, 2025
abstract · pdf · html · 12 pages, 4 figures, 2 tables
This one has code too!
https://github.com/PengFan130/CNO_based_transfer_learning_fo...
I'm very curious the author's thoughts on recovering the equations from observational data with techniques like this. My PhD work was on a deterministic algorithm to do this at the same time the first DNNs and GANs were coming out. I always wanted to apply them to these problems. I'd email them, but I'm genuinely worried about ending up on a list given the current US admin (one author works at "Key Laboratory of Maritime Intelligent Cyberspace Technology" in China).