In plain words: Instead of fixed connection weights, this network learns small adjustable curves on each link, letting it shape patterns in the data itself. On satellite traffic forecasting it beat a standard neural network while using far fewer learnable settings.
Abstract
This paper introduces a novel application of Kolmogorov-Arnold Networks (KANs) to time series forecasting, leveraging their adaptive activation functions for enhanced predictive modeling. Inspired by the Kolmogorov-Arnold representation theorem, KANs replace traditional linear weights with spline-parametrized univariate functions, allowing them to learn activation patterns dynamically. We demonstrate that KANs outperforms conventional Multi-Layer Perceptrons (MLPs) in a real-world satellite traffic forecasting task, providing more accurate results with considerably fewer number of learnable parameters. We also provide an ablation study of KAN-specific parameters impact on performance. The proposed approach opens new avenues for adaptive forecasting models, emphasizing the potential of KANs as a powerful tool in predictive analytics.
Cristian J. Vaca-Rubio, Luis Blanco, Roberto Pereira, Màrius Caus
arXiv:2405.08790 · eess.SP, cs.AI, cs.LG · submitted May 14, 2024 · updated Sep 25, 2024
abstract · pdf · html