about
Clifford-Steerable Convolutional Neural Networks (arxiv.org)
2 points by rbanffy on Mar 10, 2024 | hide | past | pdf | discuss on HN

In plain words: These networks handle data in space or spacetime, built so rotating, shifting, or speeding up the scene just rotates or shifts the answer. Their filters come from a number system encoding rotations, and they beat standard networks at forecasting fluid flows and electromagnetic fields.

Abstract

We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance, $\mathrm{E}(3)$-equivariance on $\mathbb{R}^3$ and Poincaré-equivariance on Minkowski spacetime $\mathbb{R}^{1,3}$. Our approach is based on an implicit parametrization of $\mathrm{O}(p,q)$-steerable kernels via Clifford group equivariant neural networks. We significantly and consistently outperform baseline methods on fluid dynamics as well as relativistic electrodynamics forecasting tasks.

Maksim Zhdanov, David Ruhe, Maurice Weiler, Ana Lucic, Johannes Brandstetter, Patrick Forré
arXiv:2402.14730 · cs.LG, cs.AI · submitted Feb 22, 2024 · updated Jul 6, 2024
abstract · pdf · html · accepted to ICML 2024

add comment on HN