Learning Nonlinear Heterogeneity in Physical Kolmogorov-Arnold Networks
Jack Gartside a
a Imperial College London, Exhibition Road, United Kingdom
Proceedings of MATSUS Fall 2026 Conference (MATSUSFall26)
D5 - Spintronic Nanodevices for Unconventional Computing
Palma, Spain, 2026 October 26th - 30th
Organizer: Tristan da Câmara Santa Clara Gomes
Invited Speaker, Jack Gartside, presentation 447
Publication date: 22nd July 2026

Physical neural networks typically train linear synaptic weights while treating device nonlinearities as fixed. We show the opposite - by training the synaptic nonlinearity itself using a Kolmogorov-Arnold framework, we yield markedly higher task performance per physical resource than conventional linear weight-based networks, and demonstrate that network topologies which directly learn nonlinear physical dynamics can enable strong learning at compact network sizes - up to 40-500x smaller than linear weight approaches. We demonstrate this in silicon-on-insulator on-chip devices operating at room temperature, 0.1-1 microampere currents, 750 fJ per nonlinear operation and 2 MHz speeds.

We show that physical KANs can be trained without reliance on backpropagation or surrogate device models, using forward-only noise-based decorrelated perturbative learning – which can match or exceed the performance of backpropagation.

Physical KANs demonstrate higher performance than equally-sized linear-weight based networks across a range of classification & regression tasks. These results establish programmable heterogenous physical nonlinearity as a promising computational primitive for compact and efficient learning systems.

 

Taglietti, Fabiana, et al. & Jack C. Gartside "Learning Nonlinear Heterogeneity in Physical Kolmogorov-Arnold Networks." arXiv preprint arXiv:2601.15340 (2026).

Liu, Ziming, et al. "Kan: Kolmogorov-arnold networks." arXiv preprint arXiv:2404.19756 (2024).

© FUNDACIO DE LA COMUNITAT VALENCIANA SCITO
We use our own and third party cookies for analysing and measuring usage of our website to improve our services. If you continue browsing, we consider accepting its use. You can check our Cookies Policy in which you will also find how to configure your web browser for the use of cookies. More info