about
Mathematical Theory of Deep Learning (arxiv.org)
3 points by nabla9 on Oct 28, 2024 | hide | past | pdf | discuss on HN

In plain words: A textbook explains the math behind deep learning through three areas: how well networks can approximate functions, how training finds good solutions, and how well learned models generalize to new data. It favors simple, rigorous proofs over the most general results, giving students a first foothold in the theory.

Abstract · Mathematical theory of deep learning

This book provides an introduction to the mathematical analysis of deep learning. It covers fundamental results in approximation theory, optimization theory, and statistical learning theory, which are the three main pillars of deep neural network theory. Serving as a guide for students and researchers in mathematics and related fields, the book aims to equip readers with foundational knowledge on the topic. It prioritizes simplicity over generality, and presents rigorous yet accessible results to help build an understanding of the essential mathematical concepts underpinning deep learning.

Philipp Petersen, Jakob Zech
arXiv:2407.18384 · cs.LG, math.HO · submitted Jul 25, 2024 · updated Jan 15, 2026
abstract · pdf · html

add comment on HN