Category Theory & Artificial Intelligence (AI)

machine-learning big-list category-theory artificial-intelligence neural-networks

Category theory turns out to be useful in more and more areas.

(see e.g. MSE - Category Theory & Biology)

Question. Does anyeone know of some connection of category theory to (convolutional) neural networks (CNNs) / deep learning (or to machine learning in general, natural language processing (NLP), machine reasoning or to another topic counted as AI)?

Remark. I am aware that this question could also be posted at stack overflow or some other stack exchange site. However my idea is that it could be better to ask it on the mathematics site, since it might rather be mathematicians that have some knowledge about such connections than e.g. computer scientists themselves.


Solution 1:

Additionally to Spivaks paper (see above)

Fong Spivak Tuyeras.Backprop as Functor: A compositional perspective on supervised learning

I came along these papers (couldn't read them yet)

Healy.Category Theory Applied to Neural Modeling and Graphical Representations

Gomez + Sanz.Modeling cognitive systems with Category Theory

Healy + Caudell.Neural Networks, Knowledge and Cognition: A Mathematical Semantic Model Based upon Category Theory

Related

Approximating $\displaystyle \int_{-\infty}^{\infty}\frac{e^{R+i\,u}}{\ln(R+i\,u)}du$
$\int_a^bf^2(x)\,dx\le \frac{2}{3}\int_a^bf(x)\,dx$ for a convex differentiable function
If $y^2-x^2\bigm|2^ky-1$ and $2^k-1\bigm|y-1$ then $y=2^k$ and $x=1$
Summation Formula for Tangent/Secant Numbers
Can the formula $\frac\pi2=(\frac21)^{1/2}(\frac{2^2}{1\cdot3})^{1/4}(\frac{2^3\cdot4}{1\cdot3^3})^{1/8}\cdots$ prove the irrationality of $\pi$?
Is a germ equivalent to an infinite jet?
A difficult logarithmic integral and its relation to alternating Euler Sums
Asymptotic behavior of number of triples $i,j,k\le n$ with pairwise bounded least common multiples each $\le n$.
Divergence of $\prod_{n=1}^{\infty} a\sin(n)$ for $a>1$ to $0$ or $\infty$
Really confused about the relationship between set theory, functions, ZFC, Peano axioms, etc.
Prove that $e$ is transcendental.
17 definitions of algebraic K-theory of a ring. Which should I take?