A neural net is a computation graph — literally. Modern autograd libraries (PyTorch, JAX) are engines for building and differentiating over graphs, leaning on graph-theory for things like topological ordering of backward passes.
A neural net is a computation graph — literally. Modern autograd libraries (PyTorch, JAX) are engines for building and differentiating over graphs, leaning on graph-theory for things like topological ordering of backward passes.