Detailed python notes & code for lectures and exercises of Andrej Karpathy's course "Neural Networks: Zero to Hero." The course is focused on building neural networks from scratch.
-
Updated
Jun 3, 2026 - Jupyter Notebook
Detailed python notes & code for lectures and exercises of Andrej Karpathy's course "Neural Networks: Zero to Hero." The course is focused on building neural networks from scratch.
A GPT built and trained in 243 lines of pure, dependency-free Python - no PyTorch, no NumPy. Based on Andrej Karpathy's microgpt, it hand-rolls autograd, attention and Adam to show how little a language model really needs.
Building Andrej Kapathy's micrograd from scratch
A lightweight autograd engine and neural network library.
yet another scalar autograd engine - featuring complex numbers and fixed DAG
A C++ implementation of the scalar-valued autograd engine micrograd
A header-only C++ autograd engine and neural network library inspired by Karpathy's micrograd. Learn backpropagation in modern C++17.
A rust implementation of Andrej Karpathy's Micrograd
📖 A self-contained course to learn the basics of neural networks: from backprop to GPT! 🌻
The easiest way to build Neural Networks in C# within Unity. The open-source AI project implements a scalar-valued autograd engine so you don't have to deal with backpropagation, and a Neural Network library. You can use it outside of Unity as well.
A Deep Neural network from scratch in Java
A porting of Karpathy's Micrograd to JS
A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
micrograd, but in C++ and better
Simple auto gradient project that supports basic operations written in C++ from scratch.
Small scalar autograd engine, inspired from Karpathy's micrograd, with some additional features, such as more activation functions, optimizers and loss criterions.
To associate your repository with the micrograd topic, visit your repo's landing page and select "manage topics."