ToyGrad an AutoGrad Engine A personal exploration into automatic differentiation, implementing the core concepts behind modern deep learning frameworks such as PyTorch.