Definition
Plain language
A widely used free toolkit for building and training AI models, written in the Python language.
As stated in the literature
An open-source deep-learning framework with dynamic computation graphs and automatic differentiation; the de facto research standard, with custom CUDA kernels often benchmarked against its reference implementations.
Why it matters: It is the go-to toolkit that lets researchers build and train AI models without reinventing the underlying machinery.
For example, a researcher might use PyTorch to define a neural network in a few lines of Python and have it automatically work out the math for training.
Heard on the show
“One — every speedup here is measured against PyTorch eager, the unoptimized default.”Episode 177 — Why Raw Profiler Data Made an AI Worse at Writing GPU Code