Ilya Sutskever's 30 Papers vs INT21

Explore the deep learning reading list Ilya Sutskever gave John Carmack, with free audio explainers for AlexNet, ResNet, Transformers, scaling laws, and more.

We are building self-improving AI systems for the software beneath modern AI. Our first product generates and optimizes low-level GPU software, then proves its work with...

About Ilya Sutskever's 30 Papers

Explore the deep learning reading list Ilya Sutskever gave John Carmack, with free audio explainers for AlexNet, ResNet, Transformers, scaling laws, and more. These courses, books, and code-heavy pieces do not currently have a ListenDock audio episode. When legendary game programmer John Carmack decided to move into AI, he asked OpenAI co-founder Ilya Sutskever what he should read. Ilya handed him a list of around thirty works and said that learning them would cover 90% of what matters in modern deep learning.

About INT21

We are building self-improving AI systems for the software beneath modern AI. Our first product generates and optimizes low-level GPU software, then proves its work with tests and benchmarks. Today, we are launching INT21: the first company to achieve self-improving AI agent swarms, applied to AI infrastructure. That software has an outsized effect on speed and cost. The first four implementations produced by PTX Kernel Factory are open source today. The product is also entering beta, with early access available at int21.ai.