Ilya Sutskever's 30 Papers vs Rudrite Research

Explore the deep learning reading list Ilya Sutskever gave John Carmack, with free audio explainers for AlexNet, ResNet, Transformers, scaling laws, and more.

Interactive, animated, visual explainers of landmark AI & ML papers, attention & transformers, GPT-3, FlashAttention, Mixtral, Mamba, DeepSeek, and more.

About Ilya Sutskever's 30 Papers

Explore the deep learning reading list Ilya Sutskever gave John Carmack, with free audio explainers for AlexNet, ResNet, Transformers, scaling laws, and more. These courses, books, and code-heavy pieces do not currently have a ListenDock audio episode. When legendary game programmer John Carmack decided to move into AI, he asked OpenAI co-founder Ilya Sutskever what he should read. Ilya handed him a list of around thirty works and said that learning them would cover 90% of what matters in modern deep learning.

About Rudrite Research

Interactive, animated, visual explainers of landmark AI & ML papers, attention & transformers, GPT-3, FlashAttention, Mixtral, Mamba, DeepSeek, and more. Interactive, animated, visual explainers of landmark AI & ML papers, the systems and ideas behind the models you use, redrawn and made legible. Direct Preference Optimization: Your Language Model is Secretly a Reward Model. Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.