I read every major CS paper of the last 100 years...
Summary
AI summaries can be incomplete or wrong. Verify anything important against the original video.
This video examines 10 landmark computer science papers published between 1936 and 2020 that collectively formed the theoretical and practical foundation of modern AI. It traces the lineage from the invention of the universal computer and the bit to the development of deep learning, attention mechanisms, and large language models.
The video provides a high-level historical narrative of computer science through 10 seminal papers, starting with Alan Turing's 1936 proof that some problems are undecidable by algorithms, which inadvertently defined the universal computer. It progresses through Claude Shannon's 1948 information theory, which defined the bit and entropy, and moves into the dawn of machine learning with Frank Rosenblatt's Perceptron (1958) and its 1969 critique by Minsky and Papert, which led to an AI winter. The narrative then highlights the breakthroughs that ended that winter: the formalization of backpropagation by Rumelhart, Hinton, and Williams (1986); the massive web-indexing innovation of Google's PageRank (1998); the breakthrough success of deep convolutional neural networks with ImageNet (2012); and finally, the transformative power of the transformer architecture (2017) and the scaling laws showcased in OpenAI's GPT-3 (2020). Throughout the history, the video links these abstract papers to the rapid acceleration of AI capabilities today, illustrating that intelligence often emerges simply from sufficient data and computational scale.
Concepts & takeaways
LockedKey Points
LockedWorth watching if: You are a tech enthusiast or student wanting a high-level overview of the papers that built today's generative AI boom. It is perfect for those looking for a cohesive narrative connecting decades of disconnected computer science theory to modern large language models.
Sign in to unlock the full extract
Every claim, key point, and timestamp for this Fireship video — plus a daily email of every channel you follow.
Sign in with GoogleNo credit card. Free tier forever.