Everything you need to know about AI (for PMs and builders)The first principles of AI so that you can transform your products with new AI applications
There’s no shortage of information on AI. But most of it jumps past the basics and goes into some specific news topic. I wanted to create a foundational resource for smart builders. To answer:
This is the resource for builders who want to go from a 6th grade understanding (mainstream media) to a 12th grade understanding in an afternoon. It’s the basic building blocks to bring a first principles approach to AI in your product. A big shout-out to Chamath Palihapitiya for his Deep Dive on Artificial Intelligence, which inspired me to write this piece. Today’s PostWords: 5,111 | Estimated Reading Time: 24 minutes
At the end of each section, I include links to videos and deep dives to uncover the next layer of each onion. A Selected Primer on AIThe story of AI begins with trying to replicate the human brain. It begins with Alan Turing in 1950In 1950, Alan Turing - subject of 2014 Hollywood Biopic The Imitation Game - published, “Computing Machinery and Intelligence,” where he proposed a test:
The test involves two humans and a machine. The human questioner asks the same questions of a human and a computer respondent, without knowing which is which. Then, the human rates who is a computer and who a machine. AI was said to “pass” the test when it could answer in a way that was indistinguishable from humans. This set off interest in the human brainTo be able to pass the Turing test interested in researchers in the idea of being able to build a computer like the human brain. This begs the question: how does the human brain work?
There are a number of important processes at play:
And it’s really that third area, of what happens inside the brain that AI is concerned with (although all steps are interesting). Brain = Circuitry + LogicFundamentally, the brain is a combination of biological circuitry and logic that can process large amounts of information in real-time.
AI research has attempted to replicate that in the form of electrical circuitry and neural networks. And so those two components will be the first 2 of our next 5 key concepts. After that, we’ll go deeper down neural networks, through transformers, and finally, LLMs. Additional InformationYouTube:
Reading:
Given its length, you may want to take this experience to you browser: Key Topic #1: Electrical CircuitryIf the brain is circuitry plus logic, then humans must master electrical circuitry. And if you’ve seen a stock chart for Nvidia lately, then you know there’s some pretty amazing things we have done. Let’s work our way towards the GPUs from the basics. TransistorsThe building block of computers is the transistor. Transistors are semiconductor devices that use electrical signals to have one of two states: off and on.
In other words, the native language of computers is binary. They switch off and on by applying a voltage. 8 transistors put together make a byte. Those are the bytes you hear about:
CoresMany transistors are organized into a single core. Even last generation cores using 7nm technology still pack billions of transistors into 1 to 2 millimeters squared, to create a single core. A single core processes tasks sequentially. So, these days, we have processors which are organized into multiple cores that execute tasks in parallel.
These are the typical CPUs that ship in laptops and desktops. For instance, these are the stats for Apple’s latest M3 Max. 92 billion transistors across three sets of chips:
Specialized Processing UnitsWhat’s the difference between the CPU, GPU, and neural engine? These are specialized processing units.
That’s just Apple Silicon. NvidiaThe demand for cores never ends, especially for high end models like GPT-4. GPT-4 sits atop NVIDIA’s CUDA architecture that uses thousands of expensive H100s. H100s are specialized packages of GPUs which offer 80 billion transistors across:
But, for that, you’ll have to pay $73K+ and join the waitlist. Beyond Apple and Nvidia, one other type of specialized processor has become popular in AI discussions: TPUs. Created by Google, these are Tensor Processing Units which specialized in dense matrix operations using TensorFlow.
All these advances in circuitry have enabled vast advances in logic to get closer to how the human brain works, which is our next key topic. Additional InformationYouTube:
Reading:
Key Topic #2: Computer LogicWith all these improvements in electrical circuitry, we have pushed the limits of computer logic:
It begins with pattern recognitionBut before we can build our way up to the deep neural networks of today, we need to start with how computer logic systems work:... Keep reading with a 7-day free trialSubscribe to Product Growth to keep reading this post and get 7 days of free access to the full post archives. A subscription gets you:
|
This week’s system design refresher: Top 9 Most Popular API Protocols (Youtube video) What is a deadlock? What’s the difference between Session-based authentication and JWTs? Top 6 ElasticSearch Use Cases Top 9 Cases Behind 100% CPU Usage SPONSOR US ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ...
Comments
Post a Comment