The Perceptron: A Machine That Would Think
The Perceptron promised to walk, talk, and be conscious within a decade.
The architectures and model families - from the Perceptron to the Transformer - that define what AI can do.
18 stories
The Perceptron promised to walk, talk, and be conscious within a decade.
John Hopfield showed that a network of neurons could function as an associative memorylike a brain that recalls the whole from a fragment.
LeCun's convolutional network read handwritten cheques for AT&T10% of all cheques cleared in the US by 1998.
TD-Gammon taught itself backgammon by playing 1.5 million gamesalone.
MNIST started as a post office problem: sorting zip codes by hand.
In September 2012, two grad students and their professor submitted a network to an obscure vision contest and ended the hand-engineered-features era of AI in a single afternoon.
Word2Vec proved that king − man + woman ≈ queen: geometry in meaning.
DeepMind's DQN learned to play 49 Atari games from raw pixels, and beat humans on 29 of them.
Ian Goodfellow invented GANs in a single night after an argument at a barthe generator and discriminator idea came fully formed.
"Attention Is All You Need" was written in months by a team that mostly left Google.
BERT read sentences backwards and forwards simultaneously, and rewrote how the field thought about language understanding.
Stable Diffusion was not the best text-to-image model in 2022. It was the first one anyone could run at home.
Meta released LLaMA's weights and they leaked to 4chan within a week. The open-source LLM era had begun whether anyone was ready or not.
A Chinese AI lab released an open-source reasoning model that matched OpenAI's o1. It reportedly cost $6 million to train. NVIDIA lost $600 billion in market cap in a single day.
Opus 5 scored 96% on the industry's standard coding benchmark. That's not a high score. That's the benchmark running out of room.
A frontier-class model, open weights, MIT license, and a price so low the cache hits cost a fraction of a cent per million tokens.
Moonshot launched Kimi K3 as an API. Eleven days later, it gave away all 2.8 trillion parameters for free.
Z.ai tested it anonymously first. Once revealed, it beat its own flagship at one-tenth the cost.