Epoch AI

Home
Gradient Updates by Epoch AI
The Epoch AI Brief
Podcast
Archive
About

January 2025

What went into training DeepSeek-R1?
On January 20th, 2025, DeepSeek released their latest open-weights reasoning model, DeepSeek-R1, which is on par with OpenAI’s o1 in benchmark…
 • 
Ege Erdil
AGI could drive wages below subsistence level
Historically, many have feared that automation would lead to mass unemployment and lower wages.
 • 
Matthew Barnett
How has DeepSeek improved the Transformer architecture?
DeepSeek has recently released DeepSeek v3, which is currently state-of-the-art in benchmark performance among open-weight models, alongside a technical…
 • 
Ege Erdil
The economic consequences of automating remote work
Recent AI progress has shown great promise in automating cognitive tasks, like those in natural language processing and vision.
 • 
Epoch AI

December 2024

Moravec’s paradox and its implications
Since the birth of the field of artificial intelligence in the 20th century, researchers have observed that the difficulty of a task for humans at best…
 • 
Ege Erdil
How do mixture-of-experts models compare to dense models in inference?
In last week’s Gradient Updates issue, I discussed how we can guess that GPT-4o and Claude 3.5 Sonnet have significantly fewer parameters than GPT-4.
 • 
Ege Erdil
Frontier language models have become much smaller
Between the release of the original Transformer in 2017 and the release of GPT-4, language models at the frontier of capabilities became much larger.
 • 
Ege Erdil
What did US export controls mean for China’s AI capabilities?
Four days ago, the US government announced new rules around the export of powerful chips and semiconductor manufacturing equipment to China.
 • 
Ege Erdil
© 2025 Epoch Artificial Intelligence, Inc
Substack
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture