AI capabilities continue to progress

AI capabilities have been steadily improving across a wide range of skills, and show no sign of slowing down in the near term.

Across benchmarks covering coding, math, scientific knowledge, common sense and visual reasoning, and more, state-of-the-art models have improved by 20 to 50 percentage points in the last year.

Of course, benchmarks don’t capture real-world utility perfectly. Even a model scoring 100% on GPQA Diamond probably won’t fully replace scientists, since models can be overfit to benchmarks, and benchmarks don’t capture all aspects of real-world work.

Nevertheless, it’s hard to deny that AI models have become substantially more useful over the past 12 months. One indication of this is that revenues at frontier AI companies have more than tripled in the past year.

This Data Insight was written by Luke Emberson. You can learn more about the analysis on our website.