Trends in machine learning
ReferenceTraining compute, hardware price-performance, algorithmic efficiency, inference cost and data supply, as live charts. Two facts do most of the work elsewhere: frontier compute has grown several-fold annually for a decade, and the cost of any given capability falls fast once it exists.
What to do Two curves on the first pass and ignore the rest: training compute over time, and inference cost for a fixed capability. Note the doubling time on the first and the decline rate on the second. Those two numbers quietly settle most later arguments about cost and timelines.
Also in Start here.
15 min epoch.ai · free
