AI Models Went From $100 Million to $5 Million Then To $30 In Seven Days
What a week for innovation.
We noted recently the DeepSeek had created an AI model for around $5 million that matched the performance of OpenAI’s $100 million model. Now we learn that a research team at the University of California, Berkeley has reportedly recreated the core technology behind DeepSeek AI for just $30.
According to Brian Roemmele, UC Berkeley Ph.D. candidate Jiayi Pan and his team successfully replicated DeepSeek R1-Zero’s reinforcement learning (RL) capabilities using a compact language model called TinyZero. This open-source reinforcement learning engine utilizes the self-play learning paradigm, originally pioneered by DeepMind in the development of AlphaZero, to achieve mastery of the games of chess, shogi and go.
The stunningly low cost of this replication underscores a growing trend: while tech giants pour vast sums into AI development, open-source and independent researchers are proving that high-performance AI can be built at a fraction of the cost. In fact, TinyZero is freely available for download on GitHub.
The TinyZero program achieved DeepSeek-level performance by renting two H200 Nvidia chips for under five hours at just $6.40 per hour.
XYZ Labs notes that,
Their success in implementing sophisticated reasoning capabilities in small language models marks a significant democratization of AI research…Richard Sutton, the father of reinforcement learning, would likely find vindication in these results. They align with his vision of continuous learning as the key to AI advancement, demonstrating that sophisticated AI capabilities can emerge from relatively simple systems given the right learning framework…This work from a Chinese AI research company may well mark a turning point in AI development, proving that groundbreaking advances don't require massive resources – just clever thinking and the right approach.
To put this breakthrough in perspective: the telegraph reduced the time it took the Pony Express to deliver a message from St. Joseph, Missouri, to Sacramento, California, by 99.93%—from 10 days to 10 minutes. Pan’s $30 TinyZero program slashed the cost of DeepSeek’s $5 million model by 99.9994%. For the price of a single DeepSeek model, you can build 166,667 TinyZero models.
John Mauldin reports that Oracle co-founder Larry Ellison once said that the “entry price” to get meaningfully involved in developing artificial intelligence would be $100 billion. Who will tell Larry that Pan and his team have moved that decimal point nine digits to the left?
Disruptive innovation is disrupting disruptive innovation. Clayton Christensen, originator of the “disruptive innovation” theory, would be pleased.
Meanwhile, the $500 billion Stargate AI infrastructure initiative, announced just 10 days ago, already looks obsolete.
Human intelligence continues to discover ever more efficient ways of teaching artificial intelligence how to learn. Hang on—this revolution is just beginning.
Please consider enjoying our new course on the Economics of Human Flourishing at the Peterson Academy. Students have logged over 18,000 hours watching and learning from this course. Join for a free 7-day trial.
We explain and give hundreds of examples why more people with freedom means much more resource abundances for everyone in our book, Superabundance, available at Amazon.
Gale Pooley is a Senior Fellow at the Discovery Institute, an Adjunct Scholar at the Cato Institute, and a board member at Human Progress.
When we apply this technology to crypto and abolish all governments and their preying on us, the sky is the limit.
Now, if we can just do the same for space flight! Even two orders of magnitude would make a massive difference in launch costs.