2025-11-17 · auto-analysis (draft)

AI Costs Plummeting 40x: Why Costs Are Collapsing & What It Really Means w/ Dave, Salim & AWG

The podcast discusses global concerns like cost of living and unemployment, reports on Anthropic's market share in enterprise LLM API, debates the critical path to AI singularity, and explores the business model of AI. The podcast discusses the shift from AI alignment to capabilities, the business models of AI companies, the implications of highly immersive virtual worlds, and different approaches to generating photorealistic 3D simulations. The podcast discusses advancements in AI, including methods to make AI forget specific memorized data, the potential for reducing model parameters, and a new machine learning paradigm for continual learning. The podcast discusses the significant cost reduction in AI training, the continuous learning nature of modern AI systems, and the implications of this trend on various industries and challenges. The podcast discusses the impact of AI on the job m

▶ Watch on YouTube

Topics

AI Cost AI ▶ 0:00
Discusses the rising concern over the cost of living and its relation to unemployment and poverty.
AI Market AI ▶ 3:12
Reports on Anthropic overtaking OpenAI in enterprise LLM API market share.
AI Future AI ▶ 4:16
Explores the debate on whether code generation is the critical path to recursive self-improvement and the singularity.
AI Business Model AI ▶ 6:26
Discusses the business model of AI and its implications for competition and growth.
AI Alignment AI ▶ 8:51
Discussion on the inevitable shift from alignment to capabilities in AI projects.
AI Business Models Economy ▶ 10:20
Analysis of the business models of Anthropic and OpenAI, with projections of high margins and significant revenue.
Virtual Worlds Compute ▶ 13:40
Discussion on the implications of highly immersive virtual worlds, including concerns about their impact on society.
AI Simulation Techniques AI ▶ 16:07
Comparison of different approaches to generating photorealistic 3D simulations, including Google Genie 3 and World Labs' marble model.
AI AI ▶ 17:44
Discussion on using AI models for training synthetic data for more capable vision and language action models for scientific discovery.
AI Model Pruning AI ▶ 18:02
New method helps AI forget memorized data without losing reasoning skills, focusing on pruning or regularization techniques.
Neuroplasticity AI ▶ 23:12
Discussion on the brain equivalent of neuroplasticity and its applications in understanding intelligence through playing with the weights of a big neural net.
Continuous Learning AI ▶ 24:01
Google introduces nested learning, a machine learning paradigm for continual learning, focusing on higher-order metalearning and a potential grand unified theory of machine learning.
AI Costs Compute ▶ 26:21
Historical AI training methods are being replaced by continuously learning systems.
Innovation in AI AI ▶ 26:58
AI systems have access to vast amounts of tools and information, allowing for significant innovation.

Predictions made

open Alex: Anthropic and Google will thrive in different markets, with Anthropic focusing on enterprise management tools.
EP #? · · due: unspecified · ▶ watch
“And so he's not facing a lot of competition right now in that market.”
Your call:
open Salim: Anthropic will pivot to a new project under a new name to continue investing in AI.
EP #? · · due: unspecified · ▶ watch
“But then as the date approaches, he'll launch a new project under a new name and say, 'Well, we're going to consume all that money building Stargate or you know, whatever anthropic Stargate or whatever it is.'”
Your call:
open Alex: There will be significant progress in understanding the nature of intelligence by playing with the weights of a big neural net.
EP #? · · due: unspecified · ▶ watch
“a lot more people in that area cognitive psychology types should be working on this too.”
Your call:
open Unknown: Grand challenges in math, science, engineering, and medicine will fall within the next two to three years due to the cost reduction in AI.
EP #? · · due: 2-3 years · ▶ watch
“So, can I take the other side of this?”
Your call:
open Unknown: The next 5 years will set the objective for the next century in terms of making decisions for the future of energy and data centers.
EP #? · · due: 5 years · ▶ watch
“I think the time frame for make those decisions and implement those decisions is is the next 5 years.”
Your call:
open Peter Diamandis: The gap between the rich and poor will widen due to AI and smartphones.
EP #? · · due: 2-7 years · ▶ watch
“the gap is going to get really wide.”
Your call:
open Peter Diamandis: People need to believe in a hopeful future to avoid dystopian narratives.
EP #? · · due: unspecified · ▶ watch
“they're going to believe what they see from Hollywood, which is dystopian AIs and killer robots. ”
Your call:
open Peter Diamandis: A moonshot summit could be organized with a thousand participants to address global challenges.
EP #? · · due: next fall · ▶ watch
“if we can get a thousand people who say yes, we want to be in on this, then we'll pull it together.”
Your call:
open Unknown: We might see a peak in the amount of power needed for training large AI models in a few years, followed by a decline if algorithmic innovations enable distributed training.
EP #? · · due: few years · ▶ watch
“we might actually see a peak maybe in a few gigawatts sometime over the next few years and then decline if there are algorithmic innovations that enable us to do distributed training runs rather than needing one large power intensive coherent supercluster to do it.”
Your call:
open Unknown: Ukraine will become Europe's drone manufacturing capital after the war.
EP #? · · due: unspecified · ▶ watch
“Ukraine as a nation is going to be sort of Europe's drone manufacturing capital.”
Your call:
open Unknown: Global consensus on global weather control is inevitable in the next few years.
EP #? · · due: next few years · ▶ watch
“it's inevitable that we need to get over that hurdle in the next, you know, few years, not 20 years”
Your call:
open Unknown: Exponential growth in patents and Nobel prize-winning science due to AI.
EP #? · · due: unspecified · ▶ watch
“You can actually see there's an interesting uh chart I saw where if you look at patent filings post uh chat GPT there's like just exponential growth immediately thereafter uh where it's an aid to humans but all of sudden if it's autonomously doing the science uh in sort of closed loop cycles it's amazing”
Your call:

Numbers that matter