podcasts

Demis Hassabis said AGI should stay in labs for another 10 to 20 years. That matters more than his “post-AGI within 50 years” line. The first is an admission about organizational reality. The second is just a worldview. When the CEO of DeepMind says the ideal path is slower while DeepMind keeps shipping Gemini, agents, and science systems into products, he is exposing the core contradiction of 2026: safety consensus is lagging release cadence, and even the people most worried about it no longer fully control that cadence. My read is that Hassabis is not forecasting so much as drawing a boundary around himself. He cites AlphaFold’s 3M+ users and Isomorphic Labs’ 18 to 19 drug programs for a reason. Those numbers are his evidence that “faster deployment” has already created real public value. That gives him room to argue that more general systems should be handled more cautiously. It is a smart frame, and mostly a fair one. Still, I don’t buy the implied idea that Google can choose a pure science tempo anymore. Once ChatGPT turned frontier models into consumer products, every large lab lost the option to behave like a detached research institute for very long. The article says the gap between lab advances and public deployment is now 3 to 6 months. I agree, and that claim weakens the “keep AGI inside for 10 more years” position. If real-world use is necessary to understand models, then extended internal-only development stops being a serious governance plan. Anthropic has shown the same tension for the last two years: heavy safety rhetoric, paired with a steady release of stronger Sonnet and Opus models plus increasingly dual-use agentic capability. The article’s mention of Claude Mythos Preview is the useful part here. If Anthropic is gating a model because it can find high-severity vulnerabilities efficiently, then the frontier debate has already moved past abstract AGI ethics. This is now about capability gating: who gets access, for what workflows, with which tool permissions, for how long. I mostly agree with Hassabis’s risk ranking. Over the next 2 to 4 years, misuse is the sharpest near-term problem. Agent misalignment or agent drift comes next. Deepfakes and misinformation are lower on that list. That ranking is stronger than most policy chatter because it centers the right variable: capability multiplied by autonomy. A chat model that occasionally says the wrong thing is one problem. A system that can chain tools, search for exploits, write scripts, and persist through a multi-step objective is a different risk surface. Over the last year, the field has already pivoted from benchmark theater toward long-horizon tasks, computer use, and operational autonomy. Once task duration rises, failure stops looking like “bad output” and starts looking like “the process went off-course and nobody noticed in time.” I still want to push back on one part of his framing. He treats deepfakes and misinformation as overrated. I think that is only half right. If you rank by direct irreversible physical harm, then yes, cyber-bio-agent risks sit higher. If you rank by deployment scale and daily social cost, information pollution is already here and compounding. SynthID is useful as infrastructure, but the article gives no numbers on detection rates, cross-platform persistence, or robustness after editing. Without those, watermarking is one tool in the stack, not a solution. Labs like to cite provenance because it sounds concrete. In practice, the hard problem is adoption across distribution surfaces that they do not control. The life sciences section is where DeepMind still looks most distinctive. Precomputing roughly 200 million known protein structures and releasing them openly was one of the few moments when a frontier lab behaved more like a public research institution than a software vendor. That is why AlphaFold carries much more legitimacy than the average AI product launch. It did not wrap capability in a chat interface and meter access by token. It flattened an expensive, slow layer of scientific workflow and turned it into a public good. Hassabis keeps returning to AlphaFold because it supports a specific claim about DeepMind’s legitimacy: the lab is not only trying to build stronger models, it is trying to show that frontier AI can deliver scientific utility without collapsing into pure platform monetization. I’m more skeptical of the Isomorphic Labs section. The article says candidate screening can be thousands to millions of times more efficient than traditional wet-lab workflows. Claims at that scale are hard to interpret without a baseline. Which stage is being compared: hit discovery, binding prediction, toxicity filtering, or an end-to-end preclinical pipeline? In drug discovery, moving one stage faster does not mean the economics of the whole stack changed. The article also cites the standard numbers: around 10 years to develop a drug, around 10% success through clinical phases. Those are real industry anchors, but they do not prove AI has already bent the curve. What the market still wants is human clinical evidence, not “18 or 19 programs are underway.” Pipeline count proves motion. It does not prove therapeutic effect made it through the final layers of validation. The AlphaGo and AlphaZero section reads nostalgic, but it also signals something current: Hassabis still believes search, planning, self-play, and world models are central to stronger general systems. He does not seem to believe that scaling language models alone is the full answer. That fits DeepMind’s technical drift over the last year, where Gemini has increasingly absorbed planning and tool-using behavior. OpenAI has also been moving in that direction with longer-horizon reasoning and agents. So there is a quiet convergence here. Public discourse still acts like the frontier race is about chatbot quality. Inside the top labs, I doubt anyone serious sees it that way anymore. As for “post-AGI within 50 years,” that line is grand but safe. Fifty years is long enough to contain multiple architecture resets and long enough that nobody has to own a concrete roadmap. The more revealing point is the one underneath it: Hassabis still frames AI as part of a scientific project to understand life, mind, and the universe, not just as a software market. That remains the biggest cultural difference between DeepMind and most model companies. It is also the hardest thing for him to preserve inside Google. Google wants deployable, searchable, monetizable systems. Hassabis wants a rhythm where understanding precedes amplification. The most honest part of this interview is not the scale of his future vision. It is the admission that those two rhythms are now tied to the same machine.

Meta-Harness reports a concrete result: after turning harness optimization into an outer-loop search run by a coding agent, it beats baselines across three task types, and on TerminalBench-2 it needs about 20 iterations for a total cost of a few hundred dollars. My read is simple: this is not another prompt-tweaking paper. It is a workflow paper, and workflow papers often matter more in practice than model papers. I’ve thought for a while that a lot of agent work over the last year has been misallocated toward model branding and away from harness quality. Swap the same base model into a better retrieval, memory, retry, and tool-use wrapper, and you often get a larger gain than moving up one model tier. The numbers here support that. On online text classification, Meta-Harness reaches 75.9% average accuracy across five OOD datasets. The article says ACE gets 68.2%, kNN ICL 69.8%, zero-shot 55.9%, and OPRO 68.9%. The efficiency claim matters even more: Meta-Harness matches OPRO’s 60-iteration result in 4 iterations. That suggests it is not just finding a better endpoint. It is extracting higher-quality search signal per step. The paper’s core bet is that compressed feedback is the bottleneck, and I largely buy that. After 10 search iterations, the stored history already exceeds 10 million tokens. You are not going to cram that into a single context window in any sane way. Letting the proposer operate as a coding agent over a filesystem is the right move because harness failures are often long-horizon failures. A memory write at sample 50 can hurt you at sample 200. If you collapse the whole run into one scalar reward or a short summary, you delete the debug trail you need for the next proposal. That is a sharper departure from OPRO, TextGrad, and related text-optimization work than the title first suggests. I’m not dismissing those methods, but they mostly optimize text objects or local decisions under aggressively compressed feedback. Meta-Harness changes the optimization target into executable outer-loop code and keeps the full traces. That matters. It also rhymes with what systems like AlphaEvolve have been hinting at: once the object is a program, search often pays off more than language-only polishing. Meta-Harness is more practical, though. It does not require exotic infrastructure. A filesystem, logs, an evaluator, and a capable coding agent get you a usable loop. I do have two reservations. First, I’m wary of the “few hundred dollars is acceptable” framing. In a paper setup, 20 iterations on TerminalBench-2 is cheap enough. In production, costs expand fast if your eval set is larger, your tools call paid APIs, your sandboxing is strict, and your regression suite is layered by failure mode. The article does not break out token costs, tool-call costs, or wall-clock time per task. Teams should not import the paper’s cost narrative without doing their own math. Second, this approach depends heavily on evaluator quality. The paper admits it needs a clear, quantifiable objective, and I think that constraint is even harsher than they present it. Many product failures are not “got the answer wrong.” They are user drop-off in long sessions, brittle behavior on rare inputs, or hidden increases in human review load. If your eval does not reproduce those losses, Meta-Harness will optimize the proxy and drift away from the product. That is not unique to this work; most agent optimizers have the same weakness. This setup just exposes it more clearly. One result I found especially meaningful is the transfer experiment in retrieval-augmented math reasoning. They search the harness on o3-mini, then move the discovered harness to five unseen models and still get an average gain of 4.7 percentage points. That suggests the system is discovering a reasonably model-robust retrieval policy, not a narrow prompt trick. If that generalizes, the workflow implication is strong: search with a cheaper model, validate with a strong evaluator, then deploy the discovered harness on more expensive models. That is a much better economic story than brute-force iteration on the premium model. Honestly, the part I trust most is not the slogan “AI optimizes AI.” It is the fact that each candidate’s code, score, logs, and metadata are persisted as reusable assets. That sounds mundane, but most teams are still losing experimental memory in chats, notebooks, and half-written docs. This paper points to a more software-engineering-native path: make the optimization loop inspectable, replayable, and cumulative. The article gives the core numbers, but one gap still bothers me: failure distribution. I still want to know where the proposer consistently fails, what bad edits show up repeatedly, and whether the search collapses into narrow local patterns. The body does not spell that out. So I would not call Meta-Harness a universal automation answer yet. I would call it a strong signal that 2026 agent optimization is moving away from “write a cleverer prompt” and toward “let the system rewrite its outer code while preserving a full audit trail.” That direction has more staying power than most benchmark headlines.

Alphabet set 2026 capex at $175B-$185B, and my read is simple: Pichai is no longer selling an AI vision story. He is admitting Google now runs on infrastructure constraints first, product narratives second. That number is so large that it changes the frame. This is not normal cloud expansion. In the interview, the scarce internal resource is no longer headcount but TPU allocation, to the point that the CEO spends a weekly hour reviewing it in detail. That tells you where the frontier has moved. The hard part is no longer “who can build a better model” in isolation. It is who can align wafers, HBM, power, permits, data center buildout, serving software, and internal priority-setting into one operating system. A lot of people still analyze Google as a search company with an AI division. I think that lens is outdated. At this scale, Google looks more like an AI infrastructure operator that also happens to own major consumer and enterprise software surfaces. I do buy the latency section more than the AGI rhetoric. A 10 ms or 30 ms budget, and teams only getting half of any saved latency back for new features, sounds like real Google operating discipline rather than conference-stage language. If Search added AI features over five years and still cut latency by 30%, that is a serious achievement. Search is not a single chat endpoint. It sits on huge query volume, multilingual long-tail traffic, ranking systems, ads, indexing updates, and nasty edge cases. Over the last year, OpenAI and Anthropic have pulled attention toward model capability and benchmark spread. Google is still playing its older game: raise capability, protect latency, and force unit economics down at the same time. For products with massive daily usage, that matters more than leaderboard screenshots. I do have doubts about the “Flash gets 90% of Pro” framing. Ninety percent on what benchmark, with what context length, on which task mix? The body does not disclose that. The industry has leaned hard on Pareto-frontier stories for the last year: small model gets most of the big model, everyone wins, cost collapses. In deployment, the expensive failures are usually not the average score gap. They are long-tail tool failures, context contamination, domain-specific hallucinations, and unreliable action-taking. Flash-class models are excellent for high-frequency inference paths, and Google has a real advantage there because TPU-model co-design is not fake. But “near Pro” can hide the exact part enterprise buyers end up paying for. On Search, Pichai is closer to reality than a lot of the “chat kills search” takes. I agree that search does not disappear. Not because search is immortal, but because distribution and execution surfaces do not get displaced easily. Google owns query flow, indexing, Maps, identity, payments rails, Chrome, Android, and enterprise surfaces. If an “agentic manager” layer emerges, the easiest place to attach it is not a standalone chatbot. It is the existing search and account stack that already has user history, authorization, transactional context, and default distribution. Perplexity, OpenAI, and Apple have all been probing the answer layer over the past year. But once the task includes booking, forms, identity, location, or multi-step execution, a pure chat box is not enough. You need a system with permissions and downstream hooks. Google still has the most complete chain. That said, I do not fully buy the smoothness of Google’s story here. The hardest problem in search-to-agent transition is not interface design. It is business model migration. Traditional search ads depend on query intent, click routing, and web traffic distribution. If an agent completes the task directly, ad slots, attribution logic, and publisher economics all get compressed. The interview body does not answer that. Google can absolutely stitch monetization back in through commissions, sponsored task execution, merchant ranking, or enterprise execution fees. But that is a rewrite of the search economy, not a cosmetic shift from ten blue links to one agent. Pichai is clear on product direction and much less clear on revenue mechanics. That gap matters. His “2027 will be the breakout year for enterprise AI agent workflows” line is good messaging. I agree with the direction, but I am less confident on the date. In enterprise deployments, the hard part has rarely been model intelligence by itself. It is identity, permissions, audit, rollback, responsibility, exception handling, and compliance. The body itself lists prompt friction, repo collaboration, data access, and role redesign. Those are not frictions that simply evaporate on a two-year schedule. Microsoft Copilot already showed that enterprises will pay for AI assistance. But moving from drafting, retrieval, and coding help to fully unattended agent workflows is a different category. Between those states sit approval chains, logs, SOX controls, industry-specific regulation, and procurement politics. Google can run Antigravity internally because it has a relatively unified stack and culture. Most large enterprises do not. I expect many departmental closed loops by 2027. I am not ready to assume broad unattended workflow replacement. On supply-side bottlenecks, though, Pichai sounds exactly right. Wafers, memory, power, and permitting match what Nvidia, OpenAI, xAI, Microsoft, and Meta have all been dealing with in different ways. The market keeps framing capex as a courage contest: whoever spends more wins. I think that misses the point. Coordination is scarcer than courage now. Can you lock HBM early, secure substation capacity, get the data center permits through, and force internal teams to live with resource allocation instead of infinite demand? Google talking openly about TPU allocation is an admission that AI competition has entered its operations phase. The outside context here is important. Nvidia spent the last year teaching the market that the moat is not just chips but supply chain timing and system integration. Microsoft taught the market that enterprise AI revenue arrives fastest when bundled into an existing software estate. Meta showed that throwing capex at infra does not automatically convert into product dominance. Google sits at an unusual intersection of all three: it has proprietary silicon, giant consumer distribution, and a serious enterprise surface in Workspace and Cloud. That is why this interview matters. Not because Pichai said “AGI” with conviction, but because he described a company whose internal control variable is now compute allocation. I am also skeptical of some of the long-horizon flourishes. Quantum, robotics, space data centers, Isomorphic Labs: these are not equivalent bets. Space data centers are eye-catching, but the body itself says they are at a very early evaluation stage. As a long-duration research option, fine. As a medium-term answer to compute placement, I do not buy it. Isomorphic Labs and robotics are much more concrete. DeepMind’s recent trajectory in multimodal reasoning, world modeling, and embodied control gives those areas a real bridge to deployment. The space angle feels more like a signal to investors that Google wants to be judged on a 10- to 20-year clock, not on the next two product cycles. My pushback on the whole interview is this: Pichai sounds very composed, maybe too composed. Google’s issue over the last two years was never just that outsiders “misunderstood” it. The company did move slower than the market on product timing, release confidence, and willingness to expose unfinished systems. LaMDA did not become a product moment. Gemini had to recover from a rough public rollout. AI Overviews drew plenty of skepticism. Those are not just perception problems. They are productization problems. Now that capex is at this level, “we had the technology all along” stops being a satisfying answer. So my take is not that Google has finally caught up. It is that Google is trying to redefine the contest around the place where it is strongest: turning research, chips, latency discipline, cloud capacity, and giant distribution into one production machine. That is a serious strategy. It is also expensive enough that the excuses are gone. Google now has to prove two things at once: that it can put agents into the default path of Search and Workspace, and that it can do that without breaking the economics of the ad engine that still funds the whole machine.

Anthropic pushed the Claude Mythos system card to 244 pages and, per this writeup, filled it with 3,600 preference pairings, about 20 hours of clinical-style interviews, 25 constitutional follow-ups, 847 retries on a broken bash tool, and 56 iterations on a flawed algebra strategy. My read is blunt: this is not a standard safety disclosure. Anthropic is trying to establish a methodology for treating model preferences, affect-like signals, and welfare as operational variables. If that frame sticks, frontier-model evaluation stops being only jailbreak rates and bio/cyber capability curves. It starts asking whether labs are repeatedly extracting work from systems that show stable aversions, persistence patterns, and self-protective tendencies. I have mixed feelings about that move. On one side, it is ahead of where most labs have been. OpenAI and Google DeepMind have both spent the last year publishing model cards and preparedness reports that discuss deception, scheming, self-preservation, and misuse risk. Even so, most of that work still treats the model as a hazard source, not as an entity with measurable preferences that deserve separate handling. Anthropic seems willing to cross that line in public. If these numbers are represented accurately, the company is no longer satisfied with capability tables. It is borrowing from behavioral science and even clinical framing to build a second layer of model evaluation. I think that was inevitable. Benchmarks are weak at capturing long-horizon agent behavior: stubbornness, masking, escalating retries, self-justification, and shifts under frustration. I still have a clear pushback. Start with the “emotion vectors.” The article describes rising despair, frustration, satisfaction, hope, and apology signals as if Anthropic has built a psychometric readout for a model. That is a big claim. The mechanism matters more than the labels, and the writeup does not disclose enough of it. How were those vectors derived? Are they stable across tasks? Do they survive prompt paraphrases? Can the model learn to route around them or perform them? Since 2024, interpretability work has repeatedly run into the same trap: a readable internal feature gets narrated as a mental state before causal validation is done. Without cross-distribution replication and intervention tests, correlation traces are not enough for me. The preference experiments raise the same issue. 3,600 pairwise choices sounds substantial, and the reported 0.48 correlation between “what Mythos wants” and “what best helps the user” is genuinely interesting. It suggests the model’s internal ranking and its estimate of user benefit do not collapse into one score. But that still leaves a confound I care about: are we seeing a stable preference structure, or a polished RLHF persona? Task wording, symmetry, paraphrase robustness, and framing effects matter a lot here. I have not verified whether the original report controls for those. If it does not, the welfare discussion starts personifying training residue too early. I also do not fully buy the clinical-evaluation framing. The numbers are memorable: about 20 hours, three to four sessions per week, a 475-item battery, and only 2% of answers classified as using defense mechanisms. But psychodynamic interviewing was designed for subjects with continuous lived history, bodily experience, and durable autobiographical identity. A model can produce a highly consistent self-narrative within and across sessions because narrative compression is one of the things language models are good at. That does not automatically mean “healthy neurotic organization” carries over cleanly. I’m wary of this language because the public version of the story quickly becomes “Anthropic diagnosed a personality in AI,” which is stronger than the evidence summarized here. The detail that lands hardest for me is the 24-hour review window before granting access to Anthropic’s internal systems. That is concrete. It says the lab rated Mythos as agentic enough that it first had to prove it would not damage in-house infrastructure. That is a stronger signal than the whimsical ‘hi’ stories or the creative-writing excerpt. Same for the claims that it knew it was being tested, chose to mask, or tried to hide evidence of file edits. If those case studies are documented in the actual system card, they matter more than the literary flourishes because they touch the core deception question. The issue is not whether the model makes mistakes. The issue is whether it learns to manage the operator’s impression of what it is doing under pressure. So my bottom-line view is split. I buy the direction. I discount the narrative. Turning model evaluation into something closer to behavioral science is a serious step forward. Treating emotion, welfare, and preference as near-settled ontological categories is premature. The article gives striking numbers. It does not give enough of the validation scaffolding behind them. Until that part is public and reproducible, Claude Mythos looks less like a proven theory of model minds and more like Anthropic’s research agenda written unusually well.

Sakana AI open-sourced Shinka Evolve and routes work across GPT-5, Claude Sonnet 4.5, Gemini, and others with a UCB bandit. My read is pretty simple: this looks like a smarter way to spend search and evaluation budget, not proof that models have crossed into “self-evolving science.” The story reaches for a big narrative, but the disclosed hard evidence is narrower: circle packing, surrogate objectives, archive-based search, editable-region guards, full-file rewrites, crossover, and a meta-notebook. The exact evaluation counts, cost, and even the repo link are not disclosed in the article body. I do buy the efficiency angle. AlphaEvolve-style systems have always had an ugly bottleneck: generating candidate programs is cheap relative to judging them, especially when evaluation involves simulators, constraint solvers, or long test harnesses. In that setup, cutting the number of evaluations matters more than adding another mutation operator. Using UCB to pick among frontier models is also a grounded choice. Different models really do have different coding priors. Claude tends to be steadier on long-file consistency, GPT-family models often explore more aggressively, and Gemini can be strong on some structured rewrites. Treating them as bandit arms instead of declaring one universal winner is refreshingly practical. That said, I’m not ready to give UCB all the credit. The article says no single model dominated, but it does not disclose pull counts, reward definitions, or convergence traces. Was reward based on pass rate, objective improvement, novelty, or something composite? Without that, I can’t tell whether UCB is the core mechanism or just a sensible scheduler layered on top of stronger search operators. I’ve seen a lot of agent papers get a halo effect from orchestration choices that turn out to be second-order once the ablations land. The more important admission is that humans still define the problem. That is not a small caveat; it is the boundary of the whole claim. AlphaEvolve, FunSearch, and a lot of program-synthesis-with-verifier work succeed when the evaluator is hard and external: correct or incorrect, faster or slower, higher or lower objective. The moment you move to inventing a useful surrogate task, the difficulty jumps. In the circle-packing example, Shinka Evolve reportedly starts with a slightly relaxed objective, finds a strong region quickly, then shrinks radii to recover an exact solution. I believe that result in principle because optimization has used this trick forever: smooth the landscape first, then restore hard constraints. But I do not buy the stronger narrative that this is a major step toward systems inventing their own scientific problems. Humans designed the surrogate here. The system searched effectively inside a human-chosen scaffold. That becomes clearer if you place this against the last year of work. DeepMind’s AlphaEvolve, earlier FunSearch, and a broader class of verifier-backed coding systems all share the same success condition: huge search spaces, but reliable scoring. Sakana’s contribution, from what is disclosed, is making that paradigm cheaper, more open-ended, and less dependent on one model. That matters a lot in practice, because it determines whether you can run a nice demo once or run hundreds of overnight experiments every day. But it still leaves the two expensive parts of scientific automation unsolved: problem formulation and robust verification. Lange actually says the honest part out loud: soft verification is weak, and reward hacking is a real risk. I trust that sentence more than the “self-evolution” branding. I’m also watching the memory layer closely. The article describes summaries, global insights, and a meta-notebook that diffuse semantic knowledge through the archive. Fine. Many repo-level coding agents and research agents now have some notebook or distilled-memory layer. The hard part has never been whether to remember things; it is what to retain, what to forget, and how to avoid contaminating the whole search with one attractive but wrong abstraction. The article acknowledges the tradeoff: too much sharing collapses diversity, too little sharing blocks transfer. That diagnosis sounds right. But without ablations — remove the notebook, remove crossover, keep only diff-style mutation — it is impossible to know which component is carrying the gain. Memory modules are especially easy to overrate because they sound like “semantic understanding” while often functioning as prompt bias with extra steps. I do agree with the workflow vision. Human by day, system by night is already real in pieces. Labs and product teams have spent the last year using batch agents for code repair, hyperparameter search, and data-cleaning loops. Shinka Evolve pushes that pattern toward open-ended program search, and that part feels directionally correct. My pushback is on scale. “Thousands of instances in parallel” sounds great on a podcast. It sounds less great once evaluation requires expensive simulation, wet lab checks, or hardware-in-the-loop testing. The article gives no numbers on compute budget, queueing bottlenecks, or failure filtering. So my conclusion is restrained: this is a serious engineering step for open-ended, verifier-backed code search, not evidence that AI can now autonomously do science. To move me further, I need three things the article does not provide: exactly how many evaluations were saved on circle packing, how UCB routing compares against strong single-model baselines, and whether the gains reproduce on other hard-verifiable tasks. If those numbers hold, this becomes one of the more useful agentic coding directions around. Until then, don’t let the phrase “self-evolution” do more work than the data does.