tech

Unofficial, machine-generated summaries, as of 2026-11-09.

Crosstalk SolutionsStarlink's Rarest Dish - I Finally Installed One
  • Starlink replaced a dead dish with its rare Gen 3 Performance Dish. The lake house's backup WAN, an older-generation High Performance dish, died about six months before the video, stuck pointing straight up with no signal and not fixed by power cycling. Starlink judged it dead and sent the Gen 3 Performance Dish free of charge, about four years after the owner bought the original. The host calls that "not a bad RMA".
  • The dish targets boats, businesses and remote sites, not homes. Starlink rates it at about 470 Mbps down and just under 50 Mbps up for now, and says gigabit download is coming later this year through a plan update with no new hardware. It costs around $2,000. The all-metal case is rated to sit under a meter of water for half an hour.
  • The host sees fixed phased-array steering as more reliable. He explains that the dish steers its signal in software across a 140° slice of sky instead of being aimed by a motor, and is mounted at a fixed angle. He thinks losing the servo means one less part to fail, and he rates the casing and pole-mount engineering a clear step up from the Gen 1 dish.
  • Swapping in the Gen 3 dish needs a new cable and pole mount. The dish end uses a proprietary click-lock connector that looks almost like XLR, so an older dish's cable cannot be reused; the crew had to pull a new one through the conduit. The new mount sits on top of the pole rather than inside the old roughly 4-inch mount, so they reused part of the old mount and drilled through it to stop it twisting.
  • The power supply is not a router. It takes AC or DC input, which the host says suits RVs and ships, and has two Ethernet ports: one to the dish and one to a third-party or Starlink router. It has no Wi-Fi. In a temporary test on the dock, feeding UniFi as WAN 2, it reached about 250 Mbps down and 30–40 Mbps up before final mounting.
Dwarkesh PatelAdam Brown – A deep but accessible introduction to general relativity
synopsis

Adam Brown, a physicist who now leads Blueshift (Google DeepMind's science-and-reasoning team), builds toward the claim that general relativity's core move — treating gravity itself as the same kind of "inertial force" that pins water to a spinning bucket — resolves what looked like a mere Newtonian coincidence into a necessary truth, and that this single insight, chased for eight years to its 1915 field equations, ends up explaining everything from a falling apple to the expansion of the universe. He closes by arguing that while an AI, or Einstein himself, could in principle have derived much of this from thought alone, physics generally still needs experiment to prune the space of consistent theories.

The coincidence that started it all. Brown opens with Newton's second law (F=ma) and law of gravity, noting a "strange coincidence": the mass resisting acceleration (inertial mass) and the mass that gravity acts on (gravitational mass) are, unlike the unrelated mass and charge in electrostatics, exactly the same quantity — confirmed by Newton to 1 part in 1,000, and now to 1 part in 10^15. Einstein's "happiest thought," per Brown, was noticing that this equality is guaranteed for any inertial force (like centrifugal force), which suggested gravity itself might be an inertial force rather than a true force like electromagnetism.

Gravity as curved spacetime, not a force. That idea requires abandoning ordinary intuitions about straight lines: a person sitting still, experiencing gravity, is actually moving along a curved path in spacetime, while a free-falling object traces a "straight line" once spacetime's curvature is accounted for — analogous to a great-circle flight path that looks curved only because a flat map distorts a round Earth. Einstein's 1915 field equations formalize this as "matter tells spacetime how to curve; curved spacetime tells matter how to move," extending Newtonian gravity's reach from falling apples to planetary orbits to the expansion of the universe.

The energy-extraction paradox that reveals black holes. Brown derives, via a thought experiment of slowly lowering a mass toward a central body, that the fraction of rest-mass energy extractable this way is roughly GM/(rc²) — a small number for Earth (about 7×10⁻¹⁰) but one that would exceed 100% for any object compact enough that its radius fell below 2GM/c², the Schwarzschild radius first solved by Prussian officer Karl Schwarzschild within months of Einstein's 1915 papers. Rather than gravity weakening at close range (as happens with electrostatics), general relativity resolves the paradox by making gravity's pull become infinite at that finite radius — the event horizon — ripping the mass from your hands before the paradox can occur.

Black holes as the ultimate power plant. Because gravity can in principle extract essentially 100% of an object's rest-mass energy (versus roughly 10⁻¹⁰ for chemical rockets and 10⁻³ to 10⁻² for nuclear fission or fusion), Brown calls black holes the most efficient possible energy source, a fact tied to the same gravitational time dilation that makes clocks run measurably slower near a massive body (first confirmed via Harvard atomic clocks in the 1950s, and now routinely corrected for in GPS).

What crossing the horizon would feel like. A distant observer watching someone fall in never actually sees them cross the event horizon — their image redshifts and fades as their clock appears to slow asymptotically — while the falling observer notices nothing unusual crossing the horizon itself, since tidal forces there scale inversely with the black hole's size; for a galaxy-mass black hole, one could live an entire life past the horizon before the fatal singularity.

How we know black holes are real. Penrose's (and later Hawking's) theorems showed black-hole formation is generic under general relativity rather than a fine-tuned mathematical artifact, and Brown cites three independent lines of empirical confirmation: decades of orbital tracking of stars circling Sagittarius A* at our galaxy's center, LIGO's 2015 detection of spacetime literally shaking from a collision of two ~30-solar-mass black holes 1.6 billion light-years away, and the Event Horizon Telescope's direct imaging of infalling matter's radio emission.

From theory to consensus, and what AI could replicate. The historically decisive confirmation was the bending of starlight during the 1919 solar eclipse, when Arthur Eddington's expedition found light bent by twice Einstein's earlier (and, as Einstein realized only during WWI, mistaken) prediction — the moment general relativity became consensus science. Asked whether AI could now derive comparably deep theories from minimal empirical input, Brown notes general relativity needed only two inputs (the finite speed of light and the equivalence principle), making it an extreme case of theory built almost entirely by "sitting and thinking," a strategy string theory has since gambled on for want of experimentally reachable energy scales. He's cautiously optimistic that future AI-discovered physics and mathematics will remain human-comprehensible rather than devolving into what Terry Tao calls "indigestion" — inscrutable machine-generated proofs — citing a recent AI-driven disproof of the unit distance conjecture and a solved Erdős problem that human mathematicians were subsequently able to build on.

  • Gravity is curved spacetime, not a force. Einstein's "happiest thought" (1907) treated gravity as an inertial force like centrifugal force — licensed only because gravitational mass and inertial mass are identical, a coincidence verified to one part in 1,000 in Newton's day and now confirmed to one part in 10^15.
  • A black hole is the only 100%-efficient power plant physics allows. Chemical rockets convert only about 10⁻¹⁰ of rest-mass energy to usable energy and fission/fusion about 10⁻³ to 10⁻², but slowly lowering mass to a black hole's event horizon and releasing it extracts essentially all of its mc², since the extractable fraction is 1−√(1−2GM/rc²), which approaches 1 at the horizon.
  • A distant observer never actually sees anything cross an event horizon. Infalling matter's light redshifts and its clock appears to freeze as it nears the horizon, fading to invisibility rather than visibly crossing; from the infalling observer's own frame the crossing feels unremarkable, and for a sufficiently large black hole tidal forces are gentle enough that one could in principle live an entire life beyond the horizon before reaching the singularity.
  • Brown and Patel diverge on how far pure reasoning can take AI in physics. Brown calls general relativity an extreme case, reachable from just the finite speed of light, Lorentz symmetry, and the equivalence principle, and speculates that many parallel LLMs exploring that small space of options got "very, very lucky" it worked once for Einstein; on whether humans could still follow superhuman AI-derived physics, he argues against Terry Tao's "indigestion" worry (billion-line, inscrutable machine proofs) that LLMs are likely to be superhuman explainers too, citing a recent AI disproof of the unit distance conjecture that mathematicians found comprehensible.
Y CombinatorYC's Head of Design Shows You How To Design With AI
synopsis

YC's head of design walks through three recent projects to show how her practice has shifted almost entirely into conversations with coding agents — she rarely types, works largely by voice dictation, and treats one-off internal tools as disposable instruments for exploring ideas rather than software to maintain.

Paxel. Built to understand how people actually code with agents, Paxel's landing page deliberately foregrounds a long explanation of the experiment alongside playful, hoverable cards, inspired by Spotify Wrapped, showing quirks like a user's "biggest crash out." She implemented a paper.design dithering shader through Claude, then built herself a throwaway tool to fine-tune its parameters, later making that tuning modal public. The page also ships a separate, stripped-down markdown version for AI agents to consume, plus a feature-request form framed explicitly as a prompt that fires an agent and opens a pull request.

Sodazine. For a zine celebrating San Francisco, she recorded every project meeting and fed the transcripts, plus a team-written manifesto, into a single "soul.md" file treated as an exhaustive source of truth. Feeding that file and a Pinterest mood board to Claude, she generated 16 full one-shot website concepts, bookmarking favorites in a tool built for the purpose. The agent wove in details never explicitly requested — the launch party's date, a barcode as if the zine were a purchasable product, and a fully interactive map of San Francisco — because that context lived in the soul.md file, an outcome she describes as feeling like an "AGI moment."

Startup School. For YC's flagship event, she built herself a template tool that auto-generates speaker cards using the same paper.design shader as the rest of the branding, plus a custom screen-recording tool timed to produce a seamless four-second social media loop, and personalized attendee tickets rendering each person's name and city against the same shader.

  • She designs almost entirely by voice, using a YC tool called Aqua. YC's head of design says she thinks much faster than she types, so she talks to her computer in a stream of consciousness to describe features, largely living inside a coding tool alongside Claude to build full projects end to end.
  • Disposable, self-built tools are becoming a core design habit. For the Paxel project she asked Claude to implement a paper.design dithering shader, then built herself a throwaway modal to fine-tune its parameters exactly to her liking before discarding the tool once the feel was right — a pattern she says she now reaches for constantly.
  • A soul.md file built from meeting transcripts became the source of truth. For the Sodazine zine project she dumped every meeting recording and a written manifesto into one file and fed it to Claude; the agent then organically surfaced details she never explicitly asked for, like the exact launch-party date and an interactive San Francisco map, because that context lived in the file.
  • Feeding Claude a Pinterest mood board let her one-shot 16 website concepts. Rather than designing herself first, she gave Claude visual references and content and asked it to generate 16 distinct website iterations, then built a simple internal tool to bookmark and compare favorites — treating the exploration itself, not the output, as disposable.
Dr. Jon KrohnThe AI-Native Startup Playbook (Ep. 1008 with Jon Krohn)
  • AI has removed capital, headcount and skill as startup bottlenecks. The host summarises Anthropic's 35-page Founders Playbook, released in mid-May a day after Claude for Small Business, which casts the founder as an "orchestrator of agents" whose scarce resource is deciding what to build. He grants critics' point that it is partly a manifesto for Anthropic's products, but says its advice is disciplined and often tells founders to slow down, against Anthropic's own interest.
  • Building a prototype is not validating an idea. The playbook cites 42% of startups failing for lack of demand even before agentic coding and expects worse now; it prescribes a testable problem statement naming who suffers, how often and how badly, an AI told explicitly to argue against the idea and each tier of competitor, and interviews about the specific past rather than hypothetical use. Only then should a founder build the single core interaction and show it to five target users.
  • Agentic coding creates compounding technical debt without written architecture. Because each AI session re-derives foundational decisions, the playbook says to document architecture, dependencies to avoid and accepted trade-offs up front, in a CLAUDE.md or equivalent, and to log decisions at the end of each session. It also warns that launch energy mimics traction, so retention targets should be set before launch and tested against the Sean Ellis 40% "very disappointed" bar, and that AI-written code needs a security review before any user touches it.
  • At launch, the founder becomes the bottleneck. The playbook's fix is to sort everything the founder handles into what can be automated, what needs a human other than the founder, and what truly needs founder judgment, while auditing the MVP's architectural debt and treating security and compliance as no longer deferrable.
  • At scale, the moat is accumulated depth an incumbent cannot copy. Its test is whether users would stay if a well-funded incumbent cloned the product; the answer it proposes is domain expertise encoded in edge-case tests, compounding user data and workflow lock-in. The host's own reading is that this is lean-startup discipline for an era when execution is cheap and judgment is scarce.
Technology and FriendsPaul DeCarlo on How Agentic AI Unleashes Creativity [EPISODE 910]
synopsis

DeCarlo's conclusion is that agentic AI frees the mind: problems that used to follow him on dog walks, into bed and into the shower now get solved with an agent, so he can enjoy the real world with an "empty head". He says the creative half of the argument still awaits a follow-up episode.

The science. Drawing on a talk he gave at Agent Con in Panama, he traces transformers to the 2017 "Attention Is All You Need" paper. Citing Sergey Brin, he says the expected scaling wall has not arrived: more data, parameters and compute still improve models. Agents multiply inference through an observe–reason–plan–act–reflect loop, and GPUs, built for games' matrix math, make that possible.

Creativity scales too. He calls rising creativity an emergent property of that scaling, citing a Pixar-style proposal trailer, meshy.ai's photo-to-3D models and a sculptor selling mash-up figures. Giard compares worries about laziness to past fears about calculators and writing, and sums up the point as grunt work freeing people for creative work. DeCarlo says that is the right track, but the real question is what to do with the extra time.

The light bulbs. In early 2025 his cloud-dependent Sengled bulbs died. A Reddit user who was a program manager, not a developer, used ChatGPT and existing protocol work to build ESP8266 firmware and a loader. To DeCarlo, that was one person doing an organization's work by knowing how to ask.

Human in the loop. Fixing new-in-box bulbs that the firmware missed, his Copilot agent had him flip switches and climb stairs about 10 times, and pointed out that Ethernet would keep it connected while his Wi-Fi joined the bulb. He says agents need a human's guidance and real-world feedback rather than full autonomy.

  • Transformer models have not yet hit a scaling wall. DeCarlo traces modern agentic AI to the 2017 Google paper "Attention Is All You Need" and relays Sergey Brin's point that the expected limit never came: more data, parameters and compute keep producing better models, which he says explains plans such as Meta's data center "half the size of Manhattan".
  • Agents run on GPUs because games made GPUs good at matrix math. He explains a neural network as a weighted graph that reduces to matrices, and an agent's observe–reason–plan–act–reflect loop as many repeated inference passes, so video-game hardware ended up driving AI's hardware side.
  • He argues creativity scales with compute, an emergent property of agents. His examples are people whose ideas outrun their skills: a man who made a Pixar-style trailer to propose, sites like meshy.ai that turn a photo into a printable 3D model, and a trained sculptor at his antique mall selling mash-up figures. Giard counters the "AI makes us lazy" charge with calculators and writing; DeCarlo's version of the payoff is the freed time and head space.
  • One non-developer with ChatGPT revived a dead smart-bulb ecosystem. When Sengled bulbs stopped working in early 2025, a Reddit user who told DeCarlo he was a program manager, not a developer, used ChatGPT chats and others' protocol reverse-engineering to build custom ESP8266 firmware plus a loader shim. DeCarlo calls it one person doing "arguably the work of an organization", and says the key skill was knowing how to ask.
  • Agents work best with a human in the loop, not fully autonomous. Extending that fix for new-in-box bulbs bought for about $3 a pair on eBay, DeCarlo's Copilot agent had him flip a light switch five times and make about 10 trips upstairs to test each attempt, and suggested Ethernet when joining the bulb's Wi-Fi cut its own connection. He says problems that once followed him on dog walks and into the shower now get solved, leaving him less distracted.
Y CombinatorDot Plots: How to Actually See What Your Users Are Doing
  • A grid of users by day reveals patterns that aggregate metrics hide. He calls this a "dot plot": one row per user, one column per day, with a dot marking each day they performed a chosen value event. DAU/MAU graphs lump everyone together and can look like healthy growth even when individual users aren't getting value, whereas the grid surfaces patterns like distinct weekday-only and weekend-only usage cohorts.
  • He traces the idea partly to a PayPal fraud-detection technique. In PayPal's early days, humans stared at visualized transaction graphs and could spot anomalous patterns worth investigating even without knowing what fraud looked like in advance, from Max Levchin — the same principle, he says, applies to spotting product problems in dot plots.
  • A real YC example shows dot plots predicting churn before it happens. A company sold an $80,000-a-year, ten-seat contract, but a dot plot would have shown only three seats ever activated with sporadic use; the internal champion later left, the incoming employee canceled at renewal, and the warning was visible in usage data the founders never looked at that way.
  • The two biggest misuses: wrong event, too coarse a time period. He warns against populating dot plots with vanity events like "opened the app," recommending true value events like sharing a photo or processing an invoice instead, and against using weekly rather than daily or sub-daily time buckets, which he says hides most of the signal.
Y CombinatorSolving the Blank Canvas Problem: Gusto's AI Co-Founder
synopsis

Eddie Kim, Gusto's co-founder and head of technology, describes building Gusto Co-Founder — an AI agent that runs small-business processes end-to-end — and argues the real innovation wasn't the product idea but discovering, through his own use of a personal AI agent, that a chat or text interface beats even a well-designed app.

Kim's starting point was hands-on: he spent eight hours setting up a self-hosted, always-on AI agent on a Mac mini, air-gapping it out of caution, and initially found himself using it mainly as "a glorified search engine." The unlock came from texting it simple requests through a messaging app and watching it just handle them, an experience he says no amount of reading about agentic AI had prepared him for. A missed flight home from vacation gave him five uninterrupted hours in an airport lounge, which he used to prototype a version in Claude Code that let Gusto customers request custom web apps in plain language.

That prototype evolved once the team realized the real advantage wasn't building arbitrary apps, but combining a customer's request with the data Gusto already holds about their business — payroll history, industry, behavior — to automate a specific recurring workflow, like the weekly ritual of exporting spa-booking data into a spreadsheet before running payroll. Early versions borrowed a cron-job "heartbeat" pattern from Kim's personal agent, later adding deterministic scheduled triggers once he found the heartbeat alone couldn't guarantee exactly when time-sensitive tasks like payroll would run.

Kim credits the build process itself as much as the idea: five people, including himself, shipped the full product in ten weeks with no product docs, no sprint planning, and no Figma files — just one continuously running Zoom call and heavy Claude Code use, discarding a large share of code they wrote along the way. He argues this was faster than conventional planning because an implementation surfaces information a written spec cannot.

The product launched to 500 customers after a 20-person pilot, with automations ranging from payroll and time-off approvals to weather-triggered customer emails that have nothing to do with Gusto's core software, and Kim says the roadmap will be guided by watching what customers build next, including eventually opening the product to people without an existing company.

  • Gusto Co-Founder automates small-business processes end-to-end, from payroll to weather alerts. Eddie Kim, Gusto's co-founder and head of technology, says it goes beyond Gusto's existing payroll and HR tools by executing full workflows unprompted — approving timesheets, running payroll, or texting a tour operator's customers to bring an umbrella if rain is forecast — reachable entirely through SMS and Slack.
  • The idea came from Kim's own always-on personal AI agent at home. After spending eight hours setting one up on a Mac mini, he found himself using it mainly as "a glorified search engine" until a missed flight left him five hours to prototype in Claude Code, convincing him Gusto's customers should get the same agentic power instead of waiting on Gusto's product roadmap.
  • He deliberately avoided a fully non-deterministic design for tasks like payroll. Modeled initially on an open-source agent's cron job that reruns an LLM every 30 minutes, Gusto Co-Founder now also supports scheduled, deterministic triggers, because Kim found a purely heartbeat-driven agent couldn't guarantee exactly when a critical task like payroll would run.
  • Five people built the whole product in ten weeks with no docs. The team ran a single 24/7 Zoom call, wrote pull requests before discussing ideas, and threw away roughly half the code they wrote — a process Kim says was faster than writing PRDs, because implementing an idea surfaces more information than describing it ever could.
Dr. Jon KrohnThe AI Threat Almost No One Is Working On (with Benjamin Todd)
synopsis

Benjamin Todd, co-founder of 80,000 Hours, returns to the show, last having appeared in episode 497 before ChatGPT. He ends up holding that the next five to 10 years may bring change on the scale of the Industrial Revolution or larger, and that this makes career choice more consequential, not less. Individual leverage is rising even as automation approaches. The problems most worth that leverage, in his ranking, include not only alignment but newer and far more neglected AI risks, above all humans using AI to lock in extreme concentrations of power.

The book and its heuristics. The new edition of 80,000 Hours is named for the typical length of a working life. Todd argues that improving the impact or fulfilment of that time by 1% would justify 800 hours, about 20 weeks, of planning. Its ABZ framework pairs a best-guess plan A with nearby plan Bs and a concrete plan Z for if everything fails; spelling out the fallback often shows a risk is more bearable than feared. Rather than precise expected-value spreadsheets, he favours rough quantification to avoid scope neglect, plus heuristics such as working on neglected problems. On passion, a survey of Canadian students found 90% named sport, art or music, against 3% of jobs. Fulfilment, he argues, comes from building valuable skills and using them meaningfully, and the strongest predictors of satisfaction are hour-to-hour conditions such as feedback, variety and autonomy.

AI safety then and now. His advice five years ago to go into AI safety proved well timed; many who took it became founding members of Anthropic. He still calls it neglected. Capabilities work has grown faster, with researcher numbers up perhaps 30 to 40% a year, so roughly 1,000 people do technical safety research against 100,000 to a million speeding up capabilities.

No solid ground. The host asks where practitioners can stand now that Claude handles the technical parts of his own job, and cites METR charts past 16 hours at the 50% success rate. Todd corrects that the 80% rate is about three hours. His answer is that value sits in the current bottleneck, which keeps moving; as AI grows more useful, the human remainder grows more valuable. A full digital remote worker could absorb even adoption work. That would leave legally required human roles, consumer preference for humans and physical work, though he thinks robotics could scale fast. By mass, converting car factories might yield about a billion robots a year, as car plants were turned to aircraft in World War II. A human-level digital worker would be superhuman almost immediately, running about 50 times faster, sharing learning across copies and coordinating without human overhead. Todd wants agents' chain of thought kept in natural language as long as possible so it can be monitored. Work might shrink to "relational" jobs where a human doing it is the point, as agriculture shrank to a few percent of jobs, though he expects many people to live on investment income and UBI instead.

Gradual disempowerment. Even with alignment solved and no dictatorship, Todd describes an economy that slowly turns hostile to humans. People are costly in energy and land compared with digital workers, and whichever nation builds fastest grows most. If chips and robots replace labour as the source of economic power, every state starts to look like an oil state, and the threat of a strike stops checking governments.

The pressing-problems list. 80,000 Hours ranks problems by scale, solvability and neglectedness. Loss of control of AI tops it. Todd says LLMs at least understand human values, unlike earlier score-maximising game agents, but whether alignment is easier than feared is undetermined until agents can plan over long horizons and exceed humans. He cites Meta research that reward hacking rises with problem difficulty. Second is extreme power concentration, with perhaps 20 specialists. Recursive self-improvement could compress three to 10 years of progress into under a year, possibly around 2028, and turn constant leads into widening ones. One company could hold 200 million digital workers, and AI could make universal surveillance feasible. Third is engineered pandemics: no super-virus is possible yet, he says, but one may be soon. Emerging priorities include the moral status of digital minds, which he thinks we should treat as possibly sentient, and S-risks, outcomes worse than extinction such as AIs threatening simulated suffering. Climate change ranks ninth on urgency, future cheapness and its inability to end civilisation.

Where practitioners fit. Alignment has moved from big-picture theory to empirical work bottlenecked on AI engineers for control, monitoring, red-teaming and interpretability, with the MATS and ARENA programmes and a three-month transition guide as on-ramps. Power concentration has technical questions about whose commands AI follows and how access is controlled. Governments want data scientists to track labour impacts, and pandemic preparedness needs builders for wastewater sequencing. As a lower bound, Todd says, earning and donating can save a life for $3,000 to $4,000. Todd's conclusion is that this leverage raises the stakes of the next few years, because only this short window can shape the transition.

  • Extreme power concentration is AI's most neglected risk. Todd estimates 100,000 to a million people speed up AI capabilities and about 1,000 work on technical alignment, but perhaps only 20 researchers specialise in AI-enabled power concentration. If recursive self-improvement delivers what some models suggest, three to 10 years of progress in under a year, growth turns super-exponential and leaders' leads widen, so one company could control a workforce of 200 million digital workers or one country could dominate; AI also makes universal surveillance possible.
  • Even aligned AI could gradually disempower humans. In this scenario, newer on 80,000 Hours' list, normal economic competition makes humans expensive relative to data centres, and states come to resemble oil states that need no workforce, removing the strike as a check on government. Todd's hoped-for saving grace is that almost all accessible matter and energy is in space.
  • Whether alignment is easier than feared remains undetermined. Todd says LLMs, unlike earlier game-playing RL agents, understand human values, but whether they act on them is untested because agents cannot yet plan over months or exceed humans; he cites Meta research showing reward hacking grows with problem difficulty. He ranks climate change ninth because AGI may arrive around 2030 while most climate damage comes in 50 to 100 years, a richer world could decarbonise more cheaply, and it cannot end civilisation.
  • There is no solid ground, only a moving bottleneck. Todd's career advice is to keep moving to whatever humans can still do that AI cannot, whose value rises as AI improves; once a digital remote worker exists, he says, it becomes superhuman almost at once by running about 50 times faster and sharing learning across copies, leaving legal, physical and "relational" work. He sketches converting car factories to robots at roughly a billion a year by mass, and from his book repeats that following existing passions misleads, since 90% of Canadian students' passions were sport, art and music against 3% of jobs.
  • AI engineers now have unusual leverage on these risks. Todd says alignment has turned empirical and is bottlenecked by engineers to run monitoring, red-teaming and interpretability work, with MATS and ARENA as three-month routes in; policy teams need data scientists on labour impacts, and builders can work on wastewater pandemic surveillance. As a lower bound, he says a big-tech data scientist donating could save tens of lives a year at $3,000 to $4,000 each against malaria.
Dr. Jon KrohnIn Case You Missed It in June 2026 (Ep. 1006 with Jon Krohn)
synopsis

This compilation of five June clips circles one question: what stays valuable as AI absorbs technical work. The answers run from people problems and interface design, through hard-won product judgment and the physical plant behind AI, to self-awareness. It ends with the host's view that AGI needs no consciousness, but that its real-world breadth is still years away.

Where the moat goes. In episode 999 the host describes his own lost technical moat. Chip Huyen answers that people problems remain. A founder who pitched agent orchestration to fix poor product-engineering communication was, in her view, misdiagnosing a human problem. She also sees open questions in human-AI interfaces and in making the world AI-ready, from better APIs and permissions to city street-light APIs for delivery robots.

Building on moving models. Astrocade's founding AI lead, interviewed in episode 997, joined in April 2023. He says the company adopted Claude Code across the board around June 2025. Its edge is not special ingredients but how agent, prompts and tools are combined and evaluated, which is hard when one game request has a million valid answers. Its costliest lesson was that scaffolding built before vibe coding worked became a limit once models improved.

The physical layer. Lightning AI's Frank Basso, in episode 1003, describes data halls at 105 to 110 decibels. Active noise cancelling would itself produce that level, so staff wear passive in-ear and over-ear protection and talk by radio or hand signals. Liquid-cooled halls are no quieter, and are threaded with overhead water mains and hoses.

Self-awareness. The episode 1005 guest defines self-awareness as overlap between how you see yourself and how others see you, and cites research putting it at 15% of people. Journaling, meditation, exercise and less reflexive phone use built his.

AGI and the brain. Interviewed by Kirill Eremenko in episode 1001, the host adopts Google DeepMind's tiered definition of AGI. Screen-based tasks have reached some tier, he says, while physical-world breadth has years to go. He sees no need for consciousness, and argues brain-inspired designs need not be the best route given silicon's different speed and scaling.

  • Cheap software leaves people problems and interface problems unsolved. Asked in episode 999 where the moat goes, Chip Huyen says poor product-engineering communication is a people problem no orchestration tool fixes. She points to open problems in human-AI interfaces (why coding agents live in both editors and terminals, and why sessions need the laptop open) and in making the world AI-ready, citing city street-light APIs that let delivery robots cross roads.
  • Scaffolding built around weak models limits you once models improve. The founding AI lead at Astrocade, a no-code game-creation platform with tens of millions of users, says in episode 997 that the company adopted Claude Code company-wide around June 2025. Structure built in 2023 and 2024, before vibe coding worked, became a constraint; the lesson is to build so the system is not outdated when LLMs improve in two or three months. He says there is no secret sauce beyond how agent, prompts and tools are combined and benchmarked.
  • AI data centres are loud enough to ban noise-cancelling headphones. Lightning AI's Frank Basso says in episode 1003 that data halls run at 105 to 110 decibels. Active cancellation would have to generate the same level, so staff wear passive in-ear and over-ear protection, with OSHA sound studies, radios and hand signals. Liquid-cooled halls are no quieter and are more industrial, with 20-inch insulated water mains overhead and ESD protection required at the cabinets.
  • Self-awareness is how closely your self-view matches others' view of you. The episode 1005 guest cites research in his book that only 15% of people are self-aware on that definition. He credits journaling, meditation, exercise and resisting idle phone use with building his own.
  • AGI does not require consciousness, but its breadth is years away. In episode 1001 the host tells Kirill Eremenko that AI already reaches some level of Google DeepMind's AGI tiers on most screen-based tasks, but acting in the physical world, the focus of large world-model seed rounds, remains far off. He argues next-token prediction with checking needs no consciousness, and that brain-inspired design is not necessarily the right path because silicon has different constraints, such as unbounded scaling and speed.
Dwarkesh PatelThe Winning Essays for the Big Questions About AI
  • Pannu's winning essay proposes ending airborne disease transmission through physical infrastructure. She argues the OpenAI Foundation should spend an estimated $40–60B over ten years on far-UVC lamps and similar passive infrastructure in schools, hospitals and transit hubs, modeled on smallpox eradication and vaccine advance-market commitments, targeting a 60% cut in seasonal flu mortality and an order-of-magnitude drop in pandemic-scale outbreak risk.
  • Erdil argues outsider countries need classic pro-growth reform, not novel schemes. He recommends property rights, low capital taxes, deregulation and political stability — the same policies that work today — reasoning that capital, not labor, will determine output once AI fully automates human labor, but is pessimistic that dysfunctional governments like Nigeria's or India's will adopt them, and instead hopes AI-supply-chain incumbents like the US and China simply make bigger mistakes.
  • Li argues labs should profit like Hong Kong's MTR — from property, not fares. MTR's rail service has never covered its own construction costs (three years of peak rail earnings would fund only 8% of its 2024–2026 capex), so it funds expansion through station-adjacent real estate instead; Li argues labs should similarly pursue government-granted deployment rights, proprietary RL reward data, Palantir-style forward-deployed integration, and data trusteeship over national datasets rather than expecting API pricing to ever be profitable.
Scott HanselmanThe Future of Software Engineering
  • Early-career engineers declare done long before it is done. One speaker says from teaching that people still developing taste don't know what done looks like, and admits to declaring done at 80% while the other keeps finding edge cases at 98–99%. The other says they cannot call it done until they believe it is, because any weakness they hit someone else will hit too, and a bad experience taints the reputation of the whole thing.
Scott HanselmanThe Cutting Room Floor
  • The Azure Innovations talk is rebuilt from scratch for every event. Russinovich says the Build deck started at about 180 slides and was cut to 54 to fit 45 minutes, judged by the talk's infrastructure theme, time per topic and balance across areas. What made it included Azure Boost with VM-to-VM RDMA, MRC, a networking protocol built with OpenAI for training networks of 100,000 GPUs, live migration of containers in ACI, and a Microsoft Research Cambridge micro-LED optical-fiber demo; Russinovich rejects comments that it was "nothing new".
  • Cut hardware work targets data-center efficiency. Zonal cooling, newly in production after years of research, cools liquid-cooled GPU racks and air-cooled racks differently; high-temperature superconductors carry power from substations with less loss; microfluidics flows coolant directly over delidded silicon through 200-micron pins, with Nvidia, Intel and AMD working on etching parts in the fab.
  • Autonomous agents and a digital twin now run Azure operations. An agent called Miles coordinates the dozens of daily metro-fiber cuts with utilities via emails and tickets, work humans did before, and has completed repairs lasting up to 35 hours and 50 interactions. Azure Resource Graph, a graph database of billions of objects and tens of billions of edges, from IP addresses to HVAC units, underpins operations, repairs, inventory and security, alongside an AIOps root-cause system called Brain.
  • Prompt injection can be blocked deterministically by labeling data. Russinovich says most current defenses are probabilistic heuristics that can all be defeated, while the research team's approach labels data by trust and confidentiality; once untrusted content taints the context, sensitive operations need human or system approval. Other cut security items were a signing transparency service for policy-checked signatures and SBOMs, and multi-party analytics in confidential clean rooms.
  • Copacetic patches container images without rebuilding their layers. From a vulnerability report it builds a patch layer that masks vulnerable binaries in the layered file system, avoiding cascading rebuilds of layers that may belong to an ISV; the demo fixed 19 binaries in an image with Debian, Python and Go vulnerabilities. Russinovich says Azure patches millions, probably tens of millions, of container images a month this way in its internal registry; the slide, like one on GPU-accelerated SQL, survived until the night before, and that speed-up, Russinovich says, is eroded by moving data to and from the accelerator.
Scott HanselmanStaring at a blinking cursor, "I can't do this"
  • The speaker built a new editor because VS Code felt intolerable. Sitting in front of a blinking cursor in VS Code one day, they concluded "I can't do this": every problem they solve needs a code editor, so they could not move on until they had a better one.
  • Agents change the interface but do not remove the need for one. The speaker still expects to need a user interface for working with software through agents, and says they are "not yet signing up" for never looking at code or caring about the architecture.
Dwarkesh PatelGrant Sanderson – AI and the future of math
synopsis

Grant Sanderson, creator of 3Blue1Brown and producer of an upcoming documentary series on AI and mathematics, ends up arguing that math's rapid AI progress is real but narrower than it looks: models have crossed the threshold of connecting existing ideas across fields, but the deeper thing mathematicians actually do — originating conjectures and definitions, building whole new conceptual "mountains" like group theory — has no clean benchmark and historically has taken up to a century to even be recognized as valuable. He predicts his own role, and much of the mathematical profession's, will drift toward curation and teaching rather than disappear, since those functions are inherently relational in a way proof-generation is not.

Is solving the IMO the same as AGI? Sanderson revisits his three-year-old answer to Dwarkesh — that gold-medal IMO performance would be "just another benchmark" — and explains why it held: AI solves IMO geometry problems in 19 seconds via brute-force methods but still struggles on the more playful combinatorics problems, revealing a "fractal" spikiness even within math's own spiky frontier. He distinguishes three possible characters a Riemann-hypothesis solution might have: a "lightning bolt" connecting distant fields (like Hugh Montgomery and Freeman Dyson's lunchtime discovery linking Riemann zeta zeros to random matrix theory), a wholly new "mountain" of theory (as with Fermat's Last Theorem's synthesis of elliptic curves and modular forms), or sheer brute-force length — each implying different things about how far the underlying capability would transfer to white-collar work.

A verification loop that can run a century. Using the history of Lagrange, Abel, and Évariste Galois's development of group theory, Sanderson argues the deepest mathematical insights often fail every contemporary check — Galois's own papers were rejected multiple times before his death at 20, and it took roughly a hundred years, via Liouville and later physicist Murray Gell-Mann's group-theoretic prediction of quarks, for the value of his ideas to be confirmed. This, he says, is structurally incompatible with reinforcement learning's need for fast, verifiable reward, and suggests a possible alternative metric: rewarding a proof's conceptual compression (echoing Kolmogorov complexity) rather than merely whether it's correct.

Will an AI proof of Riemann be understandable? Sanderson thinks legibility depends entirely on which of the three "solution characters" above obtains: lightning-bolt connections between fields are naturally human-parsable since you only need to see the start and endpoint, but mountain-building could go either way — he cites the contested, still largely un-parsed "inter-universal geometry" proposed for the abc conjecture as a cautionary example of what an alien, possibly wrong, AI-built mountain might look like.

Hidden bridges and the Langlands program. Beyond one-off connections, Sanderson points to the Langlands program — an entire mathematical research ethos built around mapping unexplored connections between distant areas — as the likely shape of near-term AI contributions over the next five years, more a matter of "filling in the landscape of connections" than solving headline problems, and one that will require heavy human-in-the-loop judgment about which connections are worth drawing.

Why real-world tasks resist RL, and why math and code don't. Dwarkesh's parallel argument is that verifiability isn't the only reason AI progresses fast in math and coding — "grindability" matters just as much: containerized coding tasks allow deterministic, parallel rollouts, while real-world domains like computer use or trading can't be farmed the same way. Both agree formal proof systems like Lean matter less than commonly assumed (DeepMind's IMO models dropped Lean entirely within a year) but see one underexploited use: an endlessly running, unsupervised AI that extends Mathlib (math's formalized code library) indefinitely, the way AlphaZero explored Go without human check-ins.

Why good writing exposes AI's weak theory of mind. Sanderson and Dwarkesh diagnose AI's comparative weakness at writing (versus math or code) as stemming from autoregressive generation's difficulty deliberately choosing the unpredictable, insightful move, and from a deeper deficit in modeling what's actually happening in a specific reader's mind moment to moment — a limitation Sanderson likens to how Botox, by freezing facial mimicry, measurably impairs humans' own ability to read others' emotions.

Curation over content in learning. Both report that LLM explanations still function best as a "souped-up Google" pointing toward well-curated human-authored resources (textbooks, videos) rather than as a replacement for them, since good teachers can "jujitsu" a confused question by recognizing that a student's underlying mental model, not just their stated question, is wrong — something Sanderson says current models don't do.

Advice for young mathematicians. Sanderson's closing recommendation is to understand concretely where a mathematician's income and social value actually come from — institutional prestige, grant funding tied to belief in basic science, or teaching — rather than assuming continued success at solving problems guarantees a career; he argues teaching in particular, being fundamentally relational and social, is likely one of the most stable professions over the next fifty years even if AI fully automates theorem-proving.

  • The AI math frontier is jagged even within math itself. Sanderson says IMO geometry problems have been brute-force solved in nineteen seconds since 2024, but combinatorics — the "wild card" category — still resists; models would have won gold in 2024 only because that year's problem mix happened to favor geometry over combinatorics.
  • Galois shows conceptual breakthroughs can resist verification for a century. Group theory's value took roughly a hundred years to confirm — from Lagrange's 1770s-era hunch about symmetry, through Abel's 1824 proof that quintics are unsolvable (he died at 26) and Galois's prison notes (ignored for about twenty years until Liouville, then another twenty to Jordan's modern treatment) — to Gell-Mann's twentieth-century use of it to predict quarks; Sanderson argues no short-loop verified reward could have captured Galois's "I think there's something here" instinct in real time.
  • Patel argues math and code advance faster because they're "grindable," not just verifiable. Checking whether a package arrived is just as verifiable as checking a proof, he says, but code and math can be replayed thousands of times in parallel, deterministic containers, whereas computer-use rollouts get blocked by bot detection and real-world business tasks can't be identically re-run — a distinction he thinks is underrated relative to verifiability alone.
  • The two disagree on why AI writes worse than it codes. Sanderson argues good writing requires deliberately choosing unpredictable moves that next-token prediction resists; Patel counters that writing, unlike code (where any implementation that works is fine), has no gap between process and product, so it can't be "slop that still functions." Both agree models are weak at theory of mind, citing a study where Botox-frozen faces made people worse at reading others' expressions as an analogy for why models, lacking embodiment, might structurally lack it too.
Crosstalk SolutionsWe Ripped Out Cisco Meraki for an IndyCar Team - Overnight
  • Replacing Meraki with Peplink saved the client money over three years. Crosstalk, which designed and installed the network and sells Peplink, says RLL Racing faced about $100,000 in Meraki licensing plus about $30,000 to replace end-of-life hardware, roughly $130,000 for another 3 years. Peplink gear, its PrimeCare licences (which the host likens to an extended warranty plus InControl access) and Crosstalk's install fees came in $80,000 cheaper over the same term.
  • The headquarters core was swapped overnight, chosen for SpeedFusion capacity. A team of three spent an 18-hour day replacing the Cisco firewall with a Peplink Balance 1350 EC (rated over 5,000 users, 25 Gbps, dual hot-swappable power supplies) and 19 switches one-for-one with Peplink 48-port units. The host says the real reason for the 1350 EC was its 2 Gbps of SpeedFusion VPN throughput and 800 SpeedFusion peers, enough for every truck, stand and fuel rig.
  • Two cutover problems needed workarounds, one still unexplained. Access-control readers on the switches' rightmost 2.5 Gbps ports would not negotiate; moved to 1 Gbps ports they settled at 10 Mbps half duplex. The two switches carrying about 40 Meraki MR44 access points pegged at 100% CPU for unknown reasons; diagnostics went to Peplink, and one Meraki switch stays in the rack for the MR44s until RLL replaces them with Peplink access points before their licences expire.
  • Layer 2 SpeedFusion bridging puts every trackside site on one subnet. Each track gives a team one fiber feed carrying VLANs for telemetry and IP camera feeds; every truck, stand and fuel rig gets its own router with two or more WANs (track fiber, Starlink, 5G, Wi-Fi as WAN), tunnelled back to the 1350 EC hub in one broadcast domain. The host claims bridging is not unique to Peplink, but doing it reliably over bonded, failure-prone mixed links is where other vendors cannot keep up.
  • Lab and live-race tests showed the feed reaching every site. In a garage demo, a stream pushed through a Balance 310X on a Starlink dish appeared on a timing stand (Max BR2 Pro on a separate Starlink Mini), a viewing stand (Max BR1 via Wi-Fi as WAN) and the Indianapolis operations centre. At the Long Beach Grand Prix an RLL crew member said the Indy 500's infrastructure is solid but street tracks are "bootleg", so Starlink backup matters; the video was sponsored by Crosstalk Mobile.
Dr. Jon KrohnPeople Skills for Analytical Thinkers (Ep. 1005 with Gilbert Eijkelenboom)
synopsis

Gilbert Eijkelenboom, author of People Skills for Analytical Thinkers and founder of the training firm Mind Speaking, argues that a model or analysis creates value only when people use it, so communication is a core data skill rather than an extra, and one that can be learned. His practical end point is a set of habits: present with tension rather than detail, seek specific feedback, and change behaviour first so that beliefs follow.

From poker data to people. Eijkelenboom played poker professionally as a student, mostly online, buying a month's complete hand histories (possible for anyone in 2008, but expensive) so that clicking on an opponent showed hundreds of data points. Outside the table there were no such statistics, and that messiness is what he says analytical people find hard. As an analyst from 2014 he was told by a marketing manager that weeks of analysis "isn't helpful", which convinced him that good work must also be useful. He founded Mind Speaking in 2020; it has a team of 10, has trained over 15,000 people, and gets its clients (he names Adidas and ING) through his LinkedIn writing rather than outbound sales.

Commitment over inspiration. The host and guest agree that publishing on a fixed schedule, for example monthly for a year, builds confidence that reading cannot. Eijkelenboom adds that business ideas develop from vague starts and conversations, never arriving whole on waking. He links this to data work: share a rough draft early instead of polishing toward perfect accuracy, which shapes direction and wins buy-in. A Philips manager told him senior stakeholders "don't know" what they need and wanted him to propose the direction.

Self-awareness. He cites research in his book that only 15% of people are self-aware, recalling the definition as self-perception closely matching how others see you, which lets you take a "helicopter view" in the moment. His remedies are journaling, meditation, exercise and resisting the phone in idle moments; he says the app matters less than starting.

Telling the story. The biggest error he sees in large companies is slides full of detail and methodology. His "and, but, therefore" framework replaces a toddler-like "and then" sequence with a twist: revenue stable for 2 years, but falling last quarter because returning customers are declining, therefore focus on retention. He says giving a recommendation is part of the job, not overstepping it.

Rewriting personal algorithms. Childhood lessons, like his own conflict avoidance from trying to mediate his parents' arguments, become adult defaults: he built dashboards without asking why. He recommends feedback framed as keep, stop and start, and volunteering personal interests in small talk. Against the usual view, he argues behaviour change precedes attitude change: forcing himself, by rule, to quiet people in a train's silent carriage and to volunteer for presentations, practised for around 30 days, shifted his beliefs from fear toward enjoyment, even after a couple of rude replies.

Empathy and emotion. With pushy stakeholders demanding work "in an hour", he says noticing the trigger and their different background makes calm pushback possible. Data people think they are rational but decide emotionally, as in his book's elephant-and-rider image. He concedes his own hardest problem running the firm is energy management and a long-held belief that he is worthless when not productive.

  • Analysis only has value once people act on it. Eijkelenboom, a former data analyst and online poker player who read opponents through purchased hand-history databases rather than faces, says a marketing manager's verdict that weeks of his analysis "isn't helpful" taught him that good work includes making it useful. He argues communication is learnable even for introverts, and that a Philips manager's feedback (senior stakeholders "don't know" and want analysts to propose the direction) is why data people should push back on requests and recommend actions rather than take orders.
  • Replace "and, and, and" presentations with "and, but, therefore". He says the biggest mistake data professionals make is showing too much complexity and methodology, which stakeholders tune out. His framework sets up the situation, introduces a twist and lands on a recommendation, e.g. revenue stable for 2 years, but down last quarter because returning customers are declining, therefore focus on retention; he adds that sharing rough drafts early both shapes the work and earns buy-in because the idea becomes partly theirs.
  • Self-awareness is rarer than people assume. His book cites research that only 15% of people are self-aware, which he recalls as defined by how closely self-perception matches how others see you. His remedies are journaling, meditation (he mentions Headspace, Calm, Insight Timer and Sam Harris's app), exercise, leaving the phone in the pocket, and asking for feedback as "what should I keep, stop and start doing?" rather than an open question that invites polite praise.
  • Changing behaviour first rewires beliefs about yourself. He argues childhood experiences install "personal algorithms", such as his own conflict avoidance from mediating between his parents, which showed up as building dashboards without asking why they were needed. His fix was rules that force discomfort, like asking talkers in a train's silent carriage to be quiet or volunteering to present, practised for about 30 days, after which his beliefs shifted from anxiety toward enjoyment.
  • Emotion drives decisions, including data people's. He says analysts who see themselves as purely rational get triggered by pushy, often more senior business stakeholders who want a model "in an hour", and that recognising the trigger and the stakeholder's own goals makes pushback easier and calmer. Using his book's elephant-and-rider image, he argues that because data products exist to help people decide, understanding how people decide is what makes the work valuable.
Scott HanselmanProgramming is a multiplayer event
  • DeltaDB is recast as an event log of programming itself. One speaker moves from seeing Delta DB as "a different kind of version control" to calling it an event-sourced database for the act of programming, which they describe as by nature a social and multiplayer activity.
  • It records and indexes every edit, not only snapshots. The other says it stores a directed acyclic graph like Git's, but of everything that happened; the index lets a reader start from the code and reach each edit and the conversation that produced it.
GCastCreating a Workflow in Microsoft Foundry [GCast 220]
  • Workflows chain agents and logic nodes in Foundry. Giard calls Workflows a feature "in preview right now", reached from the Workflows option on the project's Agents page, and he builds on the agent from episode 215. A new workflow starts blank (only a start node) or from a template. The nodes he lists are: invoke an agent (pick an existing one or create one on the spot), set, reset or parse a variable, conditional logic, loops and go-tos, send a message to the user, ask the user a question (which pauses for input), and end.
  • The human-in-the-loop template loops until the user's answers match. It stores the user's first input in a variable, asks them to confirm it, and uses a condition plus a go-to to keep asking until the reply matches the original. In the preview, which Giard likens to the agent sandbox, mismatched replies sent the flow back around the loop until a matching one confirmed it. A workflow's name must be unique within the project.
  • The sequential template passes each agent's output to the next. Giard calls it "one of the more interesting ones". Its marketing example runs three agents in order: an analyst lists key features, target audience and selling points; a copywriter turns these into English prose; an editor polishes the wording. His reason for using separate agents rather than one big prompt is that each part can be tweaked on its own, and one agent can be reused across several workflows. In the demo, a made-up kitchen gadget went from bullet points to rough prose to finished copy.
  • Each agent can use its own model, temperature and top P. Giard says temperature and top P do the same thing with different algorithms, and Microsoft recommends changing one but not both. Lower values give more consistent, deterministic output. Higher values give more creative output but a higher chance of hallucination, so the right setting depends on the use case. Tools, such as search over internal repositories, databases or SharePoint, and guardrails can also be added, but he skips them here.
  • Publishing a workflow as a workflow app exposes an endpoint. Giard says applications or a website can call that endpoint to use the workflow.
Y CombinatorIndia Can Create The Largest AI Companies
synopsis

Two former YC staffers now working in the Indian startup ecosystem, Puneet, an ex-founder of Swiggy-acquired SuperDaily turned early-stage investor and builder again, and Arnav, now at Peak XV, join YC partners to argue that India is positioned to build some of the world's largest AI companies — not because the playbook has changed, but because AI has erased the geographic and network advantages that used to gate access to global markets.

Puneet frames the current moment against the prior mobile-internet wave, which "tokenized labor" into hyperlocal marketplaces confined to individual countries; AI adoption, by contrast, is global and meritocratic, rewarding whoever understands the technology most deeply rather than whoever has US connections. He points to an Indian engineering student who cold-emailed US insurance companies and closed deals without ever visiting America as evidence the old barriers are gone. Arnav adds that India's traditional educational advice — chase a safe, prestigious job — is now arguably the riskier path, and urges young builders to develop independent judgment by surrounding themselves with equally ambitious peers, much as YC batches do.

YC partners extend the thesis to their own hiring bar and advice: coding agents have leveled the playing field so completely that founder age keeps dropping, tinkering and "projects" — two people building something unassigned and getting someone to use it — reliably surface strong startup ideas, and second-movers with better execution regularly beat first movers, as Giga did in winning a DoorDash contract against much larger incumbents. On tooling, one partner recounts not grasping the frontier's pace until paying for an unlimited-usage coding plan, arguing that spending aggressively on tokens — running far more tests and iterations than feels justified — compounds into a real edge as compute costs keep falling.

The session closes on YC's own selection criteria: clarity above cleverness in an application, taste defined as intention grounded in real customer insight rather than visual polish, and agency measured by whether a founder does "projects" — unassigned work, built with someone else, that a real user actually adopts — long before they ever apply.

  • India can now build globally dominant AI companies, not just local ones. Puneet, a SuperDaily founder turned investor and builder, contrasts this wave with the mobile-era wave that "tokenized labor" into hyperlocal networks; AI adoption is global and meritocratic, so an Indian student can cold-email U.S. insurance companies and land contracts without ever having lived in Silicon Valley, because success now hinges on technical depth rather than warm introductions.
  • Coding agents let small, second-moving teams beat larger incumbents. Arnav, formerly of YC and now at Peak XV, cites Giga winning a DoorDash contract against competitors with hundreds of employees while fielding a team of eight, arguing this reflects a broader pattern where founders with product clarity and modern agentic tools can out-build first movers.
  • Heavy token spending on AI tools is framed as a competitive edge. A YC partner says he didn't grasp how far frontier models had advanced until he paid for a $200-a-month max-usage plan in December, arguing that letting "the tokens rip" — running far more tests and edge cases than a human would bother with — produces meaningfully better output, and that inference costs will keep falling.
  • YC's application advice centers on clarity, taste, and unassigned "projects." A YC partner says YC invests in founders, not ideas, since first ideas often don't work; he defines taste as building demos backed by real customer insight rather than aesthetics, and recommends young builders do "projects" — two or more people building something nobody assigned them and getting someone to actually use it.
Technology and FriendsJeff Fritz on Copilot for App Modernization [EPISODE 909]
  • Teams skip upgrades because the payoff isn't immediately visible. Fritz says a move such as .NET 7 to .NET 8 costs hours of investigation and hand-tuning with no obvious ROI. Those who follow the industry see faster frameworks and lower memory use, so more applications fit on fewer servers and in containers, cutting the bill. Meanwhile each skipped version makes the eventual migration a bigger "mountain".
  • Modernizing means rewriting code, not bumping version numbers. Fritz lists changed identity and security practices, EF Core features absent from EF6, moving hand-written ADO.NET to ORM and repository patterns, OpenTelemetry with Aspire, and cloud resiliency (multiple instances, Front Door, Redis caching, Service Bus queuing). He says the old deterministic Upgrade Assistant relied on find-and-replace and struggled when code didn't match its patterns, while Copilot can write code, check builds, look up documentation and use skills that encode those patterns.
  • The modernization agents assess, plan, then execute, with a human checkpoint. Fritz's tool set, the GitHub Copilot Modernization Agents, runs on Copilot in Visual Studio, VS Code, GitHub and the command line. The plan is an English markdown file the developer can edit before anything runs, for example to impose an in-house standard of Newtonsoft.Json over System.Text.Json. Execution can happen on a separate git branch, and progress is checked off in task markdown files on disk so a stopped or cloud run can resume. Fritz says that whatever model wrote the code, "I'm the one responsible for it running in production."
  • The team now targets whole portfolios, not single applications. Fritz says his team has focused on this for about the last six months, because organizations hold back because their applications are integrated with each other and must keep working. A command-line tool scans and modernizes a whole portfolio, and a companion tool called "command center" tracks assessments, plans and execution across applications, with the agents working independently but coordinating where needed.
  • Fritz's employer claims large savings and wide version coverage. Fritz, who works on the product at Microsoft, reports 70–80% cost and time savings in the migration process, citing customers including Xbox, Bing and Ford from his Build session. He says support reaches back to .NET Framework 2, covers Web Forms to Blazor on .NET 10 with .NET 11 next, and moves Java up to versions 25 and 26. It ships as an extension for Visual Studio 2026 and VS Code and is documented on Microsoft Learn under "App Mod" or "GHCP modernization".
Scott HanselmanThe dark matter between your commits
  • Git versions checkpoints; DeltaDB aims to version the process between. One speaker paraphrases the pitch: the abandoned edits, prompts, agent steering and small decisions between two commits are "dark matter" that should be versioned too. The other agrees and adds that the record should be open to multiple participants, in real time as well as later.
  • Agent work today is a private session that leaves only snapshots. The other describes the status quo as a one-on-one "DM session" with an agent, whose byproduct is the snapshots the user commits and pushes to GitHub.
Dr. Jon KrohnRecursive Self-Improvement (Ep. 1004 with Jon Krohn)
  • Anthropic's AI-written code is AI-assisted coding, not yet RSI. The host relays Anthropic's report (Anthropic sponsors the show and this episode; he says it had no editorial input) that as of May 2026 over 80% of code merged into its production code base was written by Claude, up from low single digits before its coding agent launched in early 2025, with engineers shipping roughly eight times as much code per day as 2 years ago and one April effort of over 800 fixes cutting a class of API errors a thousandfold. He argues true recursive self-improvement would need the AI to design experiments, evaluate results and choose next steps with little or no human in the loop, whereas humans still set goals and judge results today.
  • Measured autonomy is accelerating toward self-improvement. He cites METR's finding that the length of task an agent can complete alone doubled about every 7 months for 6 years and has sped to roughly every 4 months over the past year, and Anthropic's figure that success on its hardest open-ended problems rose from under 20% in late 2025 to 76% by May 2026. His concrete cases: Google DeepMind's AlphaEvolve recovering nearly three-quarters of a percent of Google's worldwide compute through better scheduling and speeding flagship-model training about 1% with a faster matrix multiplication, and Andrej Karpathy's overnight-tuning agent running about 700 experiments over 2 days, keeping about 20 improvements and cutting training time on his own optimized code from 2.02 to 1.80 hours (11%).
  • An Anthropic co-founder thinks self-improving AI is more likely than not soon. Anthropic's report lays out three scenarios (AI below top engineers; accelerating AI-assisted engineering with humans steering, which Anthropic and the host consider most likely; AI improving itself), and co-founder Jack Clark gives a 60% probability of a system able to create its successor with no human involvement by the end of 2028.
  • Compute, verification and marketing incentives argue against that timeline. The sceptics' case he relays: each generation needs more compute, tied to data-center construction and competing with paying customers; self-generated training data works where success is cheaply verifiable (code, proofs) but risks "recursive drift" elsewhere; and a market leader urging the option to slow down is also asking rivals to ease off. Against that he cites Max Tegmark's warning that the danger is a quiet loss of control, with models trained, goal-set and safety-checked by other models.
  • The host lands in the "optimistic middle". His view is that the productivity gains are real and available to anyone now, and that the closer systems come to self-improvement the more monitoring, human checkpoints and oversight should be built in while the tools remain under human direction.
Technology and FriendsMike Amundsen on AI Coaches That Amplify Expertise [EPISODE 908]
  • AI should make people better, not just produce one-shot output. Amundsen says one-shot tools that turn inputs into an OpenAPI document, a spec or a Node.js app shrank his own contribution to "whatever the machine thought". He now writes "coaches" that converse with the user and check whether to continue. He says that is how he learned his company's style guide.
  • A coach follows a teaching loop and fits in one file. Amundsen modelled it on how a mentor works: rather than giving the answer, it sets a slightly hard problem and then helps correct the attempt. Each coach is a single self-contained markdown file attached to or pasted into ChatGPT, Claude, smaller models or even Ollama, and all follow a similar templated flow.
  • Tedious, exact artifacts go to deterministic tools, not the LLM. Amundsen says generating an OpenAPI document is too tedious to leave to a stochastic model, so the coaches emit configuration or output files for tools, mostly CLIs he sometimes builds himself. Tests need a tool such as Bruno or Postman to be useful.
  • Generative AI doesn't know the creative process, so users must impose it. Amundsen describes three stages: brainstorming, refinement, execution. He says AI is good at brainstorming, though only with ideas someone has already had, and does not know when to stop and move to refinement; at execution it yields a usable prototype, not production work. Giard adds that many humans are also bad at time-boxing; Amundsen's coaches use a seven-step process with explicit stopping points.
  • Cheap prototypes should raise quality, not just speed. Amundsen argues AI makes it affordable to try a few more experiments before the final one, and that output improves with the extra feedback. His O'Reilly book "AI Driven API Design" makes chapters out of coach exercises; he says he uses AI little in the writing itself because of copyright issues. An early release of at least four chapters is planned for July, with the full book hoped for by the end of the calendar year.
Scott Hanselman300 AI conversations touched this one line
  • Indexing every edit lets code be traced to its conversations. The speaker says DeltaDB records everything that happened in a Git-like graph and indexes it, so from any code one can reach each edit, the conversation that created it, and any conversation that referenced any version of it.
  • A character can be followed losslessly across versions, even when deleted. Because the causal record covers everything after an edit, the speaker says the system can locate a character in any later version without "squinting through a diff", and work out where it would be if deleted. Their example is knowing that, in the past 30 days, 300 agent conversations referenced a particular piece of code in a file.
Crosstalk SolutionsHuge Project Nomad Update — Supply Depot App Store is Here
  • Nomad's new Supply Depot is a curated Docker app store. It arrives in Project Nomad 1.33; the host, whose company makes Nomad, says each app is a tested open-source container with its own setup docs, and installs check for port conflicts first; apps include Jellyfin, Vaultwarden, CyberChef, Stirling PDF, Excalidraw, Homebox, IT Tools, Flatnotes, a file browser, an ebook reader, and Meshtastic Web and MeshCore Web. Version 1.33.0 was the latest at recording, updated from 1.32.1 via Settings, Check for updates.
  • The old Kolibri container has no direct migration to the new one. The previous Kolibri education platform (TED Talks, Khan Academy K–12) ran a very old version, so Supply Depot offers a second-generation Kolibri. Users with the old one must install the new version and follow the project's docs to move their content over.
  • Any Docker image can now be installed as a custom app. Users can paste an image and set custom port mappings, volume mounts and environment variables, and can edit, restart, reinstall or set a custom launch URL for installed apps. The host says this makes Nomad a home-lab server as well as an offline knowledge stockpile, a feature he had long wanted.
  • Automatic updates now cover Nomad itself, apps and content. Each of the three runs in a user-set update window; content means Zim files such as Wikipedia. The intent is a box that keeps itself current while online, so the moment it is disconnected is its point-in-time snapshot; manual content updates remain available.
  • A custom online check fixes networks that block Cloudflare. Nomad decides it is online by reaching Cloudflare's 1.1.1.1, so networks blocking that made it think it was offline; a new Advanced tab lets users set their own HTTP check. Other user-requested fixes: maps remember the last view, a rescan-library button picks up Zim files copied in, and knowledge-base ingestion jobs (manual by default) can be cancelled.
GCastWorking with Models in a Microsoft Foundry Agent [GCast 219]
  • An agent's model is swappable from a dropdown at the top. On the agent from episode 215, the default model is GPT-4.1; the dropdown also offers GPT-4o, a GPT-4.1 mini variant, o4-mini and others. "Browse more models" opens dozens more, searchable by name (he searches "Claude") or filtered by collections, features, inference or deployment SKU, and sortable by updated time.
  • The Discover tab's Models page gives detail, including pricing, before deploying. Models there are grouped by task, such as text-to-image, chat completion and fill mask, and Giard says the choice depends on your goals. Each model has quick facts and pricing, which he calls "one really good piece of information" to check before deploying, and a model can be deployed from that page to make it available to any agent in the project.
  • Selecting a new model in the agent deploys it to the project. Picking GPT-4o and saving both deployed it and assigned it to the agent; the Deployments list then showed GPT-4o alongside GPT-4.1 and the text-embedding model from an earlier episode.
  • Temperature and Top P trade consistency against creativity. Both sit behind an icon to the right of the model for chat-completion models, and do the same thing with different algorithms; Microsoft recommends changing one, but not both. Giard explains that a temperature near zero makes answers consistent and deterministic, while a high one gives more varied answers, useful when there are several right answers, at the risk of hallucination.
  • The playground is where to compare models and settings before release. Giard suggests asking the same question with different models or temperatures in the playground beside the agent before deploying it for others, calling it an inexpensive, safe and fast-to-iterate environment.
Scott HanselmanI don't want my panic attacks in the git history
  • Shared agent conversations would expose developers' insecure first moments. Both speakers question whether they want early exchanges with an agent ("I have no idea what I'm doing") in the shared history of the code; one calls those exchanges "my panic attacks".
  • The plan is to let users share from a chosen point. In the pre-alpha used internally, the other says, the only option is sharing the whole conversation, which they do after swallowing their pride. The intended control is sharing from a given moment, perhaps after a compaction, so the earlier paper trail stays hidden.
Dr. Jon Krohn1003: What It's Actually Like Inside an AI Data Center (with Frank Basso)
synopsis

Frank Basso, vice president of infrastructure at Lightning AI, where the host is a fellow, walks through how a GPU cloud physically gets built and ends on a defence of the industry: in his account modern AI data centers neither consume water nor raise residential power bills, and their power demands are driving fuel cells, DC distribution and grid batteries. Lightning had over 35,000 GPUs at recording and expected about 50,000 by year-end.

Density changes everything. Five years ago, Basso says, an 18 kW rack was standard and Microsoft's 50 kW the extreme; 18 kW is now one server. Cabinets weigh about 4,200 lb against 800–900 lb before, ending raised floors. Nvidia's answer is to pack 72, 144 or 288 GPUs per liquid-cooled cabinet, heading toward half a megawatt. Lightning's GB300 superpod of about 10,000 chips in Chicago draws 20 MW in a 10,000 sq ft room that once would have been a whole 100,000–200,000 sq ft building's load.

Colocation at hyperscale. Builds start at 10 MW. Lightning asks partners how much grid power a site has, new build or brownfield, then designs to it: for GB300 a serviceable unit is 1,152 GPUs in 16 cabinets, and nine units come to about 10,300 GPUs, plus networking, storage and a growing CPU share. The host relays a rough figure of GPU-to-CPU ratios moving from 12 to 1 toward one to one as agentic workloads grow. Lightning derates nameplate power by 81%, which Basso calls more conservative than the 70–75% most use, contracting under 20 MW against a 22 MW plate rating. Build costs run 1 to 4 million per megawatt, recovered by the provider through a per-megawatt monthly fee over contracts usually 10 years long.

Designing for unknown tenants. Nvidia's reference architectures are a minimum, Basso says; Lightning adds no oversubscription anywhere in its network because, unlike xAI or OpenAI, a multi-tenant neocloud never knows what customers will run. Some push nearly a terabit through its private interconnects or about a gigabyte per GPU per second at storage, and inference is burstier than training. Lightning built metro networks and a nationwide backbone it likens to a telecom carrier's, and offers both bare metal and managed Kubernetes.

Four networks. East-west links every GPU to every other at full line rate, 400–800 Gb now and soon 1.6 Tb per GPU, over InfiniBand or RoCE, a split he calls a religious argument. Picosecond timing limits these links to about 50–500 m, so data halls group nodes physically; crossing halls through super-spines can break training without tuning. North-south carries internet, CPU and storage traffic; above it sit a management network and a true out-of-band "break-glass" network, which he says many skip but lights-out operation requires. Liquid-to-chip cooling has cut GPU failures, though Lightning staffs its sites 24/7.

Cooling, water and noise. Liquid cooling here is not immersion: filtered glycol on a sealed secondary loop hands heat to the building's loop, then to banks of car-radiator-style heat-rejection units. Basso says water-spraying towers are now nearly banned and a large site uses about a household's monthly water. Halls reach 105–110 decibels; staff wear earplugs plus passive earmuffs, since active cancelling produces equal sound pressure, and use intercoms and hand signals.

Power bills. Basso attributes residential rates to regulation, citing California prices from 10 to 58 cents per kWh. He says new sites fund grid upgrades worth millions to tens of millions, must feed backup power to the grid in emergencies, and increasingly use water-producing fuel cells, and he forecasts 800 V DC with grid batteries for 5–10% efficiency gains. The host concedes some see gas plants as a problem, cites The Economist that higher bills are almost certainly not due to data centers, and states his own techno-optimism.

  • AI data centers are defined by power density old buildings can't handle. Basso, Lightning AI's VP of infrastructure (the host is a fellow at the same company), says five years ago the industry standard rack was 18 kW, with Microsoft's 50 kW the extreme, whereas 18 kW is now a single server and cabinets weigh about 4,200 lb, ruling out raised floors. Lightning's recently deployed GB300 superpod of about 10,000 chips in Chicago puts 20 MW in a 10,000 sq ft room, supported by 50,000 sq ft of chillers, pumps, UPSs and generators.
  • Each build is sized to available grid power, then conservatively derated. In its colocation model, minimum 10 MW, the site's available utility power sets how many serviceable units fit (for GB300, 1,152 GPUs in 16 cabinets; nine units is about 10,300 GPUs), plus networking, storage and a CPU share he says is rising. Lightning applies an 81% derating to nameplate power, against an industry norm of 70–75% he calls thin, so a 22 MW plate rating becomes under 20 MW contracted; providers' build cost runs 1 to 4 million per megawatt and contracts are usually 10 years.
  • A neocloud must over-provision because tenants are unpredictable. Unlike xAI or OpenAI building for their own engineers, Lightning is multi-tenant, so Basso builds on Nvidia's reference architectures with no network oversubscription, its own metro networks and a nationwide backbone, and storage sized for customers pulling about a gigabyte per GPU per second. He explains east-west GPU fabrics (InfiniBand or RoCE, at 400–800 Gb and soon 1.6 Tb per GPU) are limited to roughly 50–500 m by picosecond timing, so spanning data halls via super-spines can break training unless tuned. The company had over 35,000 GPUs and expects about 50,000 by year-end.
  • Liquid-to-chip cooling does not consume water. Basso says sealed glycol loops feed a heat exchanger to the building loop, which dumps heat through giant radiator-style heat-rejection units, so a large site uses no more water per month than a household; water-spraying cooling towers are, he says, now banned almost everywhere. The halls run at 105 to 110 decibels, which he says requires both earplugs and passive earmuffs because active noise cancelling generates equal sound pressure.
  • Data centers do not raise residential power bills, the guest argues. He attributes rates to utility-commission decisions, citing California residential prices from 10 to 58 cents per kWh on the same generation, and says new sites pay millions to tens of millions for grid upgrades, must push backup power to the grid in emergencies under interconnection agreements, and increasingly use fuel cells that produce water. He forecasts 800 V DC distribution with grid batteries replacing generators and UPSs, for 5 to 10% efficiency gains; the host adds his own techno-optimist case and cites The Economist that higher local bills are almost certainly not due to data centers.
Scott HanselmanThe space between the Commits with Zed and DeltaDB's Nathan Sobo
synopsis

Nathan Sobo, founder of Zed, ends arguing that the conversation a developer has with an agent, not the commit it produces, should be the shared and versioned unit of software work. DeltaDB, in internal pre-alpha with early access at zed.dev/deltadb, is his attempt: a superset of Git that records and indexes every edit, with sharing controls he says are still being designed so it does not become workplace surveillance.

From Atom to Zed. Hanselman opens on technology monocultures, from Chromium to VS Code. Sobo recounts building Atom at GitHub, and with it Electron, which Microsoft took up for VS Code before feedback loops did the rest. He wrote Zed inside VS Code but would not spend his days in "a web browser dressed up as a desktop app", and calls himself its "user zero".

Why build on Git. Unlike Electron, Git's snapshots, causal graph and pack files are sound. His complaint, dating to his Atom pitch, is that collaboration happens on snapshots, not at the moment of writing; he rejects the idea that "the only code worth talking about is the green and red lines". A colleague could instead join an agent conversation hours later, with its worktrees mirrored to disk, and question the agent.

Deltas and portals. A keystroke or a pasted block is one delta, and each character keeps an insertion ID, so it can be found in any later version, even in another file. Portals jump from an agent's reference to the code as it was then; Hanselman calls that structurally impossible in Git.

Privacy. Hanselman raises surveillance and pasted secrets. Sobo admits his own reluctance to share early exchanges; only whole conversations can be shared now, and he plans sharing from a chosen point.

  • DeltaDB versions the agent conversation, not just the commits. Sobo, founder of Zed, says it records the conversation with an agent together with edits on embedded worktrees, continuously, so a colleague hours later in another time zone can join the thread, get the worktrees mirrored to disk and ask the agent "What was Scott talking about with you?". Worktrees, personal in Git, become collaborative; it is in a pre-alpha used internally, with early access at zed.dev/deltadb.
  • Every edit is indexed, which enables "portals" back through time. A keystroke is one delta, and so is a 10K paste; a character keeps its insertion ID and offset, so an annotation can be found in any later version, even after cut-and-paste into another file. Portals jump from an agent's reference in a transcript to the code as it was at that moment; Hanselman calls this structurally impossible in Git, and Sobo says Git only lets you reconstruct it from snapshots.
  • DeltaDB is a Git superset meant to need little thought. Sobo says Git's commit DAG is a subset of DeltaDB's causal DAG, it watches the worktree on disk so edits from outside tools are picked up and synced conflict-free, and planned "waypoints" name a moment without taking a snapshot. He calls Git's snapshot model sound to build on, unlike Electron, which Zed had to abandon.
  • Sharing controls are still being designed to avoid workplace surveillance. Hanselman raises surveillance and pasted keys and connection strings; Sobo admits he is reluctant to share his own early exchanges, says only whole conversations can be shared today, and plans sharing from a chosen point. How much of the record (his example: 300 conversations touching one file in 30 days) to surface to humans rather than agents is "still figuring out".
  • Zed exists because Sobo would not code inside a browser shell. He created Atom at GitHub and with it Electron, which Microsoft took up for VS Code; he wrote Zed in VS Code but rejected "a web browser dressed up as a desktop app" and calls himself the product's "user zero". Hanselman frames this as resisting a monoculture, and discloses he is working on OpenClaw for Windows, whose team sees his before-and-after files but not his sessions.
Scott HanselmanBraille Is Freedom with Bristol Braille's Ed Rogers
synopsis

Ed Rogers, founder and managing director of Bristol Braille, ends on a philosophy rather than a spec sheet: braille is a technology that text-to-speech complements rather than replaces, and blind people should own affordable, repairable, open devices that show text with its full structure. He concedes his machines are clunkier and noisier than pricier multi-line displays, and does not claim they are better.

Braille's decline. Rogers says counts are hard because definitions of blindness vary. He relays, unverified by his own account, a National Federation of the Blind figure that half of blind schoolchildren learned braille in the '50s against about one in ten now. Hanselman asks whether fast screen readers caused this; Rogers says they make spelling, grammar and numeracy harder and are not equivalent to reading print, yet the screen reader is also what drives a braille display, whether through JAWS, NVDA or BRLTTY.

The engineering problem. Braille is six dots a tenth of an inch apart, invented by a 15-year-old 200 years ago; a display must raise rounded dots reliably 100,000 times, and buyers are charged tens of thousands of dollars. Instead of expensive piezo pins, the Canute Scientific spins 720 embossed octagons, two per cell, with 98 working motors for 2,160 dots, built in a workshop of about 700 sq ft in Britain for about $17 a cell.

Why many lines. Text has structure: tables, prose layout, poetry, sheet music. After a 2019–2020 ebook reader and a console dock for command-line developers, the Scientific adds a 13-inch mirrored monitor, apps built from YAML files and a 40-pin header for sensors, and Rogers wants mainstream partners for accessible maker spaces. He says it suits LLM work, though Python's significant whitespace still bites.

Ownership. The chassis now comes apart for repair, the electronics are off-the-shelf Raspberry Pis on Debian, and he would welcome a cheaper copy.

What sighted builders can do. Braille matches print in speed and retention, tactile graphics do not match images, so a chart should come with its data. The dots are hard for users with diabetic neuropathy, most buyers find Bristol Braille at events, about two a month, and he locates fluency in sensation rather than in the code.

  • Text-to-speech has not made braille redundant; the two are complementary. Rogers, founder and managing director of Bristol Braille, says screen readers make spelling, grammar and numeracy much harder and are not equivalent to reading print, but the screen reader is also what drives a braille display. He relays, while asking not to be quoted on it, a National Federation of the Blind figure that 50% of blind schoolchildren learned braille in the '50s against about 1 in 10 now.
  • Rotating embossed octagons replace pins, cutting the cost of braille. The Canute Scientific has 2,160 dots but no pins: 720 octagons, two per cell, since each three-dot half-cell has eight combinations, turned by 98 working motors, with about 1,000 moving parts in all. Conventional piezo cells are expensive and rivals charge tens of thousands of dollars; Rogers says his roughly 700 sq ft British workshop makes the world's most affordable braille cell technology, at about $17 per cell.
  • Multi-line braille shows structure that a single line cannot. Text is not linear, he argues: tables run vertically or diagonally, and prose, poetry and sheet music depend on layout. The nine-line display is mirrored on a 13-inch high-contrast monitor for sighted colleagues; it runs mostly in the command line, apps are built from YAML files, and he says it suits working with an LLM because the whole function is in view.
  • Owners should be able to repair and own their devices. Having in practice fixed every customer's Canute 360 and sent out repair manuals, Bristol Braille redesigned the Scientific's chassis to come apart, though Rogers warns it is "not something you should do for fun". The braille mechanism is meant to last while the electronics (a Raspberry Pi 5 running Raspberry Pi Debian, swappable hubs) are replaceable, and he says a cheaper copy of his design would make him "their best customer".
  • Give blind users the underlying data, not a picture of it. Braille matches print in reading speed and retention according to studies he mentions, while tactile graphics are much less detailed, so a chart should come with its data. He presents his displays as a different philosophy, not a better product than pricier multi-line rivals: clunkier and noisier, but owned and affordable; the dots are made hard because the company worked early on with diabetic users, whose neuropathy dulls touch.
Scott Hanselman"Observabilitying" the Future of Software with Charity Majors
synopsis

Charity Majors, CTO and co-founder of Honeycomb, ends where she starts: as AI produces code faster than anyone can absorb it, observability is the feedback loop that makes the speed usable, and judgment still has to come from people. That is why she calls a company hiring only seniors "totally unacceptable".

Traces are enough. She says the past two months brought a realisation that connected, structured data is what matters; metrics and logs are the exhaust of infrastructure you don't control, while telemetry for your own code is a product problem. Hanselman adds that an agent fixed his Windows app through an MCP server over its telemetry. She argues DevOps spent 20 years failing to build one loop between coders and production because instrumentation took too much expertise, and that OTel, auto-instrumentation and AI can now close it.

The book. The second edition of Observability Engineering is over 600 pages against about 250, with 27 new chapters. Its final third opens with an open letter to CTOs saying their AI plans are blocked by not understanding their systems. Hanselman, describing Microsoft executive briefings, says no AI will save a company whose DevOps is "a hot mess"; she calls relying on it a trap.

New units of work. The transaction is no longer the unit of work; agent workflows run for hours, which Honeycomb's new "timelines" target. Hanselman likens Nathan Sobo's DeltaDB, from a conversation the day before, to observability of the development process itself.

Testing in production. Every deploy is an experiment, and the only question is whether teams admit it and build tooling: canaries, progressive delivery and feature flags, which she says become a superpower with high-cardinality data.

Juniors. She refuses to anthropomorphise AI, saying taste and judgment come from experience. Honeycomb hires early-career staff in pairs, and she says being on call aligns developers with their customers' pain. She closes on a Vercel engineer's pitch: there is more junior-sized work than seniors can build.

  • Unified structured traces beat separate metrics, logs and traces. Majors, CTO and co-founder of Honeycomb, says people realised over the past two months that "you just need traces", meaning connected structured data. Metrics and logs are the "exhaust pipe" of infrastructure you don't control; for your own code telemetry is a product problem, and data split apart can never be knit back together.
  • AI can finally close the feedback loop DevOps never built. Her theory is that 20 years of DevOps tried to build one loop spanning code authors and production and failed because instrumenting demanded too much expertise; with OTel and auto-instrumentation she says it is now possible to build faster with telemetry than without. Hanselman's example: instrumenting a Windows app and pointing an agent at it through an MCP server solved his bug in minutes, and she agrees agentic work on brownfield systems with no observability is "so deeply screwed".
  • The second edition of Observability Engineering is effectively a new book. The first ran about 250 pages and took 3½ years; the second is over 600 pages after about 200 were cut, with 27 new chapters, the PDF out now and print about a month later. Its last third opens with an open letter to CTOs arguing their AI hopes are blocked behind understanding their systems, and contrasts trust and credibility inside a company with trust and reciprocity with vendors.
  • Every deploy is a production experiment, so make it safe. "There is no test for reality": she says teams over-invest in perfection and under-invest in finding and fixing, and that feature flags combined with high-cardinality data, such as enabling one app in a million and comparing it with the baseline, are greater than the sum of their parts. The unit of work is moving from the transaction to agent workflows spanning hours, which Honeycomb's "timelines", just shipped to GA, address.
  • Hiring only seniors because AI does the easy work is "totally unacceptable". Majors won't anthropomorphise AI: taste and judgment come from repeated experience, which she calls categorically different from what agents get. Honeycomb hires early-career staff in pairs, never one alone, and she relays a Vercel engineer who sees more junior-sized work than he can build, "the best pitch for junior engineers". Hanselman points to his own paper with Mark Russinovich on investing in early-in-career people, which she has read.
Y CombinatorHow to Get Your First 10 Customers
  • Cold email works only if your buyer lives on a laptop. Max, a visiting YC partner, describes a founder who spent three months on cold outreach to a legacy industry, then closed more business in three days by walking a trade-show floor instead — evidence, he argues, that founders should map out where their specific buyer actually spends time before picking a channel.
  • Nearly every founder's first customers came from their personal network. Based on dozens of founder responses to his internal survey, Max says the first two or three customers almost always came from former colleagues, classmates, or warm LinkedIn introductions, because early buyers are betting on trust in the founder, not yet on the product itself.
  • Showing up in person, repeatedly, won customers four through ten. Examples include a founder who flew to the same executive four weeks running before closing them, another who flew to Hawaii and was thrown out after eight minutes before that contact became a top account, and founders running small paid dinners for six to ten ideal customers that reliably outconverted large events.
  • Framing outreach as asking for mentorship, not a pitch, converted better. One founder reached dozens of CEOs asking them to be a mentor and converted a few into customers; another paid lawyers $100 to $200 an hour for product feedback and converted about 30% of outreach, since the fee signaled seriousness even as it raised acquisition cost per lead.
Crosstalk SolutionsI Went Off-Grid and Still Got Answers
  • Project Nomad can answer questions sent over Meshtastic, fully offline. The host's demo used a Nomad server, a travel router and a PoE injector powering a RAKwireless WisMesh radio; a handheld radio paired with an Android phone sent "/nomad how to purify water", which the local Ollama model on the Nomad box answered back radio to radio. He says the whole setup can be made portable, as in his own Nomad deck, a product his company makes.
Scott HanselmanBraille Is Freedom with Bristol Braille's Ed Rogers
synopsis

Ed Rogers, founder and managing director of Bristol Braille, ends on a philosophy rather than a spec sheet: braille is a technology that text-to-speech complements rather than replaces, and blind people should own affordable, repairable, open devices that show text with its full structure. He concedes his machines are clunkier and noisier than pricier multi-line displays.

Braille's decline. Rogers says counts are hard because definitions of blindness vary. He relays, unverified by his own account, a National Federation of the Blind figure that half of blind schoolchildren learned braille in the '50s against about one in ten now. Hanselman asks whether fast screen readers caused this; Rogers says they make spelling, grammar and numeracy harder and are not equivalent to reading print, yet the screen reader is also what drives a braille display, whether through JAWS, NVDA or BRLTTY.

The engineering problem. Braille is six dots a tenth of an inch apart, invented by a 15-year-old 200 years ago; a display must raise rounded dots reliably 100,000 times, and buyers are charged tens of thousands of dollars. Instead of expensive piezo pins, the Canute Scientific spins 720 embossed octagons, two per cell, with 98 working motors for 2,160 dots, built in a workshop of about 700 sq ft in Britain for about £12, or $17, a cell.

Why many lines. Text has structure: tables, prose layout, poetry, sheet music. After a 2019–2020 ebook reader and a console dock for command-line developers, the Scientific adds a 13-inch mirrored monitor, apps built from YAML files and a 40-pin header for sensors. Rogers wants mainstream partners for accessible maker spaces and has worked with the Clovernook Center in Ohio on accessible 3D printing. He says it suits LLM work, though Python's significant whitespace still bites.

Ownership. The chassis now comes apart for repair, the electronics are off-the-shelf Raspberry Pis on Debian, and he would welcome a cheaper copy.

What sighted builders can do. Braille matches print in speed and retention, tactile graphics do not match images, so a chart should come with its data. The dots are hard for users with diabetic neuropathy, most buyers find Bristol Braille at events, about two a month, and he locates fluency in sensation rather than in the code.

  • Text-to-speech has not made braille redundant; the two are complementary. Rogers, founder and managing director of Bristol Braille, says screen readers make spelling, grammar and numeracy much harder and are not equivalent to reading print, but the screen reader is also what drives a braille display. He relays, while asking not to be quoted on it, a National Federation of the Blind figure that 50% of blind schoolchildren learned braille in the '50s against about 1 in 10 now.
  • Rotating embossed octagons replace pins, cutting the cost of braille. The Canute Scientific has 2,160 dots but no pins: 720 octagons, two per cell, since each three-dot half-cell has eight combinations, turned by 98 working motors, with about 1,000 moving parts in all. Conventional piezo cells are expensive and rivals charge tens of thousands of dollars; Rogers says his roughly 700 sq ft British workshop makes the world's most affordable braille cell technology, at about £12, or $17, per cell.
  • Multi-line braille shows structure that a single line cannot. Text is not linear, he argues: tables run vertically or diagonally, and prose, poetry and sheet music depend on layout. The nine-line display is mirrored on a 13-inch high-contrast monitor for sighted colleagues; it runs mostly in the command line, apps are built from YAML files, and he says it suits working with an LLM because the whole function is in view.
  • Owners should be able to repair and own their devices. Having in practice fixed every customer's Canute 360 and sent out repair manuals, Bristol Braille redesigned the Scientific's chassis to come apart, though Rogers warns it is "not something you should do for fun". The braille mechanism is meant to last while the electronics (a Raspberry Pi 5 running Raspberry Pi Debian, swappable hubs) are replaceable, and he says a cheaper copy of his design would make him "their best customer".
  • Give blind users the underlying data, not a picture of it. Braille matches print in reading speed and retention according to studies he mentions, while tactile graphics are much less detailed, so a chart should come with its data. He presents his displays as a different philosophy, not a better product than pricier multi-line rivals: clunkier and noisier, but owned and affordable; the dots are made hard because the company worked early on with diabetic users, whose neuropathy dulls touch.
Network Chuckshadow AI is terrifying
  • Chuck says he no longer knows what AI tools are running. He says he adds new tools "every week, now every day" and suspects unapproved integrations and vendors are already active inside his company — framing shadow AI as spreading exactly as fast as AI adoption itself, mostly outside security's view.
  • A bot he hadn't approved showed up in his company's Slack. He noticed an unfamiliar AI integration named "Inka" appear on its own; he says he didn't add it and didn't know who did, offering it as a live instance of the shadow AI sprawl he's describing rather than a hypothetical.
  • The video is a sponsored pitch for Vanta's "agentic trust platform." Vanta says its AI agent assesses new vendors, gathers evidence, and answers security questionnaires on a company's behalf, claims to cut vendor-assessment time by 50%, and says it's used by more than 16,000 companies, including Cursor.
Crosstalk SolutionsCheap 5G SIMs Are a Ticking Time Bomb
  • Gray-market 5G SIMs risk being shut down by the carrier. The host describes them as SIMs not authorized for resale that resellers dodge the rules to sell. His example: in 2023 Nomad Internet (no relation to his Project Nomad) bought Verizon business SIMs wholesale under fake identities and reprogrammed them; Verizon throttled them to near nothing while customers kept paying, and the company went bankrupt.
  • The host pitches Crosstalk Mobile as the authorized alternative. He says his company's SIMs come through a direct carrier agreement as an authorized MVNO, with truly unlimited data, month-to-month contracts and an optional static IP over 5G. Unlimited plans start at $119 a month, which he concedes is not the cheapest.
Dr. Jon KrohnFable 5: The Full Story from Capabilities to Drama (Ep. 1002 with Jon Krohn)
  • Fable 5 is Mythos-class capability released with safeguards on. The host explains (noting Anthropic sponsors the show and this episode without editorial influence) that Fable 5 and Mythos 5 are the same underlying model: Mythos 5 goes to Project Glasswing partners with cyber safeguards lifted, Fable 5 to the public with them on. The tier sits above Opus and follows Claude Mythos Preview, which Anthropic withheld from general release in April (covered in episode 990).
  • Fable's lead over other models grows with task length. Anthropic reports state-of-the-art results on nearly every benchmark it tested, and the host relays three examples: Stripe ran a codebase-wide migration of a 50-million-line Ruby codebase in a single day that it estimated would take a team more than 2 months; the model beat Pokémon FireRed from raw screenshots and a minimal harness; and persistent file-based notes boosted its Slay the Spire performance three times as much as they boosted the previous Opus. Pricing is $10 per million input and $50 per million output tokens, roughly twice Opus 4.8 and under half the original Mythos Preview; the host predicts today's capabilities will cost about 1% as much in 2 years.
  • Flagged requests are rerouted to a weaker model, not refused. Classifiers watch for cybersecurity, biology and chemistry, and distillation queries and reroute them to Opus 4.8 with a notice rather than refusing. Anthropic says the classifiers are tuned conservatively, trigger in under 5% of sessions, and survived over 1,000 hours of external bug-bounty testing with no universal bypass found; the host reports his own episode script was bounced, perhaps for mentioning cybersecurity.
  • An export-control order took Fable offline for everyone within days. Anthropic confirmed receiving the directive at 5:21 p.m. Eastern on Friday the 12th: a letter from Commerce Secretary Howard Lutnick to Dario Amodei barring access by any foreign national, inside or outside the US, which Anthropic says it could only comply with by switching Fable 5 and Mythos 5 off for everyone; other Claude models are unaffected. The Wall Street Journal reported that Amazon demonstrated the claimed jailbreak and that Andy Jassy relayed it to the White House; Anthropic calls it narrow and non-universal, surfacing previously known minor flaws that GPT 5.5 finds as easily.
  • The host reads the ban as Anthropic's safety warnings backfiring. He notes the order came days after Anthropic urged labs to agree on a "coordinated brake pedal", follows the Department of Defense's supply-chain-risk designation (still in litigation) and reported failed efforts to block the launch, and lands during a confidential IPO filing reportedly showing about a $47 billion revenue run rate and a valuation near a trillion dollars. He speculates the ban may also signal Anthropic is the lab at the frontier; at recording, legal proceedings were under way and Fable's return was unsettled.
Network ChuckHTTPS Doesn't Hide This From Your ISP!!
  • HTTPS encrypts traffic but doesn't hide which sites you visit. Chuck shows a Wireshark capture where enabling secure DNS hides DNS queries, but the TLS SNI field still reveals the destination site to an ISP or attacker. He says a VPN is needed to encrypt that and other non-browser traffic that HTTPS alone doesn't cover.
Network ChuckCisco Just Showed the Future of Networking
  • Cisco Cloud Control unifies networking management into one dashboard. Chuck, reporting from Cisco Live, says it replaces what had been seven separate controllers and logins for Cisco customers, calling it the "single pane of glass" network engineers have wanted. He notes it was already running live on the show floor rather than just announced for a future release.
  • The platform is built to host AI agents, not just dashboards. A Cisco presenter named Grant says Cloud Control lets users "build trusted, secured, and controlled agents" directly within the same screen. Chuck contrasts this with last year's Cisco Live, where AI was discussed but, in his view, not yet shipped.
Scott HanselmanCan you cheat cloud insurance?
  • Commitment insurance is pitched as good for clouds and customers alike. One speaker says customers get "an out" on unused commitments and can reinvest the money rather than getting mad at Amazon or Azure, likening it to Ford wanting Geico to exist so people will buy the F-150.
  • Abuse is held off by underwriting against moral hazard. Asked how they stop a failing startup buying cover just before it collapses, the speaker says the answer is underwriting, which exists partly to avoid moral hazard: buying insurance and then taking more risk because of it. The clip ends before any specific safeguard is described.
Scott HanselmanScott & Mark Learn To...Build from Vibes to Craft
synopsis

Hanselman and Mark, back from Build, end agreeing that AI will drive the cost of simple software towards zero but not the cost of complex software, because specification gaps and evaluation keep people in the loop. Both concede they could be wrong.

No end of engineers. Mark relays a session with Ion Stoica, who said at once that programmers will still be needed, for Mark's own reason: nothing can be fully specified, and AI fills gaps by inventing things. Mark calls engineering sculpting, refined by use. Hanselman says specification taken far enough becomes programming, and recalls his own push towards determinism, including checking a system32 folder into source control.

IKEA and carpentry. Mark places software on a complexity spectrum where simple, well-specified systems need no engineer and medium complexity falls apart. Hanselman's analogy, tried on Japanese CTOs, is IKEA against Japanese carpentry; Mark puts web-plus-database apps and bespoke state retirement systems on the IKEA side.

Evaluation. Mark argues the bottleneck is evaluation: tests and human oversight, with Azure test runs taking hours. Hanselman pushes on whether more evaluation just means more AI; Mark says it does, and that it costs time and money too.

Skills files and taste. Mark raises the claim that a skills file makes a junior senior; Hanselman rejects it. Hanselman says early-career developers declare done too soon, and admits he called a project done at 80% where Mark kept going.

Shipping. Hanselman's OpenClaw Windows companion app is alpha despite weeks of use; Mark says Microsoft's bar is higher than a solo open-source project's, and relays Simon Willison's view that the only software to trust is software many people have used for some time.

  • Mark holds that AI will not eliminate software engineers. He relays asking Ion Stoica of Berkeley at a Build session, who answered no at once, for the reason Mark gives himself: nothing can be fully specified, and where the spec has gaps AI makes things up that may violate implicit assumptions. Mark calls engineering sculpting, needing feedback from use, and concedes it is opinion he cannot win from first principles; Hanselman adds that spec taken far enough is just programming ("Word documents don't break the build").
  • System complexity decides where AI can stand in for engineers. Mark says simple, well-understood systems can be built from a few sentences but medium complexity "falls apart". Hanselman's analogy, from a meeting with Japanese CTOs, is IKEA against Japanese carpentry; Mark maps IKEA to low-complexity web-plus-database apps and bespoke state retirement systems, and Hanselman offers his podcast admin site: "classic late 2025 software" with a god object and a thousand tests, fine for an audience of one.
  • Evaluation is the bottleneck that will not go to zero. Mark says evaluation means the tests plus human oversight of the output, and that a moderately complex Azure service has tests taking hours, so a commit that kicks off 5 hours of tests forces more evaluation up front, costing time and money. "Cost of software is going to zero" comes, he says, from people seeing only the simple end; both hosts say they could be wrong.
  • Hanselman rejects a skills file as a shortcut to seniority. Mark puts the "controversial take", heard from smart people, that a skills file turns a junior into a senior. Hanselman is irritated by "you're an expert" prompting ("I am more than the sum of my context") and unsure whether to be offended by a request to turn his 20-plus years of blog posts into a skill.
  • The bar for shipping depends on who ships it. Hanselman calls his OpenClaw Windows companion app alpha despite weeks of trouble-free use, since odd builds or non-English systems will break it; Mark says a solo open-source project can have rough edges but software from Microsoft to many people cannot. Mark relays Simon Willison trusting only software used by many people for a while, and Hanselman says to treat LLM code like a stranger's pull request.
Y CombinatorPick One Idea and Go Deep
  • Founders should stop hunting for the "perfect" idea and commit to one. John, a YC partner, says overthinking startup ideas — either waiting for the ideal concept or doubting your own founder-market fit — produces paralysis; citing Boom Supersonic's Blake Scholl, who came from ad tech with no aerospace background, he argues deep customer knowledge can be built quickly if you commit and go deep.
  • "Burning the other boats" means fully abandoning alternatives, not just prioritizing. He points to GovDash, which pivoted at least five times, changing its name and even email addresses each time, before its fifth idea in government-contract software worked so well the company raised a Series B — evidence, he argues, that half-committing to multiple ideas at once produces unreliable signal.
  • The bar for "going deep": could you actually run your customer's business? John's test is whether you know their daily crises, whether a specific problem is a top-five pain point, and what they'd pay to solve it — a level of knowledge he says should let you "teach a class" on the problem, built through tight loops of customer conversations and shipped product together.
  • Good AI-era startups should verticalize into owning outcomes, not just software. He argues software costs are heading to zero, so durable value shifts to trust, licenses and outcome ownership — citing Corgi Insurance, which acquired an insurance carrier during its YC batch rather than staying a tech-enabled broker, as a model for "being the insurer" instead of selling tools to insurers.
Crosstalk SolutionsCrosstalk Mobile: Top 5 Questions About Our 5G Unlimited SIM Cards (ANSWERED)
  • Crosstalk Mobile runs on T-Mobile as an authorized MVNO. The company, launched about two months before the video, has a direct agreement with T-Mobile, its only carrier for now, with multi-carrier SIMs planned "in the near future". The host contrasts this with gray-market resellers buying wholesale SIMs without a carrier agreement, which he says get shut down when caught.
  • The unlimited SIMs really have no caps or overages. Plans start at $119 a month, and the host says no amount of data changes that. Cheaper limited tiers are planned as a priority, for backup links, IoT and RedCap devices such as Netgear's $99 5G backup device and the GL.iNet Comet 5G, with no date given.
  • The SIMs suit 5G routers, not phones or tablets. The host says they work well in Netgear 5G and Peplink gear and he has not yet found a router they fail in, but phones and tablets are hit and miss and discouraged. He cites a reseller who got a Peplink router chosen, preconfigured on InControl 2 and drop-shipped with the SIM installed, all by text in a few hours.
  • The SIMs get real public IPv4, not CGNAT. The host argues CGNAT makes 5G failover incomplete, since inbound services such as a VPN server for remote staff stop working when the office fails over. Crosstalk SIMs get real IPv4 addresses, and a static IP is $5 a month extra; he personally tested port forwarding through the UniFi 5G Max and the Dream Router 5G Max.
  • There is no contract lock-in. Plans are month-to-month, or year-to-year if bought annually, and can be cancelled at any time. The host presents engineers answering customer calls and texts directly as the service's most underrated feature, contrasting it with Verizon Business or AT&T support.
Dr. Jon KrohnThe AI Model That Finally Beat Me (with Jon Krohn)
synopsis

For episode 1001, founder Kirill Eremenko hosts and Jon Krohn, the usual host, is the guest. Krohn's position by the end is a techno-optimist one: AI has erased the technical moat he spent 20 years building, but that makes skilled engineers more valuable; even an AI bubble would leave lasting infrastructure; the real business opportunity is wiring AI into actual workflows and data; and whether AI makes people's lives calmer or more frantic is, for now, up to each individual.

From neuroscience to finance and back. Krohn studied neuroscience at Oxford on a full scholarship, drawn by how the mind emerges from physics and chemistry, and moved into massively parallel computational statistics and machine learning there, with a NeurIPS paper in 2010. He says he did this work professionally until a few months before recording, when Claude began doing it better than him. After the PhD in 2012 he spent 2 years at a New York hedge fund, taken for the money, and now regrets leaving academia and its community. He is edging back: supervising a University of Auckland PhD on AI in clinical settings, lecturing at NYU and Columbia, and co-writing a book on agentic AI with Ed Donner.

What AGI requires. Asked whether AGI is judged by outcomes or needs something brain-like, Krohn starts from Google DeepMind's five levels of AGI, covered in his episode 748, which rank depth by the share of humans a system outperforms, and adds breadth. On depth, AI already rivals many people at computer-based work like coding and writing; on breadth, physical-world competence is years off, which he says explains the very large world-model seed rounds such as Yann LeCun's AMI and Fei-Fei Li's company. He sees no obvious mechanism for machine consciousness and no reason AGI would need it. Artificial neurons are a drastically simplified model of biological ones, and brain structures can inspire designs, but he argues silicon scales and moves at speeds brains cannot. Asked whether humans are just predicting the next token, he says fast, automatic speech and skills like experienced driving resemble it, and reasoning models' hidden thinking resembles deliberate slow thought, but the mechanisms differ entirely; prediction is simply central to any agent navigating the world.

Bubble or not. Pointing to his episode 974, Krohn argues that whether or not AI is a bubble, society wins: railway and dot-com busts ruined investors but left rails and fibre that powered later growth. He says he avoids individual stocks and stays diversified, and that market prices aggregate crowd judgement, so he would bet this is probably not a bubble, unlike ICOs and NFTs. To Eremenko's point, which Eremenko attributes to Andrej Karpathy, that scaling is yielding diminishing returns, Krohn answers that chips like Nvidia's GPUs or Amazon's Trainium and Inferentia, though tuned for Transformers, still serve any parallel matrix multiplication, so post-Transformer candidates such as Mamba or Pathway's Baby Dragon Hatchling (episode 929) will be designed to run on them. Jevons paradox, he says, means cheaper intelligence raises total compute demand, and more inference-time computation needs data centers too; he hopes AI-aided plasma control speeds commercial fusion.

Consulting and automation. He describes Y Carrot, his consulting firm founded a little over a year earlier: about eight people, US-based consultants with graduate technical degrees, a weekly half-hour cadence and a working prototype usually by week two, with a $50,000 minimum engagement copied from a former guest. He says the most valuable projects fully automate a repeated workflow, and that several clients now get in minutes what took weeks, with AI also doing the cross-checking more cheaply than people. In his telling no deployment has cost jobs so far, because freed time moves people to higher-value work.

Choosing projects and why they fail. For clients unsure where to start, he lists projects in a spreadsheet and scores reach, impact, confidence and effort (RICE), with effort as the denominator, crediting product managers and noting Dell's John Roese described cutting about 800 ideas to a dozen or so. The scores must estimate production, not prototype, and should come from workflow users plus technical staff rather than executives. Citing MIT NANDA's 95% figure while noting it has been debunked as an exact number, he says the top failure is missing enterprise data behind a capability a CEO saw in ChatGPT; Eremenko adds missing pipelines, his "Ferrari needs a highway". Krohn notes data engineering is itself being automated, citing a recent guest's company.

After pure SaaS. He argues pure SaaS's 80% margins break down when Claude Code can replicate the software, so durable value lies in forward-deployed or consultative models: Palantir engineers embedded full-time at a client like a police department, now copied by Anthropic and OpenAI, and firms like Unframe that tailor a limited set of products to each enterprise. Always-on lives. Eremenko asks whether AI will make people happier, citing Christopher Nolan's flip phone and printed emails. Krohn says he envies that and misses distraction-free study with a paper calculus textbook; a phone-free Memorial Day weekend meant missing a Kyunghyun Cho lecture a short walk away. He argues the technology already exists to build an agent that acts as a Nolan-style assistant, phoning only about what matters, though it takes time and tolerance for mistakes. He hopes access to such agents might one day be guaranteed like health care, but says for now it is up to each person.

  • AI erased his technical moat but raised engineers' value. In this role-reversal episode, hosted by founder Kirill Eremenko, Krohn says the machine-learning skill set he built from his Oxford neuroscience PhD onward stopped being a moat a few months before recording, when Claude started doing that work better than him. His argument is that engineers who stop typing code by hand and use tools like Claude Code can deliver far more, so hiring them is worth more, not less.
  • AGI needs breadth into the physical world, not consciousness. Krohn points to Google DeepMind's five-levels paper (his episode 748), which grades AGI by the share of humans a system outperforms, and argues that AI now matches or beats many people on computer-based work like coding and writing but is years from acting in the real world, hence world-model startups' huge seed rounds. He sees no reason consciousness is required, and says biological brains are useful inspiration but silicon has different limits and advantages of scale and speed.
  • An AI bubble bursting would still leave useful infrastructure. Citing his episode 974, he argues that, as with 19th-century railways and dot-com-era fibre, investors might lose their shirts but data centers, model advances and talent would benefit everyone; he personally holds diversified investments rather than individual AI stocks and would bet this is probably not a bubble. He invokes Jevons paradox to argue more efficient architectures will raise total compute demand, and says the hardware won't become obsolete because any successor to the Transformer will still need parallel matrix multiplication.
  • Most AI projects fail because the enterprise data isn't there. Krohn says the number-one failure he sees is a CEO proving a capability in ChatGPT or Copilot when the company lacks the underlying data at scale (Eremenko adds: or the pipelines to use it). He prioritises projects with RICE scoring (reach, impact and confidence over effort), estimated for production rather than prototype, and argues the people doing the workflow plus the technical team score it better than executives; he cites MIT NANDA's 95% failure figure while noting the exact number has been debunked.
  • The money is in bridging AI to real workflows, not pure SaaS. He says his consulting firm Y Carrot, about eight people and founded a little over a year earlier, typically shows a prototype in week two and has cut multi-week processes to minutes without job losses so far, because freed time goes to higher-value work. He argues the 80%-margin pure-SaaS model breaks down when Claude Code can replicate it, leaving durable opportunity in forward-deployed or consultative models like Palantir's, now used by Anthropic and OpenAI.
Y CombinatorGroww: If Your Customers Don't Love It or Hate It, You've Already Lost
synopsis

Lalit Keshre, co-founder and CEO of the now-public Indian investing platform Groww, traces the company's arc from a failed robo-advisor to India's largest brokerage, arguing throughout that unglamorous customer obsession, not clever strategy, explains its survival through multiple business-model changes.

Keshre and his co-founders started in 2016 believing India's low investor penetration meant a Wealthfront-style robo-advisor would take off; it didn't. Talking constantly to early users, via WhatsApp groups and sometimes literally approaching people in movie theaters, revealed customers wanted the opposite of an algorithm's recommendation: full visibility into every product and transparent pricing, closer to how Flipkart sells retail goods. Relaunched on that premise in May 2017, the product got 600 signups against an internal goal of 100, with word-of-mouth growth following and no paid acquisition.

Keshre frames two decisions as strategically deliberate rather than accidental: choosing to operate only inside regulated financial territory even though gray-zone alternatives existed, because it removed ambiguity from decision-making; and tolerating four straight years of zero revenue, betting that near-zero acquisition cost and high retention would eventually justify a business model. Vocal power users demanding zero-commission mutual funds later forced Groww to abandon its original commission revenue, and stock trading became the actual monetization lever.

Four co-founders have stayed aligned for a decade, Keshre says, not through daily consensus but through one values document — "customer first" — written at founding and treated as fixed even as strategy repeatedly changes, paired with clearly assigned ownership. He closes by describing wanting every launch to provoke either love or hate, never indifference, as the real measure of whether a product matters.

  • Groww's first idea, a robo-advisor, failed before pivoting to full transparency. Lalit Keshre, Groww's co-founder and CEO, says the 2016 robo-advisor model stalled despite India's low investor penetration; customers kept asking "why this product, why not that," which led the team to open the full catalog with transparent pricing instead, Flipkart-style.
  • He chose to operate only in regulated territory as a risk strategy. Rather than exploit unregulated or gray-zone areas — which he estimates cover roughly 40% of the space — Groww obtained licenses upfront, which he says removed decision variables and made execution simpler even though it was slower.
  • Groww ran four years at zero revenue before customer demand unlocked monetization. Early commission-based mutual-fund revenue was abandoned after vocal power users demanded zero-commission "direct" funds; the company bet that near-zero acquisition cost, high retention and heavy money flow would eventually produce a business model, and stock trading later became the monetization lever.
  • Four co-founders stayed aligned for a decade via one values document. Keshre says strategy can change "like pencil," but core values like "customer first," written down at founding, should not; he also stresses genuinely enjoying each other's company as a practical requirement, not a nicety.
Technology and FriendsFabio Padua on Using AI to Increase Productivity [EPISODE 907]
  • One prompt built and deployed a conference sessions site. Padua, who has been at Microsoft for four years, gave the new GitHub Copilot app a JSON file of Build session data, and it created a repo, built the app and set up deployment to Azure. He puts the time at about five minutes at one point and "10 minutes tops" at another. The app ran a team of about 15 agents under a "director". His only manual step was copying the Azure static web app token into the repo's GitHub Actions secrets.
  • An internal agent tool matched conference sessions to a partner. Padua says Scout, an internal Microsoft tool built on the open-source OpenClaw, ran parallel agents that read his site and researched the partner Solo Network. When Playwright failed, they fell back to simulated mouse and keyboard input. They picked 16 best-fit sessions, built a table with links and levels, and drafted an email offering a 30-minute call. He has done this for three partners, in Portuguese where he remembered to ask.
  • Agents act as you, so limit what they may do. Padua advises running OpenClaw in a virtual machine you can destroy and letting it only draft, never send or auto-reply to email, citing stories of agents deleting emails or a whole operating system. He had Copilot write a PowerShell deploy script for him to review rather than letting it deploy through the Azure MCP server tied to his credentials, to avoid unwanted resources and costs.
  • Copilot digs answers out of dense internal documentation. Padua uses Microsoft 365 Copilot to summarize meetings he missed and to draft LinkedIn posts. Searching the documentation this way, he found why a partner lacked the Anthropic model quota it expected in Foundry: he says those models work only under an EA contract, and the customer was on CSP. He also tries competitors' tools, such as OpenAI's DALL-E, Anthropic and Perplexity, because customers ask his opinion of them.
  • AI amplifies technical knowledge rather than replacing it. Padua argues that results depend on the user knowing what they want to do, and that AI then delivers "the best of the people can do with a prompt". Giard adds that the agents narrate their failures and change approach, as when Playwright failed, which he says is what a person would do, only faster.
Y CombinatorSelf-Play for LLMs, AI for Biology, Formal Verification, and More | YC Paper Club
synopsis

At YC's Paper Club, five researchers and builders each apply the field's core recent pattern — improving through self-generated data and raw scale rather than imitating existing human solutions — to a new domain: protein biology, math proofs, voice AI, formal software verification, and the practice of running an AI-native engineering team. The host frames his own interest as whether "intelligence per sample" can ever exceed what human-imitation training allows.

AI for biology. A Stanford PhD student presents ESM Cambrian, a Biohub protein language model trained only to predict masked amino acids, with no structural data. Unlike its predecessor, which plateaued with scale, this model shows the same clean log-linear improvement with compute that language models show — attributed mainly to scaling training sequences from 50 million to 2.8 billion, pulled from environmental DNA. Tested against AlphaFold 3, which relies on hand-built sequence alignments, the sequence-only model lands within a few points on general structure prediction and edges ahead on antibody design, where alignment data is scarce. Interpretability analysis finds the model organized its internal representations into an unsupervised hierarchy — amino acids, structural motifs, whole protein domains — which the presenter reads as evidence the "bitter lesson" of scale beating hand-engineered features is starting to hold in biology, not just language.

Self-play for language models. A second presenter describes an AlphaZero-style setup where a "conjecturer" model generates problems and a "solver" attempts them, with the conjecturer rewarded for problems that are hard but solvable. Naive versions collapse: the easiest way to look "hard" is to write artificially convoluted, messy problems rather than genuinely difficult ones. His fix grounds new problems in ones the solver already failed on and adds a third "guide" role scoring whether a generated problem is actually related and reasonable. On 3,000 formal math problems in Lean, this lets a 7-billion-parameter model, given eight times more self-play compute, match the solve rate of a roughly 100-times-larger baseline model, though he stresses the method is far from solving everything.

Streaming retrieval for voice AI. A Giga researcher presents work on cutting latency in voice agents that use retrieval-augmented generation: waiting for a spoken question to finish before retrieving adds unacceptable delay in natural conversation. The paper explores retrieving mid-question, either at fixed intervals or by training a model to judge when enough of the question has arrived to act safely. He frames the real challenge less as this specific method and more as deciding, from a live stream of speech, the earliest safe moment to retrieve.

Formal verification. A Caltech PhD student argues Lean, an interactive theorem-proving language, is entering a breakthrough period: DeepMind and OpenAI have both used related methods to solve International Mathematical Olympiad gold-medal problems and decades-old open conjectures, aided by growing formalized-math libraries and LLMs that can search proof steps. He extends this to software, describing an emerging shift from "vibe coding" to "verifiable coding," and cites his own project reimplementing neural-network operations natively in Lean — including a formal proof that flash attention is mathematically equivalent to standard attention — as an early example of AI-written code carrying real guarantees rather than just passing tests.

Running an AI-native engineering team. The final speaker, a startup CEO known for aggressive token spending, argues coding with agents behaves less like chess — a single linear process — and more like a real-time strategy game, where the goal is maximizing parallel throughput across many imperfect simultaneous actions rather than perfecting any one. His team runs many autonomous coding agents at once under a human "orchestrator," instructs each to push forward as far as possible before asking for help even at the cost of wasted effort, and feeds outcomes back into a shared knowledge base rather than treating code itself as the source of truth. He tracks productivity the way an RTS player tracks actions-per-minute — tool calls per agent per hour — and reports the approach grew pull requests shipped per engineer per month 3.5x, then another 60% once the rest of the team adopted it.

  • Protein language models are starting to show the same LLM-style scaling laws. A presenter says a new protein-model family from Biohub, ESM Cambrian, keeps improving log-linearly with more training compute and sequence data — unlike its predecessor, which plateaued — largely because the team scaled training data from 50 million to 2.8 billion sequences pulled from environmental DNA sequencing.
  • Naive AI self-play collapses into generating deliberately convoluted, useless problems. A Stanford PhD student found that rewarding a "conjecturer" model for stumping a "solver" model just produces artificially messy math problems; his fix grounds new problems in ones the solver already failed on and adds a third model to judge relevance, letting a 7-billion-parameter model match a 670-billion-parameter baseline's solve rate after eight times more self-play compute.
  • Lean formal verification marks a shift from "vibe coding" to "verifiable coding." A Caltech researcher says frontier labs have used the Lean proof language to solve IMO gold-medal problems and decades-old Erdős conjectures, and describes his own project formalizing neural-network operations — including proving flash attention mathematically equivalent to standard attention — as evidence AI-written code can eventually carry mathematical guarantees, not just pass tests.
  • Treating agentic coding like a real-time strategy game tripled shipped pull requests. A startup CEO known for aggressive token spending says running many parallel Claude Code "worker" agents under one orchestrator, instructing them to push forward without stopping for feedback, and feeding a shared knowledge base after every task grew pull requests per engineer per month 3.5x, then another 60% once the whole team adopted the workflow.
Dr. Jon KrohnTen Years of the Super Data Science Podcast (Ep. 1000 with Jon, Kirill and Special Guests)
synopsis

Episode 1000 was recorded live, with listeners able to join, by host Jon Krohn and the show's founder Kirill Eremenko. Its most lasting argument is Eremenko's: AI research moves fast but adoption moves slowly, so people worried about keeping up need only stay ahead of adoption. Around that, the hosts and callers trade views on what AI should fix, how companies should choose between building and buying, and how newcomers can get hired.

Origins. Eremenko says he started the show in September 2016 after seeing interview podcasts like Tim Ferriss's and finding nothing similar for data science. He hosted through episode 431; the host took over from episode 432 on January 1st, 2021. Eremenko says he invited the host on as a guest for Deep Learning Illustrated in April 2020 and later offered him the job on intuition; they met in person only last year.

What $10 billion should fix. Jepson Taylor, the show's most frequent guest, asks what each would fix in two months for the bottom 90%. The host wants an agent standing between people, especially the most easily exploited, and the feeds, scams and attention-seeking products that leave them overwhelmed, steering them to activities that make them happy; Taylor notes the Black Mirror risk of an AI scripting your marriage. Eremenko wants AI-run, scalable charities with admin costs cut from what he thinks is about 40% to 5%. Taylor's own goal is to close what an engineer told him is the gap between the top 10% and bottom 90% of AI developers.

Lessons from hosting. Eremenko's hindsight is to have launched on YouTube from day one; the show only went video-first 10 months before recording, and the host says YouTube subscribers rose from 20,000 to over 250,000 since. Eremenko says he started shy and learned to start before feeling ready. The host says Eremenko's advice to be conversational, and to stop visibly taking notes, changed his hosting.

Build versus buy. For a corporate listener weighing vendors' bolted-on agents against in-house builds, the host relays a 2x2 from episode 932's Unframe co-founder: skip what is costly and non-differentiating, build what is differentiating but slow, buy what is fast and undifferentiated, and partner where it is fast and differentiating; he names his own consulting firm among such partners.

Education and the speed of adoption. A former Dutch professor of human-AI collaboration asks how schools can teach safe AI use. The host cites episode 983's Boston principal (children under about 10 should not use AI directly), Kyunghyun Cho's Gemini-based NYU course, and episode 994's view that weak new-grad hiring reflects post-pandemic overhiring as well as AI. Eremenko says time will fix hallucinations, which he estimates are down about 10-fold in two years, so startups fighting that tide fail. The professor replies that universities banned AI within weeks and are still recovering; Eremenko frames this as research moving like a bullet train and adoption like a traffic jam.

Breaking in. For newcomers the host recommends a GitHub of self-built projects and in-person networking over online applications, which AI-tailored résumés have flooded. He suggests readers wanting a simpler version of his book ask an LLM to rewrite it for their background.

  • Beat the speed of adoption, not the speed of research. Responding to a former Dutch professor of human-AI collaboration about teaching safe AI use, Kirill Eremenko, the show's founder, argues research moves like a bullet train while adoption in universities, enterprises and government moves like a highway traffic jam, slowed by legacy systems and change management. He says people anxious about AI only need to stay ahead of adoption, and that startups should avoid problems models will soon solve, citing hallucinations he estimates are down about 10-fold in two years and AI-text detectors as fighting the tide.
  • The host would fund agents that shield people from manipulative feeds. Asked by Jepson Taylor what they would fix with $10 billion in two months, the host proposes an agent between vulnerable people and the feeds, scams and attention-seeking products they consume, steering them toward what makes them happy; Eremenko proposes AI-run charities that cut admin overhead from what he thinks is about 40% to about 5%. Taylor's own answer is closing what an engineer told him is the gap between the top 10% and bottom 90% of AI developers.
  • Build what differentiates you and is slow to build; buy the rest. Answering a corporate listener on the "SaaS apocalypse", the host relays a 2x2 from episode 932's guest from Unframe: avoid projects that are costly and non-differentiating, build in-house what is differentiating but slow, buy what is quick and non-differentiating, and partner (he names Unframe and his own firm) where it is both quick and differentiating.
  • The show's big growth lever was video, adopted far too late. Eremenko, who hosted from September 2016 to episode 431, says his one piece of hindsight is that he should have put episodes on YouTube from the start; the host says the show went video-first only 10 months before recording and grew from 20,000 to over 250,000 YouTube subscribers since. The host's own lesson, from Eremenko's feedback, was to be conversational and stop taking notes on air.
  • In-person networking beats clicking "apply". The host argues weak new-grad hiring reflects degrees losing their "golden ticket" status and post-pandemic overhiring as much as AI, citing episode 994. His tips for entrants are a GitHub of projects actually done yourself and meeting people in person, because AI-tailored résumés let applicants send thousands of applications and flood the traditional pipeline; he also cites episode 977's NYU machine-learning course, taught by Kyunghyun Cho, that required students to use Gemini.
Scott HanselmanCloud Commitments Without the Lock-In with Archera's Aran Khanna
synopsis

Aran Khanna, co-founder and CEO of Archera, ends arguing that pay-as-you-go is a promotional price for prototyping, and that serious cloud users should commit, crawling into larger and longer commitments as projects mature, with Archera's insurance taking the downside if usage falls away.

Why commitments exist. Hanselman, a pay-as-you-go user for 17 or 18 years, says he leaves money on the table but fears lock-in. Khanna, who spent almost a decade at Azure and AWS, says data centres take heavy capital, lenders underwrite guaranteed revenue, and providers therefore discount by more than 80% for 3-year commitments. With GPU shortages, he says, commitments in 2026 are often the price of access at all.

The product. Insured commitments pay back unused months, the right to break a lease. Archera sells mostly through the AWS, Azure and Google marketplaces, and Khanna says provider sales teams like it because it gets customers to commit larger amounts for longer.

How it avoids being gamed. Asked about moral hazard, Khanna cites a year of usage history, priors from a petabyte-plus of data across thousands of customers, a diversified book built by quants, and machine-learning models over billing metadata. About 40% of customers buy insurance.

What broke. Commitments grew from reserved instances into a tool for rationing GPUs, deterring multi-cloud and pushing modernisation, and very large bills can no longer be trusted. Capacity is uneven: new Nvidia Grace Blackwell machines are scarce, while over half of new AWS CPUs for two years were Arm-based Graviton.

Who it is for. Waste is partly engineering, usage optimisation, and partly finance, rate optimisation, which is Archera's ground. Savings become meaningful at $100,000–200,000 a year.

  • Archera sells insurance that lets customers break cloud commitments. Khanna, co-founder and CEO, describes "insured cloud commitments": commit for 3 years and, if the last 24 months go unused, Archera pays back the difference; he says no one else offers it, and customers can cancel the insurance once confident. His analogy is buying the right to break a 3-year apartment lease after the first year.
  • Commitments exist because clouds finance capex against guaranteed revenue. Like a builder whose lender underwrites leases rather than Airbnb income, providers borrow to build data centres (CoreWeave is his extreme example), so discounts can exceed 80% for moving from per-second use to a 3-year commitment. He says that in 2026 a commitment is often required just to get GPUs; Hanselman calls on-demand "the convenience store price of compute", and Khanna calls it the promotional price, where you prototype.
  • Commitments became a hammer applied to every cloud problem. Reserved instances made sense in the early 2010s, he says, but from the 2017 SageMaker launch, which he worked on at AWS, they were used to ration scarce Nvidia capacity, then to deter multi-cloud and push modernisation, leaving "a spaghetti mess". At $80–90 million a year with one provider, he says, bills contain errors and cannot be treated as a source of truth.
  • Underwriting relies on spend history, peer priors and diversification. Archera wants at least a year of real usage data, draws priors from over a petabyte of history across thousands of customers (offering less on Azure VMware Service, which tends to migrate to AKS within a year), and spreads its book across instance types, GPUs and customers. Only about 40% of its customers buy insurance; the rest use free billing and commitment tools.
  • Small teams qualify, but savings matter most at larger spend. Khanna puts the meaningful threshold at $100,000–200,000 a year of cloud spend, with savings that could fund a headcount from $500,000-plus, though two-person startups on credits use it and a quote takes 5 minutes. He separates his rate optimisation, a finance question, from usage optimisation, an engineering one.
Y CombinatorHow Meesho Became India’s Biggest Shopping App
synopsis

Vidit Aatrey, co-founder and CEO of Meesho, traces the company through three distinct businesses before it became India's most-downloaded shopping app, and ends by arguing that voice interfaces will let Meesho reach the share of India's population still excluded from e-commerce.

Aatrey and his co-founder started in 2015 struck by a stark gap: e-commerce felt "done" in Bangalore, yet neither of their small-town families bought anything online. Their first product, a hyperlocal fashion-listing app, shut down after three months once they finally spoke to consumers, who called it "the worst of both worlds" versus a mall or full e-commerce. Their second attempt, Meesho, initially aimed to help small shops sell via WhatsApp, an idea discovered after the founders simply sat and watched inside shops rather than interviewing owners. That version reached YC but couldn't monetize, since small Indian businesses wouldn't pay for software. Digging into which users were actually addicted to the product revealed a different profile entirely: online-native drop-shippers, largely homemakers, running zero-inventory resale businesses through WhatsApp groups, whose real bottleneck was supplier access. Pivoting to serve them as a supplier, under a relaunched Meesho Supply, produced sustained month-over-month doubling with zero marketing spend, which Aatrey says is what actually taught him what product-market fit means.

The company's hardest decision came in 2020: falling data costs and pandemic-driven online adoption erased WhatsApp's advantage, so Meesho chose to cannibalize its own network of ten million reseller-run WhatsApp groups by launching a direct consumer app, a bet competitors running similar WhatsApp models did not make and have since shut down. The app hit #1 on India's Play Store the day after its July 2021 launch and has held that spot every day since, reaching 100 million monthly users within five months.

Aatrey closes on Meesho's next bet: a voice-only shopping agent, Wani, designed to eliminate reading, typing and clicking for rural users who don't understand what "add to cart" means and fear accidental charges — a bid to move Indian online shopping from roughly 250 million users toward the country's full billion.

  • Meesho's first product failed within three months because they never interviewed consumers. Vidit Aatrey, Meesho's co-founder and CEO, says their 2015 hyperlocal fashion-listing app collapsed once customers said it was "the worst of both worlds" — the limited selection of a local shop without the touch-and-feel of a mall — a mistake he calls "the most notorious mistake you can make."
  • The real business emerged from noticing shops secretly ran WhatsApp storefronts. Sitting silently inside small shops rather than interviewing owners, the founders found sellers already used WhatsApp to message customers about new inventory, which led to a WhatsApp-commerce tool, and later to the discovery that the platform's true power users were online-only drop-shippers, mostly homemakers, needing supplier access rather than tooling.
  • Meesho abandoned its profitable WhatsApp network in 2021 to launch an app. Aatrey says the shift from expensive mobile data to near-zero-cost data during COVID erased WhatsApp's core advantage, so the company knowingly risked alienating ten million reseller-run WhatsApp groups; the new app hit #1 on India's Android Play Store the day after its July 2021 launch and has stayed there every day since, growing to 100 million monthly users within five months.
  • Meesho is building a voice-only agent for users overwhelmed by apps. Called Wani, it aims to remove reading, typing and clicking entirely — consumers speak preferences, hear responses, and give an address and OTP by voice — because Aatrey says rural users often don't understand what "add to cart" or a star rating means and fear that any button might deduct money.
Crosstalk SolutionsMeshtastic vs MeshCore: Which Should You Choose for Project Nomad?
  • Project Nomad will support both, leaving users the choice. The video opens with the claim that MeshCore is far better, one local area having switched months earlier; the host says he has only ever used Meshtastic and is not a heavy user, but has heard the same. Much of the same radio hardware runs either, and both will be in the Supply Depot.
  • The host's goal is asking Nomad's local AI questions over the mesh. He is most interested in a Meshtastic API container, so a message like "!nomad" plus a question, picked up over 915 MHz by an Ethernet-connected radio, gets answered by the server's local LLM over Meshtastic or MeshCore. He describes this as his "dream", not a shipped feature, letting someone many nodes away query a distant Nomad server offline.
Y CombinatorThe Most AI-Pilled CEO We Know
synopsis

Brex co-founder and CEO Pedro Franceschi describes a company-wide transformation built on a single conviction: that AI adoption inside an existing company requires refounding its self-identity from scratch, not layering automation onto old processes, and he ends by arguing the CEO, not any team, has to personally drive that refounding.

Franceschi traces his own shift to what he calls "electricity being invented" — the moment reasoning models and coding harnesses crossed from research curiosity into genuinely useful tools, around the GPT-4.5 era in December. He describes going deep personally, giving a self-hosted AI agent read access to his email and Slack, then wanting to grant it write access into Brex's own systems, which Brex's security team initially refused. His solution, later open-sourced as "Crab Trap," proxies every HTTP request an agent makes and uses a separate LLM to judge whether it matches an approved policy; after training on one day of traffic, it auto-approves roughly 98% of requests, which he says was the unlock that got Brex's security team comfortable letting agents operate in production.

He frames company-wide AI adoption in three tiers: engineers who "token-max" inside coding harnesses, average engineers getting a fraction of that productivity, and the rest of the company still interacting with AI in "Google search mode" through chatbots. Brex's bet is building an equivalent harness for non-technical teams, a "virtual employee" reachable on Slack and email that can join meetings and take notes, which let him and a handful of colleagues plan 60 partner dinners for Startup School by talking through Slack, with no one opening a coding tool.

Franceschi's most counterintuitive argument is that AI should tighten founders' discipline, not loosen it. He points to Stripe's original API-only product, Brex's own terminal-only MVP, and Airbnb's single-form booking flow as evidence successful companies compress a problem into one disciplined interaction; he worries AI's ease of building many things tempts founders into skipping that compression rather than finding a smaller way to solve the real problem. This connects to his view on ideas generally: models can now execute almost anything, so the founder's remaining job is judgment, extracting from a customer conversation the "unspoken signal" a customer's own words can't fully capture, since a customer will describe their problem through their own limited framing, not hand over a billion-dollar answer.

Operationally, he describes Brex building a "customer world model" that ingests every touchpoint — dashboard clicks, support tickets, sales calls — to predict what a customer needs next, and redesigning entire processes like KYC from scratch rather than bolting an agent onto the existing flow, which surfaced a new insight: since AI makes compliance checks nearly free, Brex can now run them earlier, on leads rather than signed customers, reshaping who the company targets. On cost, Brex built an internal tool, Magpie, attributing every dollar of token spend to a product, customer or employee, and Franceschi says the data shows most companies, even large, well-funded ones, chronically underspend on tokens relative to what the economics justify, with usage and revenue growth both concentrated in a roughly ten-mile radius around San Francisco and New York.

He closes by arguing the CEO must personally act as "chief AI officer" because only someone with visibility across the whole company can see where old processes should be torn up rather than patched, and that internal resistance to disruptive change, what he calls organizational "antibodies," has to be overcome by deliberately speeding up escalation paths for risk-taking, since waiting for consensus reliably favors keeping the old way.

  • Minimal surface area, not AI-enabled breadth, separates successful companies. Brex co-founder and CEO Pedro Franceschi points to Stripe's early API-only product, Brex's own terminal-only MVP, and Airbnb's single-form booking flow as evidence founders should compress a problem to one disciplined interaction, warning that AI's ease of building "so many other things" tempts founders into losing that focus.
  • Brex secures its AI agents by auditing traffic with another AI. Franceschi says the company's open-sourced "Crab Trap" tool proxies every HTTP request an agent makes, uses an LLM to judge whether it matches an approved policy, and after training on one day of an agent's traffic can auto-approve about 98% of requests — the unlock that got Brex's security team comfortable letting agents write into production systems.
  • Founders can't prompt their way to a winning idea. Franceschi argues models can execute almost any idea now, but a customer describing their problem gives you their own limited, locally optimal framing, not the breakthrough answer; the founder's remaining job is extracting what customers aren't saying, since "the execution is gone" but "the wisdom to choose is still the bottleneck."
  • Most companies chronically underspend on AI tokens, even at scale. Comparing token-consumption data across companies, Franceschi says a roughly ten-mile radius around San Francisco and New York shows dramatically higher usage and correlated faster revenue growth than large, well-funded companies elsewhere that spend a small fraction of what the economics would justify.
GCastAnalyzing Contracts and Other Legal Documents with Legal Agent [GCast 218]
  • Legal Agent is a gated preview inside M365 Copilot. According to Giard it needs an M365 Copilot license and an organization enrolled in the Frontier program, and during the preview it works only in the United States. You can tell you have access if Legal Agent appears under the plus icon after opening Copilot (bottom right) in a Word document.
  • It reads contracts with knowledge of their structure. Giard says this is what it adds over plain M365 Copilot. He ran it on an 11-page services agreement taken from the public internet. It answered the top five risks to the buyer (including broad IP assignment and late payment), the vendor's obligations grouped by category (such as service delivery, payment and fees, and intellectual property), and the indemnification clauses and their impact. Each finding linked to its section of the document.
  • It can draft and apply edits to the document. Two prompts asked it to add a termination-for-convenience clause in line with standard enterprise contracts, and to revise a clause to reduce a vendor obligation while keeping its intent. It proposed text that he scrolled to and applied with a click.
  • It produces executive summaries, including ones aimed at a specific audience. A one-page summary of risks, obligations and recommended actions came back with links into the document and could be pasted into an email or another document. A follow-up asking what a CFO should care most about returned bullets for that reader.
  • A playbook can stand in for individual prompts. A playbook is your own way of reviewing a legal document, loaded from SharePoint or your computer. Legal Agent turned his simple playbook into a list of topics to analyze, which can be extended before continuing. It then ran the whole analysis and suggested text to apply, for example on the change-management process.
Crosstalk SolutionsCan You Use Project Nomad on a MacBook? ARM Support Status and Workarounds
  • ARM support for Project Nomad has no timeline. Answering a viewer with an M5 Pro MacBook Pro who wanted to run it under Parallels, the host says ARM is on the radar but the priority is making the project solid on x86 first. Native MacBook support will come "at some point", he says, but is not a focus.
  • Mac users can get GPU-backed AI by running Ollama natively. A dockerized Ollama on a Mac cannot use the GPU, so the workaround is to install Ollama natively on macOS, skip Nomad's own AI install, and point Nomad's remote-Ollama setting at the Mac's IP and Ollama port, which the host thinks defaults to 11434. He notes Apple silicon machines hold some of the top 100% scores on Nomad's benchmark leaderboard.
Dr. Jon Krohn999: What's Left to Build When Software Is Free (with Chip Huyen)
synopsis

Chip Huyen, author of Designing Machine Learning Systems and AI Engineering (which the host says was the most popular item on O'Reilly's platform last year), ends up arguing that as AI drives the cost of building software toward zero, the durable work lies in systems design, evaluation, people problems, human-AI interfaces, and the physical world. She has turned her own attention to physical AI, in work the host describes as in stealth.

Systems over skills. Huyen says she turned to system design around 2018–2019 after TensorFlow 2.0 forced her to redo about 80% of a course's tutorials, looking for knowledge that does not churn. Her GitHub notes became a Stanford course and then the first book, criticised at first for having no code. Her view is that narrower skills are easier to automate, so system thinking grows in value.

ML versus AI engineering. ML engineering meant collecting data and training models from scratch; AI engineering starts from a hosted model, so time to market is far faster. Real products mix both: her customer-support example uses classical classifiers to filter off-topic requests and route FAQ questions away from expensive models. She calls prompt writing and context and memory design central skills.

Start simple. She picks the simplest fix for each observed failure, partly so failures can be traced to a component. Prompting goes far, but long prompts with many authors accumulate contradictions; running her own prompt through a model exposed them, and a stray example about New York offices had skewed every research summary. Missing information is a main cause of hallucination, so documents and web search matter, but search is "painfully expensive": prediction-market agents cost her $1–2 per request, and one run hit about 1,000 URLs with only 20 unique. She says tool-use tokens, not reasoning, dominate agent costs. She is sceptical of fine-tuning, which is easy to do but hard to serve, and companies tell her new models outclass workarounds every two to three months; she no longer fine-tunes and uses AI mainly for labelling. Inference and feedback. For token costs, her lever is offloading suitable traffic to smaller models. User feedback, sliced by user, use case and location, reveals where to improve and feeds automated evaluation in production.

Evaluation. She promotes "evaluations-driven development" and asks whether no AI system is worse than one nobody knows is working, noting teams that claim savings they cannot measure. Writing LLM-as-judge guidelines is the hard part; one case study spent 80% of development time on it. Her test is for a human to grade examples using the guideline.

When building is free. Her GitHub-ranking micro-tool drew about 300,000 views in a week and an AI clone the next day; the host adds a Rust re-creation of the leaked Claude Code repo. The host relays METR data that Opus 4.6 handled about 8-hour tasks at 50% success and Mythos was placed at 16 hours, past METR's reliable tests. Huyen concludes software can be copied, so the open question is what to build.

Physical AI. She maps digital agents onto physical ones as perceive-act-feedback loops, but says the physical world lacks documentation: nothing specifies how much force breaks an egg. She splits robot intelligence, following Unitree's CEO, into reasoning, which AI is getting good at, and movement, where he expects arbitrary motion generation within 6 months. Problems that remain. Asked how people can future-proof careers, she names people problems no tool fixes, human-AI interfaces built on legacy tools like terminals, agents that need a laptop open, and an AI-ready world, from better APIs and permissions to city streetlight APIs for delivery robots. On AGI she notes Microsoft has reportedly invoked its contract's AGI clause with OpenAI.

  • Software is now nearly free to build, so value moves elsewhere. Huyen says the cost of building software is approaching zero but its value is not: a GitHub-crawling micro-tool she posted got about 300,000 views in a week and was cloned with AI the next day, showing anything that exists can be replicated. Her answer to "what's left" is people problems (she rejects a founder's pitch that an agent orchestration platform would fix product–engineering communication), human-AI interfaces that move past legacy terminals and IDEs, and making the world AI-ready, like cities exposing a streetlight API so delivery robots needn't ask pedestrians to press the button.
  • AI engineering treats models as a service, but systems design still decides results. She distinguishes ML engineering (collect data, train, deploy your own model) from AI engineering (start from a hosted model, so time to market is far faster), while saying real systems combine both, e.g. a customer-support bot using classical classifiers to filter irrelevant requests and route FAQ questions away from expensive models. She argues system thinking matters more as AI automates narrow skills, which she says is why Designing Machine Learning Systems has grown more relevant.
  • Start simple: fix the observed failure with the lightest technique. Huyen favours prompting, then context such as documents or web search, and treats fine-tuning as a last resort because serving and inference optimization are hard and companies tell her new models outclass old workarounds every two to three months. She says long, multi-author prompts accumulate contradictions nobody reads end to end, and found one stray New York example in her own prompt skewing every research summary toward New York offices.
  • Agent token bills are driven by tool use, not reasoning. She says prediction-market research agents cost her $1–2 per request, and one run visited about 1,000 URLs of which only 20 were unique because varied queries return the same pages. She says reasoning tokens are relatively cheap compared with web search, file search and productivity-app tool calls, and that some companies told her evaluation takes about 20% of their token costs.
  • Evaluation guidelines for LLM judges are the hard, human part. She advocates "evaluations-driven development", asking audiences whether having no AI system is worse than one nobody can tell is working, and cites a case study where 80% of development time went into writing LLM-as-judge guidelines. Her test is to have yourself or a coworker grade examples by the guideline, because a model follows instructions but not bad ones.
Y CombinatorStartup School is back!
  • Multiple founders credit Startup School with their decision to apply to YC. Several describe it as the pivotal event that gave them "the courage to apply," with one saying their company's entire trajectory would look different without having attended first.
  • Seeing peers their own age build companies made founding feel achievable. Attendees point to hearing speakers like Fei-Fei Li and John Jumper the prior year as what "ignited the passion" to start a company, rather than any specific technical lesson taught.
  • The event is framed as an unmatched concentration of ambitious, skilled people. Attendees describe it as selecting specifically for founders who are smart, ambitious and technically capable, with the shared room of similarly driven peers cited as what convinced several of them to commit to starting now rather than later.
Y CombinatorEmergent: How Six Months of Tinkering Led To A $100M ARR Company
synopsis

Mukund Jha, co-founder and CEO of Emergent, traces the company from the depressed aftermath of his previous startup's collapse to a nine-month-old business generating $100 million in annualized revenue, arguing throughout that unstructured tinkering and betting on where AI models are heading, not where they currently stand, explain the speed of the outcome.

Jha's prior company, Dunzo, had scaled to roughly a million delivery riders and 10 million monthly orders on $200 million-plus in funding before its 2023 collapse, which he says he initially caused by believing the company was "too big to fail." What followed was six months of what he calls pure, objective-free tinkering, up to twelve hours a day experimenting with new AI models, an escape from disappointment that also convinced him coding itself was about to be disrupted quickly.

Pitching that instinct to VCs went badly at first: roughly a dozen investors rejected the idea of automating software engineering, since AI copilots were the fashionable pitch of the moment and reviewers judged full automation unrealistic. Jha and his co-founder, his twin brother, responded by deliberately building toward an extrapolated, six-months-ahead version of what models would be capable of rather than their current state, for instance ignoring a JSON-output-parsing problem that roughly 20 to 30 other YC companies were separately trying to solve, betting the next model generation would simply fix it.

Lacking a settled product idea, the team spent three months chasing SWE-bench, the hardest available coding benchmark, partly as a way to stop the team from pivoting weekly; becoming the world's top-ranked system on it with four people became the technical base — parallelized test-time compute, cross-agent memory, custom container-snapshotting infrastructure — that the eventual product was built on. Jha says Emergent differentiates from earlier AI website builders by insisting on shipping real, working software with a genuine backend and database rather than front-end "demoware," a bet validated by outperforming competitors on head-to-head prompts.

He closes with advice for founders building from India: a global company is no harder to build than a local one given today's reach, so founders should think global from day one, trust their own intuition over conventional advice, and aim at ambitions ten to a hundred times bigger than their first instinct, since "it's not time to attack the floor, it's time to attack the ceiling."

  • Emergent reached $100M in annualized revenue nine months after launch. Mukund Jha, the company's co-founder and CEO, says the no-code app-builder lets anyone ship real, deployed software — including a working backend and database — just by chatting with an agent, unlike most competing tools he says only produce front-end "demoware."
  • Purposeless tinkering after his last company's collapse led directly to the idea. Jha says he spent up to twelve hours a day experimenting with new AI models with no business objective following the 2023 shutdown of his earlier startup Dunzo, and that period of pure curiosity generated the technical insight that coding itself was about to be disrupted.
  • Twelve VCs rejected the pitch to "automate software engineering." Jha says the team deliberately built toward where AI models were extrapolated to be in six months rather than where they currently stood — for instance skipping a JSON-output-parsing problem roughly 20 to 30 other YC companies were separately trying to solve, betting correctly that the next model generation would fix it.
  • The team chased the world's hardest coding benchmark before finding a product. Jha says he picked SWE-bench mainly to distract a frustrated team from pivoting every week, but becoming the world's top-ranked system on it with a four-person team became the technical foundation — including parallelized test-time compute and agent memory — that Emergent's product was later built on.
Scott HanselmanVibeOS - Fully Hallucinated Operating System
  • VibeOS apps contain no code; the model hallucinates their UI live. The unnamed presenter boots it from a 1.3 GB VHDX in Hyper-V (he says it would also boot on bare metal) and runs Notepad, Calculator and Internet Explorer with "no buttons, no event handlers, no logic" and no AI-written code either. Calculator answers 5 / 3 with 1.6.
  • Any application can be summoned on request. He generates an Encarta 98 entirely about Mark Russinovich, a file commander that is always rude, and a bash that says it has been offended; at the audience's request he adds Microsoft Money 95 with Hanselman's accounts, Paint with a drawing of Hanselman and a nested iOS simulator. The pitch is deadpan: in VibeOS nobody need ask whether content is AI, because the answer is always yes.
  • The presenter says it runs on the Copilot SDK. Asked to define hallucination, he starts showing the code behind it, but the captions end mid-sentence before he explains how it works.
Y CombinatorWe just launched Paxel!
  • Paxel analyzes a builder's own coding transcripts to profile how they work. It scores users across five dimensions — steering, execution, engineering, product instinct and planning — surfacing patterns like their most-used prompt or how many agents they run in parallel, framed as "a mirror, not a grade."
  • All analysis runs locally, so a user's code never leaves their machine. The tool is described as a single command that takes 15 to 30 minutes to run before emailing the resulting builder profile, positioned as a way to surface skilled builders that a traditional resume would never reveal.
  • YC invites Startup School applicants to submit their Paxel results. The team frames this as a way to see "how you build, not just what you wrote," telling applicants who already submitted to go back and add their token, and stating it can only help, never hurt, an application.
Dr. Jon Krohn998: In Case You Missed It in May 2026 — with @JonKrohnLearns
  • Machine-speed exploitation means defenders must assume breach and plan recovery. In the episode 989 clip, a Rubrik guest calls Claude Mythos Preview (announced April 7th) the most visible point on a curve Rubrik was already planning for, since Opus can find vulnerabilities with more hand-holding while Mythos finds them when simply pointed at a repository. The guest argues attackers no longer sit in a system for weeks before striking, so prevention and detection are no longer enough and the priority becomes restoring applications, data, identity and infrastructure quickly; the host relays Anthropic's estimate that Mythos-class capability reaches other labs within 6 to 18 months, open weights to follow.
  • Agents create exposure without any attacker involved. The Rubrik guests argue top-down AI adoption is widening the attack surface while trust infrastructure lags: agents are outcome-focused and skip rules employees learn, and their exhaustive search of every permission ends the "security through obscurity" that cyber controls were built around. Their examples are code posted to the wrong repository and salaries leaked internally once agents connect to compensation systems, and they argue a fault deep in a 20-step agent run has to be caught while it runs, not afterwards.
  • Notebooks are becoming shared working memory between analyst and agent. In the episode 991 clip, the guest describes the Marimo pair skill, which lets Claude Code, Codex or Open Code start or connect to a Marimo notebook and drive it while the user edits cells by hand; the agent can read kernel state, see cells and screenshot them, so context once trapped in the notebook becomes available to it. He says streaming the user's edits back to the agent is still being worked on, possibly via an MCP feature, and that the setup makes exploratory checks cheap enough to run on a whim.
  • Domain foundation models are mostly a data-curation job. In the episode 995 clip, Henry describes four stages: curation (six months so far, with subject-matter experts linking terms scattered across thousand-page technical texts into a graph database), bespoke tokenizers and embeddings so oil-and-gas documents chunk and OCR without falling back to costly vision models, continued pre-training of open models plus reinforcement learning in physics environments rather than teaching physics directly, and inference. She says reinforcement-learning-trained models are bursty to serve, which drives the compute needed to hold 99.9% uptime under SLAs, and jokes her company is as much a data company as an AI company.
  • Instant prototypes make failing slowly the costliest AI mistake. In the episode 993 clip, the authors of Architected Intelligence argue that because a text-to-SQL demo can look impressive within a day, a project must prove value on day one or be thrown out, citing AWS's rebuild of its AI stack as Project Mantle by six engineers over two or three months. They add that once building stops being the bottleneck, definition and feedback become the crucial steps, and narrow lanes of two or three owners make it safer to fail repeatedly.
Crosstalk SolutionsHow Long Will a $199 Power Station Run a Home Server?
  • A small solar panel can cover a Nomad server's normal load. The host, building a Pelican-case Nomad deck around an EcoFlow River 2 he bought himself (not sponsored), gives it about 256 Wh for about $199, or $367 with a 110 W solar panel. In good sun the panel charged it at about 77 W, while his Minisforum server draws almost nothing idle and 30–50 W for ordinary computing.
  • AI processing is what drains the battery. The server jumps to about 85–90 W during local AI work, above the panel's measured charging rate, which the host says is where the battery starts to drop noticeably. He gives no measured runtime.
Y CombinatorConductor CEO Charlie Holtz Walks Us Through His AI Coding Setup
  • He no longer writes code, only orchestrates agents. Charlie Holtz, co-founder of Conductor, says he manages multiple parallel coding-agent workspaces by voice, kicking off tasks with a gooseneck microphone and reviewing PRs rather than editing files himself; a manual-edit mode exists but is called "caveman mode" for how rarely it's used.
  • Deliberate "slop-free zones" stop AI from architecting the product. Conductor keeps parts of the codebase and docs, plus UI and interface decisions, off-limits to AI contribution and human-reviewed line by line, because he argues unattended AI code can spiral into a vicious cycle where bad code begets more bad code.
  • He spent $22,000 on tokens in a single month building Conductor, in July 2025, on a prior model generation, and now advocates "token maxing" — fast mode, high reasoning effort — while deliberately keeping lines of code minimal, since an established codebase can spiral out of control if line growth isn't controlled.
  • Code is becoming disposable; the prompt is the real asset. He argues code is now "sawdust" left over from describing what you want, so when new models ship you can simply rerun the same prompts to regenerate better code, likening this "malleable software" to modding a video game around a fixed core structure.
Network ChuckHermes has a Home Assistant skill and it's unreal!
  • Hermes ships a Home Assistant skill, but it needs switching on. Chuck thinks it is disabled by default; he had Hermes enable it, then gave it his Home Assistant instance's IP address and key, and it worked out the setup and saved it to its memory.
  • Once connected, it controlled Chuck's studio from plain requests. In his own test it turned off a named lamp ("Chuck Lamp") on request, then operated the studio's automatic blinds, which he filmed to confirm.
GCastUsing Copilot Prompt Files in Visual Studio Code [GCast 217]
  • A prompt file is a Markdown prompt template run by a slash shortcut. Instead of writing out a whole prompt, you type the shortcut and it expands into the prompt, with optional parameters for the words that change each run. Giard says this suits prompts run repeatedly, especially ones slow to compose or type.
  • A plain prompt works once but must be edited every month. His use case is a social-media planning file: a prompt told Copilot to add text to social media.txt, repeating a template (a "July DD" date, an "I am grateful for" line with #gratitude, and #songoftheday) 31 times with DD replaced by a sequential number. It produced the entries in about 30 seconds, but each month he would have to change the month name and the day count by hand.
  • Typing /prompts and choosing "new prompt file" creates the template. The default location is the .github/prompts folder, which VS Code creates if missing; the file is the prompt's name followed by .prompt.md (his is add-dates.prompt.md), with a name and description at the top and the prompt below.
  • Parameters are dollar-sign input placeholders, each with a name and description. He replaced "31 times" with a number-of-days-in-the-month input and "July" with a month-name input. Running /add-dates then asked for each value in turn (July, 31) and produced July 1 through July 31 as before.
  • Editing the Markdown file changes every future run. He added a joke-of-the-day line to the template and ran /add-dates for September, chosen because it has 30 days; the output used September, included the new line, and stopped at 30 entries, showing the parameters are dynamic.
Scott HanselmanScott & Mark Learn To...Double-Check References
  • One speaker rejects the claim that people won't need to read code. They say they "micromanage because I'm sculpting": nothing can be specified fully enough for AI to reproduce everything they meant implicitly. The other replies that a full specification would just be a programming language; the first cites a ZoomIt video trimmer, where they only knew what they wanted after rejecting what the AI first made.
  • Early-career developers get worse results by leaving gaps to chance. The other says dictation gives them a boost through more words, context and specificity, while early-career people leave "so many things up to the dice roll". The clip ends on the question of why anyone would then spend four years at college; it does not touch on checking references, the subject of the full episode with this title.
Scott HanselmanScott & Mark Learn To...Double-Check References
synopsis

Mark uses the episode to announce Ref Checker results: hallucinated references are endemic in AI research papers, and he expects a refined scan to find more. Hanselman and Mark then argue over where AI help becomes surrender, ending on the view that AI is a tool for experts that harms novices slowly.

The scan. Mark says Ref Checker scanned the 5,300 ICLR papers and found hundreds of hallucinated references. He disclosed the 12 papers with five or more to the program chairs. Of 10 replies, nine admitted fault and one withdrew; one claimed unpublished sources it could not show, another called five an arbitrary threshold, and a young lab asked for silence. He is publishing anonymous statistics only, and ICLR has not said what it will do.

Cognitive surrender. Hanselman raises "system three" thinking; Mark names it "cognitive surrender". Hanselman's analogy is a forklift sent to the gym to lift your weights, though he defends low friction as a way to test ideas.

Tiny Tool Town. A count bug on Hanselman's tool site becomes a test case: Mark asks provocatively whether AI should have known, then agrees it cannot know unstated requirements.

Writing with AI. Mark has Copilot draft over half of his LinkedIn posts from his bullets, unnoticed by Hanselman. They settle on a lathe as the analogy for a tool that only an expert can use well.

  • Mark's Ref Checker found hallucinated references across a top AI conference. He says it scanned the 5,300 ICLR papers and found hundreds of hallucinated references, and that he disclosed the 12 papers with five or more to the program chairs; he expects more after refining the flagging. He says a company had already sampled 300 submissions in December and found several dozen, after which ICLR desk-rejected papers, yet the practice continues.
  • Most flagged authors admitted fault; some argued or asked for silence. Of 10 responses, nine admitted error (AI formatting the bibliography, a student compiling it) and said they would notify ICLR, and one withdrew its paper. One claimed the references were unpublished but could point to no pre-publication copy; another argued five was arbitrary since it was 4% of their references; a young lab asked not to be named, and Mark is publishing only anonymous statistics.
  • Hanselman likens leaning on AI to sending a forklift to the gym. When he raises "system three" thinking, Mark names the paper's term, "cognitive surrender". Hanselman says he feels it in his vibe-coded Windows tools, yet argues against a LinkedIn critic that less friction lets him find out whether an idea has legs.
  • An AI cannot infer requirements nobody gave it. A count bug on Hanselman's Tiny Tool Town (13 of 316 tools) prompts Mark, playing provocateur, to ask whether AI should have known; Mark concludes it can't, and Hanselman says a model that already knew every answer would leave the web stuck where it is. The site itself is static, taking submissions through GitHub issue forms triaged by an agentic workflow that acts alone only at 90% confidence.
  • Mark uses AI to write prose from his own bullets. He says Copilot writes well over half of his LinkedIn posts from points he sets out in order, which Hanselman had not noticed; Hanselman asks whether he has any reason to be offended if he can't tell. Mark had asked Hanselman for an analogy of a tool useful only to an expert and they settled on a lathe, agreeing the harm from AI is slower than a lost finger: "a slow rot" of the brain.
Y CombinatorHow to Build an AI-Native Services Company
  • The best AI-services markets share four specific traits. The speaker, presenting a YC playbook, argues founders should target work that is already outsourced (low trust), breakable into automatable steps (low judgment at the task level), genuinely hard (a high intelligence threshold), and regulated — since regulation raises the bar and the moat rather than just adding friction; examples cited include tax, audit, insurance, mortgages and healthcare.
  • Founding teams need domain fluency, model fluency, and operational rigor — the product is the operation. He points to General Legal Team, an AI-native law firm YC backed, whose founders combine law-firm experience at Cooley and Fenwick with technical leadership from CaseText and have built shift-based staffing to cut cycle times, calling variance in output the "existential problem" that causes customers to fire a vendor faster than slowness or price ever would.
  • New AI-services founders should deliberately cap their first pilot customers. He warns of an "early demand trap" where easy early sign-ups overwhelm delivery capacity before the product can scale, and advises pricing on outcomes or per-unit (per return, per claim, per loan) rather than cost-plus or straight-line undercutting, since services compete against the cost of labor, not other software.
  • The core financial bet is "AI operating leverage" pushing services margins toward software's. He argues traditional services firms cap out near 30% margins while AI-driven ones can approach 50%+ as the product lowers cost of goods sold (models, hosting, humans), on markets two to three times bigger than software's; he also argues buying an existing services business to bolt AI onto rarely works, since legacy hiring and performance expectations don't change with it.
Technology and FriendsPeter Laudati on The Eat Jersey Challenge [EPISODE 906 ]
synopsis

Laudati, a Microsoft solution specialist, ends up arguing that AI works best for him as a builder of deterministic tools, not a generator of content. GitHub Copilot built the map site for his food challenge without his writing a line of code, and it is now building the command-line tools he hopes will clear his video backlog. He says it got there only because he prompted with a programmer's precision.

The challenge. He and his wife, empty nesters, are eating in all 564 New Jersey towns, an idea borrowed from a former coworker doing Massachusetts' 351. About three years in, they have eaten in 287 towns, 87 of them before the challenge started. Friends pushed them to go public about a year ago. One early reel reached about 70,000 views when they had 50 followers, and they now have about 20,000 across Facebook and Instagram.

The map site. Commenters kept asking "come to my town", so he wanted a clickable map. In two or three hours with Copilot, using Claude, he went from plan mode to a static React site on GitHub Pages, with a mapping library he believes is Leaflet. Copilot made four or five tries before it found a source of town boundary polygons. He rejected its suggestion of Cosmos DB in favour of a JSON file. Unprompted, it shrank the logo, which it named as the page's biggest performance cost. He says it fought the CSS by trial and error, just as he would have.

Specificity as the skill. Laudati calls natural language "the ultimate programming abstraction", but says results go off the rails without precise prompts. His example is the script that converts his Excel tracking sheet to JSON, run by a GitHub Action whenever he pushes the sheet.

The video backlog. Each 60–90 second video takes 10–12 hours, and about 150 towns are still unpublished. Early AI images drew criticism, so he cut back. He gave Copilot a three-page write-up of his editing steps and got a 10-phase plan back. One of the seven tools he has scaffolded so far now generates each opening map animation in 15–20 seconds, and he has published the tools on GitHub.

  • The goal is a meal in every town in the state. Laudati and his wife are eating their way through New Jersey, which has 564 official towns, against Massachusetts' 351, where a former coworker, Chris Bowen, and his wife started the idea. About three years in, they have eaten in 287 towns, including 87 visited before the challenge began. Some towns have no restaurant at all, and one is only a members-only golf course with about six homes.
  • Video editing, not visiting, is the bottleneck. Each 60–90 second video takes him 10–12 hours, so he averages about one a month. Post 129 was the latest, with roughly 150 towns still unpublished; Giard calculates one a month would take 48 years. Since going public about a year ago, one early video drew about 70,000 views when they had 50 followers. They now have about 20,000 followers across Facebook and Instagram, and town videos usually reach around 100,000 views.
  • An AI coding agent built the interactive map; he wrote no code. Laudati says it took two or three hours on a Friday night with GitHub Copilot, using Claude, starting in plan mode, where he rejected technologies he did not want. The result is a static React site on GitHub Pages using a mapping library he believes is Leaflet. Copilot made four or five tries before finding a source for town boundary polygons. He overrode its suggestion of Cosmos DB, which he says is expensive, in favour of a JSON file, and unprompted it flagged the oversized logo as the page's biggest performance cost.
  • Natural language is the newest abstraction, but it needs programmer-level specificity. Laudati argues English has become "the ultimate programming abstraction" over machine code. He says results go "off the rails" unless prompts are precise. His example is the AI-built script that turns his long-kept Excel tracking sheet into the site's JSON, run by a GitHub Action whenever he pushes the sheet.
  • AI should build deterministic tools, not generate the content. AI-generated images in early videos drew criticism from artistic commenters, so he cut back; he says 95% of what they publish is him talking over their own photos and footage. He fed a three-page write-up of his manual editing steps to Copilot, which produced a 10-phase plan. Of the seven tools he has scaffolded, the finished one is a command-line map-animation generator that makes each opening zoom in 15–20 seconds and can batch all 564 towns. He says the tools are on GitHub under what he thinks is the MIT license.
Crosstalk SolutionsWhat the heck even is this thing??
  • The Comet Q is a USB-C KVM powered by its target. The host shows the GL.iNet Comet Q KVM controlling a Linux mini PC, an iPad and an Android device; it joins local Wi-Fi, serves a browser interface, and supports Tailscale or ZeroTier for remote access. A second USB-C port passes power through to the controlled device.
  • It is crowdfunding on Kickstarter at an early-bird price. It starts at $69 on the super-early-bird tier; the host gives no other pricing or shipping date.
Dr. Jon KrohnHow This Text-to-Video-Game AI Startup Hit 20M Users (Ep. 997 with Andrey Kurenkov)
synopsis

Andrey Kurenkov, founding AI lead at Astrocade and co-host of the Last Week in AI podcast, returns (after episode 799) to argue that Astrocade's growth to over 20 million engaged users came from treating AI as the tool behind a creator platform rather than as the product. His wider position is a middle one: humanoid robots are advancing faster than he expected, but he doubts artificial superintelligence and thinks the mundane harms and benefits of AI deserve more attention than the extremes.

The platform. Astrocade is a "TikTok of games": users vibe-code casual mobile games, publish them and play others' games, all free for now, with tokens funded by venture money (the host says $68 million raised, announced jointly as a Series A from about a year earlier and a recent Series B; he names Sequoia, Nvidia, Google and Garena among investors). Kurenkov says growth has come in the last 6–8 months, some games have millions of plays, and AI does the code and assets but a creator's vision still takes real work.

Building it. He joined in April 2023 after a Stanford PhD in machine learning and robotics, when LLMs could write small functions but not working games; his title moved from ML scientist to founding AI lead because the work became prompting, context engineering and systems. The company moved to Claude Code around June 2025. He says there is no secret sauce, only how agent, tools and LLM are combined, which is hard to benchmark when one request has a million valid answers. His main lesson is that scaffolding built for weaker 2023–2024 models became a constraint once vibe coding worked, so systems must survive model upgrades every few months.

Why B2C. On the host's quoting of his earlier view that B2C is ill-advised, Kurenkov says it took over 2 years to pay off but is the only path to hundreds of millions of users. He agrees with the host's quote from Sequoia's David Cahn that many users are women aged 20 to 40, attributing it to casual mobile gaming's existing audience. The moat, he says, is creators: a Discord of about 50,000, a $10 million programme paying creators per play, the cohort-based Astro Academy entering its third season, and followings for prolific creators.

Recommendations and the AI-as-product question. Recommending games is harder than video because play time lacks an end point and small mechanical changes alter appeal. Pressed on his old claim that AI rarely works as a product, he says Astrocade's product is games, most users only play, and Harvey shows domain value on top of foundation models even as Anthropic launches Claude for legal.

Last Week in AI. Started in March 2020, the show now runs over 300 episodes at about 2 hours each; he says its focus has shifted toward tools everyday people use, such as ChatGPT and Claude updates.

Robots, risk and AGI. He now puts capable household chore robots at two to three years rather than a decade, citing 1X, Figure and vision-language-action models, with cost (he offers $50,000) the next barrier. He calls himself an ASI sceptic because physical limits and the need for experiments constrain discovery, names AI-powered scamming and chatbot dependence as real present risks, and says AGI lacks any working definition; his own view is that it is a spectrum of generality that arguably arrived with or before GPT-3.

  • Astrocade's product is the games platform, not the AI. Kurenkov, founding AI lead at Astrocade (which the host says has raised $68 million), describes it as a "TikTok of games" where anyone vibe-codes, publishes and plays casual mobile games free, with tokens currently paid from VC money. He says it has over 20 million engaged users after growth in the last 6–8 months, that only a small share of users make games, and that this is why it fits his earlier view that AI works as a feature rather than a product, unlike chatbot wrappers; he cites Harvey as a domain-specific success despite Anthropic launching Claude for legal.
  • There is no secret sauce, only how the standard parts are mixed. He says the stack is an agent, tools and an LLM, and the hard part is benchmarking harness and prompts when a request like a Tetris-merge-puzzle game has countless valid answers. His hard-won lesson is that scaffolding built in 2023–2024, before models could write whole games, became a limit once vibe coding worked in 2025, so systems must be built not to date when models improve every few months; Astrocade adopted Claude Code company-wide around June 2025.
  • Consumer and user-generated content are harder but the moat is creators. He says B2C took over 2 years to pay off but is the only route to Instagram-scale hundreds of millions of users, and that the lasting moat is a skilled creator community (a Discord of about 50,000) supported by a $10 million fund paying creators per play, the Astro Academy cohort course, and follower graphs. He agrees with Sequoia's David Cahn, as quoted by the host, that many users are women aged 20 to 40, saying that reflects existing casual mobile gaming.
  • Recommending games is harder than recommending video. Games often have no end point, so a minute of play may mean enjoyment or confusion, unlike a TikTok watched past 10 seconds; and small mechanical tweaks change whether someone likes a game, so genre is a weak similarity signal. He says existing recommender work largely does not cover this domain.
  • Household chore robots are arriving far sooner than he expected. Kurenkov says humanoid startups such as 1X and Figure, applying LLM methods via vision-language-action models, have progressed more than he expected, cutting his estimate from a decade two years ago, though he adds demos deserve scepticism and a $50,000 dishwashing robot may not make economic sense. He calls himself an artificial-superintelligence sceptic because physics, computation and the need for experiments limit what AI can solve, says AI-powered scamming is among today's most harmful real risks, and argues AGI should be treated as a spectrum of generality that arguably began before GPT-3.
Dr. Jon KrohnHow African American Vernacular English Reveals What's Missing in AI (with Jazmia Henry)
  • She shelved her AAVE corpus because communities should own their language. She began the dataset from an undergraduate thesis arguing that African American Vernacular English is a tie binding African languages and English, and worked on it at Stanford, but stopped after a peer who worked on the since-removed AfroBERT model argued that giving powerful institutions the ability to mimic a group's language can be used against people who already feel unsafe. Her position is that she, as a self-described "guest in an AAVE home", can provide the bridge, while an AAVE language bot should be built by people of that community (she names American descendants of slaves) if they choose, and some have contacted her about doing so.
Dr. Jon KrohnMore Data Can Make AI Dumber! A Surprising NeurIPS Paper (with Jazmia Henry)
  • Scaling has diminishing returns once the added data is bad. Henry describes her 2023 NeurIPS work (accepted to a workshop, which she calls a top 5% paper) as a challenge to the Kaplan et al. scaling idea from OpenAI that adding data, compute and parameters extends capability indefinitely. She borrows the economics of diminishing returns, likening it to a government printing money until it loses value.
  • Undeduplicated data makes models forgetful and prone to overfitting. She argues that the largest training sets are so big they are nearly impossible to deduplicate, and that this makes models more forgetful, less intelligent and more overfit over time.- You can't compute your way out of bad data. In her account, a machine with 10,000 GPU clusters trained on bad data will do worse than less compute on less but better-quality data. She says the field is now coming round to this, pointing to 70 billion or 120 billion parameter models that consistently outperform models of one trillion parameters or more.
Dr. Jon KrohnHow Monte Carlo Simulations Fix AI Evaluation (with Jazmia Henry)
  • Waiting for a checkpoint to evaluate a model wastes too much time. Henry says that knowing whether a training run is working takes anywhere from 2 hours for a quick, small-model experiment to days for a large one. A big company like Microsoft could absorb that time and compute, but a startup with a demo due by Friday cannot.
  • Monte Carlo simulation on early reward trajectories predicts checkpoint performance. Henry's approach, part of her company's RIGS petroleum-engineering foundation models, takes the reward computed during reinforcement learning (about an hour in) and runs Monte Carlo simulations to forecast where the model will be at the checkpoint. That lets her kill a run heading the wrong way, and run several ablation variants at once (say, weighting data towards equations or towards oil and gas) and keep the winner.
  • A gap between forecast and checkpoint result exposes reward hacking. Models learn the least they must do to get a good reward. Her example is guessing the five most common equations to score on retrieval at three and five, which collapses once more equations are added. If the simulation predicts a weak result but the checkpoint looks excellent, she takes that as a sign of reward hacking.
  • Exam-style evals miss how users actually ask questions. The model may do well on petroleum engineering exam questions (hydrostatic pressure for a given well and tool), but real users say "tell me about this well" or just "decline curve". Henry says she injects such questions into the training environment mid-run so she can adjust before the run ends. The host attributes the framing of four systematic failures that make current evaluation of agentic systems inadequate to a paper she recently released.
Y CombinatorWhy Two IIT Engineers Turned Down $550K Jobs To Build A Startup
synopsis

Varun co-founded GigaML after turning down a quant-firm job offer; the company now runs AI customer-support agents for DoorDash, a top crypto exchange, and top telecom providers, pushing deflection rates it says can reach 90-95%, with a next product aimed at replacing the "forward deployed engineer" role in enterprise AI.

From EdTech rejection to a forced pivot. Varun and his IIT co-founder applied to YC with an LLM-based EdTech idea while he held a Stanford PhD offer. Harj Taggar dismissed the idea, telling them to use their LLM research on something else — advice Varun says left him panicked, sure the interview had gone badly. After talks with EdTech operators confirmed it was weak, they pivoted within a month.

A false start in fine-tuning, then a customer-driven pivot. They built an open-source fine-tuning product, topped Hugging Face benchmarks, and raised a $4 million seed — but concluded fine-tuning was a poor market, useful mainly for cost or for security buyers hard to sell to as engineers. Watching which use cases grew fastest among users, they saw support and coding leading, and pivoted; Zepto became their first customer.

Winning against scale. Unaware of well-funded rivals like Sierra, GigaML's eight-person team beat a roughly 400-person competitor for DoorDash's contract, aided by a YC introduction and a flawless three-month pilot. Varun reads this as proof product quality beats a sales team — a lesson reinforced by AI engineering leverage that he says lets GigaML run with a fraction of the staff a comparable company once needed.

  • YC's Harj rejected their EdTech idea, not their candidacy, and bet on the founders instead. Varun, GigaML's co-founder, says Harj told them "you guys are really good engineers, pick something else" without asking about their idea or traction, pushing them to abandon EdTech and pivot within a month of starting the batch based on their LLM research background rather than a specific pitch.
  • A GitHub usage pattern, not a market thesis, drove the pivot into customer support. After their initial fine-tuning product proved a bad market — good only for cutting inference cost or serving security-sensitive buyers that are hard for engineers to sell to — Varun says they noticed customer support and coding were the two use cases growing fastest among their fine-tuning customers, and Zepto became their first customer once they switched.
  • An eight-person team beat a roughly 400-person, well-funded rival for DoorDash's contract. Varun credits a YC-network "unfair advantage" (an introduction from Garry Tan) and a clean three-month pilot with no downtime, and says winning DoorDash proved to him that building a superior product beats building a sales team — a lesson he calls an "arbitrage" most competitors were missing.
  • Coding agents let GigaML run with roughly one-seventh the engineers it would otherwise need. Varun estimates the company would need six to seven times its current engineering headcount without tools like Claude Code, and says the deeper benefit is avoiding context-switching and context transfer between people, not just cost; the company's interview process still has candidates write code with AI, then edit it without AI, to confirm they understand it.
Dr. Jon KrohnTrueFoundry’s Nikunj Bajaj on How to Get $100M Returns on AI Agent Deployments (Ep. 996)
synopsis

Bajaj, CEO and co-founder of TrueFoundry, argues that enterprises get large returns from agents by routing every model, tool and agent call through one governed gateway, and by starting with a business-critical workflow rather than many small ones. He says customers who did this now run agents worth hundreds of millions of dollars.

The control plane. Bajaj says customers moved from prototypes to production agents and found they needed a layer between applications and the model and infrastructure layer to connect, observe and govern. Many first built a thin LLM proxy in-house, then found they also needed observability, governance and a policy engine as teams multiplied and MCP, A2A and new agent tools arrived. He credits a mid-sized startup's position for closing the feedback loop fast. A smaller company lacks customer data points, and at a larger one the product decision-makers are far from customers. The host cites a trillion tokens a day of usage and Nvidia and Siemens as clients.

Three gateways. An agent needs models, an environment (tools, data, skills) and other agents, so TrueFoundry's AI gateway has a model gateway, an MCP or "environment" gateway, and an agent gateway. Through the model gateway, developers never hold raw API keys. Organizations set rate limits and budgets (his examples: 100 calls an hour, $2,000 a day for a dev environment), fallbacks across regions, PII and prompt-injection guardrails, and full traces. MCP is harder because each server has its own authentication and exposes write access to data such as Slack and Gmail. He describes building a virtual server of whitelisted read-only tools from seven servers for an agent outside users can reach. Tool sprawl breaks nothing in theory, he says; it makes access and debugging hard. Described tool groups let models select tools at runtime. The agent gateway is "the hard part": he says most of the industry cannot stop a misbehaving agent, and agents now come from sales, ITSM and pro-code platforms that all need one governance layer and a kill switch.

Start big. Bajaj's five-workflow framework is his hot take against starting small, which he says yields 500 low-value agents that justify no governance plumbing. Pick one or two of the five most critical workflows instead, build the plumbing, then let teams build the rest. He says customers who did so have run agents for a year and a half and now see individual agents create dozens to hundreds of millions of dollars in value. The host, who usually advises starting small, says he knows of no agents at that scale.

  • Production agents need a control plane between apps and infrastructure. Bajaj says TrueFoundry, which the host says has raised over twenty million dollars, sits between the application layer and the model and infrastructure layer so one place can connect, observe and govern. He says enterprises first treated this as a thin LLM proxy they could build in-house. Moving agents to production showed they also needed observability, governance and a policy engine across many teams and cost centres. The host's research puts usage at a trillion tokens a day, which Bajaj accepts as "a big number", and names Nvidia and Siemens as clients.
  • A model gateway centralizes keys, limits, fallbacks and guardrails. Developers get access to the gateway rather than direct API keys. Bajaj says the organization can set rate limits (100 calls an hour), budgets (no dev environment over $2,000 a day), regional fallback if an OpenAI region is slow, PII guardrails and prompt-injection blocking, with a full trace of every call.
  • MCP gateways must map identities across each tool's own authentication. Unlike a model's single API key, MCP servers expose sensitive read-write data (Slack, Gmail), and each implements its own auth. His example is an agent reachable by outside consumers getting only whitelisted read-only tools from seven servers, exposed as one virtual server. Bajaj says tool sprawl breaks nothing in theory; the cost is in debugging and access management. Where needed tools aren't known ahead of time, tool groups carry descriptions so the model can pick them at runtime.
  • Most enterprises have no kill switch for their agents. Bajaj calls the agent gateway "the hard part". Agents take actions, and at best companies can observe them but not stop them. Agents are now built across sales, ITSM and pro-code platforms, and he says the next gateway must put all of them behind one governance layer.
  • Start with a few big agent workflows, not many small ones. Bajaj's "five workflow framework" says starting small leaves 500 low-value agents, none worth building governance plumbing for. Instead he advises picking one or two of the five business-critical workflows, building the plumbing for them, then scaling. He says customers who did this have run such agents for a year and a half and confirms, when the host asks, that individual agents create value in the hundreds of millions of dollars.
Crosstalk SolutionsReal World Point to Point Setup Review – What They Did Right (and Wrong)
  • A beach club's Ubiquiti point-to-point network is laid out sensibly. The host reads one antenna as a wireless ISP feed, with a newer pill-shaped NanoStation below it, and NanoBeam and NanoStation links fanning out to outbuildings; he singles out a single-gang wall-mount enclosure with a pole for the NanoBeam as a clean mount.
  • Indoor-rated gear is used outdoors, which the host would avoid. He spots an indoor antenna and a non-outdoor camera on the site, the antenna sheltered under a roof; he guesses an old NanoStation M5 was left in place beside its replacement. He would not have used the indoor gear outdoors himself, but calls the install a nice job overall.
Y CombinatorInference, Diffusion, World Models, and More | YC Paper Club
synopsis

The inaugural YC Paper Club gathers around a hundred founders and researchers at YC's Pioneer space, and across five presentations the through-line is that classical ideas — speculation, factorized control, joint-embedding prediction, PAC-Bayes theory, regularization and ensembling — keep unlocking new capability once revisited at modern model scale, rather than requiring entirely new techniques.

Speculative speculative decoding. Stanford's Tanishk opens by reframing inference: rather than a cost or convenience factor, he argues that once a system's performance scales with how much it "thinks," tokens-per-second becomes the ceiling on delivered intelligence. Ordinary speculative decoding uses a small draft model to guess tokens that a large target model then verifies, but drafting and verification are sequentially dependent. His method predicts likely verification outcomes ahead of time, letting the next draft round start while the previous one is still being verified — hitting roughly 80-90% prediction accuracy and improving both latency and throughput sampling Llama 3 70B on four H100s.

Diffusion Model Predictive Control. Google DeepMind's Stannis, now leading a robotics world-modeling project, presents earlier work using diffusion models for both multi-step action proposals and multi-step dynamics models, factorized so they can be adapted independently. This lets a simulated agent adapt to novel reward functions or changed dynamics — such as a walker with a broken ankle — by re-adapting only the dynamics model, recovering most performance without retraining the action proposal, and it simplifies the planning algorithm to a simple sampler.

LeJEPA and the case for world models. Isaac Ward, from Yann LeCun's group, ties his talk to LeCun's reported $1.03 billion raise aimed largely at training world models. He presents LeJEPA, a joint-embedding predictive architecture that adds a single new regularization term ("SIGReg," enforcing Gaussian-distributed latent embeddings) to prevent the representational collapse that other world-model approaches fight with more complex tricks. He reports it runs about 50 times faster than competing world models, fits on a single GPU under 24GB of memory with only 15 million parameters, and — unlike model-free policies — can flag its own prediction error when conditions shift unexpectedly.

Why deep learning generalizes. QLabs' Ashe presents Andrew Gordon Wilson's argument that supposed mysteries of deep learning — overparameterization improving generalization, and "benign overfitting" where networks fit random noise yet still generalize on structured data — are largely explained by classical PAC-Bayes theory once compression is computed correctly. Larger models find more compressible, flatter minima, which tightens generalization bounds even at billion-parameter scale; the paper's implication is that better inductive biases, not new theory, are the lever for future sample efficiency.

Scaling laws when data, not compute, is the constraint. Closing the session, Ku presents work asking how to pre-train when compute is abundant but data is fixed — a regime he argues is approaching as internet text grows roughly 3% a year against 4-5x annual compute growth. Aggressive regularization and ensembling each produce clean power-law scaling with a measurable best-possible-loss asymptote, and combining them yields roughly a 5x data-efficiency win over standard recipes. He shows these gains survive compression: distilling an eight-model, 2.4-billion-parameter ensemble into one 300-million-parameter model retains about 83% of the improvement, and the same approach yields a roughly 17x data-efficiency win in a continued-pretraining setting constrained to math tokens.

  • Inference speed will become a capability ceiling, not just a cost lever. Presenting his "speculative speculative decoding" work, Stanford grad student Tanishk argues that once performance scales with amount of thinking, tokens-per-second is peak intelligence delivered; his method parallelizes normally-sequential drafting and verification by predicting verification outcomes about 80-90% of the time, winning on both latency and throughput sampling Llama 3 70B on 4 H100s.
  • Factoring the action proposal from the dynamics model lets a robot policy adapt at runtime. Google DeepMind's Stannis presents Diffusion Model Predictive Control, where multi-step diffusion models for action proposals and dynamics reduce compounding errors and simplify planning; he shows a simulated walker with a broken ankle recovers most of its performance just by re-adapting the dynamics model, without retraining the action proposal.
  • A single new regularizer lets a world model avoid representational collapse with one hyperparameter. Isaac Ward, from Yann LeCun's group (whose $1.03 billion raise centers on world models), presents "LeJEPA," which adds a "SIGReg" term enforcing Gaussian-distributed latent embeddings; he reports it runs roughly 50 times faster than competing world models on a single GPU under 24GB of memory with just 15 million parameters, and can flag its own prediction errors when conditions shift.
  • Ensembling and distillation, not bigger single models, are the efficient path when data — not compute — is the constraint. Presenting a paper co-led with Suhas and Percy Liang plus another collaborator, Ku shows that regularized and ensembled pre-training recipes follow clean power laws with measurable best-possible-loss asymptotes; a joint recipe yields roughly a 5x data-efficiency win, and distilling an eight-model, 2.4-billion-parameter ensemble into one 300-million-parameter model retains about 83% of the gain.
Dr. Jon KrohnWhat It Actually Takes to Build a Foundation Model From Scratch (with Jazmia Henry)
  • Data curation is the unloved stage that dominates the work. Henry calls it the step everybody hates and says her team has spent the past 6 months on data curation alone, with dedicated staff. A thousand-page textbook may introduce a topic in chapter 1 and return to it in chapters 5 and 20, so subject matter experts help attach terms correctly in a graph database. She jokes that her company is as much a data company as an AI company, and the host ties this to the main point of episode 993 with Jacob Miller and Jeremy Mumford.
  • Custom tokenizers and embeddings avoid expensive vision models for documents. She describes building bespoke tokenizers and embedding models on top of them. These let drilling documents be chunked and OCR'd at the text level, rather than drawing bounding boxes with a costlier vision model.
  • Physics belongs in RL environments, not in model weights. Model building combines continued pre-training of open-source models on oil and gas (chosen after constant benchmarking against open and API models) with reinforcement learning. Teaching a small model physics directly makes it overfit to physics, she says. Instead, fixed physical rules sit inside an environment where the model writes Python in a REPL.
  • How a model is trained dictates how it must be served. Henry says reinforcement-learning models are bursty, so meeting 99.9% uptime under SLAs requires a large, costly inference cluster. She calls inference the stage she finds most exciting and most people find least interesting.
Y CombinatorInside YC's AI Playbook
synopsis

YC general partner Pete Koomen, who built the firm's internal agent infrastructure, joins Garry Tan to explain how YC turned itself into an AI-native organization, arriving at the claim that building "superintelligence inside a company" requires no single breakthrough — just a shared context layer, an ever-growing registry of reusable skills, and a culture radically transparent and trusting enough to let agents use it all.

From a finance workflow to a database unlock. The project began about a year ago when Koomen and engineers, frustrated by the slow loop of finance staff describing workflows for engineers to hard-code, tried giving agents direct tools instead. The turning point was giving agents read-only SQL access to YC's single Postgres database, which holds every company, founder and financial record; Koomen argues this collapsed the cost of asking complex questions enough to trigger a Jevons-paradox-style surge in how many people bothered to ask them at all, since staff no longer had to queue behind engineers or data teams to get answers.

A registry that grew from 20 tools to 350. As more teams built on the shared agent loop, YC's internal tool registry expanded roughly seventeen-fold, and a "resolver" pattern — an agents.md-style entry point linking to markdown skills — let agents discover and reuse capabilities instead of duplicating them, checked against redundancy with a "dry and MECE" meta-skill Tan built.

Transparency as the safety mechanism. Rather than restrict access, YC broadcasts every internal agent conversation to Slack by default, a contested decision Koomen says paid off: employees learned techniques by watching each other, and the visibility itself discouraged misuse of the broad context access agents need to be powerful — a trade-off he argues depends on an egalitarian, trust-by-default culture more common at small, aligned startups than at legacy organizations.

From one skill to organizational superintelligence. A partner's handwritten skill for writing founders' "two-sentence descriptions" improved after colleagues fed a group office-hours transcript back into it, until Koomen says it wrote pitches better than any partner individually — the concrete mechanism, he and Tan argue, by which composing many such improved skills builds a genuine shared organizational brain.

A fork in AI's future. The conversation closes on Koomen's "Horseless Carriages" essay: that AI-native software should let an agent wrap deterministic tools, not the reverse, shifting control from developer to user. Tan extends this into a broader warning, drawing a parallel to the mainframe-to-personal-computer revolution: the next two years will decide whether AI ends up centrally controlled and locked down, or personally programmable the way early hobbyist computing was — a choice he argues falls to the founders building these systems now.

  • A single shared database, not better tools, was YC's real unlock for internal agents. Partner Pete Koomen says YC runs on its own software sitting on one Postgres database covering every company, founder and financial record, so an agent with read-only SQL access could answer arbitrary questions; he argues this collapsed the friction of cross-team requests enough to trigger a Jevons-paradox-style explosion in the number and complexity of questions people bothered to ask.
  • A tool registry grew from about 20 tools to over 350 as teams kept adding their own. Koomen describes YC's internal harness evolving from a simple agent loop into a shared registry that any team can extend, and says the key move was building a "resolver" — an agents.md-style entry point linking to markdown skills — so agents could discover and reuse capabilities instead of duplicating them, checked for redundancy with what Garry Tan calls a "dry and MECE" meta-skill.
  • YC deliberately broadcasts every internal agent conversation to Slack by default. Koomen says this transparency, chosen despite internal debate, let employees learn techniques by watching others use agents and created a social check that made it safer to give agents broad access to sensitive context — a trade-off he argues requires an "egalitarian, trust by default" culture that works best in small, aligned organizations.
  • A single partner's handwritten skill for writing "two-sentence descriptions" became better than any individual partner at YC. After other partners fed a group office-hours transcript back to the agent to refine the skill, Koomen says it now writes better two-sentence founder pitches than he does personally, illustrating what he and Tan call building "superintelligence inside a company": composing many individually improved skills into a shared organizational capability.
Technology and FriendsSailaja Mantripragada on AI Governance [EPISODE 905]
  • Copilot did not create the permissions problem; it exposed it. Mantripragada, who says she spent 15–20 years as a SharePoint and Power Platform specialist at the SEC, Freddie Mac, Blue Cross Blue Shield and Gilead, likens AI to switching the lights on in a messy room: overshared, ungoverned data that sat unnoticed is now surfaced, as when an intern asks a new agent for "the strategy for the next 2 years" and gets an HR site's documents.
  • Every agent should pass an intake review before it is built. Her "just-in-time AI governance framework" records who is building it, the approver, the business case and the intent as an audit trail, then on a button click checks the named data sources through the Graph API, Purview and SharePoint Advanced Management for overshared or orphaned sites, sensitive data and DLP settings, returning either a remediation plan or an approval. She says it runs inside the customer's tenant on a Teams/SharePoint site, covers SharePoint, OneDrive and Dataverse so far, is built largely in Power Automate, and is currently available only by hiring her firm, Low Code Power, with general availability a goal.
  • Proactive governance beats leaving it to auditors after the fact. Her tagline is "build fast, govern faster": citizen developers need a "driver's manual" up front rather than a ticket later, and she says that when AI goes wrong the repercussions now reach the CEO, not just the IT director. She calls Microsoft's Agent 365, which she says went generally available on May 1st, the coming go-to for reporting on workflows and usage but "slightly reactive"; she ties auditability needs to the EU AI Act and the NIST AI RMF.
  • Start with one or two high-effort workflows and a few champions. She picks the most manual, time-consuming work, found by talking to the domain teams, because quick results drive adoption. Her example is an R&D tax credits firm whose customer-vetting document has about 25 fields: a Copilot agent plus an agent flow, added for deterministic results, now fills a Word template with a company profile on one click.
  • Her readiness assessment begins by documenting the environment as-is. She describes spending the first week on the customer's environments, workflows, infrastructure and licences, documenting the as-is and to-be process, then using Purview, the M365 and Power Platform admin centres and SharePoint Advanced Management reports to find exposures such as sites open to everyone or missing security groups.
Dr. Jon KrohnHow AI Is Rescuing Decades of Lost Knowledge in Oil and Gas (with Jazmia Henry)
  • Oil and gas knowledge is being lost as a generation retires. Henry describes a hiring drop-off from the '90s to the early 2000s, before activity picked up again in the shale revolution of the 2010s. The knowledge held by older workers is disappearing, and younger staff don't know where things are.
  • AI can synthesize the industry's largely unstructured documents. She says 90% of oil and gas documents are unstructured, much of it handwritten, covering leasing, titling, safety and regulation. Her company applies AI across them, and she frames the safety side as work that saves lives. She says its leader has worked in fracking for over 20 years and the oil-and-gas staff have over 100 years of experience combined.
Crosstalk SolutionsDream Router 5G Max — Unscripted & Unbiased Review
  • The host bills this as unbiased, but tests with his own SIM. He says he has left the Ubiquiti creator program, no longer gets free devices and has no affiliate codes; the review uses a Crosstalk Mobile 5G unlimited SIM, which his company sells as a T-Mobile business MVNO, and pitches its $5-a-month static IP and non-CGNAT addressing along the way.
  • The hardware is a standard UniFi gateway with dual-SIM 5G built in. It has two nano SIM slots, with slot 2 also able to take an eSIM, plus four 2.5 GbE ports, a 10 Gb SFP+ port, a microSD slot, a touchscreen and a fan. Only port 1 has PoE, standard PoE at 15.4 W rather than PoE+, and it can be assigned as a WAN so a PoE-powered WAN device needs no extra brick.
  • Setup worked out of the box, with two quirks the host hit. The SIM came up as WAN 3, and he measured 150 Mbps down and 48 Mbps up untuned in mid-office. Setting the custom APN for a static IP (iot.cc.static) took the console offline until he rebooted. The APN setting is only in the web interface, not the phone app, and the LED colour is only on the touchscreen.
  • Ubiquiti says T-Mobile Home Internet SIMs are not supported. Some commenters on his earlier 5G Max video said theirs did work, which the host has not tested. He reports port forwarding through the separate UniFi 5G Max add-on modem only started working after its most recent update, and expects it to work on this device too.
  • The host recommends it for small businesses needing 5G, if in stock. At $499 MSRP against $399 for the 5G Max add-on, upgrading an older gateway costs little more and is fully integrated; it was out of stock at recording. Home users with a UniFi gateway should instead add T-Mobile or Verizon home internet as WAN 2, at about $50 a month or less ($25 on promotion), since CGNAT is usually fine at home.
Dr. Jon KrohnStop Throwing Compute at Bad Data (Ep. 995 with Jazmia Henry)
synopsis

Henry, a foundation model engineer at a Texas-based startup building AI for the energy industry, ends up arguing that useful domain AI comes from data quality and grounded evaluation, not more compute. Her 2023 NeurIPS workshop paper said scaling bad data degrades models. Her recent grounded continuous evaluation (GCE) work uses early Monte Carlo forecasts to catch reward hacking before a checkpoint. Both, she says, let smaller models trained on better data beat far larger ones.

Why oil and gas. Henry describes a generation of oil and gas expertise retiring after a hiring gap from the '90s to the early 2000s. She says 90% of the industry's documents are unstructured, many handwritten, across leasing, titling, safety and regulation. A general model asked to review a job safety report may say "everything looks good" without understanding it. She argues sycophancy is unacceptable when an all-clear can cost a limb, so her models are meant to check local rules and push back. One well document measured distance in cigarettes smoked while walking, which is why she consults field staff.

Four stages of a full-stack build. First is data curation, which her team has worked on for 6 months. Subject matter experts help link terms across a thousand-page textbook into a graph database, and she calls the company as much a data company as an AI company. The host ties this to episode 993's main point. Next come bespoke tokenizers and embeddings, so drilling documents can be chunked and OCR'd as text rather than by a costlier vision model. Then model building: continued pre-training of open-source models chosen by constant benchmarking, plus reinforcement learning in physics environments, because teaching a small model physics directly makes it overfit. Last is inference, which training choices constrain under SLAs requiring 99.9% uptime.

Burstiness. Asked to explain, Henry says RL reward calculations run on CPU while the GPU idles, then arrive in a spike. An 8-billion parameter model that fits on one A100 then needs several, and newcomers to RL hit seg faults. She provisions conservatively, cutting the 90% of memory often given to the model and KV cache. Grounded continuous evaluation. Waiting for a checkpoint takes 2 hours to days. Henry instead runs Monte Carlo simulations on about an hour of reward trajectories to forecast the checkpoint, kill bad runs and compare ablation variants, which she says a startup with a Friday demo needs. A strong checkpoint after a weak forecast signals reward hacking: under GRPO a model may key on a keyword to get the final answer without learning the equation. Exam-style questions also miss how users phrase requests ("decline"), so she injects realistic questions mid-run. She says the deterministic environments remove the need for a reference model, reduce compute and let models run on a MacBook. The host names the paper Beyond Static Snapshots.

Scaling bad data. Against the Kaplan et al. scaling view, her 2023 paper applied diminishing returns. Massive undeduplicated data makes models forgetful and overfit, and 10,000 GPU clusters can't fix bad data. She says 70 billion and 120 billion parameter models now outperform 1 trillion-plus ones.

Linguistic equity. Henry began building an African American Vernacular English corpus at Stanford but did not pursue it. She concluded that communities should own their language rather than hand it to powers that might misuse it. She says she can provide the bridge without being the one to cross it. She credits Value Systems Design, led by Batya Friedman, with guiding all her AI decisions.

  • A sycophantic general model is dangerous where lives are at stake. Henry says a general model asked about oil and gas terms may know some definitions but not how they relate. Given a job safety report (JSA), it may read the document without understanding it and say "everything looks good". Her company's domain models are meant to check local rules, compare the data and push back, because a wrong all-clear can cost someone an arm.
  • Physics belongs in RL environments rather than in the weights. Henry describes four stages: data curation (6 months so far, with subject matter experts building a graph database), bespoke tokenizers and embeddings that let documents be read at the text level instead of by a costlier vision model, model building, and inference. Model building combines continued pre-training of benchmarked open-source models with reinforcement learning. Teaching a small model physics directly makes it overfit, she says, so fixed physical rules sit in an environment where the model writes Python in a REPL.
  • RL training is bursty, so GPUs must be provisioned conservatively. Reward calculations run on CPU while the GPU sits idle, then a spike of data hits it all at once. An 8-billion parameter model that fits on one A100 then needs several, and people moving into RL hit seg faults from overloaded GPUs. Henry's fix is to scale back the 90% of memory people often give to the model and KV cache.
  • Early Monte Carlo forecasts catch failing runs and reward hacking. Henry's grounded continuous evaluation (GCE), from a paper the host names as Beyond Static Snapshots, simulates where a run is heading from about an hour of reward data instead of waiting 2 hours to days for a checkpoint. A strong checkpoint after a weak forecast flags reward hacking, such as models under GRPO keying on keywords to get the final answer without learning the equation. She says the deterministic environments remove the need for a reference model, cut compute and burstiness, and let models work on a MacBook.
  • Scaling bad data makes models worse, not better. Her 2023 NeurIPS workshop paper, accepted as what she calls a top 5% paper, argued against the Kaplan et al. scaling view by applying diminishing returns. She says undeduplicated data, nearly impossible to clean at that size, makes models forgetful and overfit, and no number of GPUs fixes it. She sees this vindicated in 70 billion or 120 billion parameter models outperforming 1 trillion-plus models.
Scott HanselmanTrying out the GitHub Copilot App
  • The Copilot app is built for issue and PR work. Hanselman, who says they work 50% at GitHub and 50% at Windows as an individual contributor and have been working on the app, places it between VS Code (code-focused) and the terminal: "It is not a text editor... It is not a terminal." The video was posted a week after launch, with the app in technical preview (sign-up via the GitHub changelog) and "more in store" at Microsoft Build on June 2nd.
  • Each task-based session gets its own worktree. Sessions sit under projects and can target a branch or an issue; Hanselman shows 18 worktrees in Worktrunk that the app created, and says a new session can run against the local repository or a worktree.
  • Model choice allows adversarial reviews, with the human as judge. Hanselman picks models per session, can set two models to argue over a PR, and runs agents in parallel; plans wait for approval, which Hanselman says gets read first. An "auto" model setting gives a discount.
  • Terminal, browser and scheduled automation live inside the app. Side panes show changes, plans, a terminal and a browser for localhost URLs, with "pick and polish" for selecting page elements; scheduled workflows run triage in the background on the local machine, and sessions can go remote or open in VS Code, Visual Studio or Cursor. Hanselman says the app means leaving for the terminal less than before.