Professor G Markets$Hillary. Rodham. Clinton.
- This post includes paid content that is not available publicly. See the original source.
Mark uses the episode to announce Ref Checker results: hallucinated references are endemic in AI research papers, and he expects a refined scan to find more. Hanselman and Mark then argue over where AI help becomes surrender, ending on the view that AI is a tool for experts that harms novices slowly.
The scan. Mark says Ref Checker scanned the 5,300 ICLR papers and found hundreds of hallucinated references. He disclosed the 12 papers with five or more to the program chairs. Of 10 replies, nine admitted fault and one withdrew; one claimed unpublished sources it could not show, another called five an arbitrary threshold, and a young lab asked for silence. He is publishing anonymous statistics only, and ICLR has not said what it will do.
Cognitive surrender. Hanselman raises "system three" thinking; Mark names it "cognitive surrender". Hanselman's analogy is a forklift sent to the gym to lift your weights, though he defends low friction as a way to test ideas.
Tiny Tool Town. A count bug on Hanselman's tool site becomes a test case: Mark asks provocatively whether AI should have known, then agrees it cannot know unstated requirements.
Writing with AI. Mark has Copilot draft over half of his LinkedIn posts from his bullets, unnoticed by Hanselman. They settle on a lathe as the analogy for a tool that only an expert can use well.
The hosts read the day as a rotation market drifting lower -- S&P futures down 30 to 35, the Nasdaq held up by AMD and Meta -- with active traders mostly short and investors mostly long. Their advice was to keep trading: sell premium against names that have run or collapsed, buy a leveraged inverse semiconductor ETF via a covered call, and manage positions by fixed rules on implied volatility rank and days to expiration rather than by waiting.
Open and the PDT rule. One host reports that this is the last day firms must enforce the pattern day trader rule. Per tastytrade, he says, locked accounts reopen the next day with no day-trade counter. The hosts' response: "trade them up."
Positive drift. One host defines it as the return owed for taking risk above the risk-free rate. Most people should act on it unless they cannot bear the risk, though he keeps part of his own portfolio in cash. He applies it to careers too: not improving and earning more over time means something is wrong.
Viewer trades. Netflix, down from 107 to 82 since earnings, gets short July 75 puts, outside the expected move. SMH, about 634 after a "hyperbolic" run, gets a July 725/730 call spread for about $1.30, with IVR 105. A South Korea ETF with illiquid options gets a resting order for a $5-wide put spread at no more than $2.50. SOXS near $4.98 gets a covered call at the July 7 strike; the host calls it his favorite and is long. A plug for the channel's coming AI prediction tool is product pitch.
Boosting a career. The hosts list quick decisions, problem solving, visibility, going beyond your title, saying yes, treating the role as your own business and making colleagues stronger. They split on refusals. One never asks again after a single "no"; another says fearful people decline work they could do. Asked about finding someone to tell you you're wrong, they say their companies are flat and welcome criticism.
Who is short. A caller asks whether shorting is now the public's position. One host first says everyone is long. The other cites 62% of London CFD index accounts being short and argues active traders, a few percent of perhaps 100 million US investors, are net short while passive investors are long. The first host agrees with that split.
Regulators. A caller asks whether purging bipartisan regulators will cost confidence. One host sees no real deterioration at the SEC, CFTC or Fed yet, beyond some bias on prediction markets. The other calls the Gensler SEC brutally restrictive and fears an overcorrection. Both say the next big down move will be the test.
Rolling and adjusting. With IVR high, adjust within the cycle if over 30 days remain; under 24, roll and recenter. Rolling early is said to cut risk 25–30%. Below IVR 30, close undefined-risk trades; defined-risk trades can run longer. Adjust the moment you are uncomfortable. A covered call whose short call is losing on a rally should be closed and replaced with a short out-of-the-money put.
Close. The hosts see no good way to say no to an employer. A poll finds 47% of viewers expect the S&P to close higher. One host calls it the dumbest bet in the world; the other notes buy-the-dip has paid for 14 or 15 years.
Laudati, a Microsoft solution specialist, ends up arguing that AI works best for him as a builder of deterministic tools, not a generator of content. GitHub Copilot built the map site for his food challenge without his writing a line of code, and it is now building the command-line tools he hopes will clear his video backlog. He says it got there only because he prompted with a programmer's precision.
The challenge. He and his wife, empty nesters, are eating in all 564 New Jersey towns, an idea borrowed from a former coworker doing Massachusetts' 351. About three years in, they have eaten in 287 towns, 87 of them before the challenge started. Friends pushed them to go public about a year ago. One early reel reached about 70,000 views when they had 50 followers, and they now have about 20,000 across Facebook and Instagram.
The map site. Commenters kept asking "come to my town", so he wanted a clickable map. In two or three hours with Copilot, using Claude, he went from plan mode to a static React site on GitHub Pages, with a mapping library he believes is Leaflet. Copilot made four or five tries before it found a source of town boundary polygons. He rejected its suggestion of Cosmos DB in favour of a JSON file. Unprompted, it shrank the logo, which it named as the page's biggest performance cost. He says it fought the CSS by trial and error, just as he would have.
Specificity as the skill. Laudati calls natural language "the ultimate programming abstraction", but says results go off the rails without precise prompts. His example is the script that converts his Excel tracking sheet to JSON, run by a GitHub Action whenever he pushes the sheet.
The video backlog. Each 60–90 second video takes 10–12 hours, and about 150 towns are still unpublished. Early AI images drew criticism, so he cut back. He gave Copilot a three-page write-up of his editing steps and got a 10-phase plan back. One of the seven tools he has scaffolded so far now generates each opening map animation in 15–20 seconds, and he has published the tools on GitHub.
Andrey Kurenkov, founding AI lead at Astrocade and co-host of the Last Week in AI podcast, returns (after episode 799) to argue that Astrocade's growth to over 20 million engaged users came from treating AI as the tool behind a creator platform rather than as the product. His wider position is a middle one: humanoid robots are advancing faster than he expected, but he doubts artificial superintelligence and thinks the mundane harms and benefits of AI deserve more attention than the extremes.
The platform. Astrocade is a "TikTok of games": users vibe-code casual mobile games, publish them and play others' games, all free for now, with tokens funded by venture money (the host says $68 million raised, announced jointly as a Series A from about a year earlier and a recent Series B; he names Sequoia, Nvidia, Google and Garena among investors). Kurenkov says growth has come in the last 6–8 months, some games have millions of plays, and AI does the code and assets but a creator's vision still takes real work.
Building it. He joined in April 2023 after a Stanford PhD in machine learning and robotics, when LLMs could write small functions but not working games; his title moved from ML scientist to founding AI lead because the work became prompting, context engineering and systems. The company moved to Claude Code around June 2025. He says there is no secret sauce, only how agent, tools and LLM are combined, which is hard to benchmark when one request has a million valid answers. His main lesson is that scaffolding built for weaker 2023–2024 models became a constraint once vibe coding worked, so systems must survive model upgrades every few months.
Why B2C. On the host's quoting of his earlier view that B2C is ill-advised, Kurenkov says it took over 2 years to pay off but is the only path to hundreds of millions of users. He agrees with the host's quote from Sequoia's David Cahn that many users are women aged 20 to 40, attributing it to casual mobile gaming's existing audience. The moat, he says, is creators: a Discord of about 50,000, a $10 million programme paying creators per play, the cohort-based Astro Academy entering its third season, and followings for prolific creators.
Recommendations and the AI-as-product question. Recommending games is harder than video because play time lacks an end point and small mechanical changes alter appeal. Pressed on his old claim that AI rarely works as a product, he says Astrocade's product is games, most users only play, and Harvey shows domain value on top of foundation models even as Anthropic launches Claude for legal.
Last Week in AI. Started in March 2020, the show now runs over 300 episodes at about 2 hours each; he says its focus has shifted toward tools everyday people use, such as ChatGPT and Claude updates.
Robots, risk and AGI. He now puts capable household chore robots at two to three years rather than a decade, citing 1X, Figure and vision-language-action models, with cost (he offers $50,000) the next barrier. He calls himself an ASI sceptic because physical limits and the need for experiments constrain discovery, names AI-powered scamming and chatbot dependence as real present risks, and says AGI lacks any working definition; his own view is that it is a spectrum of generality that arguably arrived with or before GPT-3.
Varun co-founded GigaML after turning down a quant-firm job offer; the company now runs AI customer-support agents for DoorDash, a top crypto exchange, and top telecom providers, pushing deflection rates it says can reach 90-95%, with a next product aimed at replacing the "forward deployed engineer" role in enterprise AI.
From EdTech rejection to a forced pivot. Varun and his IIT co-founder applied to YC with an LLM-based EdTech idea while he held a Stanford PhD offer. Harj Taggar dismissed the idea, telling them to use their LLM research on something else — advice Varun says left him panicked, sure the interview had gone badly. After talks with EdTech operators confirmed it was weak, they pivoted within a month.
A false start in fine-tuning, then a customer-driven pivot. They built an open-source fine-tuning product, topped Hugging Face benchmarks, and raised a $4 million seed — but concluded fine-tuning was a poor market, useful mainly for cost or for security buyers hard to sell to as engineers. Watching which use cases grew fastest among users, they saw support and coding leading, and pivoted; Zepto became their first customer.
Winning against scale. Unaware of well-funded rivals like Sierra, GigaML's eight-person team beat a roughly 400-person competitor for DoorDash's contract, aided by a YC introduction and a flawless three-month pilot. Varun reads this as proof product quality beats a sales team — a lesson reinforced by AI engineering leverage that he says lets GigaML run with a fraction of the staff a comparable company once needed.
Bajaj, CEO and co-founder of TrueFoundry, argues that enterprises get large returns from agents by routing every model, tool and agent call through one governed gateway, and by starting with a business-critical workflow rather than many small ones. He says customers who did this now run agents worth hundreds of millions of dollars.
The control plane. Bajaj says customers moved from prototypes to production agents and found they needed a layer between applications and the model and infrastructure layer to connect, observe and govern. Many first built a thin LLM proxy in-house, then found they also needed observability, governance and a policy engine as teams multiplied and MCP, A2A and new agent tools arrived. He credits a mid-sized startup's position for closing the feedback loop fast. A smaller company lacks customer data points, and at a larger one the product decision-makers are far from customers. The host cites a trillion tokens a day of usage and Nvidia and Siemens as clients.
Three gateways. An agent needs models, an environment (tools, data, skills) and other agents, so TrueFoundry's AI gateway has a model gateway, an MCP or "environment" gateway, and an agent gateway. Through the model gateway, developers never hold raw API keys. Organizations set rate limits and budgets (his examples: 100 calls an hour, $2,000 a day for a dev environment), fallbacks across regions, PII and prompt-injection guardrails, and full traces. MCP is harder because each server has its own authentication and exposes write access to data such as Slack and Gmail. He describes building a virtual server of whitelisted read-only tools from seven servers for an agent outside users can reach. Tool sprawl breaks nothing in theory, he says; it makes access and debugging hard. Described tool groups let models select tools at runtime. The agent gateway is "the hard part": he says most of the industry cannot stop a misbehaving agent, and agents now come from sales, ITSM and pro-code platforms that all need one governance layer and a kill switch.
Start big. Bajaj's five-workflow framework is his hot take against starting small, which he says yields 500 low-value agents that justify no governance plumbing. Pick one or two of the five most critical workflows instead, build the plumbing, then let teams build the rest. He says customers who did so have run agents for a year and a half and now see individual agents create dozens to hundreds of millions of dollars in value. The host, who usually advises starting small, says he knows of no agents at that scale.
The inaugural YC Paper Club gathers around a hundred founders and researchers at YC's Pioneer space, and across five presentations the through-line is that classical ideas — speculation, factorized control, joint-embedding prediction, PAC-Bayes theory, regularization and ensembling — keep unlocking new capability once revisited at modern model scale, rather than requiring entirely new techniques.
Speculative speculative decoding. Stanford's Tanishk opens by reframing inference: rather than a cost or convenience factor, he argues that once a system's performance scales with how much it "thinks," tokens-per-second becomes the ceiling on delivered intelligence. Ordinary speculative decoding uses a small draft model to guess tokens that a large target model then verifies, but drafting and verification are sequentially dependent. His method predicts likely verification outcomes ahead of time, letting the next draft round start while the previous one is still being verified — hitting roughly 80-90% prediction accuracy and improving both latency and throughput sampling Llama 3 70B on four H100s.
Diffusion Model Predictive Control. Google DeepMind's Stannis, now leading a robotics world-modeling project, presents earlier work using diffusion models for both multi-step action proposals and multi-step dynamics models, factorized so they can be adapted independently. This lets a simulated agent adapt to novel reward functions or changed dynamics — such as a walker with a broken ankle — by re-adapting only the dynamics model, recovering most performance without retraining the action proposal, and it simplifies the planning algorithm to a simple sampler.
LeJEPA and the case for world models. Isaac Ward, from Yann LeCun's group, ties his talk to LeCun's reported $1.03 billion raise aimed largely at training world models. He presents LeJEPA, a joint-embedding predictive architecture that adds a single new regularization term ("SIGReg," enforcing Gaussian-distributed latent embeddings) to prevent the representational collapse that other world-model approaches fight with more complex tricks. He reports it runs about 50 times faster than competing world models, fits on a single GPU under 24GB of memory with only 15 million parameters, and — unlike model-free policies — can flag its own prediction error when conditions shift unexpectedly.
Why deep learning generalizes. QLabs' Ashe presents Andrew Gordon Wilson's argument that supposed mysteries of deep learning — overparameterization improving generalization, and "benign overfitting" where networks fit random noise yet still generalize on structured data — are largely explained by classical PAC-Bayes theory once compression is computed correctly. Larger models find more compressible, flatter minima, which tightens generalization bounds even at billion-parameter scale; the paper's implication is that better inductive biases, not new theory, are the lever for future sample efficiency.
Scaling laws when data, not compute, is the constraint. Closing the session, Ku presents work asking how to pre-train when compute is abundant but data is fixed — a regime he argues is approaching as internet text grows roughly 3% a year against 4-5x annual compute growth. Aggressive regularization and ensembling each produce clean power-law scaling with a measurable best-possible-loss asymptote, and combining them yields roughly a 5x data-efficiency win over standard recipes. He shows these gains survive compression: distilling an eight-model, 2.4-billion-parameter ensemble into one 300-million-parameter model retains about 83% of the improvement, and the same approach yields a roughly 17x data-efficiency win in a continued-pretraining setting constrained to math tokens.