Linda Haviv, who at the time of recording had just left her role as staff developer advocate at Anyscale to work independently on AI-infrastructure education, content and developer-relations consulting, ends up arguing that this is the best moment to build on one's own: coding is being abstracted away, but the systems problems underneath it, the AI-infrastructure layer, are surfacing for everyone, and people who bring transferable skills, open-source habits and a community will do best. The second half of the conversation turns technical, on Ray, what "AI infra" means and open-source governance.
A non-linear path. Haviv majored in philosophy at CUNY Baruch because it "does not have an answer", worked in TV news before law school, and taught herself to code by building book sites for anchors. She found developer relations through New York meetups, took her first JavaScript job in 2016, and has made technical content on Instagram since then. She says the profession is now going through an identity crisis: she misses writing code, though watching agents work has its own satisfaction, and systems thinking, once a principal-level skill, is now needed by more people.
Infrastructure surfaces for everyone. The host's premise is that within "a couple months" it has become theoretically possible to train, fine-tune, deploy and front an AI application through natural-language prompts alone. Haviv accepts the speed but says that beyond toy examples people hit systems problems. What stopped her that week was a non-technical person talking about memory: builders complain that context "is not working" or lags, which is the KV-cache and prefill-decode-disaggregation problem in different words. Engineers keep an edge because they know where things fail; agentic workflows sit on a distributed-systems layer, and even model training is an orchestration problem. Domain knowledge transfers as well: she could build a content management system for journalists because she had written articles. The host draws the lesson that a newcomer may do better moving into development at a current employer than applying to Meta first.
Community and building in public. Both prefer in-person learning; Haviv attended Flatiron School at the height of the bootcamps and expects in-person events to grow in popularity as more work goes digital. She says you learn by reading others' code, and that explaining something when you are one step ahead is often the clearest version for the next learner. Her advice is to start small, with a screenshot and a caption.
Why go independent now. Haviv calls side work insurance: to a company you are "a human resource", and her Amazon job came because the company found her cloud-computing videos on TikTok. She likens the moment to the arrival of the internet and guesses, explicitly without data, that maybe 50% of jobs will be at small companies, with two- to three-person and perhaps one-person billion-dollar companies. Outside a company she finds project work more efficient and less tied up in red tape. She plans content, developer-relations consulting focused on digital communities and technical founders' personal brands, and building her own systems on Claude.
Ray and AI infrastructure. Haviv describes Ray as a Python-native open-source distributed computing framework, built in Ion Stoica's Berkeley lab by Robert Nishihara and colleagues because ML researchers were spending more time on distributed systems than on reinforcement-learning research. It now spans Ray Data, Ray Train and Ray Serve, integrates natively with vLLM and Hugging Face, and suits multimodal workloads that do not fit on one GPU better than Spark does. She defines AI infrastructure loosely, as infrastructure specific to compute-heavy AI/ML workloads, overlapping with traditional infrastructure; inference is where users first meet it. Neoclouds such as Nebius, CoreWeave and Crusoe are specialists next to hyperscalers that "do everything". Her popcorn analogy for batch inference has single kernels as latency-optimised and the always-on microwave as throughput-optimised, with CPU preprocessing needed to keep the GPUs fed.
Open source and governance. She says it is crucial that Ray, vLLM, Kubernetes and MCP sit under Linux Foundation governance rather than with one company, and expects open models such as the newly released Gemma 4 and DeepSeek to catch up. She runs Gemma 4 on her phone for offline use and says she has moved most of her assistant work from OpenClaw to Claude skills and plugins.