a16z Podcast·Season 1, Episode 1165

How Open-Source AI Became Critical Infrastructure

How Open-Source AI Became Critical Infrastructure

0:000:00

Listen on:

About this episode

Elena Burger and Matt Bornstein are joined by Simon Mo, co-founder and CEO of Inferact, the open-source inference engine powering many of today's most advanced AI applications. Together, they explore how open-source AI evolved from a research project into critical infrastructure, why inference has become one of the most important layers of the AI stack, and what it takes to bring frontier intelligence to developers around the world. The conversation covers vLLM's origins, the rise of open-weight models, why companies increasingly want control over their AI infrastructure, and how open-source inference enables the next generation of AI applications. They also discuss model licensing, the economics of open-weight AI, Kimi K3, distillation, AI infrastructure, and why Simon believes the gap between open and closed models is rapidly disappearing. Resources: Follow Simon Mo on X: https://x.com/simon_mo_ Follow Matt Bornstein on X: https://x.com/BornsteinMatt Follow Elena Burger on X: https:/

Recent Episodes

AI is lowering the barrier to launching sophisticated cyberattacks

Lexicon·Ep. 20· 2311·

AI is making cyberattacks faster, cheaper, and more accessible by allowing attackers to automate tasks such as reconnaissance, vulnerability discovery, infrastructure mapping, and attack planning. In a recent Lexicon interview, Redsift CEO Rahul Pavar explains how AI is shifting cybersecurity from human speed toward machine speed, why critical infrastructure such as water utilities could become softer targets, and why organizations need to focus on fundamentals like MFA, continuous asset discovery, attack surface management, and faster threat detection. He also expects the next 6 to 18 months to bring a surge in vulnerabilities as AI uncovers weaknesses that may have existed for years but were previously too difficult to find. Also, don’t forget to subscribe to IE+ for premium insights and exclusive content!

Inside Cursor: The Anatomy of a Generational Startup

a16z Podcast·Ep. 1180· 2369·

a16z General Partners Martin Casado, Sarah Wang, and Matt Bornstein unpack the story of Cursor: how a small, product-obsessed team entered one of the most competitive markets in technology, took on incumbents with seemingly unbeatable advantages, and repeatedly made decisions that ran against conventional startup wisdom. They revisit the early bet that the interface between humans and AI would matter more than building a coding-specific foundation model, why Cursor built its own product rather than a VS Code plugin, and how the founders' ability to say "no" became one of the company's defining strengths. They also discuss Cursor's rapid evolution from IDE to agent and model platform, and why the team was willing to cannibalize its own products as AI capabilities improved. The conversation gets into what founders can learn from Cursor's approach to competition, hiring, enterprise sales, M&A, and company culture, including why the team remained unfazed by competitors from Microsoft to An

#501 – DHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux

Lex Fridman Podcast·Ep. 20· 19317·

DHH is the creator of Ruby on Rails, Omarchy Linux, CTO of 37signals, and a racecar driver. https://lexfridman.com/sponsors/ep501-sc Transcript: https://lexfridman.com/dhh-2-transcript CONTACT LEX: Feedback – give feedback to Lex: https://lexfridman.com/survey AMA – submit questions, videos or call-in: https://lexfridman.com/ama Hiring – join our team: https://lexfridman.com/hiring Other – other ways to get in touch: https://lexfridman.com/contact EPISODE LINKS: https://x.com/dhh https://world.hey.com/dhh https://omarchy.org https://rubyonrails.org https://37signals.com SPONSORS: Wispr Flow: AI-powered voice dictation app. https://wisprflow.ai/lex Blitzy: AI agent for large enterprise codebases. https://blitzy.com/lex NetSuite: Business management software. http://netsuite.ai/lex Shopify: Sell stuff online. https://shopify.com/lex LMNT: Zero-sugar electrolyte drink mix. https://drinkLMNT.com/lex Plaud: AI-powered note-taking devices and software. https://plaud.ai/lex Higgsfield AI: AI-

The State of AI: Macro, Apps, and Consumer

a16z Podcast·Ep. 1179· 2234·

Anish Acharya joins Jen Kha to break down the next frontier of AI, from the evolving model landscape and open-source AI to why the application layer, and consumer AI in particular, may be entering a new phase. Anish explains why he believes there will be multiple winners at the model layer, why traditional moats like network effects, scale, and brand still matter, and how companies can choose between frontier and open-weight models depending on the economics of the task. They also explore why models are increasingly specializing, and how applications can combine different types of intelligence to create products that are more valuable than any single model. The conversation then turns to consumer AI: personal agents that can shop and manage your inbox, coding tools enabling a new generation of small businesses, and why Anish thinks we're seeing a renaissance for consumer builders. They also discuss the changing economics of AI software, the rise of "luxury software," and why the bigges