The Future of Inference Market & Model Routing: Commodity or Increasing in Value? | LangChain CEO
Episode details
Episode description
Harrison Chase is the co-founder and CEO of LangChain, which helps developers build, test and deploy AI agents. Backed by Sequoia Capital, Benchmark and IVP, LangChain has announced approximately $160 million in funding with the last round at a $1.25BN valuation. The company works with 35% of the Fortune 500, has surpassed one billion open-source downloads and processes over one billion events daily through LangSmith. ----------------------------------------------- Timestamps: 00:00 Intro 01:05 What Is LangChain and Why Are Agents Still So Hard to Build? 03:17 Why Better Models Force LangChain to Delete Parts of Its Product 05:52 Why Neutral Agent Harnesses Still Matter 08:59 Why Harrison Is Massively Bullish on Vertical Agents 10:42 Are Companies Really Building Their Own AI Models? 12:14 Do Specialized Models Actually Beat Frontier Models? 14:15 Where Does the Value in Model Routing Really Sit? 20:05 Can You Trust AI Evals? 21:15 Where Does the Value Actually Accrue in the Agent Stack? 23:13 How Continual Learning Changes Agents 24:36 Why the Agent Memory Layer Is Still Wide Open 29:05 What About Agents Today Will Be Obvious in 3 Years? 32:06 Will Every Consumer App Have Its Own Vertical Agent? 33:37 What Happens When Agents Generate 1,000x More Requests Than Humans? 35:49 Why Agent Costs Could Become a Huge Problem 38:44 LangChain Spends ~30% of Engineering Salary on Coding Agents 41:41 Will AI Agents Make Engineering Teams Dramatically Smaller? 43:41 What Anthropic’s Valuation Depends On 44:53 Are Enterprises Afraid of Chinese Open-Source Models? 46:46 What Most People Get Wrong About Open Models 48:05 Why Harrison Thinks the Inference Market Is Massive 49:31 Where Would Harrison Invest in AI Today? 54:31 Is Being First More Important Than Ever in AI? 55:32 The Bull Case for Jev at a $9BN Valuation 56:18 How Benchmark and Sequoia Actually Help Founders 58:15 Is It Worth Taking a Valuation Discount for a Top-Tier VC? 1:00:45 The Most Important Thing People Get Wrong About Agents 1:01:47 OpenAI at $1.5TN vs Anthropic at $2TN ---------------------------------------------------------------------------------------------- Subscribe…