Post-Training Is How You Keep Your Taste | Fireworks CEO Lin Qiao
Episode details
Episode description
When should a company move from prompting to post-training its own models? Fireworks AI co-founder and CEO Lin Qiao lays out the full progression at Sequoia Capital’s Own Your Intelligence event, from prompting and RAG to supervised fine-tuning, preference tuning, reinforcement learning, and distillation. And she explains which technique solves which problem. Lin also covers the pitfalls teams hit along the way: prioritizing data quantity over quality, relying on vibes instead of systematic evals, sloppy RL environments, and reward hacking. She shares how companies like Cursor have used post-training to compete at frontier quality, and why the right moment to start is after product-market fit, when production data becomes your fuel and owning your stack can cut serving costs 5–10x. 00:00 Introduction 00:37 What Fireworks sees across thousands of AI applications 02:47 Off-the-shelf APIs and the problem of keeping your taste 03:58 What "owning your intelligence" actually means 05:43 The progression: prompting → RAG → SFT → Preferences → RL 07:20 Why this mirrors how humans learn 09:03 Matching the technique to the problem you actually have 10:46 Where teams get stuck: data quality and vibe evals 12:28 Reward hacking: the model that wrote zero lines of code 13:59 Training-to-serving alignment (and why quality silently drops) 15:55 Post-training in healthcare and security 17:31 From coding to every co-work domain 19:35 Incumbents, cost burden, and not scaling into bankruptcy 21:26 How much control do you want? 23:24 Q&A: What makes a good reward signal 25:00 Q&A: When to start thinking about post-training