E20: The Great Implementation with Raza Habib, CEO of Humanloop

Raza Habib is on the front lines of LLM implementation as CEO of Humanloop, a Y Combinator backed startup that helps companies of all kinds, small and large bridge the gap from API access to successful LLM deployment. Nathan sat down with Raza to hear what he has learned in the process of helping so many companies on their LLM implementation journeys – and he did not disappoint – as you'll hear, he shared a bunch of concrete examples of customer use cases, practical challenges that people face, and the strategies they use to overcome them.

RECOMMENDED PODCAST:

Founding a business is just the tip of the iceberg; the real complexity comes with scaling it. On 1 to 1000, hosts Jack Altman and Erik Torenberg dig deep into the inevitable twists and turns operators encounter along the journey of turning an idea into a business. Hear all about the tactical challenges of scaling from the people that built up the world’s leading companies like Stripe, Ramp, and Lattice. Our first episode with Eric Glyman of Ramp is out now: https://link.chtbl.com/1to1000

Also, check out the Hackaprompt 2023 competition. There are $40,000 worth of cash and AI credit prizes available.  The competition begins on May 5 and will run for 3 weeks, after which we'll have the organizer Sander Schulhoff, who is also the creator of LearnPrompting.org, on the show to talk about the results. Head to this link to sign up: https://www.aicrowd.com/challenges/hackaprompt-2023

Also, we recommend Erik Torenberg’s interview show "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here:

[Apple Podcasts] bit.ly/3z8TldL

[Spotify] bit.ly/40letd0

TIMESTAMPS:

(00:00) Preview of episode

(07:00) Humanloop’s mission and surprising customer base

(12:10) Why a language model is so advantageous

(15:00) Customization and understanding model performance

(18:14) Sponsor: Omneky

(18:35) Users graduating from playground experimentation to develop robust implementations 

(23:25) Raza’s two mental models for using AI

(27:50) How customers are actually integrating API

(31:50) Challenge of evaluation and feedback

(43:33) Prediction: more fine tuning in the immediate future

(47:00) RLHF myth-busting

(57:12) Robust agents need feedback loops

(1:02:27) AI productization challenges

(01:07:32) Adopt or die moment for incumbents

(01:11:19) Fast iteration cycles

(1:15:45) Rapid fire questions for The Cognitive Revolution guests

TWITTER:

@CogRev_Podcast

@RazRazcle (Raza)

@labenz (Nathan)

Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/