E17: The Prompt Engineering Revolution with Riley Goodside

For anyone who discovered this show on Twitter, Riley (@goodside) likely needs no introduction – after all, he spent most of 2022 posting his explorations of OpenAI's text-davinci-002, and quickly became one of the must-follow accounts in AI. Riley Goodside is the world's first Staff Prompt Engineer at Scale AI, and is an expert in prompting large language models and integrating them into AI-powered applications. Few have spent as much time on the language model frontier, so I hope you enjoy this unique conversation with Riley Goodside.

RECOMMENDED PODCAST:

Founding a business is just the tip of the iceberg; the real complexity comes with scaling it. On 1 to 1000, hosts Jack Altman and Erik Torenberg dig deep into the inevitable twists and turns operators encounter along the journey of turning an idea into a business. Hear all about the tactical challenges of scaling from the people that built up the world’s leading companies like Stripe, Ramp, and Lattice. Our first episode with Eric Glyman of Ramp is out now: https://link.chtbl.com/1to1000

Also, check out the debut of Erik Torenberg's new long-form interview podcast "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here:

(Apple Podcasts) bit.ly/3z8TldL (Spotify) bit.ly/40letd0

TIMESTAMPS:

(0:00) Preview of the episode

(05:13) Riley's unique background

(11:24) Riley's original narrow moat

(15:07) Sponsors: Omneky

(17:02) LLMs can take on ncreasingly complex instructions

(27:41) Language models can do math

(30:05) Models can learn from context

(37:29) Fine-tune models for tasks

(38:47) Automate instruction following

(44:34) Large language models are alien text prediction

(52:27) Avoid mode collapse by framing

(59:05) Composing AI capabilities like Lego bricks

(1:00:37) Language models solve tasks

(1:05:37) GPT-3 solves real-world tasks

(1:15:03) GPT-4's amazing capabilities

(1:17:03) Multimodal abilities unlock possibilities

(1:25:03) Compare models for best task fit

(1:26:24) Compare models using trial and error

(1:36:15) AI and the future of work

(1:42:29) GPT-4 can provide second opinions

(1:45:06) AI safety discussion

(1:50:20) AI permeates society cautiously

(1:55:26) The AI revolution underway

TWITTER:

@CogRev_Podcast

@Goodside (Riley)

@scale_AI (Scale)

@labenz (Nathan)

Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/