Supper Club × OpenAI, Future of programming, LLMs, and Math with Andrey Mishchenko

In this supper club episode of Syntax, Wes and Scott talk with Andrey Mishchenko about working at OpenAI, getting started in machine learning, what RLHF is, the impact of plugins on ChatGPT, and what the future holds for developers in a world with ChatGPT tools. Show Notes 00:33 Welcome 00:59 ChatGPT introduction 02:17 Who is Andrey Mishchenko? 03:17 What is circle packing? 05:04 When did you start at OpenAI? 06:21 Levels of interaction 08:39 How do you train the model to understand? 11:13 What’s RLHF? 13:56 What are plugins for ChatGPT? 16:11 What languages are you using to code for AI? 19:15 Did you have any idea ChatGPT would be so popular? 21:13 Did your math degree help get into language modeling? 28:34 Do Wes or Scott worry they’re going to lose their job? 33:24 How has farming been shaken up by AI? 34:59 Do you think the pace of AI will continue? 35:30 Will plugins change how people use AI tools? 41:21 What does AI do better than anything else? 49:11 Supper Club questions 55:04 SIIIIICK ××× PIIIICKS ××× Andrey Mishchenko - Member of Technical Staff - OpenAI Bing Chat (GPT-4) in Google - Chrome Web Store ChatGPT plugins Introduction - OpenAI API ××× SIIIIICK ××× PIIIICKS ××× Shameless Plugs Tweet us your tasty treats Scott’s Instagram LevelUpTutorials Instagram Wes’ Instagram Wes’ Twitter Wes’ Facebook Scott’s Twitter Make sure to include @SyntaxFM in your tweets Wes Bos on Bluesky Scott on Bluesky Syntax on Bluesky