Sign in to confirm you’re not a bot
This helps protect our community. Learn more

State of GPT | BRK216HFS

Microsoft Developer
643K subscribers
730K views 2 years ago #MSBuild
Learn about the training pipeline of GPT assistants like ChatGPT, from tokenization to pretraining, supervised finetuning, and Reinforcement Learning from Human Feedback (RLHF). Dive deeper into practical techniques and mental models for the effective use of these models, including prompting strategies, finetuning, the rapidly growing ecosystem of tools, and their future extensions. Speakers:
  • Andrej Karpathy
Session Information: This video is one of many sessions delivered for the Microsoft Build 2023 event. View the full session schedule and learn more about Microsoft Build at https://build.microsoft.com BRK216HFS | English (US) | AI #MSBuild ...more
...more
State of GPT | BRK216HFS
16KLikes
730,922Views
2023May 25
Learn about the training pipeline of GPT assistants like ChatGPT, from tokenization to pretraining, supervised finetuning, and Reinforcement Learning from Human Feedback (RLHF). Dive deeper into practical techniques and mental models for the effective use of these models, including prompting strategies, finetuning, the rapidly growing ecosystem of tools, and their future extensions. Speakers:
  • Andrej Karpathy
Session Information: This video is one of many sessions delivered for the Microsoft Build 2023 event. View the full session schedule and learn more about Microsoft Build at https://build.microsoft.com BRK216HFS | English (US) | AI #MSBuild
How this content was made
Auto-dubbed
Audio tracks for some languages were automatically generated. Learn more

Follow along using the transcript.

Microsoft Developer

643K subscribers