This helps protect our community. Learn more

The 35 Year History of ChatGPT

168K subscribers

1.1M views 1 year ago

I follow the 35 year journey that led to the explosion of Large Language Models. From Jordan's pioneering work in 1986 to today's GPT-4, this documentary traces how AI learned to talk. Featuring insights from AI pioneers including Chomsky, Hofstadter, Hinton, and LeCun, exploring the revolutionary concepts that made ChatGPT possible: transformer architecture, attention mechanism, next-token prediction, and emergent capabilities. Next video following open ai's o1 model My script, references & visualizations here: https://docs.google.com/document/d/1s... Consider joining my channel as a YouTube member: / @artoftheproblem This is part of "The Pattern Machine" series: • Introduction to Deep Learning TIMESTAMPS: 00:00 - Introduction 00:32 - hofstader's thoughts on chatGPT 01:00 - recap of supervised learning 01:55 - first paper on sequential learning 02:55 - first use of state units (RNN) 04:33 - first observation of word boundary detect

…

...more

Art of the Problem tagged products below. Learn more

Art of the Problem - Contrast Coffee Mug

Spreadshop

$16.77

Art of the Problem - Men's Hoodie

Spreadshop

$37.82

Art of the Problem - Men's T-Shirt

Spreadshop

$21.76

Art of the Problem - Sticker

Spreadshop

$1.99

The 35 Year History of ChatGPT

29KLikes

1,185,066Views

2023Nov 27

Transcript

Follow along using the transcript.

Art of the Problem

168K subscribers

Detecting Alien Life with Math

by Art of the Problem

What Is Machine Learning?

by Art of the Problem

Computer Science

by Art of the Problem

The 35 Year History of ChatGPT

Chapters View all

Introduction

Introduction

Introduction

hofstader's thoughts on chatGPT

hofstader's thoughts on chatGPT

hofstader's thoughts on chatGPT

recap of supervised learning

recap of supervised learning

recap of supervised learning

first paper on sequential learning

first paper on sequential learning

first paper on sequential learning

first use of state units (RNN)

first use of state units (RNN)

first use of state units (RNN)

first observation of word boundary detection

first observation of word boundary detection

first observation of word boundary detection

first observation of word clustering

first observation of word clustering

first observation of word clustering

first "large" language model Hinton/Sutskever

first "large" language model Hinton/Sutskever

first "large" language model Hinton/Sutskever

Art of the Problem

The 35 Year History of ChatGPT

Comments 2.2K

Chapters

Introduction

Introduction

Introduction

hofstader's thoughts on chatGPT

hofstader's thoughts on chatGPT

hofstader's thoughts on chatGPT

recap of supervised learning

recap of supervised learning

recap of supervised learning

first paper on sequential learning

first paper on sequential learning

first paper on sequential learning

first use of state units (RNN)

first use of state units (RNN)

first use of state units (RNN)

first observation of word boundary detection

first observation of word boundary detection

first observation of word boundary detection

first observation of word clustering

first observation of word clustering

first observation of word clustering

first "large" language model Hinton/Sutskever

first "large" language model Hinton/Sutskever

first "large" language model Hinton/Sutskever

sentiment neuron (Ilya | OpenAI)

sentiment neuron (Ilya | OpenAI)

sentiment neuron (Ilya | OpenAI)

transformer explanation

transformer explanation

transformer explanation

GPT-1

GPT-1

GPT-1

GPT-2

GPT-2

GPT-2

GPT-3

GPT-3

GPT-3

In-context learning

In-context learning

In-context learning

ChatGPT / GPT-4

ChatGPT / GPT-4

ChatGPT / GPT-4

tool use

tool use

tool use

philosophical question: what is thought?

philosophical question: what is thought?

Chapters

Chapters