Adding random variables, with connections to the central limit theorem.
Help fund future projects: https://www.patreon.com/3blue1brown
An equally valuable form of support is to simply share the videos.
0:00 - Intro quiz
2:24 - Discrete case, diagonal slices
6:49 - Discrete case, flip-and-slide
8:41 - The discrete formula
10:58 - Continuous case, flip-and-slide
15:53 - Example with uniform distributions
18:42 - Central limit theorem
20:50 - Continuous case, diagonal slices
25:26 - Returning to the intro quiz
------------------
These animations are largely made using a custom python library, manim. See the FAQ comments here:
https://www.3blue1brown.com/faq#manim
https://github.com/3b1b/manim
https://github.com/ManimCommunity/manim/
You can find code for specific videos and projects here:
https://github.com/3b1b/videos/
Music by Vincent Rubinetti.
https://www.vincentrubinetti.com/
Download the music on Bandcamp:
https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
Stream the music on Spotify:
https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u
------------------
3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe: http://3b1b.co/subscribe
Various social media stuffs:
Website: https://www.3blue1brown.com
Twitter: https://twitter.com/3blue1brown
Reddit: https://www.reddit.com/r/3blue1brown
Instagram: https://www.instagram.com/3blue1brown
Patreon: https://patreon.com/3blue1brown
Facebook: https://www.facebook.com/3blue1brown
...
https://www.youtube.com/watch?v=IaSGqQa5O-M
Space-filling curves, turning visual information into audio information, and the connection between infinite and finite math (this is a re-upload of an older video which had much worse audio).
Supplement with more space-filling curve fun: https://youtu.be/RU0wScIj36o
For more information on sight-via sound, this paper involving rewiring a ferret's retinas to its auditory cortex is particularly thought-provoking: http://phy.ucsf.edu/~houde/coleman/sur2.pdf
Alternatively, here is the NYT summary: https://goo.gl/qNuc14
Also, check out this excellent podcast on Human echolocation: https://goo.gl/23f4Yh
...
https://www.youtube.com/watch?v=3s7h2MHQtxc
An algorithm for numerically solving certain 2d equations.
Brought to you by...you! https://patreon.com/3blue1brown
Special thanks to these supporters: http://3b1b.co/winding-thanks
Even though we described how winding numbers can be used to solve 2d equations at a high level, it's worth pointing out that there are a few details missing for if you wanted to actually implement this. For example, in order to determine how often to sample points, you'd want to have some bounds on the rate at which the direction of the output changes. We will perhaps discuss this more in a follow-on video!
Music by Vincent Rubinetti:
https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
...
https://www.youtube.com/watch?v=b7FxPsqfkOY
Beginning tomorrow. Stay tuned!
Home page: https://www.3blue1brown.com
Brought to you by you: http://3b1b.co/thanks
------------------
Music by Vincent Rubinetti.
Download the music on Bandcamp:
https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
Stream the music on Spotify:
https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u
If you want to contribute translated subtitles or to help review those that have already been made by others and need approval, you can click the gear icon in the video and go to subtitles/cc, then "add subtitles/cc". I really appreciate those who do this, as it helps make the lessons accessible to more people.
------------------
3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe: http://3b1b.co/subscribe
Various social media stuffs:
Website: https://www.3blue1brown.com
Twitter: https://twitter.com/3blue1brown
Reddit: https://www.reddit.com/r/3blue1brown
Instagram: https://www.instagram.com/3blue1brown_animations/
Patreon: https://patreon.com/3blue1brown
Facebook: https://www.facebook.com/3blue1brown
...
https://www.youtube.com/watch?v=ppWPuXsnf1Q
Demystifying attention, the key mechanism inside transformers and LLMs.
Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support
An equally valuable form of support is to simply share the videos.
Demystifying self-attention, multiple heads, and cross-attention.
Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support
The first pass for the translated subtitles here is machine-generated, and therefore notably imperfect. To contribute edits or fixes, visit https://translate.3blue1brown.com/
------------------
Here are a few other relevant resources
Build a GPT from scratch, by Andrej Karpathy
https://youtu.be/kCc8FmEb1nY
If you want a conceptual understanding of language models from the ground up, @vcubingx just started a short series of videos on the topic:
https://youtu.be/1il-s4mgNdI?si=XaVxj6bsdy3VkgEX
If you're interested in the herculean task of interpreting what these large networks might actually be doing, the Transformer Circuits posts by Anthropic are great. In particular, it was only after reading one of these that I started thinking of the combination of the value and output matrices as being a combined low-rank map from the embedding space to itself, which, at least in my mind, made things much clearer than other sources.
https://transformer-circuits.pub/2021/framework/index.html
Site with exercises related to ML programming and GPTs
https://www.gptandchill.ai/codingproblems
History of language models by Brit Cruise, @ArtOfTheProblem
https://youtu.be/OFS90-FX6pg
An early paper on how directions in embedding spaces have meaning:
https://arxiv.org/pdf/1301.3781.pdf
------------------
Timestamps:
0:00 - Recap on embeddings
1:39 - Motivating examples
4:29 - The attention pattern
11:08 - Masking
12:42 - Context size
13:10 - Values
15:44 - Counting parameters
18:21 - Cross-attention
19:19 - Multiple heads
22:16 - The output matrix
23:19 - Going deeper
24:54 - Ending
------------------
These animations are largely made using a custom Python library, manim. See the FAQ comments here:
https://3b1b.co/faq#manim
https://github.com/3b1b/manim
https://github.com/ManimCommunity/manim/
All code for specific videos is visible here:
https://github.com/3b1b/videos/
The music is by Vincent Rubinetti.
https://www.vincentrubinetti.com
https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u
------------------
3blue1brown is a channel about animating math, in all senses of the word animate. If you're reading the bottom of a video description, I'm guessing you're more interested than the average viewer in lessons here. It would mean a lot to me if you chose to stay up to date on new ones, either by subscribing here on YouTube or otherwise following on whichever platform below you check most regularly.
Mailing list: https://3blue1brown.substack.com
Twitter: https://twitter.com/3blue1brown
Instagram: https://www.instagram.com/3blue1brown
Reddit: https://www.reddit.com/r/3blue1brown
Facebook: https://www.facebook.com/3blue1brown
Patreon: https://patreon.com/3blue1brown
Website: https://www.3blue1brown.com
...
https://www.youtube.com/watch?v=eMlx5fFNoYc
A link to the full video is at the bottom of the screen.
Or, for reference: https://youtu.be/HZGCoVF3YvM
Editing from long-form to short by Dawid Kołodziej
...
https://www.youtube.com/watch?v=w-CXIqIjfRI
A new and more circularly proof of a famous Wallis product for pi.
Here's supplemental blog post, expanding some of the rigor of this proofs, along with other interesting tidbits about surrounding topics that we didn't fit into the video:
https://www.3blue1brown.com/sridhars-corner/2018/4/17/wallis-product-supplement-dominated-convergence
Try out Udacity: https://udacity.com/3b1b
Special thanks to the following Patreon supporters:
http://3b1b.co/wallis-thanks
...
https://www.youtube.com/watch?v=8GPy_UMV-08
A good time for a primer on exponential and logistic growth, no?
Home page: https://www.3blue1brown.com
Brought to you by you: http://3b1b.co/covid-thanks
Data source: https://www.worldometers.info/coronavirus/coronavirus-cases/#total-cases
Some have (quite rightfully) commented on how you shouldn't look at the R^2 of linear regressions on cumulative data since even for completely random changes each total is not at all independent of the last. Since the derivative of an exponential should also be an exponential, we could instead run the same test on the logarithms of the differences from day to day, which in this case gives R^2 = 0.91.
While this video uses COVID-19 (aka the Coronavirus) as a motivating example, the main goal is simply a math lesson on exponentials and logistic curves. If you're looking for a video more focused on COVID-19 itself, I'd recommend taking a look at this one from Osmosis: https://youtu.be/cFB_C2ieW5I
Extrapolation xkcd: https://xkcd.com/605/
------------------
These animations are largely made using manim, a scrappy open source python library: https://github.com/3b1b/manim
If you want to check it out, I feel compelled to warn you that it's not the most well-documented tool, and it has many other quirks you might expect in a library someone wrote with only their own use in mind.
Music by Vincent Rubinetti.
Download the music on Bandcamp:
https://vincerubinetti.bandcamp.com/album/the-music-of-3blue1brown
Stream the music on Spotify:
https://open.spotify.com/album/1dVyjwS8FBqXhRunaG5W5u
If you want to contribute translated subtitles or to help review those that have already been made by others and need approval, you can click the gear icon in the video and go to subtitles/cc, then "add subtitles/cc". I really appreciate those who do this, as it helps make the lessons accessible to more people.
------------------
3blue1brown is a channel about animating math, in all senses of the word animate. And you know the drill with YouTube, if you want to stay posted on new videos, subscribe: http://3b1b.co/subscribe
Various social media stuffs:
Website: https://www.3blue1brown.com
Twitter: https://twitter.com/3blue1brown
Reddit: https://www.reddit.com/r/3blue1brown
Instagram: https://www.instagram.com/3blue1brown_animations/
Patreon: https://patreon.com/3blue1brown
Facebook: https://www.facebook.com/3blue1brown
...
https://www.youtube.com/watch?v=Kas0tIxDvrg