What happens *inside* a neural network?

Published: 15 October 2021
on channel: vcubingx
39,264
2.2k

Visuals to demonstrate how a neural network classifies a set of data. Thanks for watching!
Support me on Patreon!   / vcubingx  
Source Code: https://github.com/vivek3141/dl-visua...

Here's the course I referred to in the video. I am not affiliated with NYU.
   • NYU Deep Learning SP20  

Sinusoids as activation functions:
https://openreview.net/forum?id=Sks3z...
https://vsitzmann.github.io/siren/

Here's the distill.pub article:
https://distill.pub/2020/grand-tour/

Special thanks to Alfredo Canziani and Nikhil Maserang for reviewing the video.

And also thanks to Grant Sanderson himself for giving me some manim tips!

I've been active on twitter, follow me here!
  / vcubingx  

Join my discord server!
  / discord  

These animation in this video was made using 3blue1brown's library, manim:
https://github.com/3b1b/manim

Music is from GameChops (Route 113, Azalea Town, Ecruteak City

Follow me!
Website: https://vcubingx.com
Twitter:   / vcubingx  
Github: https://github.com/vivek3141
Instagram:   / vcubingx  
Patreon:   / vcubingx  

What does a Neural Network actually do? Visualizing Deep Learning, Chapter 2

0:00 Intro
0:18 Recap of Part 1
1:57 Introducing the dataset
2:52 Structure of the Neural Network we’ll be using
3:34 What is softmax?
5:52 Input space decision boundaries
6:24 Modifying the Neural Network to visualize what it’s doing
7:36 Out-of-domain boundaries
8:46 sin(x) as an activation function
9:30 Neuron planes
11:57 Softmax surfaces
13:20 MNIST Transformation
13:42 Outro


Watch video What happens *inside* a neural network? online without registration, duration hours minute second in high quality. This video was added by user vcubingx 15 October 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 39,264 once and liked it 2.2 thousand people.