Positional Encoding in Transformer Neural Networks Explained

Published: 01 January 1970
on channel: CodeEmporium
42,468
1.6k

Positional Encoding! Let's dig into it

ABOUT ME
⭕ Subscribe: https://www.youtube.com/c/CodeEmporiu...
📚 Medium Blog:   / dataemporium  
💻 Github: https://github.com/ajhalthor
👔 LinkedIn:   / ajay-halthor-477974bb  

RESOURCES
[ 1🔎] Code for video: https://github.com/ajhalthor/Transfor...
[ 2🔎] My video on multi-head attention attention:    • Multi Head Attention in Transformer N...  
[3 🔎] Transformer Main Paper: https://arxiv.org/abs/1706.03762

PLAYLISTS FROM MY CHANNEL
⭕ ChatGPT Playlist of all other videos:    • ChatGPT  
⭕ Transformer Neural Networks:    • Natural Language Processing 101  
⭕ Convolutional Neural Networks:    • Convolution Neural Networks  
⭕ The Math You Should Know :    • The Math You Should Know  
⭕ Probability Theory for Machine Learning:    • Probability Theory for Machine Learning  
⭕ Coding Machine Learning:    • Code Machine Learning  


MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: https://imp.i384100.net/MathML
📕 Calculus: https://imp.i384100.net/Calculus
📕 Statistics for Data Science: https://imp.i384100.net/AdvancedStati...
📕 Bayesian Statistics: https://imp.i384100.net/BayesianStati...
📕 Linear Algebra: https://imp.i384100.net/LinearAlgebra
📕 Probability: https://imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning
📕 Python for Everybody: https://imp.i384100.net/python
📕 MLOps Course: https://imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): https://imp.i384100.net/NLP
📕 Machine Learning in Production: https://imp.i384100.net/MLProduction
📕 Data Science Specialization: https://imp.i384100.net/DataScience
📕 Tensorflow: https://imp.i384100.net/Tensorflow

TIMSTAMPS
0:00 Transformer Overview
2:23 Transformer Architecture Deep Dive
5:11 Positional Encoding
7:25 Code Breakdown
11:11 Final Coded Class


Watch video Positional Encoding in Transformer Neural Networks Explained online without registration, duration hours minute second in high quality. This video was added by user CodeEmporium 01 January 1970, don't forget to share it with your friends and acquaintances, it has been viewed on our site 42,468 once and liked it 1.6 thousand people.