Attention and Transformers Bonus Edition

Published: 01 December 2021
on channel: George Zoto
95
3

Event page: https://www.meetup.com/Deep-Learning-...

Hello dear friends 🌎 🌍,

We hope you are enjoying our latest sessions 🏖️ deploying models and cool applications to our phones 📱 and edge devices 🕹️

Our friend Dmitri has offered to lead some very interesting papers, code and content all on the attention mechanism in deep learning models and transformers! 😲

Attention and Transformers Bonus Edition | Applications of transformers for a non-NLP task

Kaggle competition on knowledge tracing:
Riiid Answer Correctness Prediction
Track knowledge states of 1M+ students in the wild
https://www.kaggle.com/c/riiid-test-a...

Dmitri's approach, ranked # 54 out of 3,395 participants (top 2%).
https://github.com/dlevonian/riiid-pr... ✅

Presentation: https://docs.google.com/presentation/...

The recording of this cool event 😎 is available at:
https://bit.ly/dla-transformers

Join us on Slack:
https://join.slack.com/t/deeplearning...

Spread the word about our meetup 🎉

Deep Learning YouTube playlists, feel free to share and subscribe 😀
https://bit.ly/dla-youtube

Are you excited to join us? See you soon!

Best,
Dmitri, Robert, George, and David


Watch video Attention and Transformers Bonus Edition online without registration, duration hours minute second in high quality. This video was added by user George Zoto 01 December 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 95 once and liked it 3 people.