AI Reading List (by Ilya Sutskever) - Part 3
In the third part of the AI reading list series, we continue with the next 5 items that Ilya Sutskever, former OpenAI chief scientist, gave to John Carmack. Ilya followed by saying that "If you really learn all of these, you’ll know 90% of what matters today".
References
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
AI Reading List - Part 1: • AI Reading List (by Ilya Sutskever) -...
AI Reading List - Part 2: • AI Reading List (by Ilya Sutskever) -...
Transformer Self-Attention Mechanism Explained: • Transformer Self-Attention Mechanism ...
Effective Approaches to Attention-based Neural Machine Translation paper: https://arxiv.org/abs/1508.04025
Reading List
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Multi-Scale Context Aggregation by Dilated Convolutions: https://arxiv.org/pdf/1511.07122
Neural Message Passing for Quantum Chemistry: https://arxiv.org/pdf/1704.01212
Attention Is All You Need: https://arxiv.org/pdf/1706.03762
Neural Machine Translation by Jointly Learning to Align and Translate: https://arxiv.org/pdf/1409.0473
Identity Mappings in Deep Residual Networks: https://arxiv.org/pdf/1603.05027
Related Videos
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Why Language Models Hallucinate: • Why Language Models Hallucinate
Grounding DINO, Open-Set Object Detection: • Object Detection Part 8: Grounding DI...
Transformer Self-Attention Mechanism Explained: • Transformer Self-Attention Mechanism ...
How to Fine-tune Large Language Models Like ChatGPT with Low-Rank Adaptation (LoRA): • How to Fine-tune Large Language Model...
Multi-Head Attention (MHA), Multi-Query Attention (MQA), Grouped Query Attention (GQA) Explained: • Multi-Head Attention (MHA), Multi-Que...
LLM Prompt Engineering with Random Sampling: Temperature, Top-k, Top-p: • LLM Prompt Engineering with Random Sa...
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits: • The Era of 1-bit LLMs: All Large Lang...
Contents
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:21 - Item 1: Dilated Convolutions
01:10 - Item 2: Neural Message Passing for Quantum Chemistry
01:35 - Item 3: Attention Is All You Need
02:42 - Item 4: NMT by Jointly Learning to Align and Translate
03:12 - Item 5: Identity Mappings in Deep Residual Networks
04:30 - Outro
Follow Me
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
🐦 Twitter: @datamlistic / datamlistic
📸 Instagram: @datamlistic / datamlistic
📱 TikTok: @datamlistic / datamlistic
Channel Support
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)
If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Patreon: / datamlistic
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a
#seq2seq #attentionmechanism #dilatedconvolutions #identitymappings #messagepassing
Watch video AI Reading List (by Ilya Sutskever) - Part 3 online without registration, duration hours minute second in high quality. This video was added by user DataMListic 12 June 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,621 once and liked it 56 people.