AI Reading List (by Ilya Sutskever) - Part 2
In this video, we continue the reading list series with the next 6 items that Ilya Sutskever, former OpenAI chief scientist, gave to John Carmack. Ilya followed by saying that "If you really learn all of these, you’ll know 90% of what matters today".
References
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
AI Reading List - Part 1: • AI Reading List (by Ilya Sutskever) -...
Why Residual Connections (ResNet) Work: • Why Residual Connections (ResNet) Work
Reading List
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Keeping Neural Networks Simple by Minimizing the Description Length of the Weights: https://www.cs.toronto.edu/~hinton/ab...
Pointer Networks: https://arxiv.org/pdf/1506.03134
ImageNet Classification with Deep Convolutional Neural Networks: https://proceedings.neurips.cc/paper_...
Order Matters: Sequence to Sequence for Sets: https://arxiv.org/pdf/1511.06391
GPipe: Easy Scaling with Micro-Batch Pipeline Parallelism: https://arxiv.org/pdf/1811.06965
Deep Residual Learning for Image Recognition: https://arxiv.org/pdf/1512.03385
Related Videos
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Why Language Models Hallucinate: • Why Language Models Hallucinate
Grounding DINO, Open-Set Object Detection: • Object Detection Part 8: Grounding DI...
Transformer Self-Attention Mechanism Explained: • Transformer Self-Attention Mechanism ...
How to Fine-tune Large Language Models Like ChatGPT with Low-Rank Adaptation (LoRA): • How to Fine-tune Large Language Model...
Multi-Head Attention (MHA), Multi-Query Attention (MQA), Grouped Query Attention (GQA) Explained: • Multi-Head Attention (MHA), Multi-Que...
LLM Prompt Engineering with Random Sampling: Temperature, Top-k, Top-p: • LLM Prompt Engineering with Random Sa...
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits: • The Era of 1-bit LLMs: All Large Lang...
Contents
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:23 - Item 1: Keeping Neural Networks Simple
00:58 - Item 2: Pointer Networks
01:45 - Item 3: ImageNet Classification with CNNs
02:30 - Item 4: Sequence to Sequence for Sets
03:11 - Item 5: GPipe
04:02 - Item 6: ResNets
04:43 - Outro
Follow Me
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
🐦 Twitter: @datamlistic / datamlistic
📸 Instagram: @datamlistic / datamlistic
📱 TikTok: @datamlistic / datamlistic
Channel Support
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)
If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Patreon: / datamlistic
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a
#aireadinglist #pointernetworks #imagenet #resnet #gpipe
Watch video AI Reading List (by Ilya Sutskever) - Part 2 online without registration, duration hours minute second in high quality. This video was added by user DataMListic 09 June 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,297 once and liked it 104 people.