AI Reading List (by Ilya Sutskever) - Part 5

Опубликовано: 22 Июнь 2024
на канале: DataMListic
1,277
36

In the fifth and last part in the AI reading list series, we continue with the next 6 items that Ilya Sutskever, former OpenAI chief scientist, gave to John Carmack. Ilya followed by saying that "If you really learn all of these, you’ll know 90% of what matters today".

References
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
AI Reading List - Part 1:    • AI Reading List (by Ilya Sutskever) -...  
AI Reading List - Part 2:    • AI Reading List (by Ilya Sutskever) -...  
AI Reading List - Part 3:    • AI Reading List (by Ilya Sutskever) -...  
AI Reading List - Part 4:    • AI Reading List (by Ilya Sutskever) -...  

Reading List
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin: https://arxiv.org/abs/1512.02595
Scaling Laws for Neural Language Models: https://arxiv.org/pdf/2001.08361
A Tutorial Introduction to the Minimum Description Length Principle: https://arxiv.org/abs/math/0406077
Machine Super Intelligence: http://www.vetta.org/documents/Machin...
Kolmogorov Complexity and Algorithmic
Randomness
: https://www.lirmm.fr/~ashen/kolmbook-...
CS231n: Convolutional Neural Networks for Visual Recognition: https://cs231n.github.io

Related Videos
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Why Language Models Hallucinate:    • Why Language Models Hallucinate  
Grounding DINO, Open-Set Object Detection:    • Object Detection Part 8: Grounding DI...  
Transformer Self-Attention Mechanism Explained:    • Transformer Self-Attention Mechanism ...  
How to Fine-tune Large Language Models Like ChatGPT with Low-Rank Adaptation (LoRA):    • How to Fine-tune Large Language Model...  
Multi-Head Attention (MHA), Multi-Query Attention (MQA), Grouped Query Attention (GQA) Explained:    • Multi-Head Attention (MHA), Multi-Que...  
LLM Prompt Engineering with Random Sampling: Temperature, Top-k, Top-p:    • LLM Prompt Engineering with Random Sa...  
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits:    • The Era of 1-bit LLMs: All Large Lang...  

Contents
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:16 - Item 1: DeepSpeech2
00:49 - Item 2: Scaling Laws for Neural Language Models
01:29 - Item 3: Minimum Description Length Principle
02:00 - Item 4: Machine Super Intelligence
02:34 - Item 5: Kolmogorov Complexity and Algorithmic
Randomness
03:11 - Item 6: CS231n: CNNs for Visual Recognition
03:37 - Outro

Follow Me
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
🐦 Twitter: @datamlistic   / datamlistic  
📸 Instagram: @datamlistic   / datamlistic  
📱 TikTok: @datamlistic   / datamlistic  

Channel Support
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)

If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Patreon:   / datamlistic  
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a

#aireadinglist #deepspeech #LLMs #machinelearning


Смотрите видео AI Reading List (by Ilya Sutskever) - Part 5 онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь DataMListic 22 Июнь 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 1,277 раз и оно понравилось 36 людям.