AI Reading List (by Ilya Sutskever) - Part 5

Published: 22 June 2024
on channel: DataMListic
1,277
36

In the fifth and last part in the AI reading list series, we continue with the next 6 items that Ilya Sutskever, former OpenAI chief scientist, gave to John Carmack. Ilya followed by saying that "If you really learn all of these, you’ll know 90% of what matters today".

References
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
AI Reading List - Part 1:    • AI Reading List (by Ilya Sutskever) -...  
AI Reading List - Part 2:    • AI Reading List (by Ilya Sutskever) -...  
AI Reading List - Part 3:    • AI Reading List (by Ilya Sutskever) -...  
AI Reading List - Part 4:    • AI Reading List (by Ilya Sutskever) -...  

Reading List
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin: https://arxiv.org/abs/1512.02595
Scaling Laws for Neural Language Models: https://arxiv.org/pdf/2001.08361
A Tutorial Introduction to the Minimum Description Length Principle: https://arxiv.org/abs/math/0406077
Machine Super Intelligence: http://www.vetta.org/documents/Machin...
Kolmogorov Complexity and Algorithmic
Randomness
: https://www.lirmm.fr/~ashen/kolmbook-...
CS231n: Convolutional Neural Networks for Visual Recognition: https://cs231n.github.io

Related Videos
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Why Language Models Hallucinate:    • Why Language Models Hallucinate  
Grounding DINO, Open-Set Object Detection:    • Object Detection Part 8: Grounding DI...  
Transformer Self-Attention Mechanism Explained:    • Transformer Self-Attention Mechanism ...  
How to Fine-tune Large Language Models Like ChatGPT with Low-Rank Adaptation (LoRA):    • How to Fine-tune Large Language Model...  
Multi-Head Attention (MHA), Multi-Query Attention (MQA), Grouped Query Attention (GQA) Explained:    • Multi-Head Attention (MHA), Multi-Que...  
LLM Prompt Engineering with Random Sampling: Temperature, Top-k, Top-p:    • LLM Prompt Engineering with Random Sa...  
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits:    • The Era of 1-bit LLMs: All Large Lang...  

Contents
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
00:00 - Intro
00:16 - Item 1: DeepSpeech2
00:49 - Item 2: Scaling Laws for Neural Language Models
01:29 - Item 3: Minimum Description Length Principle
02:00 - Item 4: Machine Super Intelligence
02:34 - Item 5: Kolmogorov Complexity and Algorithmic
Randomness
03:11 - Item 6: CS231n: CNNs for Visual Recognition
03:37 - Outro

Follow Me
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
🐦 Twitter: @datamlistic   / datamlistic  
📸 Instagram: @datamlistic   / datamlistic  
📱 TikTok: @datamlistic   / datamlistic  

Channel Support
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
The best way to support the channel is to share the content. ;)

If you'd like to also support the channel financially, donating the price of a coffee is always warmly welcomed! (completely optional and voluntary)
► Patreon:   / datamlistic  
► Bitcoin (BTC): 3C6Pkzyb5CjAUYrJxmpCaaNPVRgRVxxyTq
► Ethereum (ETH): 0x9Ac4eB94386C3e02b96599C05B7a8C71773c9281
► Cardano (ADA): addr1v95rfxlslfzkvd8sr3exkh7st4qmgj4ywf5zcaxgqgdyunsj5juw5
► Tether (USDT): 0xeC261d9b2EE4B6997a6a424067af165BAA4afE1a

#aireadinglist #deepspeech #LLMs #machinelearning


Watch video AI Reading List (by Ilya Sutskever) - Part 5 online without registration, duration hours minute second in high quality. This video was added by user DataMListic 22 June 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,277 once and liked it 36 people.