BERT Research - Ep. 8 - Inner Workings V - Masked Language Model
In the final video of the series, we’ll look in detail at the BERT pre-training tasks: the “Masked Language Model” and “Next Sentence Prediction”, which are what really set it apart from prior models.
We’ll finish by looking at how the OpenAI GPT model relates and compares to BERT--the two models are surprisingly similar!
==== Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe
==== References ====
Kaggle Interview with Jacob Devlin (BERT Author): • Kaggle Coffee Chat: Jacob Devlin (Goo... (sorry for the awkward screenshot… I didn’t catch how goofy it looked while editing!)
Yannic Kilcher’s walkthrough of the BERT paper was very helpful for me in understanding the relation between BERT and the OpenAI GPT: • BERT: Pre-training of Deep Bidirectio...
Смотрите видео BERT Research - Ep. 8 - Inner Workings V - Masked Language Model онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь ChrisMcCormickAI 25 Февраль 2020, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 15,979 раз и оно понравилось 572 людям.