BERT Research - Ep. 8 - Inner Workings V - Masked Language Model
In the final video of the series, we’ll look in detail at the BERT pre-training tasks: the “Masked Language Model” and “Next Sentence Prediction”, which are what really set it apart from prior models.
We’ll finish by looking at how the OpenAI GPT model relates and compares to BERT--the two models are surprisingly similar!
==== Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe
==== References ====
Kaggle Interview with Jacob Devlin (BERT Author): • Kaggle Coffee Chat: Jacob Devlin (Goo... (sorry for the awkward screenshot… I didn’t catch how goofy it looked while editing!)
Yannic Kilcher’s walkthrough of the BERT paper was very helpful for me in understanding the relation between BERT and the OpenAI GPT: • BERT: Pre-training of Deep Bidirectio...
Watch video BERT Research - Ep. 8 - Inner Workings V - Masked Language Model online without registration, duration hours minute second in high quality. This video was added by user ChrisMcCormickAI 25 February 2020, don't forget to share it with your friends and acquaintances, it has been viewed on our site 15,979 once and liked it 572 people.