BERT Research - Ep. 2 - WordPiece Embeddings
Update: The BERT eBook is out! You can buy it from my site here: https://www.chrismccormick.ai/bert-eb...
In Episode 2 we’ll look at:
What a word embedding is.
How BERT’s WordPiece model tokenizes text.
The contents of BERT’s vocabulary.
The Colab Notebook from the second half of the video (`Inspect BERT Vocabulary.ipynb`) can be found here: https://colab.research.google.com/dri...
I've also uploaded the `vocabulary.txt` file here if you want to peruse it without running the above notebook: https://drive.google.com/open?id=12jx...
==== Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe
Watch video BERT Research - Ep. 2 - WordPiece Embeddings online without registration, duration hours minute second in high quality. This video was added by user ChrisMcCormickAI 18 November 2019, don't forget to share it with your friends and acquaintances, it has been viewed on our site 71,415 once and liked it 1.7 thousand people.