BigBird Research Ep. 1 - Sparse Attention Basics
UPDATE: This series was a build-up to a more polished tutorial on BigBird, and it’s available now! Check out our complete guide to BigBird here: https://www.chrismccormick.ai/LongerT...
Weekly Research Group, April 8th, 2021
Sign up for our weekly newsletter for information on our weekly discussion group! https://www.chrismccormick.ai/subscribe
Our first "Weekly Research Group" meeting! Thanks again to everyone who attended.
The first half provides some introduction to BigBird, and in the second half we ventured off into other BERT-related topics such as applying BERT to graphs, co-reference resolution, and finding synonyms.
Sorry about my noisy keyboard! I'll figure that out better for next week.
There's a dedicated forum post for this meeting here: https://discourse.chrismccormick.ai/t...
Watch video BigBird Research Ep. 1 - Sparse Attention Basics online without registration, duration hours minute second in high quality. This video was added by user ChrisMcCormickAI 12 April 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 3,160 once and liked it 64 people.