BigBird Research Ep. 5 - Where Does BigBird Help? & Series Conclusion
UPDATE: This series was a build-up to a more polished tutorial on BigBird, and it’s available now! Check out our complete guide to BigBird here: https://www.chrismccormick.ai/LongerT...
Weekly Research Group, May 13th, 2021
Sign up for our weekly newsletter for information on our weekly discussion group! https://www.chrismccormick.ai/subscribe
This week, I shared my results from applying BigBird to just the long comments in the 20 Newsgroups test set (thanks to Ronan McCormick for the idea!), and gave a review of a Notebook from Huggingface demonstrating BigBird on the TriviaQA benchmark.
You can view my “Research Journal” doc here: https://docs.google.com/document/d/1f...
For BigBird Q&A, we dug into some of my findings on BigBird’s training speed and the effects of the SentencePiece tokenizer.
You can view our notes from the Q&A discussion in this doc: https://docs.google.com/document/d/1j...
This forum post serves as a place for further discussion and questions from the session: https://discourse.chrismccormick.ai/t...
Next up we’ll be discussing our plans for a series on Chatbots, starting with its applications to Question Answering. Sign up here:
https://www.chrismccormick.ai/weekly-...
Watch video BigBird Research Ep. 5 - Where Does BigBird Help? & Series Conclusion online without registration, duration hours minute second in high quality. This video was added by user ChrisMcCormickAI 13 May 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 452 once and liked it 11 people.