HuggingFace Fundamentals with LLM's such as TInyLlama and Mistral 7B
chris looks under the hood of huggingface models such as TinyLlama and Mistral 7-B. In the video Chris presents a high level reference model of large language models and uses this to show how tokenization and the AutoTokenizer module works from the HuggingFace transfomer library linking it back to the HuggingFace repository. In addition we look at the tokenizer config and Chris shows how Mistral and Llama-2 both use the same tokenizer and embeddings architecture (albeit different vocabularies). Finally Chris shows you how to look at the model configuration and model architecture of hugging face models.
As we start to build towards our own large language model, understanding these fundamentals are critical no matter whether you are a builder or consumer of AI.
Google Colab:
https://colab.research.google.com/dri...
Watch video HuggingFace Fundamentals with LLM's such as TInyLlama and Mistral 7B online without registration, duration hours minute second in high quality. This video was added by user Chris Hay 05 February 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 7,795 once and liked it 296 people.