How to Create Llama 2 Chatbot with Gradio and Hugging Face in Free Colab
In this Gradio and Hugging Face tutorial, you'll learn how to create a Chatbot for Llama 2. We will use Gradio Chat Interface, a convenient module to build Chatbots with open-source Large Language Models, such as Llama 2, available on Hugging Face. And we'll run everything in the free Colab Notebook.
+++ Useful Resources +++
Colab Notebook for this video: https://colab.research.google.com/dri...
+++ Hugging Face +++
Get your Llama-2 for the project: https://huggingface.co/meta-llama/Lla...
A blog post for running Llama 2 (Llama 2 is here) by Hugging Face: https://huggingface.co/blog/llama2
+++ Other resources +++
Build applications with Hugging Face on DeepLearning.ai: https://learn.deeplearning.ai/hugging...
Llama 2 with Gradio by Abhishek Thakur: • The FASTEST way to build CHAT UI for ...
Source for format_message: https://gist.github.com/abhishekkrtha...
Gradio Chat Interface Docs: https://www.gradio.app/docs/chatinter...
Connect with me:
LinkedIn: / kris-ograbek
Medium: / kris-ograbek
Chapters:
0:00 Intro
1:00 Installing Hugging Face PyTorch and Gradio
2:05 Get access to Llama 2
2:56 Login into Hugging Face in Colab
3:34 Loading Llama 2 Model and Tokenizer into Colab
4:13 Creating the Hugging Face Pipeline for Llama 2
5:00 Showing the previous solution and its drawbacks
7:27 How to Actually Prompt Llama 2
9:05 Function to format prompts for Llama 2
13:26 Function to Get Llama 2 responses
15:15 Gradio Chat Interface module
15:55 Chatting with Llama 2
18:31 Outro
Watch video How to Create Llama 2 Chatbot with Gradio and Hugging Face in Free Colab online without registration, duration hours minute second in high quality. This video was added by user Kris Ograbek 06 September 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 6,770 once and liked it 114 people.