Setting Up a RAG Demo on NVIDIA AI Workbench
Walk through a complete start-to-finish installation of a generative AI retrieval-augmented generation (RAG) system with Lee Bushen, solutions architect at NVIDIA.
You can use this system to create a RAG project on your own computer (no local GPU required) in about 1 hour.
This approach uses NVIDIA AI Workbench to install the system. NVIDIA AI Workbench is an easy-to-use developer toolkit for data science, machine learning, and AI project development. AI Workbench is free, and you can install it in minutes.
For more details, see the resources listed below.
######################
CHAPTERS IN THIS VIDEO
######################
0:00 – Intro and Prerequisites
02:01 – Create GitHub and NGC Accounts
05:39 – AI Workbench Install
09:46 – Clone/Launch the RAG Project
16:49 – How to Re-Enter the API Key
18:35 – Example Prompts
23:11 – Stopping/Restarting the Demo
Project storage and sharing: http://github.com
Used for API calls to optimized LLM: http://ngc.nvidia.com
Download NVIDIA AI Workbench: https://www.nvidia.com/en-us/deep-lea...
Hybrid RAG example project: https://github.com/NVIDIA/workbench-e...
Sample user data files:
NVIDIA H100 data sheet: https://resources.nvidia.com/en-us-te...
NVIDIA AI Enterprise Solution Overview:
https://resources.nvidia.com/en-us-da...
Watch video Setting Up a RAG Demo on NVIDIA AI Workbench online without registration, duration hours minute second in high quality. This video was added by user NVIDIA Developer 14 June 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 7,660 once and liked it 159 people.