Setting up GPT-in-a-Box on Nutanix Kubernetes Engine | Tech Bytes | Nutanix University
GPT-in-a-Box helps you deploy AI-ready infrastructure quickly. In this video, Laura Jordana, Nutanix Technical Marketing Engineer, will walk you through setting up GPT-in-a-Box on Nutanix Kubernetes Engine and connecting a sample chatbot application to it.
0:00 Intro
0:21 Review Kubernetes and NFS configuration with NKE and NUS
0:49 Review jump host configuration
1:29 Mount NFS share and download Kubeconfig
2:33 Configure GPU Operator
3:07 Download GPT-in-a-Box K8s package
3:37 Install KServe and required Python packages
4:15 Generate Model Archive File
5:07 Deploy Inference Server
6:00 Test Inference Endpoint
7:20 Setup chatbot application
7:45 Run chatbot application
8:24 Conclusion
Resources:
Github repo: https://github.com/nutanix/nai-llm-k8s
Documentation: https://opendocs.nutanix.com/gpt-in-a...
#techbytes #gptinabox #nke #nutanixuniversity #ai #chatbot
Watch video Setting up GPT-in-a-Box on Nutanix Kubernetes Engine | Tech Bytes | Nutanix University online without registration, duration hours minute second in high quality. This video was added by user Nutanix University 21 March 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,031 once and liked it 11 people.