🤗 Hugging Cast S2E4 - Deploying LLMs on AMD GPUs and Ryzen AI PCs
Hugging Cast is a live show about building AI with open source.
In this episode, Felix, Mohit and Jeff demo new experiences to deploy LLMs on AMD, on the cloud using the latest MI300X GPU instances on Azure, and on-device using the new Ryzen AI PCs.
🚀 How we collaborate with AMD to make open models go brrr everywhere
☁️ Deploy LLMs on Azure with the new ND MI300X v5 VMs and TGI
💻 Unlock on-device inference with optimum-amd on the new Ryzen AI PCs
Ryzen AI PC demo notebook: https://huggingface.co/mohitsha/ryzen...
Watch video 🤗 Hugging Cast S2E4 - Deploying LLMs on AMD GPUs and Ryzen AI PCs online without registration, duration hours minute second in high quality. This video was added by user HuggingFace 06 June 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,618 once and liked it 65 people.