Run an AI Large Language Model (LLM) at home on your GPU
Download Docker Desktop:
This video is sponsored by Docker.
Large Language Models (LLMs) are a type of AI model that have proven to be extremely powerful and useful for a wide variety of tasks. They may be "large" in the sense that they use billions of parameters, but that doesn't mean you need to be a big company in order to run one. In fact, you can run some of the latest and greatest LLMs on your own machine, on your GPU, completely for free. We'll see how to do all that and more in this video using Docker Desktop! We'll even write an app to detect YouTube comment spam using an LLM.
― mCoding with James Murphy (
Docker:
Ollama:
Ollama Docker image:
Ollama Python:
GPU compatibility:
Docker Tutorial Video:
Fast Pow algorithm Video:
YouTube Data API Video:
Source code:
SUPPORT ME
---------------------------------------------------
Sign up on Patreon to get your donor role and early access to videos!
Feeling generous but don't have a Patreon? Donate via PayPal! (No sign up needed.)
Want to donate crypto? Check out the rest of my supported donations on my website!
Top patrons and donors: Laura M, Neel R, Dragos C, Jameson, Matt R, Pi, Vahnekie, Johan A, Mark M, Mutual Information
BE ACTIVE IN MY COMMUNITY
---------------------------------------------------
Discord:
Github:
Reddit:
Facebook:
CHAPTERS
---------------------------------------------------
0:00 Intro
0:56 Prerequisites
2:24 Running an model
4:33 Building an app
8:33 Containerizing the script
Смотрите видео Run an AI Large Language Model (LLM) at home on your GPU онлайн без регистрации, длительностью 09 минут 20 секунд в хорошем hd качестве. Это видео добавил пользователь mCoding 15 Август 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 13 тысяч раз и оно понравилось 704 людям.