An Introduction to Quantization & MLX
Hello all! A few months ago, Apple released their own Python-based ML framework with idea that users can make use of the extremely fast Apple Silicon hardware in a Mac for machine learning purposes. It turns out that MLX is also really good for LLMs, but depending on what kind of Mac you have, you may need to use a quantized LLM. In this upcoming #livecoding stream, we will demonstrate how we can use quantization to run an LLM on an average MacBook. See you this Friday (3/15) at 11:30am CT! #llm #genai #mlx
Watch video An Introduction to Quantization & MLX online without registration, duration hours minute second in high quality. This video was added by user David Hundley 01 January 1970, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,489 once and liked it 51 people.