Get started Gemma 2 Locally on Mac using MLX
In this video, we'll explore how to convert and run Google's Gemma 2 language model locally on your Mac using the MLX framework. You'll learn:
What Google Gemma 2 is and its variants
How to convert a Hugging Face/PyTorch model to MLX
Steps to run Gemma 2 on your local machine
What is Google Gemma 2?
Gemma 2 is a family of lightweight, state-of-the-art open-source language models developed using the same technology behind Google's Gemini models. It comes in three sizes:
1. Gemma 2.6B
2. Gemma 9B
3. Gemma 27B
Each size is available in pre-trained and instruction-tuned variants.
Is Google Gemma 2 free?
Yes, Gemma 2 is completely open-source and accessible through the Hugging Face Hub.
Model Weights
Quantized for MLX: https://huggingface.co/collections/ml...
Full Precision: https://huggingface.co/collections/go...
Additional Resources
Gemma 2 MLX Conversion Script:https://github.com/Blaizzy/LLMOps/blo...
Gemma 2 Transformers Implementation: https://github.com/huggingface/transf...
Gemma 2 PyTorch Implementation: https://github.com/google/gemma_pytor...
Fine-tuning Gemma Guide: https://unsloth.ai/blog/gemma2
Gradio App for MLX: https://github.com/SOSONAGI/mlx-simpl...
Connect with Me
LinkedIn: / prince-canuma
Twitter: / prince_canuma
Medium: / prince-canuma
Смотрите видео Get started Gemma 2 Locally on Mac using MLX онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Prince Canuma 20 Июль 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 1,223 раз и оно понравилось 43 людям.