Fine-Tune Llama3 using Synthetic Data

Published: 06 May 2024
on channel: Chris Hay
3,290
114

how to fine tune Llama-3 model in Google Colab in this tutorial using synthetically generated data. In this video chris not only shows you how to fine tune the model but also shows you his lessons learned, such as diversity of data, why the system prompt makes a difference, generalization and fine tuning to a particular format.

You will not only learn how to fine tune a model but also how to generate synthetic data, and learn what works and what doesn't.

Google Colab
https://colab.research.google.com/dri...

GIthub for Dataset:
https://github.com/chrishayuk/chuk-da...

HuggingFace for Model
https://huggingface.co/chrishayuk/lla...

HuggingFace for DataSet
https://huggingface.co/datasets/chris...


Watch video Fine-Tune Llama3 using Synthetic Data online without registration, duration hours minute second in high quality. This video was added by user Chris Hay 06 May 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 3,290 once and liked it 114 people.