Stable Beluga 2 (FreeWilly) AI New LLM Leader! Better than Llama 2
*The name was recently changed to Stable Beluga 1 and Stable Beluga 2 - * Stability AI has unveiled the 'Orca 🐳' LLM based models FreeWilly1 and FreeWilly2. In benchmark tests, these freely available models are showing capabilities on par with or even exceeding commercial systems like GPT-3.5!
FreeWilly1 leverages the 65 billion parameter LLaMA foundation model, while FreeWilly2 is built on the larger 70 billion parameter LLaMA 2 model. Both were fine-tuned on a dataset of just 600,000 high-quality examples - around 10% the size used for Microsoft's proprietary Orca model.
Yet despite the smaller dataset, FreeWilly is ranking #1 in the Hugging Face open source leaderboard, outperforming other open LLMs. On OpenAI benchmarks, it matches or beats GPT-3.5 on 6 out of 8 tasks. And on the AGI Eval reasoning test, FreeWilly2 gets nearly 90% accuracy compared to only 60% for GPT-3.5.
So what's the secret behind FreeWilly's impressive performance? It seems to be the quality of the training data rather than just model size. FreeWilly1 and 2 achieve similar results despite a 5 billion parameter difference. This highlights the importance of curating the right data.
Of course, these are still early benchmark results. Real-world performance remains to be tested. And currently FreeWilly is limited to research use only. But this represents a major milestone for open source AI - we finally have freely available models that can go toe-to-toe with the most advanced commercial LLMs out there!
I'll be keeping close tabs on FreeWilly's progress and future iterations. Let me know if you want to see any other AI developments covered in-depth!
Subscribe, Like, & Share for more videos and to stay updated with the latest technology: https://www.youtube.com/c/CloudDataSc...
Watch video Stable Beluga 2 (FreeWilly) AI New LLM Leader! Better than Llama 2 online without registration, duration hours minute second in high quality. This video was added by user Cloud Data Science 26 July 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,433 once and liked it 24 people.