65,000 Tokens in a LOCAL LLM 🤯 One-Click Install | Crazy New Model (High PC requirements)
Want to try out the new MPT-7B models including the 65k+ token StoryWriter, Instruct and Chat models? Well, this video includes a simple one-line install command you can run now to try it out on your PC! These models have crazy requirements, but not something people can't meet. You'll either need a lot of RAM (~32GB+) or a 3090/4090 (16GB VRAM required). The one-click installer lets you choose between CPU and GPU modes for the model.
It's a fun tech demo-type model that shows crazy things coming in the future!
MoscaicML: https://huggingface.co/mosaicml
More about MPT-7B: https://www.mosaicml.com/blog/mpt-7b
One-line install command: iex (irm mpt.tc.ht)
Timestamps:
0:00 - Intro/Explanation
0:40 - What is MPT-7
1:26 - 65,000+ tokens (Understanding pretty much a whole book!)
3:06 - Requirements
4:11 - One-line install command
7:53 - CPU only mode (for most users probably!)
8:32 - Fix crashes by lowering core count for Ooba
9:25 - Testing MPT-7b Chat
9:45 - Testing MPT-7b Storywriter (65k+ tokens!)
#MPT #AI #ChatGPT
-----------------------------
💸 Found this useful? Help me make more! Support me by becoming a member: / @troublechute
-----------------------------
💸 Direct donations via Ko-Fi: https://ko-fi.com/TCNOco
💬 Discuss the video & Suggest (Discord): https://s.tcno.co/Discord
👉 Game guides & Simple tips: / troublechutebasics
🌐 Website: https://tcno.co
📧 Need voiceovers done? Business query? Contact my business email: TroubleChute (at) tcno.co
-----------------------------
🎨 My Themes & Windows Skins: https://hub.tcno.co/faq/my-windows/
👨💻 Software I use: https://hub.tcno.co/faq/my-software/
➡️ My Setup: https://hub.tcno.co/faq/my-hardware/
🖥️ My Current Hardware (Links here are affiliate links. If you click one, I'll receive a small commission at no extra cost to you):
Intel i9-13900k - https://amzn.to/42xQuI1
GIGABYTE Z790 AORUS Master - https://amzn.to/3nHuBHx
G.Skill RipJaws 2x(2x32G) [128GB] - https://amzn.to/42cilxN
Corsair H150i 360mm AIO - https://amzn.to/42cznvP
MSI 3080Ti Gaming X Trio - https://amzn.to/3pdnLdb
Corsair 1000W RM1000i - https://amzn.to/42gOTGY
Corsair MP600 PRO XT 2TB - https://amzn.to/3NSvwzx
🎙️ My Current Mic/Recording Gear:
Shure SM7B - https://amzn.to/3nDGYo1
Audient iD14 - https://amzn.to/3pgf2XK
dbx 286s - https://amzn.to/3VNaq7O
Triton Audio FetHead - https://amzn.to/3pdjIgZ
Everything in this video is my personal opinion and experience and should not be considered professional advice. Always do your own research and ensure what you're doing is safe.
Watch video 65,000 Tokens in a LOCAL LLM 🤯 One-Click Install | Crazy New Model (High PC requirements) online without registration, duration hours minute second in high quality. This video was added by user TroubleChute 10 May 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 27,301 once and liked it 808 people.