Summarize PDFs with a Local AI (Private GPT) in Python
In this video, we'll see how you can code your own python web app to summarize and query PDFs with a local private AI large language model (LLM) using Ollama, Langchain, and Streamlit.
The code is available here: https://github.com/Vincent-Codes-Fina...
A written version of the tutorial is available here: https://vincent.codes.finance/posts/d...
The paper used as example is here: https://doi.org/10.1016/j.jfineco.202...
From this example, you should be able to create and modify your own version of this application, and to extend it to other use-cases.
Don't send your private data to OpenAI's ChatGPT , keep it private on your pc or mac! Or send it there if you want! he project uses an open-source local LLM (Mixtral), but you can use gpt-4 or gpt-3.5 through the OpenAI API.
👍 Please like if you found this video helpful, and subscribe to stay updated with my latest tutorials. 🔔
❤️ You can support this channel by buying me a ☕: https://buymeacoffee.com/codesfinance
🔖 Chapters:
00:00 Intro
00:20 Project
00:53 Tools
01:41 ML workflow
03:42 Dependencies
05:12 Summarize with stuffing
11:37 Query with MapReduce
18:35 UI with Streamlit
28:38 Final thoughts
🍺 Homebrew installation commands:
brew install ollama
⚙ Other commands
ollama pull mixtral
streamlit run doc_app.py
🔗 Video links:
Ollama: https://ollama.com/
LangChain: https://python.langchain.com/docs/get...
LangChain document loaders: https://python.langchain.com/docs/mod...
LangChain summarization example: https://python.langchain.com/docs/use...
Streamlit: https://streamlit.io/
🐍 More Vincent Codes Finance:
✍🏻 Blog: https://vincent.codes.finance
🐦 X: / codesfinance
🧵 Threads: https://www.threads.net/@codesfinance
😺 GitHub: https://github.com/Vincent-Codes-Finance
📘 Facebook: / 61559283113665
👨💼 LinkedIn: / vincent-codes-finance
🎓 Academic website: https://www.vincentgregoire.com/
#langchain #gpt #python #ollama #streamlit #chatgpt #llm #largelanguagemodels #javascript #programming #code #gpt #opensource #opensourceai #llama2 #mistral #bigdata #research #researchtips #vscode #professor #datascience #dataanalytics #dataanalysis #uncensored #private #claude #anthropic #llama3 #openai #llama
Смотрите видео Summarize PDFs with a Local AI (Private GPT) in Python онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Vincent Codes Finance 30 Март 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 3,353 раз и оно понравилось 138 людям.