Summarize PDFs with a Local AI (Private GPT) in Python
In this video, we'll see how you can code your own python web app to summarize and query PDFs with a local private AI large language model (LLM) using Ollama, Langchain, and Streamlit.
The code is available here: https://github.com/Vincent-Codes-Fina...
A written version of the tutorial is available here: https://vincent.codes.finance/posts/d...
The paper used as example is here: https://doi.org/10.1016/j.jfineco.202...
From this example, you should be able to create and modify your own version of this application, and to extend it to other use-cases.
Don't send your private data to OpenAI's ChatGPT , keep it private on your pc or mac! Or send it there if you want! he project uses an open-source local LLM (Mixtral), but you can use gpt-4 or gpt-3.5 through the OpenAI API.
👍 Please like if you found this video helpful, and subscribe to stay updated with my latest tutorials. 🔔
❤️ You can support this channel by buying me a ☕: https://buymeacoffee.com/codesfinance
🔖 Chapters:
00:00 Intro
00:20 Project
00:53 Tools
01:41 ML workflow
03:42 Dependencies
05:12 Summarize with stuffing
11:37 Query with MapReduce
18:35 UI with Streamlit
28:38 Final thoughts
🍺 Homebrew installation commands:
brew install ollama
⚙ Other commands
ollama pull mixtral
streamlit run doc_app.py
🔗 Video links:
Ollama: https://ollama.com/
LangChain: https://python.langchain.com/docs/get...
LangChain document loaders: https://python.langchain.com/docs/mod...
LangChain summarization example: https://python.langchain.com/docs/use...
Streamlit: https://streamlit.io/
🐍 More Vincent Codes Finance:
✍🏻 Blog: https://vincent.codes.finance
🐦 X: / codesfinance
🧵 Threads: https://www.threads.net/@codesfinance
😺 GitHub: https://github.com/Vincent-Codes-Finance
📘 Facebook: / 61559283113665
👨💼 LinkedIn: / vincent-codes-finance
🎓 Academic website: https://www.vincentgregoire.com/
#langchain #gpt #python #ollama #streamlit #chatgpt #llm #largelanguagemodels #javascript #programming #code #gpt #opensource #opensourceai #llama2 #mistral #bigdata #research #researchtips #vscode #professor #datascience #dataanalytics #dataanalysis #uncensored #private #claude #anthropic #llama3 #openai #llama
Watch video Summarize PDFs with a Local AI (Private GPT) in Python online without registration, duration hours minute second in high quality. This video was added by user Vincent Codes Finance 30 March 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 3,353 once and liked it 138 people.