New course with Weaviate: Building Multimodal Search and RAG

Published: 13 May 2024
on channel: DeepLearningAI
2,476
73

Enroll now: https://bit.ly/3JVgIwW

Learn how to build multimodal search and RAG systems. RAG systems enhance an LLM by incorporating proprietary data into the prompt context. Typically, RAG applications use text documents, but, what if the desired context includes multimedia like images, audio, and video? This course covers the technical aspects of implementing RAG with multimodal data to accomplish this.

Learn how multimodal models are trained through contrastive learning and implement it on a real dataset.
Build any-to-any multimodal search to retrieve relevant context across different data types.
Learn how LLMs are trained to understand multimodal data through visual instruction tuning and use them on multiple image reasoning examples
Implement an end-to-end multimodal RAG system that analyzes retrieved multimodal context to generate insightful answers
Explore industry applications like visually analyzing invoices and flowcharts to output structured data.
Create a multi-vector recommender system that suggests relevant items by comparing their similarities across multiple modalities.

As AI systems increasingly need to process and reason over multiple data modalities, learning how to build such systems is an important skill for AI developers.

This course equips you with the key skills to embed, retrieve, and generate across different modalities. By gaining a strong foundation in multimodal AI, you'll be prepared to build smarter search, RAG, and recommender systems.

Learn more: https://bit.ly/3JVgIwW


Watch video New course with Weaviate: Building Multimodal Search and RAG online without registration, duration hours minute second in high quality. This video was added by user DeepLearningAI 13 May 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,476 once and liked it 73 people.