Data Architecture 101: Kappa (Real-Time Data)
Want to build a reliable, modern data architecture without the mess?
Here’s a free checklist to help you → https://bit.ly/kds-checklist
All things being equal, I think we'd all want access to source data in real time.
This is the holy-grail of data engineering and removes most delays to insights.
One architecture approach that makes this possible is known as the Kappa Architecture.
It focuses on real-time data loading & processing rather than waiting on batches.
No brainer, right?
Well, back here in the real-world, things aren't made equal.
Different architecture approaches require different levels of complexity (aka skill requirements).
Which impacts design & maintenance time.
Which all tends to mean higher overall cost of ownership.
All that to say, just because it's technically possible, doesn't always mean it's the best choice for your team.
Truthfully, I find it's usually not necessary.
BUT that doesn't mean you shouldn't be aware of it and be able to evaluate it.
So in this video we'll review at a high level what the Kappa architecture is about.
By the end, you'll understand the key points and be able to decide whether or not it makes sense for your team.
Enjoy!
Timestamps:
0:00 - Intro
0:23 - What is a Kappa Architecture
1:28 - General Considerations
2:53 - Example Architecture
Title & Tags:
Data Architecture 101: Kappa (Real-Time Data)
#kahandatasolutions #dataengineering #dataarchitecture
Смотрите видео Data Architecture 101: Kappa (Real-Time Data) онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Kahan Data Solutions 01 Ноябрь 2023, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 5,386 раз и оно понравилось 190 людям.