What Table Format Should I Choose For My Data Lake? Hudi | Iceberg | Delta Lake

Published: 03 July 2023
on channel: Johnny Chivers
8,990
206

LINKS TO FULL BLOG:
ℹ️ AWS Blog:
https://aws.amazon.com/blogs/big-data...

Using a blog recently posted on AWS I break down and discuss the key considerations when deciding on an open source format for your transactional data lake tables in AWS. We look at the general considerations you should factor into your decision making process before diving into the different options available for streaming, CDC and batch. The video covers the three most popular open source table formats: Apache Hudi, Apache Iceberg, and Delta Lake.


SUPPORT THE CHANNEL:
☕ Buy Me A Coffee: https://www.buymeacoffee.com/johnnych...
🖥️ My VPN: https://go.nordvpn.net/aff_c?offer_id...


▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬

00:00 - Intro
01:19 - General Considerations
02:52 - Streaming
04:11 - Change Data Capture
05:16 - Batch Loads
06:01 - Outro


OTHER USEFUL LINKS:
ℹ️ My Website: https://johnnychivers.co.uk
🔗 Linkedin:   / johnny-chivers  


😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software


Enjoy 🤘


Watch video What Table Format Should I Choose For My Data Lake? Hudi | Iceberg | Delta Lake online without registration, duration hours minute second in high quality. This video was added by user Johnny Chivers 03 July 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 8,990 once and liked it 206 people.