YouTube Data Analysis | END TO END DATA ENGINEERING PROJECT
➡️ Check Out My Data Engineering Bootcamp: https://bit.ly/3yXsrcy
USE CODE: COMBO50 for a 50% discount
In this video, you will execute the END TO END DATA ENGINEERING PROJECT using Kaggle YouTube Trending Dataset.
If you are someone who wants to learn Data Engineering by doing hands-on projects then this video is for you!
👉🏻Part 2 of the video - • YouTube Data Analysis | END TO END DA...
✨Visit ProjectPro for more projects - https://bit.ly/3iIGfM5
Useful links mentioned in the video -
1. Create Your AWS Account - https://aws.amazon.com/premiumsupport...
2. Download AWS CLI - https://aws.amazon.com/cli/
3. Download Data From Here - https://www.kaggle.com/datasnaek/yout...
Find Commands and Code Used in the video here - https://github.com/darshilparmar/data...
👉🏻 Learn Basics (If you don't know) 👈🏻
1. Learn Python From Here - https://bit.ly/3t9pFLx
2. Learn SQL here - https://bit.ly/3KNmUW8
3. Learn Spark and Big Data - https://bit.ly/3telBcW
4. Learn AWS Lambda - https://aws.amazon.com/lambda/
Join Data With Darshil Discord Server: / discord
Timestamps
0:00 Project Introduction (Very Important)
2:22 What You Will Learn
4:57 Understand Dataset That We Are Going To Use
6:16 On-Premise vs Cloud Data Processing
8:50 Create Your AWS Account
9:19 Best Practices To Follow On AWS
9:59 Create IAM Account For Admin
13:15 Install AWS CLI
16:05 Create S3 Bucket and Upload Our Data
22:05 What is Data Lake?
23:40 Understand Data That Got Uploaded
24:45 Build Glue Crawler and Catalog
30:14 Use Athena and SQL to Query Data
32:20 Solving Error and Preprocessing Data
34:57 Writing ETL Job In Lambda and Cleaning Data
42:33 What is AWS Lambda and Layers?
47:51 Querying Our Cleaned Data on Athena
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / darshilparmarr
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life and Work: https://amzn.to/3HQJDyP
👀Deep Work: https://amzn.to/3IParkk
💼Rework: https://amzn.to/3HW981O
Tech I use every day
💻MacBook Pro M1: https://amzn.to/3CiFVwC
📺LG 22 Inch Monitor: https://amzn.to/3zk0Dts
🎥Sony ZV1: https://amzn.to/3hRpSMJ
🎙Maono AU-A04: https://amzn.to/3Bnu53n
⽴Tripod Stand: https://amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: https://amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: https://amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: https://amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: https://amzn.to/3IRpiL2
👉Data Engineering Complete Roadmap: • Data Engineer Complete Road Map 2022
👉Data Engineering Project Series: • Data Engineering Project Portfolio
👉Become Full-Time Freelancer: • Best Freelancer Series 2024
👉Data With Darshil Podcast: • Podcast Series - Data With Darshil
✨ Tags ✨
data engineering projects, big data project, data engineering project hands-on, hands-on data engineering projects, learn data engineering, data engineering roadmap, how to become data engineer, data engineering free projects, big data engineering, big data
✨ Hashtags ✨
#dataengineer #project #darshil
Смотрите видео YouTube Data Analysis | END TO END DATA ENGINEERING PROJECT онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Darshil Parmar 28 Март 2022, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 299,722 раз и оно понравилось 6.1 тысяч людям.