Big Data Engineering Full Course Part 1 | 17 Hours

Опубликовано: 28 Август 2023
на канале: The Data Tech

266,071

6.6k

This Course Cover Complete Big Data Engineering Topics

Part 1 -    • Big Data Engineering Full Course Part...
Part 2 -    • Big Data Engineering Full Course Part...

Resources
========
Hadoop Installation Steps - https://github.com/atozknowledge/bigd...

Hadoop Multi Node Cluster Setup Installation Steps - https://bit.ly/3LRwgRi

Big Data Integration Book - https://bit.ly/3ipIlBx

Hive
Hive-site.xml - https://github.com/Gowthamsb12/hive/b...
Hive ACID commands - https://bit.ly/2V9W1qT
Apache Hive ORC vs TextFile Format - https://bit.ly/3cbIbNl
Hive UDF Code - https://codewithgowtham.blogspot.com/...

Spark
Spark Submit Cluster [YARN] Mode Code link - https://github.com/atozknowledge/bigdata
Spark Kafka Cassandra | End to End Streaming Project Code and Steps - https://bit.ly/3LqXXRC

Kafka Installation Video -    • Apache Kafka Installation and Use Case

Sqoop Commands - https://codewithgowtham.blogspot.com/...

Course Outline

00:00 About Instructor
00:48 All about [What is Big Data]
37:52 Big Data Engineering Road Map
54:45 Hadoop Distributed File System (HDFS)
02:16:39 Unboxing [Hadoop Framework]
02:38:06 Hadoop Single Node Setup
03:14:24 HDFS Quotas Use Cases
03:26:57 MapReduce Complete Video
05:30:33 Apache Hive Introduction & Architecture
05:47:23 Installation [ Apache Hive 2 with MySQL ]
06:00:50 Hive SQL [Create Load Insert Show]
06:19:05 Hive Internal Vs External Table
06:25:53 Hive Partition [ Static Vs Dynamic]
06:43:47 Hive Bucket End to End Explained
07:03:09 How to Decide [Bucket Count] in Hive
07:14:09 Hive Partition with Bucket Explained
07:20:42 Hive ORC File Format with Demo
07:28:18 Hive ACID Table
07:35:09 Hive UDF
07:47:39 Apache Spark Introduction
08:35:18 Apache Spark Installation
08:52:36 Apache Spark Scala Wordcount Program (REPL)
09:05:51 Spark Standalone Architecture

YouTube-    / @thedatatech
Instagram - instagram.com/bigdata.in

Hash Tags
#bigdata #dataengineering

Смотрите видео Big Data Engineering Full Course Part 1 | 17 Hours онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь The Data Tech 28 Август 2023, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 266,07 раз и оно понравилось 6.6 тысяч людям.