The Data Guy

End-to-End Parallel ETL Pipeline with Airflow, Snowflake, and S3 Buckets!

Best Practices for dbt With Real World Examples!

Everything New in Airflow 2.10!

End to End Micro-Batching Pipeline With Apache Airflow and Kafka!

What is a Delta Lake? Delta Lakes Explained!

Apache Hudi Vs Apache Iceberg! Apache Hudi and Iceberg Comparison!

Data Modeling Best Practices! Best Practices for Designing Your Data Models!

End-to-End Postgres to Data Lake Data Processing Pipeline with Apache Spark, Airflow, and Minio!

Best Practices for Building Data Pipelines! How to Build the Best Data Pipelines

dbt Explained in 60 Seconds

How to Build a Retrieval Augmented Generation Pipeline with Meta's LLAMA 3 Large Language Model!

Apache Presto Explained in 60 Seconds!

End to End Incremental Data Lake Data Loading Pipeline with Apache Hudi, Trino, and Spark!

Why Apache Cassandra Rocks for Big Data!

Introduction to Mesop, an Open-Source Streamlit Competitor for Creating Easy AI Applications!

Apache Hudi: Real Time Data Magic!

How to Batch Run Machine Learning Models with Apache Flink's PyFlink!

Apache Hadoop: Big Data Powerhouse!

Apache Presto: The Ultimate SQL Query Engine

How to Migrate Data from a Postgres SQL Database to a Snowflake Database Using Apache Airflow!

Intro to Apache Iceberg! Apache Iceberg Explained for Beginners!

What is Semi Structured Data?

What are Data Assets?

Top Python Utility Scripts for Data Engineers and Data Scientists!

What is Data Integration?

Fiber Optic Broadband: The Future of the Internet

Satellite Internet: Connecting the Unreachable

Introduction to Apache Hudi for Data Lake Management! Apache Hudi for Beginners!

How to Use Index-All to Make Your Database and SQL Queries Hum!

How to Optimize Your SQL Queries with Real World Examples! SQL Query Optimization for Business!

Particle Accelerators: Powering the Future

Data Migration Explained!

How to Migrate Data from a Redshift Database to Any SQL Database Using Airflow!

How The Internet Works

How Routers Keep Your Internet Running Smoothly!

How Network Address Translation Works!

How Airbnb Manages Machine Learning at Scale with Chronon! Airbnb's Chronon Platform Explained!

Common Data Engineering Career Challenges and How to Overcome Them!

Data Structures: The Backbone of Efficiency

How to Migrate Airflow DAG Metadata from One Airflow Environment to Another Using Airflow!

Why PDFs Are a Game Changer!

Project Set-Up Best Practices! How to Set Up Your Data Engineering Project File Structure and CICD!

Apache NiFi: Master Data Flows in Seconds

How to Build a Fraud Detection Pipeline with PyFlink! Apache Flink Python Script for Fraud Detection

Apache Oozie in 60 Seconds!

What's the Role of a Data Engineer in a Business? Data Engineer's Role in an Organization Explained!

Kubernetes Pods: The Basics in 60s!

Hop Count Explained in 60 Seconds!

Bandwidth Explained in 60 Seconds!

Address Routing Explained in 60 Seconds!