Map Reduce Paper - Distributed data processing

Опубликовано: 03 Май 2019
на канале: Defog Tech
49,865
1.2k

Paper that inspired Hadoop. This video explains Map Reduce concepts which is used for distributed big data processing.

This video takes some liberties to explain the underlying concept as simply as possible. For example; the map process for song count is typically implemented as, emit number 1 for each song title. After this a combiner function is used to locally aggregate/sum these counts per song.

Also, this video leaves out many implementation details, which are interesting. I encourage you to read the paper for them.

Thanks for watching.

Channel
----------------------------------
Complex concepts explained in short & simple manner. Topics include Java Concurrency, Spring Boot, Microservices, Distributed Systems etc. Feel free to ask any doubts in the comments. Also happy to take requests for new videos.

Subscribe or explore the channel -    / defogtech  

New video added every weekend.

Popular Videos
----------------------------------
What is an API Gateway -    • What is an API Gateway?  
Executor Service -    • Java ExecutorService - Part 1 - Intro...  
Introduction to CompletableFuture -    • Introduction to CompletableFuture in ...  
Java Memory Model in 10 minutes -    • Java Memory Model in 10 minutes  
Volatile vs Atomic -    • Using volatile vs AtomicInteger in Ja...  
What is Spring Webflux -    • What is Spring Webflux and when to us...  
Java Concurrency Interview question -    • Java Concurrency Interview Question: ...  


Смотрите видео Map Reduce Paper - Distributed data processing онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Defog Tech 03 Май 2019, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 49,86 раз и оно понравилось 1.2 тысяч людям.