How to use Hadoop Python Streaming?

Published: 19 September 2019
on channel: Sanket Shanbhag - Technical Coach
2,123
22

Mapper python file:
-------------------------------
https://drive.google.com/file/d/1t0fv...

Reducer python file:
-------------------------------
https://drive.google.com/file/d/1spXZ...

Commands:
-------------------
su - hduser
hadoop fs -mkdir /input
sudo nano /home/sanket/input
hadoop fs -put /home/sanket/input /input
create folder wordcount
sudo chmod -R 777 /home/sanket/wordcount
cd /home/sanket/wordcount

mapred streaming \
-input /input/input \
-output /output \
-mapper /home/sanket/wordcount/mapper.py \
-reducer /home/sanket/wordcount/reducer.py


Watch video How to use Hadoop Python Streaming? online without registration, duration hours minute second in high quality. This video was added by user Sanket Shanbhag - Technical Coach 19 September 2019, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,123 once and liked it 22 people.