Data Ingestion using NiFi - Quick Overview
We are glad to come up with Tech Series on Mondays where we will be talking about a particular topic between 4 to 8 weeks. Some of them will be free and some of them will be paid. In case you want to get notified in case of events, please sign up to our Meetup group - https://www.meetup.com/itversityin/
NiFi is one of the key tools in the area of Data Engineering and Big Data. It is primarily used for Data Ingestion and Orchestration. As part of 6 to 8 workshops between August and September, you will be learning key capabilities. Live sessions will be free and pre-recorded videos will be available exclusively for members of our YouTube channel.
As part of the first demo, I will demonstrate key capabilities.
* Overview of NiFi
* Understanding NiFi Layout as a service
* Key Concepts such as Flow Files, Attributes etc
* Understanding how to access the documentation
* Simple pipeline to copy files from Local File System and HDFS
However, there are quite a few advanced capabilities which I will be covering as part of the Tech Workshop Series on Mondays (6 to 8 Sessions):
* Setting up of NiFi in a single node using our AMI
* Building generic data ingestion flows
* Converting File Formats
* Writing conditional flows based upon attributes
* Triggering Shell Commands or Spark Jobs
* Transforming inflight data
* Logging Attributes and Messages
* Scheduling, Monitoring, and Alerting
and many more
Key Takeaways for those who sign up for the workshop.:
* Free end to end live workshop to provide data ingestion solutions using NiFi
* Pre-recorded videos for members exclusively after live session
* Details about AMI Image which can be leveraged to set up environment your selves
* Limited support using Slack
Connect with me or follow me at
/ durga0gadiraju
/ itversity
https://github.com/dgadiraju
/ itversityin
/ itversity
Watch video Data Ingestion using NiFi - Quick Overview online without registration, duration hours minute second in high quality. This video was added by user itversity 01 January 1970, don't forget to share it with your friends and acquaintances, it has been viewed on our site 7,893 once and liked it 139 people.