Muzammil Rehman - How LinkedIn is leveraging kafka for log aggregation and monitoring

Published: 17 May 2015
on channel: Hasgeek TV
1,617
16

Apache Kafka is publish-subscribe messaging rethought as a distributed commit log. It is used within LinkedIn for metrics and intra-application queuing.

Will give an overview on how we leverage kafka for the log aggregation (ELK) and service monitoring.

I am SRE Manager at LinkedIn with 8 years of industry experience. ELK and kafka are integral part of my day to day activity, apart from my regular responsibilities I build and manager ELK cluster for various team.

I am a technology enthusiasts and passionate on developing large scale infrastructure, I believe complex and large operations don’t necessarily have to be complex, simplicity is the best way.


Watch video Muzammil Rehman - How LinkedIn is leveraging kafka for log aggregation and monitoring online without registration, duration hours minute second in high quality. This video was added by user Hasgeek TV 17 May 2015, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,617 once and liked it 16 people.