"Distributed Commit Log: Application Techniques for Transaction Processing" by David McNeil

Published: 17 September 2016
on channel: Strange Loop Conference
6,125
like

Messaging systems built on the idea of a distributed commit log such as Apache Kafka and Amazon Kinesis offer a powerful approach for building robust, real-time systems. However, because of their unique nature there are particular techniques required to use them effectively.

This talk will catalog approaches used in practice to address topics such as: dealing with duplicate event delivery, merging & splitting of shards, poison events, exception handling, detecting failed workers, performing rapid failover, and providing facilities for debugging. These approaches provide a foundation for using distributed commit logs not just for applications such as click-stream analysis but for transaction processing.


Watch video "Distributed Commit Log: Application Techniques for Transaction Processing" by David McNeil online without registration, duration hours minute second in high quality. This video was added by user Strange Loop Conference 17 September 2016, don't forget to share it with your friends and acquaintances, it has been viewed on our site 6,125 once and liked it like people.