Lifecycle of a Sample in the Prometheus TSDB
Ganesh Vernekar, Grafana Labs
Prometheus is the leading open-source metrics monitoring solution. Prometheus 2.x contains a highly optimised Time Series Database (TSDB). It has ACID compliance and works efficiently with 100s of millions of time series on a single node. On top of its code base, Cortex, Thanos and Mimir have implemented distributed TSDBs.
The Prometheus TSDB has many components that make this all possible—an in-memory database, a Write-Ahead Log (WAL) for durability, memory-mapping of data from disk, persistent immutable data blocks with highly optimised inverted indices, and various techniques of maintaining this data in the background.
This talk will take you through the entire lifecycle of a time series sample (timestamp int64, value float64) starting from the point it enters the Prometheus TSDB's in-memory database until it gets deleted from the persistent blocks according to the retention policies.
View the full SREcon22 Asia/Pacific program at https://www.usenix.org/conference/sre...
Watch video SREcon22 Asia/Pacific - Lifecycle of a Sample in the Prometheus TSDB online without registration, duration hours minute second in high quality. This video was added by user USENIX 30 January 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,155 once and liked it 38 people.