Date: Mon, October 11, 2021
Location: Los Angeles, CA + Virtual
We are excited to be a Diamond sponsor for this year’s PromCon North America! In addition to Rob, CTO and Co-founder, giving a short keynote, we will also be leading a breakout session in the afternoon.
The key to quickly resolving problems is knowing about them as soon as possible. To accomplish this, you need fast and reliable alerting. However, many companies find that as their environments grow, and their alerts and queries become increasingly more expensive, it can become challenging to maintain the speed of real-time queries alerts as the metrics become higher in cardinality. This is where aggregation can help!
In this keynote, Rob will discuss how M3 aggregation can be used to create derived metrics, similar to Prometheus recording rules, with any Prometheus remote storage that supports Prometheus Remote Write. This can help relieve the pressure on Prometheus or remote storage when querying and alerting on metrics at large scale.
As the Prometheus ecosystem has matured, the compatibility between projects has accelerated and it is possible to use features from one project with another. In this talk, Rob and Gibbs will show how to use various parts of the M3 ecosystem to perform in-memory streaming metrics aggregation, without using M3DB itself, thanks to developments in core Prometheus and M3. Using two deployment options, they will perform a demo using a concrete example of creating a highly efficient cAdvisor overview dashboard that shows fast aggregate views of CPU, memory, network and disk activity for pod groups from tens of thousands of active containers. They will also demo how to use streaming recording rules to store per-metric 10m or 1h downsampled metrics with a global metric suffix in Prometheus, Cortex, and other Prometheus remote storage solutions, like M3 and Thanos, that don’t yet have the ability to downsample metrics.
Rob Skillington is the Co-Founder and CTO of Chronosphere. He was previously at Uber, where he was the technical lead of the observability team and creator of M3DB, the time-series database at the core of M3. He has worked in both very large (Microsoft), medium (Uber) and small teams. As of 2023, Rob is based in Melbourne, Australia with his family of four after 10 years spent living in Seattle, San Francisco and New York City.