CONTAINERS: PARTS AND LABOUR DANIEL MAHER, DATADOG @phrawzty

CONTAINERS: PARTS AND LABOUR DANIEL MAHER, DATADOG @phrawzty DOCKER DOCKER DOCKER

IS THE DOCKER FAD OVER?

DANIEL MAHER DOCS & TALKS DEVOPSDAYS GLOBAL GREAT OUTDOORS GOURMAND SUITS FOR NO REASON @phrawzty

DATADOG SAAS-BASED MONITORING TRILLIONS OF POINTS/DAY WE’RE HIRING: www.datadoghq.com/careers @datadoghq

Docker Adoption - Docker pulls?

https://www.datadoghq.com/docker-adoption/

Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Docker Adoption

Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Adopter : the average number of containers running during the month was at least 50% the number of distinct hosts run, or there were at least as many distinct containers as distinct hosts run during the month. Docker Adoption

Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Adopter : the average number of containers running during the month was at least 50% the number of distinct hosts run, or there were at least as many distinct containers as distinct hosts run during the month. Abandoner : a currently active company that used Docker in the past, but hasn't used it at all in the last month. Docker Adoption

WHO’S ADOPTING DOCKER?

WHAT’S RUNNING?

NGINX Redis Postgres FluentD Elasticsearch Mongo MySQL etcd RabbitMQ HAproxy % Customers Running a Tech in Containers 0   % 10   % 20   % 30   % 40   %

Redis Postgres Elasticsearch MySQL MongoDB etcd RabbitMQ % Customers Running Data Stores in Containers 0   % 10   % 20   % 30   % 40   %

HOW DENSELY PACKED?

ENTER THE ORCHESTRATORS

ORCHESTRATORTION IS NORMAL

CONTAINERS INCREASE COMPLEXITY HOW DO WE MONITOR THEM?

Alcohol: The cause of, and solution to, all of life’s problems. HOMER SIMPSON

Alcohol: The cause of, and solution to, all of life’s problems. HOMER SIMPSON CONTAINERS

Side Car Containers

AS COMPLEXITY INCREASES FUNDAMENTALS BECOME MORE IMPORTANT

4 QUALITIES OF GOOD METRICS NOT ALL METRICS ARE EQUAL

  1. MUST BE WELL UNDERSTOOD

  1. SUFFICIENT GRANULARITY

1 second Peak 46% 1 minute Peak 36% 5 minutes Peak 12%

  1. TAGGED & FILTERABLE

Query Based Monitoring “What’s the average throughput of application:nginx per version ?” “Alert me when role:web-app running

application:postgres

hosted in region:eu-west-1

behaves differently than region:eu-west-2 ”

  1. LONG-LIVED

M T W TH F M T W TH F M T W TH F M T W TH F

M T W TH F M T W TH F M T W TH F M T W TH F OUTAGE? TUESDAY HOLIDAY?

SUMMARY 1. Both Docker adoption and system complexity continue to grow 2. The fundamentals of monitoring are therefore more important than ever

MERCI ! DANIEL MAHER @phrawzty daniel.maher@datadoghq.com