Les Conteneurs: Pièces et Main-d’Oeuvre

A presentation at Devops DDay in November 2018 in Marseille, France by Daniel "phrawzty" Maher

Slide 1

Slide 1

CONTAINERS: PARTS AND LABOUR DANIEL MAHER, DATADOG @phrawzty

Slide 2

Slide 2

CONTAINERS: PARTS AND LABOUR DANIEL MAHER, DATADOG @phrawzty DOCKER DOCKER DOCKER

Slide 3

Slide 3

Slide 4

Slide 4

IS THE DOCKER FAD OVER?

Slide 5

Slide 5

DANIEL MAHER DOCS & TALKS DEVOPSDAYS GLOBAL GREAT OUTDOORS GOURMAND SUITS FOR NO REASON @phrawzty

Slide 6

Slide 6

DATADOG SAAS-BASED MONITORING TRILLIONS OF POINTS/DAY WE’RE HIRING: www.datadoghq.com/careers @datadoghq

Slide 7

Slide 7

Slide 8

Slide 8

Docker Adoption - Docker pulls?

Slide 9

Slide 9

https://www.datadoghq.com/docker-adoption/

Slide 10

Slide 10

Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Docker Adoption

Slide 11

Slide 11

Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Adopter : the average number of containers running during the month was at least 50% the number of distinct hosts run, or there were at least as many distinct containers as distinct hosts run during the month. Docker Adoption

Slide 12

Slide 12

Dabbler : used Docker during a given month, but hadn’t reached significant use as defined by Adopter. Adopter : the average number of containers running during the month was at least 50% the number of distinct hosts run, or there were at least as many distinct containers as distinct hosts run during the month. Abandoner : a currently active company that used Docker in the past, but hasn't used it at all in the last month. Docker Adoption

Slide 13

Slide 13

Slide 14

Slide 14

Slide 15

Slide 15

Slide 16

Slide 16

WHO’S ADOPTING DOCKER?

Slide 17

Slide 17

Slide 18

Slide 18

Slide 19

Slide 19

Slide 20

Slide 20

Slide 21

Slide 21

Slide 22

Slide 22

Slide 23

Slide 23

WHAT’S RUNNING?

Slide 24

Slide 24

NGINX Redis Postgres FluentD Elasticsearch Mongo MySQL etcd RabbitMQ HAproxy % Customers Running a Tech in Containers 0   % 10   % 20   % 30   % 40   %

Slide 25

Slide 25

Redis Postgres Elasticsearch MySQL MongoDB etcd RabbitMQ % Customers Running Data Stores in Containers 0   % 10   % 20   % 30   % 40   %

Slide 26

Slide 26

HOW DENSELY PACKED?

Slide 27

Slide 27

Slide 28

Slide 28

Slide 29

Slide 29

Slide 30

Slide 30

Slide 31

Slide 31

ENTER THE ORCHESTRATORS

Slide 32

Slide 32

ORCHESTRATORTION IS NORMAL

Slide 33

Slide 33

Slide 34

Slide 34

CONTAINERS INCREASE COMPLEXITY HOW DO WE MONITOR THEM?

Slide 35

Slide 35

Alcohol: The cause of, and solution to, all of life’s problems. HOMER SIMPSON

Slide 36

Slide 36

Alcohol: The cause of, and solution to, all of life’s problems. HOMER SIMPSON CONTAINERS

Slide 37

Slide 37

Slide 38

Slide 38

Side Car Containers

Slide 39

Slide 39

AS COMPLEXITY INCREASES FUNDAMENTALS BECOME MORE IMPORTANT

Slide 40

Slide 40

4 QUALITIES OF GOOD METRICS NOT ALL METRICS ARE EQUAL

Slide 41

Slide 41

  1. MUST BE WELL UNDERSTOOD

Slide 42

Slide 42

  1. SUFFICIENT GRANULARITY

Slide 43

Slide 43

1 second Peak 46% 1 minute Peak 36% 5 minutes Peak 12%

Slide 44

Slide 44

  1. TAGGED & FILTERABLE

Slide 45

Slide 45

Slide 46

Slide 46

Slide 47

Slide 47

Query Based Monitoring “What’s the average throughput of application:nginx per version ?” “Alert me when role:web-app running

application:postgres

hosted in region:eu-west-1

behaves differently than region:eu-west-2 ”

Slide 48

Slide 48

  1. LONG-LIVED

Slide 49

Slide 49

Slide 50

Slide 50

Slide 51

Slide 51

M T W TH F M T W TH F M T W TH F M T W TH F

Slide 52

Slide 52

M T W TH F M T W TH F M T W TH F M T W TH F OUTAGE? TUESDAY HOLIDAY?

Slide 53

Slide 53

Slide 54

Slide 54

Slide 55

Slide 55

Slide 56

Slide 56

Slide 57

Slide 57

SUMMARY 1. Both Docker adoption and system complexity continue to grow 2. The fundamentals of monitoring are therefore more important than ever

Slide 58

Slide 58

MERCI ! DANIEL MAHER @phrawzty daniel.maher@datadoghq.com