Cloud Cost Optimisation: A Primer

A presentation at Datadog & HashiCorp webinar in October 2021 in by Daniel "phrawzty" Maher

Slide 1

Slide 1

Cloud Cost Optimisation A Primer Daniel Maher Engineer (Community Team) at Datadog @phrawzty Kerim Satirli Sr. Developer Advocate at HashiCorp @ksatirli 6 October 2021

Slide 2

Slide 2

Daniel Maher Engineer (Community Team) at Datadog he/him @phrawzty

Slide 3

Slide 3

Kerim Satirli Sr. Developer Advocate at HashiCorp he/him @ksatirli

Slide 4

Slide 4

01 Challenge Let’s talk about… The Cloud

Slide 5

Slide 5

Cloud Market revenue (USD) market share (%) YoY growth (%) Amazon Web Services 26,20 40.8 28.7 Microsoft Azure 12,69 19.7 59.2 Alibaba Cloud 6,12 9.5 52.8 Google Cloud Platform 3,93 6.1 202.8 Others 15,34 24 25.6 Source: gtnr.it/3B9xxhE

Slide 6

Slide 6

Cloud Market $64B Annual spend on public cloud Source: gtnr.it/3B9xxhE

Slide 7

Slide 7

Cloud Market $64B 41% Annual spend on public cloud Annual growth of public cloud Source: gtnr.it/3B9xxhE

Slide 8

Slide 8

Cloud Waste $64B Annual spend on public cloud Source: devops.com/the-cloud-is-booming-but-so-is-cloud-waste $17.6B Annual public cloud waste

Slide 9

Slide 9

Cloud Waste $64B Annual spend on public cloud $17.6B Annual public cloud waste 20-30% Spend attributed to cloud waste Source: flexera.com/blog/cloud/cloud-computing-trends-2021-state-of-the-cloud-report

Slide 10

Slide 10

Cloud Waste “Between idle and over-provisioned resources alone, that’s $17.6B in cloud spend that will be completely wasted this year. And the potential is even higher […] That’s a minimum of about $5M wasted per day, every day this year, that could be reallocated toward other areas of the business.” $11B Annual public cloud waste $6.6B Wasted from over-sized resources Source: devops.com/the-cloud-is-booming-but-so-is-cloud-waste

Slide 11

Slide 11

Cloud Waste Side - Effects

Slide 12

Slide 12

Cloud Waste Side - Effects Reduced Productivity Wasted spend is correlated with poor standardisation, or worse yet: anti-patterns. If there’s no easy way for developers to re-use patterns, then everybody re-invents the wheel, over and over again.

Slide 13

Slide 13

Cloud Waste Side - Effects Reduced Productivity Risk Wasted spend is correlated with poor standardisation, or worse yet: anti-patterns. Lack of governance and oversight across the enterprise results in an increased risk surface. If there’s no easy way for developers to re-use patterns, then everybody re-invents the wheel, over and over again. Validated models are easier to reason about, which is part of a heightened security posture.

Slide 14

Slide 14

Cloud Waste Side - Effects Reduced Productivity Risk Misallocation Wasted spend is correlated with poor standardisation, or worse yet: anti-patterns. Lack of governance and oversight across the enterprise results in an increased risk surface. Literally: money that could and should - be spent on other things. If there’s no easy way for developers to re-use patterns, then everybody re-invents the wheel, over and over again. Validated models are easier to reason about, which is part of a heightened security posture. Brass tacks: wasted cloud spend is basically a vampire that is making your organisation weaker.

Slide 15

Slide 15

02 Opportunity Let’s talk about… Opportunity

Slide 16

Slide 16

Shift-left on Cloud Spend Engineers as the new cloud financial controllers

Slide 17

Slide 17

Shift-left on Cloud Spend Engineers as the new cloud financial controllers ▪ Availability of billing minutiae

Slide 18

Slide 18

Shift-left on Cloud Spend Engineers as the new cloud financial controllers ▪ Availability of billing minutiae ▪ Billing data is just that: data

Slide 19

Slide 19

Shift-left on Cloud Spend Engineers as the new cloud financial controllers ▪ Availability of billing minutiae ▪ Billing data is just that: data ▪ Programmatic access to that data

Slide 20

Slide 20

Shift-left on Cloud Spend Engineers as the new cloud financial controllers ▪ Availability of billing minutiae ▪ Billing data is just that: data ▪ Programmatic access to that data ▪ Wait a minute… an API full of metrics?

Slide 21

Slide 21

Shift-left on Cloud Spend Engineers as the new cloud financial controllers ▪ Availability of billing minutiae ▪ Billing data is just that: data ▪ Programmatic access to that data ▪ Wait a minute… an API full of metrics? ▪ That can be correlated with deployments?

Slide 22

Slide 22

Shift-left on Cloud Spend Engineers as the new cloud financial controllers ▪ Availability of billing minutiae ▪ Billing data is just that: data ▪ Programmatic access to that data ▪ Wait a minute… an API full of metrics? ▪ That can be correlated with deployments? ▪ This sounds like a job for dashboards!

Slide 23

Slide 23

Shift-left on Cloud Spend …y tho?

Slide 24

Slide 24

Shift-left on Cloud Spend …y tho? ▪ Get involved in product discussions

Slide 25

Slide 25

Shift-left on Cloud Spend …y tho? ▪ Get involved in product discussions ▪ Bring insight to business decisions

Slide 26

Slide 26

Shift-left on Cloud Spend …y tho? ▪ Get involved in product discussions ▪ Bring insight to business decisions ▪ Increase your capacity to generate value

Slide 27

Slide 27

Shift-left on Cloud Spend …y tho? ▪ Get involved in product discussions ▪ Bring insight to business decisions ▪ Increase your capacity to generate value ▪ Level-up your career

Slide 28

Slide 28

Demo

Slide 29

Slide 29

🔒 app.terraform.io/app/ksatirli/workspaces/minimise-cloud-waste

Slide 30

Slide 30

🔒 app.terraform.io/app/ksatirli/workspaces/minimise-cloud-waste

Slide 31

Slide 31

🔒 app.datadoghq.com/dashboard/aws-ec2-cost-optimiser

Slide 32

Slide 32

Thank You! daniel.maher@datadoghq.com kerim@hashicorp.com