Share
Embed
FinOps! karpenterによるk8sコスト削減
Aya (Igarashi) Ozawa
December 11, 2023
Transcript
55 slides
-
FinOps! 72% OF COMPANIES HAVE A DEDICATED FINOPS TEAM. SOURCE:
FLEXERA 2023 STATE OF THE CLOUD REPORT -
Source: Flexera 2023 State of the Cloud Report “WASTED AVG.
28% OF CLOUD COSTS” -
FinOpsʹ͓͚Δίετͷ࠷ దԽ୯ʹҰ൪͍҆Πϯϑ ϥΛ͏ͱ͍͏ҙຯ͚ͩͰ ͳ͍ɻ ෆཁϦιʔεআͷ Πϯϑϥίετݮ WHAT IS COST OPTIMIZATION?
IT DOES NOT JUST MEAN SAVING INFRASTRUCTURE EXPENSES ӡ༻ޮԽ(ࣗಈԽ)ʹΑΔ ਓతίετݮ ΠϯϑϥͷίετΛ҆͘Ͱ ͖ͨͱͯ͠ɺͦΕΛҡ࣋ ͢ΔͨΊʹଟ͘ͷखಈΦϖ Ϩʔγϣϯ͕ඞཁʹͳΔͱ ϏδωεʹूதͰ͖ͳ͍ɻ Մ༻ੑ্ʹΑΔ ػձଛࣦͷݮ (≒ ച্૿Ճ) Πϯϑϥͷ͚҆ͩ͞Λٻ ͯ͠ɺαʔϏε͕ఀࢭͨ͠ Γɺ࣭͕ྼԽͯ͠͠·͏ ͱɺϏδωεͷػձଛࣦ͕ ੜ·Εͯ͠·͏ɻ -
FinOpsʹ͓͚Δίετͷ࠷ దԽ୯ʹҰ൪͍҆Πϯϑ ϥΛ͏ͱ͍͏ҙຯ͚ͩͰ ͳ͍ɻ ෆཁϦιʔεআͷ Πϯϑϥίετݮ WHAT IS COST OPTIMIZATION?
IT DOES NOT JUST MEAN SAVING INFRASTRUCTURE EXPENSES ӡ༻ޮԽ(ࣗಈԽ)ʹΑΔ ਓతίετݮ ΠϯϑϥͷίετΛ҆͘Ͱ ͖ͨͱͯ͠ɺͦΕΛҡ࣋ ͢ΔͨΊʹଟ͘ͷखಈΦϖ Ϩʔγϣϯ͕ඞཁʹͳΔͱ ϏδωεʹूதͰ͖ͳ͍ɻ Մ༻ੑ্ʹΑΔ ػձଛࣦͷݮ (≒ ച্૿Ճ) Πϯϑϥͷ͚҆ͩ͞Λٻ ͯ͠ɺαʔϏε͕ఀࢭͨ͠ Γɺ࣭͕ྼԽͯ͠͠·͏ ͱɺϏδωεͷػձଛࣦ͕ ੜ·Εͯ͠·͏ɻ ࠷దͳόϥϯεΛऔΔ -
AGENDA Optimize Cost KarpenterʹΑΔίετ࠷ దԽͷ͘͠Έ 04 WHAT YOU CAN LEARN
TODAY! Optimize More! KarpenterͰΑΓίετΛ ࠷దԽ͢Δʹ 05 Karpenter K8SΫϥελΦʔτεέʔ ϥͷKarpenterͱ 03 Autoscalers ίετ࠷దԽʹ͓͚ΔΦʔ τεέʔϥͷར 02 Cost Optimization ίετ࠷దԽͱ? 01 -
ݱࡏඞཁͱ͢ΔϦιʔεͩ ͚Λ֬อ͢ΔͷͰɺແବͳ ϦιʔεͷίετΛݮͰ ͖Δɻ ෆཁϦιʔεআͷ Πϯϑϥίετݮ AUTOSCALER OPTIMIZE COST THE
BENEFITS OF AUTOSCALER ӡ༻ޮԽ(ࣗಈԽ)ʹΑΔ ਓతίετݮ ඞཁͳϦιʔεྔ͕มԽͯ͠ ࣗಈैͰ͖ΔͷͰɺӡ ༻ऀ͕εέʔϦϯάͷͨΊ ͷϦιʔεࢹ࡞ۀΛ ݮͰ͖Δɻ Մ༻ੑ্ʹΑΔ ػձଛࣦͷݮ (≒ ച্૿Ճ) ਓͷखΛհͣ͞ʹεέʔϦ ϯάͰ͖ΔͷͰɺਓతϛε ԆͷϦεΫΛܰݮ͠ɺ Մ༻ੑΛ্Ͱ͖Δɻ -
ݱࡏඞཁͱ͢ΔϦιʔεͩ ͚Λ֬อ͢ΔͷͰɺແବͳ ϦιʔεͷίετΛݮͰ ͖Δɻ ෆཁϦιʔεআͷ Πϯϑϥίετݮ AUTOSCALER OPTIMIZE COST THE
BENEFITS OF AUTOSCALER ӡ༻ޮԽ(ࣗಈԽ)ʹΑΔ ਓతίετݮ ඞཁͳϦιʔεྔ͕มԽͯ͠ ࣗಈैͰ͖ΔͷͰɺӡ ༻ऀ͕εέʔϦϯάͷͨΊ ͷϦιʔεࢹ࡞ۀΛ ݮͰ͖Δɻ Մ༻ੑ্ʹΑΔ ػձଛࣦͷݮ (≒ ച্૿Ճ) ਓͷखΛհͣ͞ʹεέʔϦ ϯάͰ͖ΔͷͰɺਓతϛε ԆͷϦεΫΛܰݮ͠ɺ Մ༻ੑΛ্Ͱ͖Δɻ ֤ίετΛݮͰ͖Δ!! -
AGENDA Optimize Cost KarpenterʹΑΔίετ࠷ దԽͷ͘͠Έ 04 WHAT YOU CAN LEARN
TODAY! Karpenter K8SΫϥελΦʔτεέʔ ϥͷKarpenterͱ 03 Autoscalers ίετ࠷దԽʹ͓͚ΔΦʔ τεέʔϥͷར 02 Optimize More! KarpenterͰΑΓίετΛ ࠷దԽ͢Δʹ 05 Cost Optimization ίετ࠷దԽͱ? 01 -
THE TYPES OF AUTOSCALERS KUBERNETES AUTOSCALING Workload(/Pod) Autoscaling Cluster(/Node) Autoscaling
Pod Node scale Pod Pod Node scale Pod Pod Node scale Pod New! Node -
AWS͕։ൃͨ͠k8sͷΫϥελΦʔτεέʔϥ https://karpenter.sh/ https://github.com/aws/karpenter AWSҎ֎ʹAzureʹରԠ͍ͯ͠Δ https://github.com/Azure/karpenter ίΞػೳk8sίϛϡχςΟͰཧ͞Ε͍ͯΔ https://github.com/kubernetes-sigs/karpenter ONE OF KUBERNETES
CLUSTER AUTOSCALER WHAT IS KARPENTER? 2021/11/26: Ұൠఏڙ։࢝ 01 02 03 2023/11/06: AzureͷαϙʔτΛൃද 2023/11/23: sig-autoscalerʹدଃ -
AWS͕։ൃͨ͠k8sͷΫϥελΦʔτεέʔϥ https://karpenter.sh/ https://github.com/aws/karpenter AWSҎ֎ʹAzureʹରԠ͍ͯ͠Δ https://github.com/Azure/karpenter ίΞػೳk8sίϛϡχςΟͰཧ͞Ε͍ͯΔ https://github.com/kubernetes-sigs/karpenter ONE OF KUBERNETES
CLUSTER AUTOSCALER WHAT IS KARPENTER? aws/karpenter Azure/karpenter kuberentes-sigs/ karpenter v0.33.0 v0.2.0 v0.33.0 -
LESS MANUAL OPERATION, FASTER SCALE (AWS) WHAT IS DIFFERENT FROM
CAS? Kubernetes Cluster Autoscaler (CAS) Karpenter CAS Pod Node Pod Pod 1. Unschedulable Node 2. Create a new node from NG Node Group AWS ASG -
LESS MANUAL OPERATION, FASTER SCALE (AWS) WHAT IS DIFFERENT FROM
CAS? Kubernetes Cluster Autoscaler (CAS) Karpenter CAS Pod Node Pod Pod Node Node Group AWS ASG Large Node Group AWS ASG Small 1. Unschedulable 2. Create a new node from NG (small) -
LESS MANUAL OPERATION, FASTER SCALE (AWS) WHAT IS DIFFERENT FROM
CAS? Kubernetes Cluster Autoscaler (CAS) Karpenter CAS Pod Node Pod Pod Node Karpenter Pod Node Pod Node AWS Fleet Node Pool Node Group AWS ASG Pod 1. Unschedulable 2. Create a new Node -
LESS MANUAL OPERATION, FASTER SCALE (AWS) WHAT IS DIFFERENT FROM
CAS? Kubernetes Cluster Autoscaler (CAS) Karpenter CAS Pod Node Pod Pod Node Karpenter Pod Node Pod Pod Node 1. Unschedulable 2. Create a new (medium) Node AWS Fleet Node Pool Node Group AWS ASG -
LESS MANUAL OPERATION, FASTER SCALE (AWS) WHAT IS DIFFERENT FROM
CAS? Kubernetes Cluster Autoscaler (CAS) Karpenter • NodeCASͷNodeGroup(NG)ઃఆʹैͬ ͯՃ͞ΕΔ (AWSͰEC2 ASGʹରԠ) • Ճ͢ΔNodeͷγϛϡϨʔτʹNG͝ͱ ʹ1छྨͷNodeαΠζ͕ΘΕΔ • ৽͍͠ΠϯελϯελΠϓͷNodeΛCAS͔ Βੜ͢ΔʹNGͷՃ͕ඞཁͰɺ·ͨɺ NG͕ଟ͗͢Δͱεέʔϧʹ͕͔͔࣌ؒΔ • NodeNodePoolʹॻ͔Εͨ࡞͢Δϊʔ ͷ੍ࣄ߲ΛݩʹKarpenter͕બ͢Δ • Ճ͢ΔNodeͷγϛϡϨʔτNodePool Λݩʹ༷ʑͳαΠζͷNode͕ΘΕΔ • AWSͷ߹ɺΠϯελϯεΛEC2 ASGΛܦ ༝ͤͣʹEC2 Fleet͔Β্ཱͪ͛ΔͷͰ CASʹൺΔͱΠϯελϯεͷىಈ͕ૣ͍ -
LESS MANUAL OPERATION, FASTER SCALE (AWS) WHAT IS DIFFERENT FROM
CAS? Kubernetes Cluster Autoscaler (CAS) Karpenter • NodeCASͷNodeGroup(NG)ઃఆʹैͬ ͯՃ͞ΕΔ (AWSͰEC2 ASGʹରԠ) • Ճ͢ΔNodeͷγϛϡϨʔτʹNG͝ͱ ʹ1छྨͷNodeαΠζ͕ΘΕΔ • ৽͍͠ΠϯελϯελΠϓͷNodeΛCAS͔ Βੜ͢ΔʹNGͷՃ͕ඞཁͰɺ·ͨɺ NG͕ଟ͗͢Δͱεέʔϧʹ͕͔͔࣌ؒΔ • NodeNodePoolʹॻ͔Εͨ࡞͢Δϊʔ ͷ੍ࣄ߲ΛݩʹKarpenter͕બ͢Δ • Ճ͢ΔNodeͷγϛϡϨʔτNodePool Λݩʹ༷ʑͳαΠζͷNode͕ΘΕΔ • AWSͷ߹ɺΠϯελϯεΛEC2 ASGΛܦ ༝ͤͣʹEC2 Fleet͔Β্ཱͪ͛ΔͷͰ CASʹൺΔͱΠϯελϯεͷىಈ͕ૣ͍ ख࡞ۀ͕ݮΓɺ ΑΓૣ͘εέʔϧͰ͖Δ! -
AGENDA Optimize Cost KarpenterʹΑΔίετ࠷ దԽͷ͘͠Έ 04 WHAT YOU CAN LEARN
TODAY! Karpenter K8SΫϥελΦʔτεέʔ ϥͷKarpenterͱ 03 Autoscalers ίετ࠷దԽʹ͓͚ΔΦʔ τεέʔϥͷར 02 Optimize More! KarpenterͰΑΓίετΛ ࠷దԽ͢Δʹ 05 Cost Optimization ίετ࠷దԽͱ? 01 -
CREATE THE RIGHT SIZE INSTANCE AND DELETE THE UNNECESSARY INSTANCE
KARPENTER OPTIMIZES COSTS! Provisioning Karpenter Node AWS Fleet Node Pool Pod Pod Pod Pod Pod Pod Pod Pod 1. Grouping pending Pods and Finding f itting candidates. 3. Create an optimal instance based on strategy • Pending PodΛ·ͱΊͯϑΟοτ͢ΔNode ͷछྨΛ୳͢(BinPacking, FFD Algorithm) • ϑΟοτ͢ΔͷΑΓେ͖͍max 60ީิͷ ͏ͪɺઓུʹԠͨ͡࠷దͳΠϯελϯε͕ ىಈͰ͖Δ on-demand: lowest-price (࠷͍҆ͷ) spot: price-capacity-optimized (҆͘தஅՄೳੑͷ͍ͷ) 2. Send max 60 Candidates Save Costs! -
CREATE THE RIGHT SIZE INSTANCE AND DELETE THE UNNECESSARY INSTANCE
KARPENTER OPTIMIZES COSTS! Disruption Controllers • Expiration: ಛఆ͕࣌ؒܦաͨ͠Βআ • Consolidation: Node্ͷશͯͷPod͕ଞͷNode ʹҠಈՄೳͳΒআɺ·ͨɺݱࡏͷΠϯελϯ εΑΓ͍҆Πϯελϯε͕ར༻ՄೳͳΒஔ • Drift: NodePoolͷઃఆ͕มߋ͞ΕɺطଘͷΠϯε λϯε͕·͍͠ঢ়ଶͱͷ͕ࠩͰͨΒআ͢Δ • Interruption: SpotΠϯελϯεͷఀࢭ UnhealthyʹͳͬͨΒஔ͢Δ Karpenter Pod Node Pod Node Pod Node Delete Unnecessary or Costly Nodes Save Costs! -
Node A Pod Node A Pod Pod CREATE THE RIGHT
SIZE INSTANCE AND DELETE THE UNNECESSARY INSTANCE KARPENTER OPTIMIZES COSTS! Disruption Controllers • Expiration: ಛఆ͕࣌ؒܦաͨ͠Βআ • Consolidation: Node্ͷશͯͷPod͕ଞͷNode ʹҠಈՄೳͳΒআɺ·ͨɺݱࡏͷΠϯελϯ εΑΓ͍҆Πϯελϯε͕ར༻ՄೳͳΒஔ • Drift: NodePoolͷઃఆ͕มߋ͞ΕɺطଘͷΠϯε λϯε͕·͍͠ঢ়ଶͱͷ͕ࠩͰͨΒআ͢Δ • Interruption: SpotΠϯελϯεͷఀࢭ UnhealthyʹͳͬͨΒஔ͢Δ Pod Expire 2h Delete after 2 hours -
CREATE THE RIGHT SIZE INSTANCE AND DELETE THE UNNECESSARY INSTANCE
KARPENTER OPTIMIZES COSTS! Disruption Controllers Node A Pod Node B Pod Node A’ Pod Pod $0.05 $0.02 Recreate a new node Reallocate a Pod • Expiration: ಛఆ͕࣌ؒܦաͨ͠Βআ • Consolidation: Node্ͷશͯͷPod͕ଞͷNode ʹҠಈՄೳͳΒআɺ·ͨɺݱࡏͷΠϯελϯ εΑΓ͍҆Πϯελϯε͕ར༻ՄೳͳΒஔ • Drift: NodePoolͷઃఆ͕มߋ͞ΕɺطଘͷΠϯε λϯε͕·͍͠ঢ়ଶͱͷ͕ࠩͰͨΒআ͢Δ • Interruption: SpotΠϯελϯεͷఀࢭ UnhealthyʹͳͬͨΒஔ͢Δ Pod -
CREATE THE RIGHT SIZE INSTANCE AND DELETE THE UNNECESSARY INSTANCE
KARPENTER OPTIMIZES COSTS! Disruption Controllers • Expiration: ಛఆ͕࣌ؒܦաͨ͠Βআ • Consolidation: Node্ͷશͯͷPod͕ଞͷNode ʹҠಈՄೳͳΒআɺ·ͨɺݱࡏͷΠϯελϯ εΑΓ͍҆Πϯελϯε͕ར༻ՄೳͳΒஔ • Drift: NodePoolͷઃఆ͕มߋ͞ΕɺطଘͷΠϯε λϯε͕·͍͠ঢ়ଶͱͷ͕ࠩͰͨΒআ͢Δ • Interruption: SpotΠϯελϯεͷఀࢭ UnhealthyʹͳͬͨΒஔ͢Δ Node A Pod Node A’ Pod Recreate Im age v1 Im age v2 Desired state of machine image was changed from v1 to v2. Node Pool v2 -
Node A CREATE THE RIGHT SIZE INSTANCE AND DELETE THE
UNNECESSARY INSTANCE KARPENTER OPTIMIZES COSTS! Disruption Controllers • Expiration: ಛఆ͕࣌ؒܦաͨ͠Βআ • Consolidation: Node্ͷશͯͷPod͕ଞͷNode ʹҠಈՄೳͳΒআɺ·ͨɺݱࡏͷΠϯελϯ εΑΓ͍҆Πϯελϯε͕ར༻ՄೳͳΒஔ • Drift: NodePoolͷઃఆ͕มߋ͞ΕɺطଘͷΠϯε λϯε͕·͍͠ঢ়ଶͱͷ͕ࠩͰͨΒআ͢Δ • Interruption: SpotΠϯελϯεͷఀࢭ UnhealthyʹͳͬͨΒஔ͢Δ Spot Spot interruptions have a 2-minute notice Node A’ Pod Pod Recreate -
CREATE THE RIGHT SIZE INSTANCE AND DELETE THE UNNECESSARY INSTANCE
KARPENTER OPTIMIZES COSTS! Provisioning Disruption Controllers • Pending PodΛ·ͱΊͯϑΟοτ͢ΔNode ͷछྨΛ୳͢(BinPacking, FFD Algorithm) • ϑΟοτ͢ΔͷΑΓେ͖͍max 60ީิͷ ͏ͪɺઓུʹԠͨ͡࠷దͳΠϯελϯε͕ ىಈͰ͖Δ on-demand: lowest-price (࠷͍҆ͷ) spot: price-capacity-optimized (҆͘தஅՄೳੑͷ͍ͷ) • Expiration: ಛఆ͕࣌ؒܦաͨ͠Βআ • Consolidation: Node্ͷશͯͷPod͕ଞͷNode ʹҠಈՄೳͳΒআɺ·ͨɺݱࡏͷΠϯελϯ εΑΓ͍҆Πϯελϯε͕ར༻ՄೳͳΒஔ • Drift: NodePoolͷઃఆ͕มߋ͞ΕɺطଘͷΠϯε λϯε͕·͍͠ঢ়ଶͱͷ͕ࠩͰͨΒআ͢Δ • Interruption: spotͷΠϯελϯεͷఀࢭ UnhealthyʹͳͬͨΒஔ͢Δ CASΑΓΞάϨογϒ ͳͷͰҙ! -
CREATE THE RIGHT SIZE INSTANCE AND DELETE THE UNNECESSARY INSTANCE
KARPENTER OPTIMIZES COSTS! Provisioning Disruption Controllers • Pending PodΛ·ͱΊͯϑΟοτ͢ΔNode ͷछྨΛ୳͢(BinPacking, FFD Algorithm) • ϑΟοτ͢ΔͷΑΓେ͖͍max 60ީิͷ ͏ͪઓུʹԠͨ͡࠷దͳΠϯελϯε͕ى ಈ͞ΕΔ on-demand: lowest-price (࠷͍҆ͷ) spot: price-capacity-optimized (҆͘தஅՄೳੑͷ͍ͷ) • Expiration: ಛఆ͕࣌ؒܦաͨ͠Βআ • Consolidation: Node্ͷશͯͷPod͕ଞͷNode ʹҠಈՄೳͳΒআɺ·ͨɺݱࡏͷΠϯελϯ εΑΓ͍҆Πϯελϯε͕ར༻ՄೳͳΒஔ • Drift: NodePoolͷઃఆ͕มߋ͞ΕɺطଘͷΠϯε λϯε͕·͍͠ঢ়ଶͱͷ͕ࠩͰͨΒআ͢Δ • Interruption: spotͷΠϯελϯεͷఀࢭ UnhealthyʹͳͬͨΒஔ͢Δ CASΑΓΞάϨογϒ ͳͷͰҙ! ίετΛ࠷దԽ! ඞཁͳϦιʔε͚ͩ࡞ ෆཁͳϦιʔεআ ✕ ࣗಈԽ -
AGENDA Optimize Cost KarpenterʹΑΔίετ࠷ దԽͷ͘͠Έ 04 WHAT YOU CAN LEARN
TODAY! Karpenter K8SΫϥελΦʔτεέʔ ϥͷKarpenterͱ 03 Autoscalers ίετ࠷దԽʹ͓͚ΔΦʔ τεέʔϥͷར 02 Optimize More! KarpenterͰΑΓίετΛ ࠷దԽ͢Δʹ 05 Cost Optimization ίετ࠷దԽͱ? 01 -
CHARACTERISTICS OF PURCHASE TYPES AND COST EC2 INSTANCE PURCHASE TYPES
On-Demand On-Demand Instance EC2ΠϯελϯεͷఆՁɻ Spot Instance धཁͱڙڅʹԠͯ͡Ձ͕֨ௐ͞ΕΔɻΠϯελϯ εͷআ͕͋Δ͕ɺେ෯ʹׂҾ͔ΕΔ͜ͱ͕ଟ͍ɻ SavingsPlans / Reserved Instance 1-3ͷOn-DemandͷظίϛοτΛࣄલܖ͢Δ ͜ͱͰɺେ෯ͳׂҾΛड͚Δϓϥϯɻআͳ͍ɻ -
CHARACTERISTICS OF PURCHASE TYPES AND COST EC2 INSTANCE PURCHASE TYPES
On-Demand Instance EC2ΠϯελϯεͷఆՁɻ Spot Instance धཁͱڙڅʹԠͯ͡Ձ͕֨ௐ͞ΕΔɻΠϯελϯ εͷআ͕͋Δ͕ɺେ෯ʹׂҾ͔ΕΔ͜ͱ͕ଟ͍ɻ SavingsPlans / Reserved Instance 1-3ͷOn-DemandͷظίϛοτΛࣄલܖ͢Δ ͜ͱͰɺେ෯ͳׂҾΛड͚Δϓϥϯɻআͳ͍ɻ m5.large t2.medium c4.xlarge spot spot pool spot pool -
CHARACTERISTICS OF PURCHASE TYPES AND COST EC2 INSTANCE PURCHASE TYPES
On-Demand Instance EC2ΠϯελϯεͷఆՁɻ Spot Instance धཁͱڙڅʹԠͯ͡Ձ͕֨ௐ͞ΕΔɻΠϯελϯ εͷআ͕͋Δ͕ɺେ෯ʹׂҾ͔ΕΔ͜ͱ͕ଟ͍ɻ SavingsPlans / Reserved Instance 1-3ͷOn-DemandͷظίϛοτΛࣄલܖ͢Δ ͜ͱͰɺେ෯ͳׂҾΛड͚Δϓϥϯɻআͳ͍ɻ 1-3 years max 72% off -
KARPENTER USES PUBLIC ON-DEMAND AND SPOT INSTANCE RATE DISCOUNT PLAN
NOT SUPPORTED KarpenterͱߪೖΦϓγϣϯ • αϙʔτ͍ͯ͠ΔߪೖΦϓγϣϯ ެ։ϨʔτͷOn-DemandͱSpotͷ ΈͰɺׂҾϓϥϯʹ͍ͭͯߟྀ͞ Εͳ͍ • Reserved InstanceSavings Plan ɺSpotͷΑ͏ʹΠϯελϯε͕ಥ વআ͞ΕΔ͜ͱͳ͘ɺίετ ݮʹΑ͘ΘΕ͍ͯΔΦϓγϣϯ Flexera 2023 State of the Cloud Report -
IN CASE YOU HAVE A SAVINGS PLAN FOR $0.047/HR EXAMPLE:
COST IS NOT OPTIMIZED ҎԼͷSavings PlansΛܖͨ͠߹… 3 years EC2 Savings Plan Compute Instance Max Savings 66% 72% t3.large Sample (ఆՁ: $0.1088) $0.062 (43%) $0.047 (57%) Locked Single Instance Family & Region No Yes t3.large, Tokyo Region, 3 years, No Upfront, Linux ※ 2023/11/15 21:00 ࣌ Savings Plans for K8S Nodes $0.047 t3.large t3.large 1 hour t3.large t3.large • Instance Saving PlanͷTokyo Region, t3.largeΛ3ؒ • 1࣌ؒ͋ͨΓ$0.047Λܖ 57% off -
IN CASE YOU HAVE A SAVINGS PLAN FOR $0.047/HR EXAMPLE:
COST IS NOT OPTIMIZED c5.largeͷOn-Demand͕࡞͞Εͨ߹ Instance Type Purchase Type Price (Discount) c5.large On-demand $0.096 t3.large On-demand $0.1088 SavingsPlan $0.047 (57%) t3.large, Tokyo Region, 3 years, No Upfront, Linux ※ 2023/11/15 21:00 ࣌ EC2 Instance Pricing List • c5.largeͷOn-demandt3.largeΑΓ͍҆ • c5.large͕࡞͞ΕΔͱՃͰ$0.096ͷՃίετ c5.large t3.large +$0.096 $0.047 Karpenter 1 hour < Compare with c5.large and t3.large on-demand rate. -
+$0.033 t3.large IN CASE YOU HAVE A SAVINGS PLAN FOR
$0.047/HR EXAMPLE: COST IS NOT OPTIMIZED t3.largeͷSpot͕࡞͞Εͨ߹ Instance Type Purchase Type Price (Discount) t3.large On-demand $0.1088 Spot $0.033 (73%) SavingsPlan $0.047 (57%) t3.large, Tokyo Region, 3 years, No Upfront, Linux ※ 2023/11/15 21:00 ࣌ EC2 Instance Pricing List • t3.largeͷSpott3.largeͷOn-demandΑΓ͍҆ • SpotͰ࡞͞ΕΔͱՃͰ$0.033ͷՃίετ t3.large $0.047 Karpenter 1 hour < Compare with t3.large spot and on-demand rate. spot -
EXAMPLE: COST IS NOT OPTIMIZED IN CASE YOU HAVE A
SAVINGS PLAN FOR $0.047/HR Unoptimized Optimized! 👍 Unused Savings Plans -
Optimized! 👍 EXAMPLE: COST IS NOT OPTIMIZED IN CASE YOU
HAVE A SAVINGS PLAN FOR $0.047/HR Unoptimized Unused Savings Plans ίετ࠷దԽʹSavingsPlanͷ༻্͕ ͕ΔΑ͏ͳߟྀඞཁ! -
• Savings PlanΛߪೖͨ͠ΞΧϯτ(͘͠ ڞ༗͍ͯ͠Δ৫)ͷଞͷk8sΫϥελ ɺk8sҎ֎ͰΘΕ͍ͯΔΠϯελϯεͷ ߟྀ͕ඞཁ • Savings Planόϥόϥͳ࣌ظʹෳߪೖ ͢Δ͜ͱଟ͍ͷͰɺͦΕͧΕͷϓϥϯͷ
ঢ়گΛखಈͰཧ͢Δͷେม • GetSavingsPlansUtilization API1୯Ґͳ ͷͰཻ͕͋Β͗͢Δ • ίετͱ༻ঢ়گϨϙʔτ(AWS CUR) ͔Β1 ࣌ؒ୯Ґͷར༻ΛऔಘͰ͖Δ͕ɺجຊత ʹલͷσʔλʹͳΔ HOW CAN WE CALCULATE SAVINGS PLAN UTILIZATION? CHALLENGING PARTS Savings Planͷར༻ΛϦΞϧλΠϜʹऔ ಘ͢ΔAPI͕ଘࡏ͠ͳ͍ K8sΫϥελͷΠϯελϯεใ͚ͩͰ ར༻͕ܭࢉͰ͖ͳ͍ -
• Savings PlanΛߪೖͨ͠ΞΧϯτ(͘͠ ڞ༗͍ͯ͠Δ৫)ͷଞͷk8sΫϥελ ɺk8sҎ֎ͰΘΕ͍ͯΔΠϯελϯεͷ ߟྀ͕ඞཁ • Savings Planόϥόϥͳ࣌ظʹෳߪೖ ͢Δ͜ͱଟ͍ͷͰɺͦΕͧΕͷϓϥϯͷ
ঢ়گΛखಈͰཧ͢Δͷେม • GetSavingsPlansUtilization API1୯Ґͳ ͷͰཻ͕͋Β͗͢Δ • ίετͱ༻ঢ়گϨϙʔτ(AWS CUR) ͔Β1 ࣌ؒ୯Ґͷར༻ΛऔಘͰ͖Δ͕ɺجຊత ʹલͷσʔλʹͳΔ HOW CAN WE CALCULATE SAVINGS PLAN UTILIZATION? CHALLENGING PARTS Savings Planͷར༻ΛϦΞϧλΠϜʹऔ ಘ͢ΔAPI͕ଘࡏ͠ͳ͍ K8sΫϥελͷΠϯελϯεใ͚ͩͰ ར༻͕ܭࢉͰ͖ͳ͍ CUR͔ΒSavings PlanใΛूܭ ✕ ݱࡏͷશΠϯελϯεঢ়گΛऩू → Savings Planͷར༻ΛγϛϡϨʔτ -
PREDICT PLANS UTILIZATION FEEDBACK ON PREDICATED RESULTS TO KARPENTER S3
Agent Karpenter Node Pool Cost Usage Report Kubernetes Cluster 1. Process CUR & Predicate SavingsPlan Utilization Server Node Pool Node Pool 2. Send Instance Information & Get Predicate Result 3. Update NodePool according to predication Cost Usage Report Upload Create Optimal Node! -
Optimize Cost KarpenterʹΑΔίετ࠷ దԽͷ͘͠Έ 04 Cost Optimization ίετ࠷దԽͱ? 01 Autoscalers
ίετ࠷దԽʹ͓͚ΔΦʔ τεέʔϥͷར 02 Optimize More! KarpenterͰΑΓίετΛ ࠷దԽ͢Δʹ 05 🏆 AGENDA WHAT YOU CAN LEARN TODAY! Karpenter K8SΫϥελΦʔτεέʔ ϥͷKarpenterͱ 03 -
WHAT YOU LEARNED TODAY! 1. FinOpsͰɺ୯ʹ҆͞ΛٻΊΔ͚ͩͰͳ͘ɺӡ༻ޮԽՄ༻ ੑͷόϥϯεΛऔͬͨίετ࠷దԽΛࢦ͢ 2. Φʔτεέʔϥɺk8sͷίετ࠷దԽͷ༗༻ͳखஈͰ͋Γɺ KarpenterͦͷதͷબࢶͷҰͭ
3. Savings PlanʹରԠͨ͠Πϯελϯε͕࡞͞Εͳ͍ͳͲɺ୯ʹ πʔϧΛಋೖ͚ͨͩͩ͠ͱɺίετ࠷దԽͰ͖ͳ͍έʔε͕͋Δ RECAP