Share
Embed
明日から始められるKyvernoを用いたポリシー制御
CNDT2022登壇資料
Kyvernoとは?
Kyvernoの使い方は?
そんな疑問に答えるような資料になっています。
#Kyverno #kyverno #Policy #OPA #Validation #Mutation #Generation # VerifyImage
ry
November 21, 2022
Transcript
105 slides
-
໌͔Β࢝ΊΒΕΔ KyvernoΛ༻͍ͨϙϦγʔ੍ޚ 2022/11/21 Cloud Native Days Tokyo 2022 15:20 ~
16:00 Track D Ryotaro Uwatsu -
Copyright © Dell Inc. All Rights Reserved. of Y 2
ࣗݾհ Name: Ryotaro Uwatsu (@URyo_0213) Title: Solutions Architect Community: • Kubernetes Meetup Novice • Kubenews • Cloud Native Days Tokyo -
Copyright © Dell Inc. All Rights Reserved. of Y 3
Table of contents • ϙϦγʔ੍ޚ • Kyvernoͱ • Kyvernoʹ͓͚ΔϙϦγʔ੍ޚ • Kyvernoͷӡ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 5
ϙϦγʔ੍ޚͱ ϙϦγʔ: • (৫) ࡦɺํ • (ݸਓ) ͋ͳ͕ͨ৴͡ɺ͋ͳͨͷߦಈʹӨڹΛ༩͑ΔΑ͏ͳݪଇ ex) ʲONE PIECEʳ αϯδ ʮͨͱ͑ࢮΜͰɺԶঁऽΒΜʯͱ͍͏໊ݴ͕͋ΓɺʮঁੑΛઈରʹই͚ͭͳ͍ʯͱ͍͏ϙϦγʔΛ͍࣋ͬͯΔɻ → ͜Εઈରʹ͠ͳ͍ -
Copyright © Dell Inc. All Rights Reserved. of Y 6
ϙϦγʔ੍ޚͱ ϙϦγʔ: • (৫) ࡦɺํ • (ݸਓ) ͋ͳ͕ͨ৴͡ɺ͋ͳͨͷߦಈʹӨڹΛ༩͑ΔΑ͏ͳݪଇ ex) ʲONE PIECEʳ αϯδ ʮͨͱ͑ࢮΜͰɺԶঁऽΒΜʯͱ͍͏໊ݴ͕͋ΓɺʮঁੑΛઈରʹই͚ͭͳ͍ʯͱ͍͏ϙϦγʔΛ͍࣋ͬͯΔɻ → ͜Εઈରʹ͠ͳ͍ -
Copyright © Dell Inc. All Rights Reserved. of Y 7
ϙϦγʔ੍ޚͱ ϙϦγʔ: • (৫) ࡦɺํ • (ݸਓ) ͋ͳ͕ͨ৴͡ɺ͋ͳͨͷߦಈʹӨڹΛ༩͑Δݪଇ ex) ʲONE PIECEʳ αϯδ ʮͨͱ͑ࢮΜͰɺԶঁऽΒΜʯͱ͍͏໊ݴ͕͋ΓɺʮঁੑΛઈରʹই͚ͭͳ͍ʯͱ͍͏ϙϦγʔΛ͍࣋ͬͯΔɻ → ͜Εઈରʹ͠ͳ͍ [Kubernetes] latestλάͷimageΛࢦఆͨ͠Podઈରʹಈ͔͞ͳ͍ -
Copyright © Dell Inc. All Rights Reserved. of Y 8
ϙϦγʔ੍ޚͱ ϙϦγʔ: • (৫) ࡦɺํ • (ݸਓ) ͋ͳ͕ͨ৴͡ɺ͋ͳͨͷߦಈʹӨڹΛ༩͑Δݪଇ ex) ʲONE PIECEʳ αϯδ ʮͨͱ͑ࢮΜͰɺԶঁऽΒΜʯͱ͍͏໊ݴ͕͋ΓɺʮঁੑΛઈରʹই͚ͭͳ͍ʯͱ͍͏ϙϦγʔΛ͍࣋ͬͯΔɻ → ͜Εઈରʹ͠ͳ͍ [Kubernetes] latestλάͷimageΛࢦఆͨ͠Podઈରʹಈ͔͞ͳ͍ ϙϦγʔͱɺݸਓɺνʔϜɺ͘͠৫ͷதͰઃ͚ͨӡ༻্ͷܾΊࣄͰ͋Γɺ ϙϦγʔ੍ޚͱɺϙϦγʔΛఆΊͨΒɺͦΕΛඞͣकΔΑ͏ʹ͔͠Δ͖ΞΫγϣϯΛͱΔ͜ͱͰ͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 9
Kubernetesʹ͓͚ΔجຊతͳϙϦγʔ੍ޚ KubernetesͰɺҎԼͷΑ͏ͳϙϦγʔ੍ޚ͕Ͱ͖ΔΑ͏ʹͳ͍ͬͯ·͢ɻ • Network Policy – Ingress(Πϯόϯυ)ɺEgress(Ξτόϯυ)ͷ੍ޚΛ͢Δɻ • Pod Security Admission – Pod Security StandardsΛجʹɺ࡞Ͱ͖ΔϫʔΫϩʔυϦιʔεΛ੍ݶ͢Δɻ • Resource Quota – Namespace͝ͱͷ૯ϦιʔεফඅྔΛ੍ݶ͢Δɻ • etc… -
Copyright © Dell Inc. All Rights Reserved. of Y 11
Kyverno KyvernoKubernetesΫϥελʔͰɺDynamic Admission Controllerͱ࣮ͯ͠ߦ͞ΕΔϙϦγʔΤϯδϯͰ͢ɻ kube-apiserver͔ΒAdmission WebhookΛड͚औΓɺఆٛͨ͠ϙ Ϧγʔʹج੍͍ͮͯޚΛ࣮ߦ͠·͢ɻ Custom ResourceΛ༻͍ͯɺKubernetesͷϚχϑΣετϕʔεͰ ϙϦγʔΛద༻Ͱ͖ΔͨΊɺֶशίετ͕ͱͯ͘ͳ͍ͬͯ ·͢ɻ όʔδϣϯ: 1.8.0 https://github.com/kyverno/kyverno -
Copyright © Dell Inc. All Rights Reserved. of Y 12
Dynamic Admission Control -
Copyright © Dell Inc. All Rights Reserved. of Y 13
Dynamic Admission Control Authentication Authorization Mutating Admission Object Schema Admission Validating Admission Persist data to etcd Webhook Webhook Webhook Webhook Kyverno -
Copyright © Dell Inc. All Rights Reserved. of Y 14
Mutating ͱ Validating Mutating: ͋Δ݅Λجʹɺ࡞͠Α͏ͱ͍ͯ͠ΔϦιʔεͷύϥϝʔλʹมߋΛՃ͑·͢ɻ ex) sidecar.istio.io/inject: trueͱ͍͏ϥϕϧͷ͘PodʹɺEnvoyΛαΠυΧʔͱͯ͠Ճ͢Δɻ Validating: ࡞͠Α͏ͱ͍ͯ͠ΔϦιʔε͕ɺ࡞ͯ͠ྑ͍͔൱͔Λ݅ʹج͍ͮͯஅ͠·͢ɻ ex) allowed-by-kyverno: trueͱ͍͏ϥϕϧ͕͍ͨPodͷΈ࡞ͯ͠Α͍ɻ ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 15
KyvernoͷΠϯετʔϧ ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 16
KyvernoͷΠϯετʔϧ Kyverno ɺHelm͘͠YAMLϚχϑΣετ͔ΒσϓϩΠ͢Δ͜ͱ͕Ͱ͖·͢ɻ [ຊ൪ڥ] helm install kyverno kyverno/kyverno -n kyverno --create-namespace --set replicaCount=3 [ݕূڥ] helm install kyverno kyverno/kyverno -n kyverno --create-namespace ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 17
ϨϓϦΧͷࢦఆʹΑͬͯൃੜ͢Δҧ͍ ϨϓϦΧΛ1ΑΓେ͖͍ʹ͢Δ͜ͱͰɺPod Disruption Budget͕ద༻͞Ε·͢ɻ (Helm Template) ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 18
Pod Anti-Affinity Rule Pod Anti-Affinity Rule͕ద༻͞Ε͍ͯΔͷͰɺՄೳͳݶΓϊʔυؒͰࢄ͞ΕΔΑ͏ʹͳ͍ͬͯ·͢ɻ ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 19
͜͜·Ͱͷ؆୯ͳ·ͱΊ • ϙϦγʔɺӡ༻্ͷܾΊࣄͰ͋Γɺ͜ΕΛकΔͨΊʹ͔͠Δ͖ߦಈΛͱΔ͜ͱ͕ϙϦ γʔ੍ޚͰ͢ɻ • Kyvernoɺkube-apiserver͕Ϧιʔεͷ੍ޚΛ͢ΔࡍͷWebhookͷ͛ઌͰ͢ɻ • KyvernoɺWebhookΛड͚औͬͨࡍʹɺϙϦγʔʹج͍ͮͨΞΫγϣϯΛͱΓ·͢ɻ ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 20
Kyvernoʹ͓͚ΔϙϦγʔ੍ޚ -
Copyright © Dell Inc. All Rights Reserved. of Y 21
KyvernoʹΑΔϙϦγʔͷద༻ KyvernoΛ༻͍ͯϙϦγʔΛద༻͢Δࡍʹ༻͍ΔϦιʔε2ͭ͋Γ·͢ɻ 1. Cluster Policy: ΫϥελʔશମʹϙϦγʔΛద༻͢Δࡍʹ༻͍Δɻ 2. Policy: Namespaceʹดͨ͡ϙϦγʔΛద༻͢Δࡍʹ༻͍Δɻ ҙͱͯ͠ɺϙϦγʔؒͰͷॱংੑ͕ଘࡏ͠ͳ͍ͨΊɺෳͷϙϦγʔΛΈ߹Θͤͨϧʔ ϧͷ֦ு͔͠Ͱ͖·ͤΜɻ ͢ͳΘͪPolicyؒͰͷ্ॻ͖͕Ͱ͖ͳ͍ͷͰɺCluster PolicyͰݫ͠ΊͷPolicyΛઃఆ͓͍ͯͯ͠ɺ ͋ΔNamespaceʹ͓͍ͯPolicyΛ༻੍͍ͯݶΛ؇ΊΔͱ͍͏͜ͱ͕Ͱ͖·ͤΜɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 22
ϙϦγʔߏ Policy Rule Preconditions Match Exclude Validate Resources Mutate Resources Generate Resources Verify Images ରͷܾఆ ΞΫγϣϯ -
Copyright © Dell Inc. All Rights Reserved. of Y 24
Kyvernoʹ͓͚ΔϙϦγʔ੍ޚ ~ ରͷܾఆ ~ -
Copyright © Dell Inc. All Rights Reserved. of Y 25
Validate Resources Mutate Resources Generate Resources Verify Images ΞΫγϣϯ Policy Rule Preconditions Match Exclude ରͷܾఆ ରͷܾఆ -
Copyright © Dell Inc. All Rights Reserved. of Y 26
Match MatchɺରͷϦιʔεΛબఆ͢ΔͨΊʹ༻͍ΒΕΔϧʔϧͰ͢ɻ rules[*].matchΛ༻͍ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ ҎԼͷྫͰɺDeploymentΛରʹ”ΞΫγϣϯ”Λ࣮ߦ͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 27
Exclude ExcludeɺMatchʹؚ·ΕΔϦιʔεʹରͯ͠ɺྫ֎Λ࡞Δ߹ʹ༻͍·͢ɻ rules[*].excludeΛ༻͍ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ ҎԼͷྫͰɺNamespace(kube-system)Ҏ֎ͷPodΛରʹ”ΞΫγϣϯ”Λ࣮ߦ͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 28
All ͱ Any matchͱexcludeಉ͡ߏΛ࣋ͪɺҎԼ2ͭͷཁૉͷ͏ͪͷ1ͭΛࢦఆ͢Δ͜ͱ͕Ͱ͖·͢ɻ • any: Ϧιʔεͷબʹ͓͍ͯOR݅Λద༻͢ΔͨΊͷͷɻ • all: Ϧιʔεͷબ࣌ʹAND݅Λద༻͢ΔͨΊͷͷɻ OR AND -
Copyright © Dell Inc. All Rights Reserved. of Y 29
Any ͱ All ҎԼͷྫͷΑ͏ʹɺany͘͠allΛࢦఆͤͣʹɺهड़͢Δ͜ͱݱঢ়Մೳͱͳ͍ͬͯ·͕͢ɺ deprecatedͱͳ͓ͬͯΓɺকདྷͷϦϦʔεͰαϙʔτ͞Εͳ͘ͳΔ༧ఆͳͷͰɺҙ͍ͯͩ͘͠͞ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 30
ରͷࢦఆํ๏ ରΛબఆ͢Δʹ͋ͨΓɺҎԼͷࢦఆ߲Λ༻͍Δ͜ͱ͕Ͱ͖·͢ɻ • resources: – kind(Deployment, Pod, ServiceͳͲ)Λඞਢ߲ͱͯ͠ࢦఆ͢Δɻ – Ϧιʔε໊ɺNamespaceɺ Ξϊςʔγϣϯɺϥϕϧࢦఆ͠ɺ໌֬ʹରΛࢦఆ͢Δ͜ͱ͕Ͱ͖Δɻ • subjects: – User, Group, Service AccountΛࢦఆ͢Δɻ • roles/clusterRoles: – Role͘͠Cluster RoleΛࢦఆ͢Δɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 31
ରͷࢦఆํ๏ ҎԼͷྫͰɺ User(cndt-admin)͘͠Cluster Role(cluster-admin)ʹΑͬͯ࡞͞ΕͨϦιʔεΛআ͖ɺ ϥϕϧʹapp=criticalΛ࣋ͭPod ͕ରͱͳΓ·͢ɻ apiVersion: v1 kind: Pod metadata: name: test1 labels: app: critical apiVersion: v1 kind: Pod metadata: name: test1 labels: app: critical apiVersion: v1 kind: Pod metadata: name: test1 labels: app: critical User: John ClusterRole: cluster-admin User: cndt-admin ClusterRole: admin User: ry ClusterRole: admin ର֎ ର -
Copyright © Dell Inc. All Rights Reserved. of Y 32
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector -
Copyright © Dell Inc. All Rights Reserved. of Y 33
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] શDeploymentϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 34
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] testͱ͍͏໊લͷDeploymentϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 35
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] ࢦఆͷϥϕϧΛ࣋ͭDeploymentϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 36
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] ࢦఆͷϥϕϧΛ࣋ͭDeploymentϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 37
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] ࢦఆͷΞϊςʔγϣϯΛ࣋ͭDeploymentϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 38
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] ࢦఆͷNamespaceʹ͓͚ΔDeploymentϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 39
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] ࢦఆͷNamespaceʹ͓͚ΔDeploymentϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 40
resourcesʹ͓͚ΔࢦఆՄೳ߲ resourcesͰɺҎԼͷ߲Λࢦఆ͢Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ • (Required) kind • (Optional) name • (Optional) selector • (Optional) annotations • (Optional) namespaces • (Optional) namespaceSelector [ର] ࢦఆͷNamespaceʹ͓͍ͯɺ ࢦఆͨ͠ϥϕϧΛ࣋ͭDeployment ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 41
resourcesʹ͓͚ΔࢦఆϑΥʔϚοτ resourcesͷkindͰɺҎԼͷϑΥʔϚοτΛαϙʔτ͍ͯ͠·͢ɻ • Group/Version/Kind • Version/Kind • Kind ͜Εɺྫ͑Network PolicyʹΛࢦఆ͢Δࡍʹɺಉ͡Ϧιʔε໊Λ࣋ͭΑ͏ͳͷ͕ෳଘࡏ͢Δ ߹ͳͲʹ༗ޮͰ͢ɻ (Kubernetes) apiVersion: networking.k8s.io/v1 kind: NetworkPolicy (Calico) apiVersion: projectcalico.org/v3 kind: NetworkPolicy ຊ൪ະ༻ -
Copyright © Dell Inc. All Rights Reserved. of Y 42
ϫΠϧυΧʔυ ϫΠϧυΧʔυͷࢦఆɺҎԼͷϧʔϧʹ͓͍ͯࢦఆ͕Մೳ ͱͳ͍ͬͯ·͢ɻ • *: ҙͷ͞ͷจࣈྻ • ?: ҙͷ1จࣈ [ର] ͯ͢ͷϦιʔε -
Copyright © Dell Inc. All Rights Reserved. of Y 43
Preconditions PreconditionsɺϧʔϧΛద༻͢ΔλΠϛϯάΛΑΓࡉ੍͔͘ޚͨΊʹ༻͍·͢ɻ AdmissionReviewΛࢀর͠ɺPreconditionsʹهड़ͨ͠ϧʔϧΛجʹɺKyvernoʹΑΔϙϦγʔ ੍ޚΛ࣮ࢪ͢Δ͔Ͳ͏͔Λஅ͠·͢ɻ rules[*].preconditionsΛ༻͍ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ matchexcludeͱಉ༷ʹɺany ͘͠ all ͷԼʹϧʔϧΛهड़͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 44
AdmissionReview Dynamic Admission ControlͷதͰɺWebbookΛඈ͢ࡍɺ Ϧιʔεʹର͢Δ༷ʑͳใΛૹ৴͢ΔͨΊʹ༻͍Δͷ͕ɺ AdmissionReviewͰ͢ɻ ࠓճͷૢ࡞͕ͲͷΑ͏ͳ͜ͱΛ͠Α͏ͱ͍ͯ͠Δͷ͔Λࣔ͢ request.operation(CREATE, UPDATE, DELETE, CONNECT)ɺ ૢ࡞ରͷϦιʔεͷύϥϝʔλ͕֨ೲ͞Ε͍ͯΔ request.object ͳͲͷใؚ͕·Ε͍ͯ·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 45
Preconditions Example spec.rules.preconditions.(any/all)[*]ԼͰɺ key – operator – value ͷΈ߹ΘͤΛ༻͍ ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ ͜ͷྫͰɺ࡞͘͠ߋ৽ͷ߹ʹɺର ͕PodͰ͋ΕϙϦγʔ੍ޚΛ࣮ࢪ͢Δͱ ͍͏ڍಈΛ͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 46
ԋࢉࢠ Preconditionsʹ͓͍ͯهड़͢ΔԋࢉࢠʹɺҎԼΛઃఆ͢Δ͜ͱ͕Ͱ͖·͢ɻ • Equals • NotEquals • In (deprecated) • AnyIn • AllIn • NotIn (deprecated) • AnyNotIn • AllNotIn • GreaterThan • GreaterThanOrEquals • LessThan • LessThanOrEquals • DurationGreaterThan • DurationGreaterThanOrEquals • DurationLessThan • DurationLessThanOrEquals -
Copyright © Dell Inc. All Rights Reserved. of Y 47
“ରͷܾఆ” ͷ·ͱΊ • MatchΛ༻͍ͯɺϙϦγʔ੍ޚΛ࣮ߦ͢ΔରΛࢦఆ͠·͢ɻ • ExcludeΛ༻͍ͯɺରͷϦιʔεʹରͯ͠ྫ֎Λ࡞Γ·͢ɻ • PreconditionsΛ༻͍Δ͜ͱͰɺલఏ݅ΛઃఆͰ͖·͢ɻ • ϧʔϧʹରͯ͠ɺany(OR) ͘͠ all(AND) Λ༻͍ͯྻߏͰࢦఆΛ͠·͠ΐ͏ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 48
Kyvernoʹ͓͚ΔϙϦγʔ੍ޚ ~ ΞΫγϣϯ ~ -
Copyright © Dell Inc. All Rights Reserved. of Y 49
Preconditions Match Exclude ରͷܾఆ ϙϦγʔߏ Policy Rule Validate Resources Mutate Resources Generate Resources Verify Images ΞΫγϣϯ -
Copyright © Dell Inc. All Rights Reserved. of Y 50
Validate Resources Ϣʔβʔ·ͨϓϩηεʹΑͬͯ৽͍͠Ϧιʔε͕࡞͞ΕΔ߹ʹɺͦͷϦιʔεΛ࡞͠ ͯΑ͍͔൱͔Λஅ͢ΔͨΊʹ༻͍·͢ɻ spec.rules[*].validateΛ༻͍ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ ϧʔϧʹҧ͢ΔϦιʔεʹର͢Δڍಈspec.validationFailureActionʹΑ੍ͬͯޚ͢Δ͜ͱ ͕ՄೳͰ͢ɻ • enforce – ϧʔϧʹҧͨ͠߹ɺ࡞ΛϒϩοΫ͢Δɻ • audit – ϧʔϧʹҧͨ͠߹ʹ࡞ڐՄ͢Δɻ – ϙϦγʔϨϙʔτʹҧ͢ΔϦιʔεͱͯ͠ه͢Δɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 51
Validate Resources Example spec.rules[*].validate.patternԼͰɺ ରϦιʔεʹ͓͚Δ࠷্Ґͷ metadata͘͠specԼΛهड़͠ɺ ݕূϧʔϧΛઃఆ͠·͢ɻ nginx-with-labelɺࢦఆ͞Εͨϥϕϧ Λ͍࣋ͬͯΔͨΊ࡞͕ڐՄ͞Εɺ nginx-without-labelɺࢦఆͨ͠ϥϕϧ Λ࣋ͨͳ͍ͨΊ࡞͕ڋ൱͞Ε·͢ɻ [࣮ߦ݁Ռ] -
Copyright © Dell Inc. All Rights Reserved. of Y 52
validationFailureActionOverrides ClusterPolicyͰͷvalidationʹݶΓɺ validationFailureActionOverridesΛ༻ ͍ͯɺNamespaceΛࢦఆ͠ɺݸʑʹ FailuerAction(audit, enforce)Λઃఆ͢ Δ͜ͱ͕Մೳͱͳ͍ͬͯ·͢ɻ લͷεϥΠυͰɺ࡞͕ڋ൱͞Εͨ Pod͕Namespace(no-label)ʹ͓͍ͯ ࡞͞Εͨ͜ͱ͕֬ೝͰ͖·͢ɻ [࣮ߦ݁Ռ] -
Copyright © Dell Inc. All Rights Reserved. of Y 53
Validate݅ͷهड़ํ๏ ҎԼͷදݱΛ༻͍ͯɺvalidationͷ݅Λهड़͢Δ͜ͱ͕Ͱ͖·͢ɻ • pattern • anyPattern • deny • Foreach • Manifest Validation • Pod Security -
Copyright © Dell Inc. All Rights Reserved. of Y 54
Validate݅ͷهड़ํ๏ ຊηογϣϯͰɺҎԼͷ3ͭʹ͍ͭͯղઆ͠·͢ɻ • pattern • anyPattern • deny • Foreach • Manifest Validation • Pod Security -
Copyright © Dell Inc. All Rights Reserved. of Y 55
patternͷهड़ํ๏ patternͰɺmetadata͘͠specԼΛهड़ ͠ɺϦιʔεͷใͱൺֱ͢Δ͜ͱͰݕূΛ࣮ ࢪ͠·͢ɻ ͜ͷྫͰɺDeploymentͷspecԼΛهड़ͯ͠ɺ DeploymentʹΑͬͯੜ͞ΕΔPodʹ͓͍ͯɺ ϥϕϧʹʮpermitted-by-kyverno=“true”ʯ͕͋Δ ͜ͱΛඞਢ݅ͱ͍ͯ͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 56
patternͷهड़ํ๏ patternΛ༻͍ͨ݅ͷهड़ͰɺҎԼͷදݱΛར༻͢Δ͜ͱ͕Ͱ͖·͢ɻ • ϫΠϧυΧʔυ • ԋࢉࢠ • ΞϯΧʔ -
Copyright © Dell Inc. All Rights Reserved. of Y 57
ϫΠϧυΧʔυ ϫΠϧυΧʔυͷࢦఆɺҎԼͷϧʔϧʹ͓͍ͯࢦఆ͕Մ ೳͱͳ͍ͬͯ·͢ɻ • *: ҙͷ͞ͷจࣈྻ • ?: ҙͷ1จࣈ [ϧʔϧ] allowed-byΛΩʔͱͨ͠ϥϕϧΛ࣋ͭඞཁ͕͋ Δɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 58
ԋࢉࢠ ԋࢉࢠΛ༻͍Δ͜ͱͰɺʹରͯ͠ৄࡉͳ݅Λهड़Ͱ͖·͢ɻ ԋࢉࢠ ҙຯ > ΑΓେ͖͍ < ະຬ >= Ҏ্ <= ҎԼ ! ࢦఆͱ͘͠ͳ͍ | OR & AND - ൣғ !- ൣғ֎ -
Copyright © Dell Inc. All Rights Reserved. of Y 59
ԋࢉࢠ $ kubectl create deploy not-enough-replica \ --replicas=2 --image nginx:alpine [ൺֱ] ԋࢉࢠ ҙຯ > ΑΓେ͖͍ < ະຬ >= Ҏ্ <= ҎԼ ! ࢦఆͱ͘͠ͳ͍ | OR & AND - ൣғ !- ൣғ֎ -
Copyright © Dell Inc. All Rights Reserved. of Y 60
ԋࢉࢠ [ࢦఆҎ֎ͷબ] ԋࢉࢠ ҙຯ > ΑΓେ͖͍ < ະຬ >= Ҏ্ <= ҎԼ ! ࢦఆͱ͘͠ͳ͍ | OR & AND - ൣғ !- ൣғ֎ $ kubectl run nginx --image nginx:alpine –n default -
Copyright © Dell Inc. All Rights Reserved. of Y 61
ΞϯΧʔ ΞϯΧʔΛ༻͍ͯɺΩʔʹର͢Δ༷ʑͳ͚݅Λ͢Δ͜ͱ͕Ͱ͖·͢ɻ ΞϯΧʔ λά ҙຯ ͖݅ () ϐΞཁૉʹର͢Δ݅ͷઃఆ ฏ =() ͠ଘࡏͨ͠߹ʹ… ଘࡏ ^() গͳ͘ͱ1ͭଘࡏ͢Δ ൱ఆ X() ରͷڋ൱ άϩʔόϧ <() ҙͷॴͰ݅Λઃఆ -
Copyright © Dell Inc. All Rights Reserved. of Y 62
ΞϯΧʔ [() ΞϯΧʔ] ΞϯΧʔ λά ҙຯ ͖݅ () ϐΞཁૉʹର͢Δ݅ͷઃఆ ฏ =() ͠ଘࡏͨ͠߹ʹ… ଘࡏ ^() গͳ͘ͱ1ͭଘࡏ͢Δ ൱ఆ X() ରͷڋ൱ άϩʔόϧ <() ҙͷॴͰ݅Λઃఆ [݅] (݅: specԼ, ϐΞ: metadata) spec.volumes.hostPath͕ఆٛ͞Εɺpath͕/var/logͩͬͨ ߹ʹɺmetadata.labelsʹͯɺallow-log-hostpath: “true”͕ ࢦఆ͞Ε͍ͯͳ͚ΕͳΒͳ͍ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 63
͖݅ΞϯΧʔʹ͍ͭͯ ͖݅ΞϯΧʔɺPeerཁૉʹରͯ͠ͷ͚݅ͷͨ Ίɺຊདྷͷಈ͖ͱͯ͠ɺPeerཁૉͷ֎ʹ͍Δͷʹؔ͠ ͯɺΞϯΧʔ͖ͷཁૉͷධՁʹӨڹΛड͚·ͤΜɻ Ver1.8.0࣌Ͱɺ͜ͷྫͷΑ͏ʹɺPeerཁૉͰͳ͍ͷ ʹؔͯ͠ɺϧʔϧʹҰக͠ͳ͍ʹؔΘΒͣɺΞϯΧʔ ཁૉ͕Ұக͠ͳ͍ࣄʹӨڹΛड͚ɺධՁ͕εΩοϓ͞Εͯ ͠·͏ͷͰҙΛ͍ͯͩ͘͠͞ɻ ※ ݱঢ়issueΛ։͍ͯରԠΛ͍͍͍ͯͨͩͯ͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 64
ΞϯΧʔ [=() ΞϯΧʔ] [݅] spec.volumes.hostPath͕ఆٛ͞Ε͍ͯͨ߹ʹɺ path͕ /proc ٴͼ /sys Ͱ͋ͬͯͳΒͳ͍ɻ ΞϯΧʔ λά ҙຯ ͖݅ () ϐΞཁૉʹର͢Δ݅ͷઃఆ ฏ =() ͠ଘࡏͨ͠߹ʹ… ଘࡏ ^() গͳ͘ͱ1ͭଘࡏ͢Δ ൱ఆ X() ରͷڋ൱ άϩʔόϧ <() ҙͷॴͰ݅Λઃఆ -
Copyright © Dell Inc. All Rights Reserved. of Y 65
ΞϯΧʔ [^() ΞϯΧʔ] [݅] PodΛ࡞͢Δ߹ʹɺlivenessProveΛઃఆͨ͠ίϯςφ Λগͳ͘ͱ1ؚͭ·ͳͯ͘ͳΒͳ͍ɻ ΞϯΧʔ λά ҙຯ ͖݅ () ϐΞཁૉʹର͢Δ݅ͷઃఆ ฏ =() ͠ଘࡏͨ͠߹ʹ… ଘࡏ ^() গͳ͘ͱ1ͭଘࡏ͢Δ ൱ఆ X() ରͷڋ൱ άϩʔόϧ <() ҙͷॴͰ݅Λઃఆ -
Copyright © Dell Inc. All Rights Reserved. of Y 66
ΞϯΧʔ [X() ΞϯΧʔ] [݅] no-ephemeral=“true”ͱ͍͏ϥϕϧΛ࣋ͭPodʹؔͯ͠ɺ ΤϑΣϝϥϧίϯςφͷ࡞Λڋ൱͢Δɻ ※ ʹ “null” Λ༻͍Δ ΞϯΧʔ λά ҙຯ ͖݅ () ϐΞཁૉʹର͢Δ݅ͷઃఆ ฏ =() ͠ଘࡏͨ͠߹ʹ… ଘࡏ ^() গͳ͘ͱ1ͭଘࡏ͢Δ ൱ఆ X() ରͷڋ൱ άϩʔόϧ <() ҙͷॴͰ݅Λઃఆ -
Copyright © Dell Inc. All Rights Reserved. of Y 67
ΞϯΧʔ [<() ΞϯΧʔ] [݅] my-local-reg.com͔Βऔಘ͢ΔΠϝʔδΛ͏ίϯςφ͕͋ Δ߹ʹɺmy-registry-secretΛimagePullSecretͱͯ͠Θͳ ͯ͘ͳΒͳ͍ɻ ΞϯΧʔ λά ҙຯ ͖݅ () ϐΞཁૉʹର͢Δ݅ͷઃఆ ฏ =() ͠ଘࡏͨ͠߹ʹ… ଘࡏ ^() গͳ͘ͱ1ͭଘࡏ͢Δ ൱ఆ X() ରͷڋ൱ άϩʔόϧ <() ҙͷॴͰ݅Λઃఆ -
Copyright © Dell Inc. All Rights Reserved. of Y 68
anyPatternͷهड़ํ๏ anyPatternΛ༻͍Δ͜ͱͰɺෳͷpatternΛఆٛ ͢Δ͜ͱ͕Ͱ͖·͢ɻ ͜ͷྫͰɺPodશମʹରͯ͠securityContextsΛ ઃఆ͢Δ͔ɺ֤ίϯςφ(container, init container, ephemeral container)ʹରͯ͠securityContextΛ ઃఆ͢Δ͜ͱΛڧ੍͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 69
denyͷهड़ํ๏ denyͰɺهड़ͨ͠Ұ࿈ͷ݅ʹج͍ͮͯ ཁٻΛڋ൱͍ͨ͠߹ʹ༻͍·͢ɻ ݅ɺ௨ৗdeny.conditionsԼͰɺany͠ ͘allΛࢦఆ͠ɺkey – operator – value ͷ Έ߹ΘͤΛ༻͍ͯهड़͍͖ͯ͠·͢ɻ denyΛ༻͍Δ߹validationFailureAction Λenforceʹ͢Δඞཁ͕͋Γ·͢ɻ [ϧʔϧ] ClusterRole(cluster-adminҎ֎)ͷݖݶʹΑΔૢ࡞ʹ͓͍ͯɺ app.kubernetes.iomanaged=“kyverno” ͱ͍͏ϥϕϧΛͭϦιʔεͷআૢ࡞Λڋ൱͢Δɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 70
ԋࢉࢠ denyʹ͓͍ͯɺconditionsͰهड़͢ΔԋࢉࢠʹɺҎԼΛઃఆ͢Δ͜ͱ͕Ͱ͖·͢ɻ • Equals • NotEquals • In (deprecated) • AnyIn • AllIn • NotIn (deprecated) • AnyNotIn • AllNotIn • GreaterThan • GreaterThanOrEquals • LessThan • LessThanOrEquals • DurationGreaterThan • DurationGreaterThanOrEquals • DurationLessThan • DurationLessThanOrEquals -
Copyright © Dell Inc. All Rights Reserved. of Y 71
denyͷهड़ํ๏ denyͰɺࢦఆϦιʔεʹରͯ͠ɺશͯͷૢ ࡞Λڋ൱͢ΔΑ͏ઃఆ͢Δ͜ͱՄೳͰ͢ɻ [ϧʔϧ] ClusterRole(cluster-adminҎ֎)ͷݖݶʹΑΔૢ࡞ ʹ͓͍ͯɺNetwork PolicyϦιʔεͷૢ࡞Λશͯ ڋ൱͢Δɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 72
Mutate Resources ϧʔϧʹҰகͨ͠Ϧιʔεʹରͯ͠ɺύϥϝʔλʹมߋΛՃ͑Δࡍʹ༻͍·͢ɻ spec.rules[*].mutateΛ༻͍ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ ҎԼͷ߲Λ༻͍ͯϧʔϧΛద༻͢Δ͜ͱ͕Ͱ͖·͢ɻ • RFC 6902 JSONPatch • Strategic Merge Patch • Foreach -
Copyright © Dell Inc. All Rights Reserved. of Y 73
RFC 6902 JSONPatch RFC 6902 JSONPatchɺJSON Patch(https://jsonpatch.com/)ϑΥʔϚοτΛ༻͍ͯରΛܾఆ͠ɺ ϦιʔεͷཁૉʹมߋΛՃ͑Δࡍʹ༻͍·͢ɻ spec.rules[*].mutate.patchesJson6902ԼͰɺpath – op – value ͷΈ߹ΘͤΛ༻͍ͯهड़͠·͢ɻ pathʹมߋΛՃ͍͑ͨॴΛࢦఆ͠ɺopʹͦͷมߋͷڍಈΛɺvalueʹมߋ࣌ͷΛೖΕ·͢ɻ opʹɺҎԼͷ3ͭͷૢ࡞ํ๏͕αϙʔτ͞Ε͍ͯ·͢ɻ • add • replace • remove -
Copyright © Dell Inc. All Rights Reserved. of Y 74
RFC 6902 JSONPatch ͜ͷϧʔϧͰɺadd-tls-secret=“true”ͱ͍͏ ϥϕϧΛ࣋ͭPodʹର͠ɺSecretΛVolumeͱ ͯ͠ૠೖ͢ΔΑ͏manifestʹมߋΛ͠·͢ɻ ҙͱͯ͠ɺྻߏΛѻ͏߹ɺطଘ ͷࢀরΠϯσοΫεɺ৽نՃ”-”Λͬ ͯදݱ͠·͢ɻ path: "/spec/containers/0/volumeMounts/-" 1ͭΊͷίϯςφΛࢀর volumeMountsʹ ྻߏͰσʔλΛՃ -
Copyright © Dell Inc. All Rights Reserved. of Y 75
RFC 6902 JSONPatch [લϖʔδͷϧʔϧΛmutete6902.yamlʹهड़͠ద༻ͨ͠ࡍͷ࣮ߦྫ] $ kubectl create secret tls tls-cert --cert=server.crt --key=server.key -n default $ kubectl apply -f mutate6902.yaml $ kubectl run nginx-tls --image nginx:alpine -l add-tls-secret="true" $ kubectl exec -it nginx-tls -- ls /cndt tls.crt tls.key -
Copyright © Dell Inc. All Rights Reserved. of Y 76
Strategic Merge Patch ཁૉͷϚʔδಈ࡞Λ੍ޚ͢ΔͨΊʹ༻͍ΒΕ·͢ɻ spec.rules[*].mutate.patchStrategicMergeԼʹɺϚχϑΣετͷܗࣜͰهड़ͨ͠ͷΛ༻͍ ͯɺࠩͷൺֱΛ͠ύϥϝʔλͷมߋΛద༻͠·͢ɻ validateϧʔϧಉ༷ʹɺmutateʹ͓͍ͯΞϯΧʔΛ੍ͬͨޚՄೳͱͳ͍ͬͯ·͢ɻ mutateϧʔϧʹ͓͍ͯɺҎԼͷΞϯΧʔ͕༻Մೳͱͳ͍ͬͯ·͢ɻ ΞϯΧʔ λά ҙຯ ͖݅ () if݅Λઃఆ͠ɺpeerཁૉͦͷ݁ՌʹมߋͷӨڹΛड͚Δ Ճ +() ΞϯΧʔΛ༩ͨ͠Ωʔ͕ଘࡏ͠ͳ͍߹ʹɺઃఆͨ͠ΩʔٴͼΛ Ճ͢Δ άϩʔόϧ <() ҙͷॴʹ݅Λઃఆ͠ɺͦͷ΄͔ͷՕॴʹมߋΛՃ͑Δ -
Copyright © Dell Inc. All Rights Reserved. of Y 77
Strategic Merge Patch ͜ͷϧʔϧͰɺcndt-vault-injection: “true” ͱ͍͏ϥϕϧΛ࣋ͭPod͕࡞͞Εͨࡍʹɺ VaultʹొΛͨ͠ಛఆͷγʔΫϨοτσʔλΛɺ PodʹࢦఆͷϑΥʔϚοτͰஔ͢ΔͨΊͷ ΞϊςʔγϣϯͱαʔϏεΞΧϯτΛ༩ͯ͠ ͍·͢ɻ {{ ~~ }} Λ༻͍ͨهड़Λ͠ͳ͚ΕͳΒͳ͍߹ɺ Kyvernoʹ͓͍ͯɺෳࡶͳ݅Λهड़͢Δࡍʹ ༻͍ΔJMESPathͱ͍͏ه๏ͱޡೝ͞Εͳ͍Α͏ ʹɺ\Λ༻͍ͯΤεέʔϓͤ͞Δඞཁ͕͋Γ·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 78
Strategic Merge Patch [લϖʔδͷϧʔϧΛstrategicMerge.yamlʹهड़͠ద༻ͨ͠ࡍͷ࣮ߦྫ] $ vault secrets enable -path=secret kv-v2 $ vault kv put secret/cndt/config username="static-user" password="static-password" $ vault policy write cndt - <<EOF path "secret/data/cndt/config" { capabilities = ["read"] } EOF $ vault write auth/kubernetes/role/cndt \ bound_service_account_names=cndt \ bound_service_account_namespaces=default \ policies=cndt \ ttl=24h -
Copyright © Dell Inc. All Rights Reserved. of Y 79
Strategic Merge Patch [લϖʔδͷϧʔϧΛstrategicMerge.yamlʹهड़͠ద༻ͨ͠ࡍͷ࣮ߦྫ] $ kubectl apply –f strategicMerge.yaml $ kubectl create sa cndt -n default $ kubectl run cndt-app --image nginx:alpine -l cndt-vault-injection="true“ $ kubectl exec -it cndt-app -- cat /vault/secrets/cndt-credentials Defaulted container "cndt-app" out of: cndt-app, vault-agent, vault-agent-init (init) USERNAME=static-user PASSWORD=static-password -
Copyright © Dell Inc. All Rights Reserved. of Y 80
Generate Resources ৽͍͠Ϧιʔε͕࡞͞ΕͨࡍɺՃͷϦιʔεΛ࡞͢Δ߹ʹ༻͍·͢ɻ spec.rules[*].generateΛ༻͍ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ ࡞͢ΔϦιʔεͷใΛɺҎԼͷ2ͭΛ༻͍ͯهड़͢Δ͜ͱ͕Ͱ͖·͢ɻ • data: ࡞͢ΔϦιʔεͷใΛهड़͢Δ • clone: طʹଘࡏ͢ΔϦιʔεΛΫϩʔϯ͢Δ -
Copyright © Dell Inc. All Rights Reserved. of Y 81
Generate Resources with data spec.rules[*].generateԼͰɺҎԼΛهड़͠ ·͢ɻ • synchronize: ιʔεϦιʔεͱͷಉظ – true: ಉظΛ͠ɺߋ৽আ͕Ͱ͖ͳ͍ – false: ಉظͤͣɺੜ͞ΕͨϦιʔεΛ ߋ৽·ͨআͰ͖Δ • ੜ͢ΔϦιʔεͷapiVersion, kind, name, namespace • data: metadataٴͼspecΛهड़ [ϧʔϧ] Namespace࡞࣌ʹɺIngressͱEgressΛڋ൱͢Δ Network PolicyΛ࡞͢Δɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 82
Generate Resources with clone spec.rules[*].generateԼͰɺҎԼΛهड़͠ ·͢ɻ • synchronize: ιʔεϦιʔεͱͷಉظ – true: ಉظΛ͠ɺߋ৽আ͕Ͱ͖ͳ͍ – false: ಉظͤͣɺੜ͞ΕͨϦιʔεΛ ߋ৽·ͨআͰ͖Δ • ੜ͢ΔϦιʔεͷapiVersion, kind, name, namespace • clone: NamespaceٴͼϦιʔε໊Λهड़ [ϧʔϧ] Namespace࡞࣌ʹɺࢦఆͨ͠Namespace(default) ʹଘࡏ͢ΔSecret(regsecret)ΛΫϩʔϯ͢Δɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 83
Verify Images CosignΛ༻ͯ͠ɺOCIϨδετϦʹ֨ೲ͞Ε͍ͯΔΠϝʔδͷॺ໊͓Αͼূ໌Λݕূ͠·͢ɻ ݱঢ়ɺϕʔλػೳͰ͋ΓɺϓϩμΫγϣϯڥͰͷ༻ਪ͞Ε͍ͯ·ͤΜɻ spec.rules[*].verifyImagesΛ༻͍ͯهड़͍ͯ͘͜͠ͱʹͳΓ·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 84
Verify Images imageReferencesʹ͓͍ͯࢦఆ͞Ε͍ͯ ΔΠϝʔδ͕ɺattestorsԼͰࢦఆ͞Ε͍ͯ ΔΩʔΛ༻͍ͯॺ໊͕͞Ε͍ͯΔͱ͍͏ ͜ͱΛݕূ͠·͢ɻ ॺ໊Λ͞Ε͍ͯͳ͍Πϝʔδٴͼɺࢦఆ ͨ͠ΩʔͱରͰͳ͍ΩʔʹΑͬͯॺ໊ ͞ΕͨΠϝʔδΛࢦఆͨ͠Pod͕ɺ͜ͷݕ ূʹΑͬͯڋ൱͞ΕΔ͜ͱʹͳΓ·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 85
“ΞΫγϣϯ” ͷ·ͱΊ • Validate ResourcesͰɺϦιʔεΛ࡞ͯ͠Α͍͔൱͔Λஅ͠·͢ɻ • Mutating ResourcesͰɺϦιʔεʹରͯ͠ύϥϝʔλͷมߋΛ࣮ࢪ͠·͢ɻ • Generate ResourcesͰɺ͋ΔϦιʔεͷ࡞ʹඥ͍ͮͯɺผϦιʔεΛ࡞͠·͢ɻ • Verify ImageͰɺΠϝʔδͷ҆શੑΛ֬ೝ͢ΔͨΊʹॺ໊Λ֬ೝ͠·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 88
ϙϦγʔϨϙʔτ ϙϦγʔϨϙʔτɺద༻ͨ͠validate ResourcesϙϦγʔʹରͯ͠ɺൺֱ݁ՌΛఏڙ͢ΔϦ ιʔεͰ͢ɻ KyvernoɺNamespace͝ͱͷϨϙʔτ͓ΑͼΫϥελʔϨϕϧͷϨϙʔτΛɺKubernetes Policy WGʹΑͬͯൃߦ͞ΕͨϙϦγʔϨϙʔτεΩʔϚΛ༻͍ͯ࡞͠·͢ɻ ݁ՌΤϯτϦɺ֘͢Δϧʔϧʹର͠ 1 ͭҎ্ͷϧʔϧʹҧ͢ΔϦιʔε͕࡞͞ΕΔͨ ͼʹϨϙʔτʹՃ͞ΕɺϦιʔε͕আ͞ΕΔͱɺಉ࣌ʹϨϙʔτ͔Βফڈ͞Ε·͢ɻ $ kubectl get polr -A -
Copyright © Dell Inc. All Rights Reserved. of Y 89
Ϩϙʔτର ରͱͯ͠ɺvalidationFailureActionٴͼbackgroundʹ͓͍ͯઃఆͨ͠ʹґଘ͠·͢ɻ Background: true Background: false ৽͍͠Ϧιʔε طଘͷϦιʔε validationFailureAction: enforce None Report validationFailureAction: audit Report Report ৽͍͠Ϧιʔε طଘͷϦιʔε validationFailureAction: enforce None None validationFailureAction: audit Report None -
Copyright © Dell Inc. All Rights Reserved. of Y 90
Ϩϙʔτ༰ ϙϦγʔϨϙʔτͷΤϯτϦʹɺpassɺskipɺwarnɺerrorɺͦͯ͠failͷ͍ͣΕ͔Ͱใࠂ͞Ε·͢ɻ • pass: ϙϦγʔʹର͢ΔධՁΛ௨աͨ͠Ϧιʔεɻ • skip: Preconditionͷ݅Λຬͨͣ͞ɺධՁ͕࣮ߦ͞Εͳ͔ͬͨͷɻ • fail: ϙϦγʔʹର͢ΔධՁʹରͯ͠ɺҧ͍ͯ͠ΔͱΈͳ͞Εͨͷɻ • warn: ҎԼͷ2ͭͷ݅Λຬͨͨ͠߹ʹద༻͞ΕΔɻ – PolicyͷΞϊςʔγϣϯʹ policies.kyverno.io/scored: “false“ ͕ηοτ͞Ε͍ͯΔɻ – ϙϦγʔʹର͢ΔධՁʹରͯ͠ɺҧ͍ͯ͠ΔͱΈͳ͞Εͨɻ • error: Preconditionsͷ֎ଆͰɺruleͷதʹ͓͍ͯมஔ͕ࣦഊͨ͠ͷ -
Copyright © Dell Inc. All Rights Reserved. of Y 92
ϞχλϦϯά KyvernoͰɺόʔδϣϯ1.4.0͔Βɺద༻༷ͨ͠ʑͳϙϦγʔʹର͢ΔΞΫςΟϏςΟΛ Prometheus༻ͷϝτϦοΫͱͯ͠ల։Ͱ͖ΔΑ͏ʹͳΓ·ͨ͠ɻ kyvernoΛσϓϩΠ͢ΔͱɺService(kyverno-svc-metrics)͕ϝτϦοΫΛެ։͢ΔͨΊʹ࡞ ͞Ε·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 93
ϝτϦοΫͷछྨ ҎԼͷϝτϦοΫ͕ఏڙ͞Ε·͢ɻ • Policies and Rule Counts • Policy and Rule Execution • Policy Rule Execution Latency • Admission Review Latency • Admission Requests Counts • Policy Change Counts -
Copyright © Dell Inc. All Rights Reserved. of Y 94
ϝτϦοΫͷछྨ ຊηογϣϯͰɺҎԼͷ3ͭʹ͍ͭͯղઆ͠·͢ɻ • Policies and Rule Counts • Policy and Rule Execution • Policy Rule Execution Latency • Admission Review Latency • Admission Requests Counts • Policy Change Counts -
Copyright © Dell Inc. All Rights Reserved. of Y 95
Policies and Rule Counts ͜ͷϝτϦοΫɺΫϥελʔͰݱࡏ༻Մೳͳͯ͢ͷϙϦγʔʹՃ͑ɺطʹআ͞Εͨϙ ϦγʔͳͲͷϙϦγʔͷཤྺอ͍࣋ͯ͠·͢ɻ ϝτϦοΫ໊: kyverno_policy_rule_info_total : • طଘͷϙϦγʔ = 1 • আ͞ΕͨϙϦγʔ = 0 ※ 1ͭͷϙϦγʔʹෳϧʔϧΛॻ͍ͨ߹ɺ֤ϧʔϧຖʹϝτϦοΫ͕࡞͞Ε·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 96
Policies and Rule Counts (ෳͷϙϦγʔ) (طଘ) (আࡁΈ) -
Copyright © Dell Inc. All Rights Reserved. of Y 97
Policies and Rule Counts (ෳͷϧʔϧΛ࣋ͭϙϦγʔ) -
Copyright © Dell Inc. All Rights Reserved. of Y 98
Policy and Rule Execution ͜ͷϝτϦοΫɺϧʔϧʹର͢ΔධՁͷ࣮ߦ݁ՌͱόοΫάϥϯυͰεΩϟϯͨ݁͠ՌΛ ه͠·͢ɻ ϝτϦοΫ໊: kyverno_policy_results_total : ϧʔϧʹؔ࿈͚ΒΕͨ݁Ռ -
Copyright © Dell Inc. All Rights Reserved. of Y 99
Policy and Rule Execution $ kubectl get pods -n service-stg $ kubectl get clusterpolicy all-containers-need-requests-and-limits Prometheus metric -
Copyright © Dell Inc. All Rights Reserved. of Y 100
Policy Change Counts ͜ͷϝτϦοΫɺϙϦγʔͷ࡞ɺߋ৽ɺআͳͲɺͯ͢ͷϙϦγʔมߋͷཤྺΛه͠ ·͢ɻ ϝτϦοΫ໊: kyverno_policy_changes_total : ϙϦγʔϨϕϧͰͷมߋͷ૯ -
Copyright © Dell Inc. All Rights Reserved. of Y 101
Policy Change Counts (࡞ޙ) (1ճɹमਖ਼) (2ճɹमਖ਼) -
Copyright © Dell Inc. All Rights Reserved. of Y 102
“Kyvernoͷӡ༻” ͷ·ͱΊ • Validate Resourcesʹରͯ͠ɺҧ͍ͯ͠ΔϦιʔεΛ֬ೝ͢ΔͨΊʹϙϦγʔϨϙʔτͱ͍ ͏ͷΛࢀর͢Δ͜ͱ͕Ͱ͖·͢ɻ • ݱࡏద༻͍ͯ͠ΔϙϦγʔɺͦͷϙϦγʔʹର͢ΔධՁͷ݁ՌɺϙϦγʔͷมߋݕͳͲ ʹؔ͢ΔใΛఏڙ͢ΔͨΊͷϝτϦοΫ͕ఏڙ͞Ε͍ͯ·͢ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 103
ຊηογϣϯͷ·ͱΊ • KyvernoΛ༻͍Δ͜ͱͰɺ؆୯͔ͭॊೈʹϙϦγʔ੍ޚΛ࣮ࢪ͢Δ͜ͱ͕Ͱ͖·͢ɻ • ϙϦγʔΛॻ্͘Ͱಛ༗ͷݴޠΛ༻͍Δඞཁ͕͋Γ·ͤΜɻ • ϙϦγʔʹର͢ΔϦιʔεͷঢ়ଶΛɺϙϦγʔϨϙʔτϝτϦοΫΛ༻͍ͯ֬ೝ͢Δ͜ͱ ͕Ͱ͖·͢ɻ (Tips) • Validate ResourcesΛద༻͢ΔࡍɺvalidationFailureActionΛ·ͣauditʹઃఆ͠ɺҙਤͨ͠ ڍಈʹͳΔ͜ͱΛ֬ೝͨ͠ޙenforceʹΓସ͑Δ͜ͱͰɺطଘϦιʔεʹର͢ΔӨڹͳͲΛ Ѳ্ͨ͠ͰϙϦγʔͷద༻͕Ͱ͖·͢ɻ • Mutate Resourcesʹ͓͍ͯɺ1ͭͷϙϦγʔʹෳͷϧʔϧΛඳ͘߹ɺ্͔ΒԼॲཧ͞ ΕΔ͜ͱʹҙ͍ͯͩ͘͠͞ɻ -
Copyright © Dell Inc. All Rights Reserved. of Y 104
ࢀߟࢿྉ • KyvernoͷϙϦγʔͷॻ͖ํ • https://kyverno.io/docs/writing-policies/ • ຊηογϣϯͰઆ໌͍ͯ͠ͳ͍ϙϦγʔͷॻ͖ํͳͲɻ • Kyverno αϯϓϧϙϦγʔ • https://github.com/kyverno/policies • ϕετϓϥΫςΟεɺPod Security Standardsʹ४ڌͨ͠ϙϦγʔͳͲɻ • ͦͷ΄͔༷ʑͳ֎෦πʔϧʹର͢ΔαϯϓϧϙϦγʔ͕༻ҙ͞Ε͍ͯΔɻ