Share
Embed
Docker Compose利用者から見た Kubernetes 開発環境構築入門 / introduction to kubernetes for docker compose user
Kou
September 15, 2018
Transcript
68 slides
-
Docker ComposeͷΈͷӡ༻ʹΑΔ ओͳ ϗετΛԽ͢Δʹ͋ͨͬͯͦ͜ ·Ͱ͘͠ͳ͍͕ɺϗετ͝ͱʹΞ ϓϦέʔγϣϯΛσϓϩΠͨ͠Γɺσ ϓϩΠ࣌ʹϩʔυόϥϯαʔ͔Βͷ Γ͠Λߦ͏ͳͲΛࣗ࡞͢Δඞཁ͕ग़ ͯ͘Δɻ 1.
ϗετͷԽ ྫ͑σϓϩΠʹࣦഊͯ͠ଈΓ͠ Λ͍ͨ͠ͱ͍ͬͨέʔεʹ͓͍ͯɺ Docker Compose୯ମͰಛผͳػೳ͕ ఏڙ͞Ε͍ͯΔΘ͚Ͱͳ͍ͷͰࣗ ͰͦͷΛ࡞Δඞཁ͕͋Δɻ (Ϗϧυͨ͠Πϝʔδͷλάཧɺλά Λࢦఆͯ͠ͷσϓϩΠͳͲ) 2. ίϯςφͷόʔδϣϯཧ ίϯςφͷࢮ׆ࢹো࣌ͷ෮چʹ ͍ͭͯखಈͩͬͨΓࣗ࡞͢Δ෦͕ ଟ͍ɻ 3. ࢮ׆ࢹো͔Βͷ෮چ -
Kubernetesͱ DockerίϯςφͷΫϥελཧΛ࢝Ίͱ͠ ͨΦʔέετϨʔγϣϯΛߦ͏αʔϏεͰ ͢ɻϗετؒͷ࿈ܞσϓϩΠʹ͍ͭͯ૯ ׅతʹཧͰ͖ΔΑ͏ʹͳΓ·͢ɻ (໊শ͕͍ͷͰ k8s ͱུ͞Ε·͢) ※DockerެࣜͷΦʔέετϨʔγϣϯπʔϧͱͯ͠ Docker
Swarmͱ͍͏ͷ͋Γ·͕͢ɺk8s͕ੈͷதతʹ ΄΅σϑΝΫτελϯμʔυͱͳ͍ͬͯ·͢ -
ReplicaSetͱDeploymentʹ͍ͭͯ • ReplicaSetDeploymentͱ͍͏ϦιʔεͰཧ͞ΕΔ • ReplicaSetPodͷෳɾҡ࣋ͷͨΊͷཧΛ୲͍ͬͯΔ͕ɺ DeploymentReplicaSetͷ࡞ɾҡ࣋ͷͨΊͷཧΛ୲͍ͬͯΔ • DeploymentσϓϩΠ࣌ʹ৽͍༷͠ͷReplicaSetΛ࡞͠ɺچ ReplicaSet͕ཧ͍ͯ͠ΔچPodͱͷΛௐ͠ͳ͕Β৽PodΛ૿ ͍͖ͯ͠ɺ࠷ऴతʹReplicaSet͝ͱ৽͍༷͠ʹஔ͖͑ΔΑ
͏ʹͳ͍ͬͯΔɻ·ͨɺϦϏδϣϯཧ͓ͯ͠Γɺ৽όʔδϣ ϯʹ͕͋ͬͨࡍʹچόʔδϣϯ͢͜ͱՄೳͰ͋Δ -
Serviceʹ͍ͭͯ • ServiceͱPodͷΞΫηεܦ࿏Λఏڙ͢ΔϦιʔεͰ͋Δ • ओʹPodʹ͚ͭͨϥϕϧΛݩʹɺͲͷϥϕϧ͕͍ͭͨPodΞΫη ε͢Δ͔Λܾఆ͢Δ • Ϋϥελ෦ͷΈͰར༻Ͱ͖ΔService(ClusterIP)ɺΫϥελ֎ ෦͔ΒΞΫηεՄೳͳService(NodePort)ͳͲͷServiceΛ࡞͢Δ ͜ͱ͕ՄೳͰ͋Δ
• AWSΛ͍ͬͯΔ߹ɺLoad Balancerͱͯ͠CLBɾNLBΛׂΓ ͯΔ͜ͱՄೳ -
KubernetesͰڥΛߏங͢Δʹ • KubernetesͰDocker Composeಉ༷ʹYAMLܗࣜͷϑΝΠϧΛѻ ֤ͬͯϦιʔεͷઃఆΛهड़͢Δ͜ͱͰڥΛߏங͍͖ͯ͠· ͢ɻઃఆ༰͓͓ͬ͟ͺʹ࣍ͷΑ͏ͳϑΥʔϚοτʹͳͬͯ ͍·͢ • ϩʔΧϧڥͷߏஙʹ͍ͭͯҰੲલ minikube
Λͬͯߏங͠ ͍ͯ·͕ͨ͠ɺݱࡏ Docker for Mac/Win Ͱਖ਼ࣜαϙʔτ͞Ε ͍ͯ·͢ɻ(σϑΥϧτͰ༗ޮʹͳ͍ͬͯͳ͍ͷͰ༗ޮԽ͢Δඞཁ ͕͋Γ·͢) -
ओͳKubernetesͷઃఆϑΝΠϧ߲ apiVersion: ϦιʔεͰར༻͢ΔAPIͷόʔδϣϯΛهࡌɻϦιʔε͝ͱʹҟͳΔ kind: ϦιʔεͷछผΛهड़ɻ (ex: Deployment, Service) metadata: Ϧιʔε༩Մೳͳϝλσʔλɻओʹ໊শϥϕϧΛ༩͢Δͷʹ༻
spec: Ϧιʔεݻ༗ͷઃఆΛهड़͢Δ data: ConfigMapSecretΛ࢝Ίͱͨ͠ઃఆσʔλΛهड़͢ΔϦιʔεͰར༻͞ΕΔ -
1. ਤͷΑ͏ͳNginxͷઃఆϑΝΠϧΛஔ ͨ͠σΟϨΫτϦΛ༻ҙ͓ͯ͘͠ 2. nginxσΟϨΫτϦͷ1্ͭʹҠಈͯ͠Ҏ ԼͷίϚϯυͰConfigMapΛ࡞͢Δ kubectl create configmap nginx-config-common
-—from-file=nginx/etc/common ConfigMapͷ࡞ྫ 3. ͜ΕΛඞཁͳ͚ͩߦ͏ɻ※αϒσΟϨΫτϦ·Ͱ ݟͯ͘Εͳ͍ͷͰσΟϨΫτϦߏʹҙ -
࡞ͨ͠ConfigMapͷ༰ΛkubectlͰ֬ೝ͢ΔͱҎԼͷΑ͏ʹͳ͍ͬͯΔ $ kubectl get configmap nginx-config-common -o yaml ——————————————————————— apiVersion:
v1 data: nginx.conf: | user daemon daemon; daemon off; error_log /var/opt/nginx/log/error.log; pid /var/run/nginx.pid; worker_processes auto; worker_rlimit_nofile 100000; events { worker_connections 4000; use epoll; multi_accept on; } ɾɾɾɾ(͍ͷͰলུ) kind: ConfigMap metadata: creationTimestamp: 2018-09-12T12:47:51Z name: nginx-config-common namespace: default resourceVersion: "121247" selfLink: /api/v1/namespaces/default/configmaps/nginx-config-common uid: 0fae62dd-b68a-11e8-bbb2-025000000001 -
࡞ͨ͠ConfigMapͷ༰ΛಡΈࠐΜͰ͍ΔDeploymentઃఆྫ apiVersion: apps/v1 kind: Deployment metadata: name: nginx-deployment spec: replicas:
2 selector: matchLabels: app: nginx template: metadata: labels: app: nginx spec: containers: - name: nginx image: library/nginx:latest ports: - containerPort: 8080 - containerPort: 8443 volumeMounts: - name: v-nginx-config mountPath: /etc/nginx volumes: - name: v-nginx-config-common configMap: name: nginx-config-common volumesʹ࡞ͨ͠ConfigMap໊Λࢦఆͯ͠ɺ ίϯςφͷvolumeMounts ͷઃఆͰ Ϛϯτ͍ͨ͠ύεΛهड़͢Δ -
Deploymentͷ࡞ ྫͱͯ͠ɺ࡞ͨ͠DeploymentͷઃఆΛ nginx-django- deployment.yaml ͱ͍͏ϑΝΠϧ໊Ͱอଘ͠·͢ɻ ͦͷޙɺҎԼͷίϚϯυͰ Deployment ͷ࡞Λߦ͍·͢ɻ kubectl apply
-f nginx-django-deployment.yaml kubectl create Ͱ࡞ՄೳͰ͕͢ɺapply࡞͓Αͼߋ৽ͷ྆ ํʹରԠ͍ͯ͠·͢ɻ(createطʹ࡞͞Ε͍ͯΔͱΤϥʔʹͳΔ) ͦͷͨΊɺσϓϩΠ࣌ͷมߋөͰ͜ͷίϚϯυΛར༻͢Δέʔ ε͕ଟ͍Ͱ͢ɻ -
Serviceͷઃఆྫ kind: Service apiVersion: v1 metadata: name: nginx-service spec: type:
NodePort selector: app: nginx ports: - name: http protocol: TCP port: 8080 targetPort: 8080 - name: https protocol: TCP port: 8443 targetPort: 8443 selectorʹରPodͷϥϕϧʹఆٛͨ͠Λࢦ ఆͯ͠Serviceͱඥ͚Δ -
IngressͷઃఆͱΠϯετʔϧ IngressΛ͑AWSͰ͋ΕALBΛׂΓͯΔ͜ͱՄೳͳͷͰ͢ ͕ɺएׯઃఆ͕໘ͳͷͰࠓճ Nginx Ingress Controller Λར༻͠· ͢ɻ(ALBͷׂΓͯʹ͍ͭͯؾʹͳΔํ alb-ingress-controller, kube-aws-ingress-controller
͋ͨΓΛௐͯΈ͍ͯͩ͘͞) Nginx Ingress Controllerʹ͍ͭͯ helm ͱ͍͏Kubernetesͷύοέ ʔδϚωʔδϟʔΛͬͯҎԼͷΑ͏ʹΠϯετʔϧ͠·͢ɻ helm install stable/nginx-ingress -
Ingress (Nginx Ingress Controller)ͷઃఆྫ apiVersion: extensions/v1beta1 kind: Ingress metadata: annotations:
kubernetes.io/ingress.class: nginx name: example-lb spec: rules: - host: www.example.com http: paths: - backend: serviceName: nginx-service servicePort: 8080 path: / tls: - hosts: - www.example.com secretName: example-tls selectorʹରPodͷϥϕϧʹఆٛͨ͠Λࢦ ఆͯ͠Serviceͱඥ͚ΔɻservicePortʹ serviceͰࢦఆ͞Εͨ port ·ͨ targetPort Λ ࢦఆ͢ΔɻHTTPSͷઃఆΛߦ͏߹ tls ͱ͍ ͏߲ʹূ໌ॻͷઃఆ͕ඞཁʹͳΓɺSecret ʹূ໌ॻΛొͯͦ͠ΕΛࢦఆ͢Δඞཁ͕͋Δɻ -
Jobͷઃఆྫ apiVersion: batch/v1 kind: Job metadata: name: db-migrate spec: backoffLimit:
1 parallelism: 1 completions: 1 template: spec: containers: - name: job-sleep image: debian:stretch-slim command: ["migrate", "up"] restartPolicy: Never backoffLimitͷΛมߋ͢Δ͜ͱͰࣦഊ࣌ͷ࠶ ࢼߦճͳͲఆٛ͢Δ͜ͱͰ͖Δɻ restartPolicy͕Neverʹઃఆ͞Εͨδϣϒ͕Ұ ਖ਼ৗྃ͢Δͱɺdelete͞ΕΔ·Ͱ࠶࣮ߦ͞Ε Δ͜ͱͳ͘ͳΔɻ -
CronJobͷઃఆྫ apiVersion: batch/v1beta1 kind: CronJob metadata: name: cron-job spec: schedule:
"*/1 * * * *" jobTemplate: spec: template: spec: containers: - name: job-sleep image: debian:stretch-slim imagePullPolicy: Always command: ["echo", "test"] restartPolicy: Never scheduleʹcronܗࣜͰ࣮ߦ࣌ؒΛࢦఆ͢Δ͜ͱ ͕ग़དྷΔ -
Kubernetesʹ͓͚ΔΩϟογϡ ͱDBͷѻ͍ ϩʔΧϧ։ൃڥͰRedis/MySQLίϯςφΛಈ͔ͯ͠Α͍ͷͰ ͕͢ɺAWSΛར༻͍ͯ͠Δέʔεͩͱຊ൪ڥͰElastiCache RDSΛ͍ͨ͘ͳΔ͔ͱࢥ͍·͢ɻ͜ͷ߹ɺKubernetes୯ମ (kubectl)Ͱ؆୯ʹ੍ޚ͕Ͱ͖ͳ͍ͨΊɺଞͷϓϩϏδϣχϯάπʔ ϧͰ͋Δ kops Terraform
ΛΈ߹Θͤͯߏங͢Δ͜ͱʹͳΓ· ͢ɻ·ͨɺKubernetes on AWSͱͯ͠ EKS ͱ͍͏Ϛωʔδυαʔ Ϗε͋Γɺ20189݄ݱࡏ౦ژϦʔδϣϯͰ·ͩ͑·ͤΜ ͕ɺ౦ژϦʔδϣϯʹରԠͨ͠ࠒʹͪ͜ΒΛར༻͢Δͷྑ͍͔ͱ ࢥ͍·͢ɻ -
kompose ࣮ߦྫ 1. HomebrewͰΠϯετʔϧ brew install kompose 2. ݩͱͳΔ docker-compose.yaml
Λࢦఆ͢Δ kompose convert -f docker-compose.yaml -o (ग़ྗઌσΟϨΫτϦ) volumeʹ͍ͭͯσϑΥϧτͩͱPersistentVolumeClaimม͞Ε·͕͢ɺ ͜Εʹ͍ͭͯ --volumes Φϓγϣϯʹͯ hostPath ͱͯ͠ίϯόʔτ͢Δ͜ͱՄ ೳͰ͢ɻDocker ComposeͰϗετྖҬΛϚϯτͯ͠ར༻͍ͯ͠Δέʔε͕ଟ͍ ͱࢥ͏ͷͰɺ࠷ॳ hostPath ࢦఆͰίϯόʔτ͢Δํ͕ྑ͍͔Ε·ͤΜɻ (ͪΖΜޙ͔Βॻ͖͢લఏʹͳΓ·͢) -
2. ΫϥελߏஙͷͨΊͷपลπʔϧ͕๛ kops kube-aws ͳͲɺΫϥελߏஙΛίϚϯυ࣮ߦ͢Δ͚ͩͰ؆୯ʹ༻ҙͯ͠ ͘ΕΔपลπʔϧ͕͋ΔͨΊɺҰ͔ΒVPCαϒωοτͷઃܭΛࡉ͔͘Terraformͳ ͲͰ࡞͍ͬͯ͘ඞཁগͳ͍Ͱ͢ɻ·ͨɺࡉ੍͔͍ޚΛ͍ͨ͠߹Ͱ kops ͕
TerraformͷtfϑΝΠϧΛग़ྗͰ͖ΔͷͰͦͷΑ͏ͳέʔεʹରԠ͕ग़དྷ·͢ɻ -
1. ൿಗใΛϦϙδτϦʹͦͷ··ίϛοτ͠ਏ͍ KubernetesͰSecretϦιʔεΛ͏͜ͱͰൿಗใΛѻ͍͘͢ͳΓ·͕͢ɺઃ ఆϑΝΠϧ্ΛBase64Τϯίʔυͯ͠ه͍ͯ͠Δ͚ͩʹա͗ͳ͍ͨΊɺ؆୯ ʹσίʔυͰ͖·͢ɻͦͷͨΊɺ͜ΕΛͦͷ·· git ϦϙδτϦίϛοτ͢Δͷ ጨΒΕͯ͠·͍·͢ɻྫ͑ΔͳΒ Rails 5.2ͷCredentialsʹ૬͢Δػೳ͕ݸਓతʹ
͋Ε͍͍ͳͱࢥ͍ͬͯ·͕͢ɺͦͷΑ͏ͳػೳඪ४Ͱଘࡏ͠ͳ͍༷Ͱ ͢ɻͰ͕͢ɺ͜Εʹ͍ͭͯ bitnami-labs/sealed-secrets ΛΠϯετʔϧͯ͠ SealedSecretϦιʔεΛՃ͢Δ͜ͱͰ࣮ݱՄೳͷΑ͏Ͱ͢ɻ ʻࢀߟαΠτʼ https://engineering.bitnami.com/articles/sealed-secrets.html -
2. ڥมΛઃఆϑΝΠϧͰࢀরͰ͖ͳ͍ Docker ComposeͷΑ͏ʹίϚϯυ࣮ߦ࣌ʹڥมΛ༩͑ɺͦΕΛઃఆϑΝΠϧ Ͱࢀর͢Δͱ͍ͬͨػೳݱঢ়αϙʔτ͞Ε͍ͯͳ͍Α͏Ͱ͢ɻDocker Composeͷ ͱ͖͜ΕͰϏϧυͨ͠λάͷόʔδϣϯΛΓସ͍͑ͯͨͨΊɺগʑࠔΓ·͠ ͨɻ( $(pwd) ͷΑ͏ʹΧϨϯτσΟϨΫτϦΛࢦఆ͢Δ͜ͱग़དྷ·ͤΜ)
ͨͩɺ͜Εʹ͍ͭͯճආࣗମՄೳͰɺͲ͏ͯͦ͠ͷΑ͏ͳ͍ํΛ͍ͨ͠ ߹ envsubst ίϚϯυΛ࣮͑ݱՄೳʹͳΓ·͢ɻ