Share
Embed
Dockerを利用したローカル環境から本番環境までの構築設計 / Project structure design for docker application
Kou
February 03, 2018
Transcript
64 slides
-
Α͋͘ΔWeb։ൃݱͷಈ࡞ڥ 1. ࣗͷϚγϯͰ࣮தͷΞϓϦέʔγϣϯΛελϯυΞ ϩϯʹಈ࡞ͤ͞Δڥ (ϩʔΧϧڥ) 2. ࣮͕ྃͨ͠ΞϓϦέʔγϣϯΛଞͷϓϩδΣΫτϝϯό ʔςελʔʹಈ࡞֬ೝͯ͠Β͏͚ࣾڥ (։ൃڥ) 3.
ࣾͰಈ࡞֬ೝͨ͠ΞϓϦέʔγϣϯΛຊ൪ϦϦʔεલʹ ͓٬͞Μʹݕऩͯ͠Β͏ͨΊͷڥ (εςʔδϯάڥ) 4. ςετݕऩྃͨ͠ΞϓϦέʔγϣϯΛՔಇͤ͞Δͨ Ίͷڥ (ຊ൪ڥ) -
Α͋͘Δڥ͝ͱͷཁ݅ 1. ϩʔΧϧڥίʔυमਖ਼ͨ͠Β͙͢ʹಈ࡞֬ೝΛ ߦ͑ΔΑ͏ʹ͍ͨ͠ 2. ։ൃڥ༧ࢉͷؔͰ1͔͠༻ҙͰ͖ͳ͍ɻͦͷ 1ʹશͯͷϛυϧΣΞΛΠϯετʔϧͯ͠ߏஙͯ͠ ཉ͍͠ 3. ຊ൪ӡ༻Մ༻ੑΛߟྀͯ͠ϩʔυόϥϯαʔɺ
σʔλϕʔεɺΩϟογϡϚωʔδυαʔϏε (ALBɺRDSɺElastiCache)Λར༻͍ͨ͠͠ -
֤αʔόͰಈ࡞ͤ͞ΔϛυϧΣΞ/ΞϓϦέʔγϣϯ ▪ϩʔυόϥϯαʔ ɾAWSͷApplication Load Balancer (ALB)Λ༻ ▪Ωϟογϡαʔό ɾAWSͷElastiCache (Redis)Λ༻
▪σʔλϕʔε ɾAWSͷRDS (MySQL)Λ༻ ▪web01/02 (EC2αʔό) ɾNginx (HTTPαʔό) ɾWebΞϓϦέʔγϣϯ (DjangoͰಈ͘Python3ΞϓϦέʔγϣϯ) ▪batch01/02 (EC2αʔό) ɾPython3Ͱಈ͘όονΞϓϦέʔγϣϯ ɾδϣϒεέδϡʔϥ(Celery beat) ɾRabbitMQ (CeleryͷδϣϒΩϡʔͱͯ͠༻) -
DockerΛΘͳ͍ϩʔΧϧڥͷߏஙखॱ 1. ALBϩʔΧϧͩͱཱͯΒΕͳ͍ͷͰɺΘΓʹHAProxyΛ ͏ 2. HAProxyɺRedisɺMySQLɺNginxɺRabbitMQɺPython3Λ HomebrewͰΠϯετʔϧ͢Δ 3. ϩʔΧϧ༻ͷ֤ϛυϧΣΞͷઃఆϑΝΠϧΛهड़͢Δ 4.
WebΞϓϦέʔγϣϯͱόονΞϓϦέʔγϣϯͰґଘؔ Λͤ͞ΔͨΊʹ venv Λ༻͢Δ 5. WebΞϓϦέʔγϣϯͱόονΞϓϦέʔγϣϯͷґଘؔ ΛͦΕͧΕ pip ͰΠϯετʔϧ͠ɺͦΕͧΕىಈ͓ͯ͘͠ɻ -
DockerΛΘͳ͍ϩʔΧϧڥͷߏஙखॱͷܽ 1. Homebrewجຊతʹ࠷৽όʔδϣϯΛΠϯετʔϧ͢ΔͨΊɺݹ͍ όʔδϣϯΛΠϯετʔϧ͢Δࡍ͍͍ͪͪઃఆ͕໘ͳ্ʹසൟʹ ༻͕มΘΔɻ։ൃ͍ͯ͠ΔΞϓϦέʔγϣϯ͕ෳ͋Δ߹͞Βʹό ʔδϣϯΛ߹ΘͤΔͷ͕ඇৗʹେม 2. ಈ࡞ͤ͞ΔOS͕ຊ൪ػͱҟͳΔͨΊɺσΟϨΫτϦύε͔ͳΓҟ ͳΔɻϛυϧΣΞͷઃఆϑΝΠϧͰϑΝΠϧύεΛهड़͍ͯ͠ΔՕॴ ૬ରύε͕͑ͳ͚ΕϩʔΧϧઐ༻ʹઃఆΛ༻ҙ͢Δඞཁ͕͋Δ
3. 1ͱ2ͷཧ༝͔ΒɺݸਓͷϚγϯͷঢ়ଶʹґଘͯ͠ಈ࡞͠ͳ͔ͬͨΓɺ ผಈ࡞ΛҾ͖ى͜͢έʔε͕ඇৗʹଟ͍ɻڥߏஙखॱͱ֤ͯ͠ਓ͕ؾ Λ͚ͭͳ͚Ε͍͚ͳ͍ϙΠϯτ͕ଟ͘ɺཧ͢Δଆͱͯ͠ඇৗʹ໘ Ͱ͋Δ -
DockerΛ͏ϩʔΧϧڥͷߏஙखॱ 1. ALBϩʔΧϧͩͱཱͯΒΕͳ͍ͷͰɺΘΓʹHAProxyΛ͏ 2. HAProxyɺRedisɺMySQLɺNginxɺRabbitMQɺPythonͷ༻͢ΔΠϝʔδ໊ͱ λά໊(όʔδϣϯ)ɺઃఆΛ docker-compose ͷઃఆϑΝΠϧ(docker- compose.yml)ʹهड़͢Δ 3.
ϩʔΧϧ༻ͷ֤ϛυϧΣΞͷઃఆϑΝΠϧΛهड़͢Δ 4. मਖ਼Λ͙͢ʹ֬ೝͰ͖ΔΑ͏ʹ͢ΔͨΊɺϗετଆʹ͋ΔΞϓϦέʔγϣϯͷι ʔεϑΝΠϧΛVOLUME໋ྩͰϚϯτͯ͠ར༻͢Δ 5. WebΞϓϦέʔγϣϯͱόονΞϓϦέʔγϣϯͷґଘؔΛͦΕͧΕDockerͰ औಘͨ͠Pythonͷ pip ͰΠϯετʔϧ͠ɺϗετଆͷͦΕͧΕผσΟϨΫτϦอ ଘͰ͖ΔΑ͏ʹ͓ͯ͘͠ 6. docker-composeΛىಈ͠ɺdocker-compose.ymlʹهड़ͨ͠ϛυϧΣΞͱΞϓ ϦέʔγϣϯΛىಈ͢Δ -
DockerΛ͏ϩʔΧϧڥͷߏஙखॱͷར 1. Homebrewͱҧ͍ɺ֤ϛυϧΣΞ͝ͱʹಛఆͷόʔδϣϯΛ؆୯ʹ ࢦఆ͢Δ͜ͱ͕Ͱ͖ΔɻόʔδϣϯΞοϓ͢ΔͷઃఆϑΝΠϧͷॻ͖ ͚͑ͩͰOKɻ·ͨɺDockerΠϝʔδͷऔಘdocker-composeͷىಈ࣌ʹ ࣗಈతʹߦΘΕΔ 2. ϗετଆͷOS͕ҟͳͬͯDockerΠϝʔδຊ൪ػͱಉ͡OSͷಈ࡞Λ ίϯςφԽՄೳͰ͋ΔͨΊɺσΟϨΫτϦϑΝΠϧύεͷҧ͍ͱ͍ͬͨ ڥࠩҟൃੜ͠ͳ͍
3. 1ͱ2ͷཧ༝͔ΒɺݸਓͷϚγϯͷঢ়ଶʹґଘͯ͠ಈ࡞͠ͳ͔ͬͨΓɺผ ಈ࡞ΛҾ͖ى͜͢έʔεΛ΄΅ආ͚ΒΕΔɻ 4. جຊతʹdocker-compose.ymlΛཧ͍ͯ͠ΔϦϙδτϦͷऔಘͱɺ docker-compose up -d ͚ͩͰڥߏங͕ྃ͢ΔɻཧߏஙϝνϟΫ νϟ؆୯ʂ -
DockerΛΘͳ͍։ൃ/ຊ൪ڥͷߏஙखॱ 1. ༻͢ΔALBɺElastiCache (Redis)ɺRDS (MySQL) Λ࡞͢Δ 2. NginxɺRabbitMQɺPythonͷ༻͢ΔόʔδϣϯΛAnsibleͳͲΛͬ ͯΠϯετʔϧ͢Δ 3.
։ൃ/ຊ൪༻ͷ֤ϛυϧΣΞͷઃఆϑΝΠϧΛهड़͢Δ 4. ։ൃػʹWebΞϓϦέʔγϣϯͱόονΞϓϦέʔγϣϯΛύοέʔ δϯάͯ͠ɺϑΝΠϧసૹ͢Δ (CapistranoAnsistrano͋ͨΓΛ͏) 5. WebΞϓϦέʔγϣϯͱόονΞϓϦέʔγϣϯͰґଘؔΛ͞ ͤΔͨΊʹ venv Λ༻͢Δ 6. WebΞϓϦέʔγϣϯͱόονΞϓϦέʔγϣϯͷґଘؔΛσϓϩ Π࣌ʹͦΕͧΕ pip ͰΠϯετʔϧ͠ɺىಈ͓ͯ͘͠ɻ -
DockerΛ͏։ൃ/ຊ൪ڥͷߏஙखॱ 1. ༻͢ΔALBɺElastiCache (Redis)ɺRDS (MySQL)Λ࡞ ͢Δ 2. NginxɺRabbitMQɺϏϧυͨ͠PythonΞϓϦέʔγϣϯͷ ༻͢ΔΠϝʔδ໊ͱλά໊(όʔδϣϯ)ɺઃఆΛ docker-
compose ͷઃఆϑΝΠϧ(docker-compose.yml)ʹهड़͢Δ 3. ։ൃɾຊ൪༻ͷ֤ϛυϧΣΞͷઃఆϑΝΠϧΛهड़͢Δ 4. docker-composeΛىಈ͠ɺdocker-compose.ymlʹهड़͠ ͨϛυϧΣΞͱΞϓϦέʔγϣϯΛىಈ͢Δ -
DockerΛ͏։ൃ/ຊ൪ڥͷߏஙखॱͷར 1. ϛυϧΣΞͷόʔδϣϯΞοϓ͕͍͢͠ɻdocker-compose ͷઃఆϑΝΠϧΛॻ͖͑Δ͚ͩͰOK 2. ΞϓϦέʔγϣϯͱͦͷґଘؔΛ̍ͭͷΠϝʔδͱͯ͠·ͱΊ Δ͜ͱ͕ग़དྷΔɻvenvΛ͏ඞཁͳ͘ͳΔ 3. 2Ͱ࡞ͨ͠ΠϝʔδΛ։ൃػ͔Βຊ൪ڥ·Ͱશ͘ಉ͡ͷΛ ར༻Ͱ͖ΔͨΊɺڥґଘ͢Δ͜ͱ͕΄΅ͳ͍ɻ(DBଓઌͳͲͷ
ઃఆͪΖΜڥมͱͯ͠ผͷͷΛ͢ඞཁ͋Γ) 4. ϩʔΧϧಉ༷ʹɺجຊతʹdocker-compose.ymlΛཧ͍ͯ͠ΔϦ ϙδτϦͷऔಘͱɺdocker-compose up -d ͚ͩͰڥߏங͕ྃ͢ ΔɻཧߏஙϝνϟΫνϟ؆୯ʂ -
ϩʔΧϧڥʹ͓͚Δґଘؔͷཧͷྫ 1. ར༻͢ΔPythonͷDockerΠϝʔδΛ༻ҙ͢Δ 2. 1ͷΠϝʔδʹґଘؔΛ֨ೲ͢ΔσΟϨΫτϦΛ VOLUME໋ྩͰϚϯτՄೳͳঢ়ଶʹ͓ͯ͘͠ (pip --user ΦϓγϣϯΛར༻͢Δ͜ͱͰɺ
PYTHONUSERBASEڥมͰࢦఆ͞ΕͨσΟϨΫτ ϦʹґଘؔΛ֨ೲ͢Δ͜ͱ͕ՄೳͱͳΔ) 3. 2Ͱࢦఆͨ͠PYTHONUSERBASEͷσΟϨΫτϦ ʹ͋ΔbinσΟϨΫτϦΛPATHʹؚΊΔΑ͏ʹ͓ͯ͘͠ -
ґଘؔͷΠϯετʔϧͱىಈ (ϩʔΧϧ) # ґଘؔΛΠϯετʔϧ͢Δ docker-compose run --rm web pip install
--user -r requirements.txt # ىಈ͢Δ docker-compose -f docker-compose.local.yml up -d -
ΞϓϦέʔγϣϯͷDockerfileͷྫ ϩʔΧϧڥͰར༻͍ͯ͠ΔPython༻ ͷΠϝʔδΛݩΠϝʔδʹઃఆ͢Δ (Ϗ ϧυ࣌ؒॖͷͨΊʹॏཁ) ADDͰϓϩδΣΫτͷιʔεશମΛΠ ϝʔδʹՃ͢Δɻ/var/opt/example ͕ ΞϓϦέʔγϣϯͷϧʔτͱͳΔ pipͷΠϯετʔϧઌσΟϨΫτϦσϑΥϧτ(ϢʔβσΟ
ϨΫτϦԼͷ .local σΟϨΫτϦͱ͢Δ) ͜ΕADDର ͱͳͬͨσΟϨΫτϦԼΛΠϯετʔϧઌͱͨ͠߹ɺ ADDͨ͠ॠؒͷঢ়ଶʹϩʔϧόοΫ͞Εͯ͠·͏ͨΊɺ ϩʔΧϧͱҟͳΔσΟϨΫτϦͱ͍ͯ͠Δ -
ΞϓϦέʔγϣϯͷىಈ (։ൃɾຊ൪) # ىಈ͢Δ (։ൃ) docker-compose -f docker-compose.development.yml pull docker-compose
-f docker-compose.development.yml run --rm web python manage.py collectstatic -- noinput docker-compose -f docker-compose.development.yml up -d # ىಈ͢Δ (ຊ൪Web) docker-compose -f docker-compose.production_web.yml pull docker-compose -f docker-compose.production_web.yml run --rm web python manage.py collectstatic -- noinput docker-compose -f docker-compose.production_web.yml up -d # ىಈ͢Δ (ຊ൪Batch) docker-compose -f docker-compose.production_batch.yml pull docker-compose -f docker-compose.production_batch.yml up -d -
։ൃɾຊ൪ͰґଘؔΛؚΊͨΞϓϦέʔγϣϯ ͷΠϝʔδΛ୯ʹىಈ͢Δ͚ͩʹͳΓ·͢ɻ͜ͷΠ ϝʔδJenkinsCircleCIͳͲɺCIڥͰdocker build͠ɺ։ൃɾຊ൪͔ΒΞΫηεՄೳͳϨδε τϦdocker push͓͖ͯ͠·͢ɻ ։ൃɾຊ൪Ϗϧυͨ͠DockerΠϝʔδΛ pull ͠ ͯىಈ͢Δ͚ͩͰσϓϩΠ͕ྃ͢ΔͨΊɺ։ൃ
ڥͰಈ࡞֬ೝͨ͠ΠϝʔδΛͦͷ··ຊ൪࣋ͬͯ ͍͘͜ͱՄೳͱͳΓɺ΄΅ڥࠩҟͷͳ͍ಈ࡞Λ ظͰ͖·͢ɻ -
DockerΛ͍࢝ΊͨϓϩδΣΫτA͞ΜͷରԠࡦ 1. DockerΠϝʔδʹDBଓઌΫϨσϯγϟϧ ใแ͠ͳ͍ɻDockerΠϝʔδىಈ࣌ʹڥมͱ ͯ͢͠ 2. Ͳ͏ͯ͠ڥม͕ಡΈࠐΊͳ͍ઃఆϑΝΠϧͳ Ͳͷ߹ɺgettextʹଐ͍ͯ͠Δ envsubst ίϚϯυΛ
༻ͯ͠ઃఆϑΝΠϧʹهड़͞ΕͨڥมΛஔ͖ ͑ΔΑ͏ʹ͢Δ 3. ڥมͷཧ direnv Λ͏ͱศར