Share
Embed
Transcript
86 slides
-
ࣗݾհ ໊લɿপ Ұथ ॴଐɿmediba ͬͯΔ͜ͱɿ ɹAWS Λͬͨ Web αʔϏεͷઃܭɾߏஙɾӡ༻ ͖ͳAWSαʔϏεɿLambda,
SSM Facebookɿhttps://www.facebook.com/numazawa.kazuki -
• ຊ൪ͷσʔλΛੳʹ͔͚͍ͨʂ • ຊ൪ͷσʔλͰιʔείʔυΛݕূ͍ͨ͠ʂ • ຊ൪ͷσʔλͱಉ͡σʔλͰҧ͏WebαΠτΛ࡞ Γ͍ͨʂ • ͔͠ຊ൪σʔλͱͷࠩΛͳΔ͘খͨ͘͞͠ ͍ʂ
͜ΕΒΛͳΔ҆͘શʹ ޮΑ͘ Γ͍ͨʂ ຊ൪ڥͷσʔλͷ׆༻ -
Aurora Multi-Master • re:Invent 2017 Ͱൃද͞ΕͨɺAurora ͷ৽ػೳ(ϓϨϏϡʔ) • ཁ Aurora
ͷ Writer ΠϯελϯεΛεέʔϧΞτ͢Δͷ • ैདྷ Writer ΠϯελϯεΫϥελʔʹ1ͷΈͰɺWriter Πϯελ ϯεͷো࣌ʹ Reader ΠϯελϯεʹϑΣΠϧΦʔόʔ͢Δ͜ͱͰՄ༻ ੑΛอ͍ͬͯͨ • ࢀߟ • Amazon Aurora Multi-Master ͷϓϨϏϡʔਃ͠ࠐΈ։࢝ • https://aws.amazon.com/jp/blogs/news/sign-up-for-the-preview-of-amazon-aurora-multi- master/ • ʲใʳAmazon AuroraͷϚϧνϚελػೳ͕ൃද͞Ε·ͨ͠ʂ • https://dev.classmethod.jp/cloud/aws/reinvent-2017-aurora-multi-master/ -
Aurora Multi-Master • Aurora Ϋϥελʔʹ Master(Writer) ͕ෳ࡞ Մೳ •
ॻ͖ࠐΈੑೳͷେ෯ͳ্͕ݟࠐΊΔ • Writer ͕1ͭࢮΜͰϑΣΠϧΦʔόʔ͕࣮࣭ແ͍ • θϩμϯλΠϜͷ࣮ݱ • ͋͘·Ͱ1Ϋϥελʔͷ -
࠶ ܝ ຊ൪ڥͷσʔλͷ׆༻ • ຊ൪ͷσʔλΛੳʹ͔͚͍ͨʂ • ຊ൪ͷσʔλͰιʔείʔυΛݕূ͍ͨ͠ʂ • ຊ൪ͷσʔλͱಉ͡σʔλͰҧ͏WebαΠτΛ࡞ Γ͍ͨʂ
• ͔͠ຊ൪σʔλͱͷࠩΛͳΔ͘খͨ͘͞͠ ͍ʂ -
ϘπҊᶄ • ຊ൪༻ Aurora ͷ Reader Πϯελϯεͷ1 ͭΛΤϯυϙΠϯτࢦఆͰ͏ • ௨ৗͷΞϓϦέʔγϣϯ͔Β
Reader Τ ϯυϙΠϯτΛར༻ -
ૉΒ͠ެࣜυΩϡϝϯτ Aurora ͱ MySQL ͱͷؒɺ·ͨ Aurora ͱผͷ Aurora DB Ϋ
ϥελʔͱͷؒͷϨϓϦέʔγϣϯ https://docs.aws.amazon.com/ja_jp/AmazonRDS/latest/ UserGuide/AuroraMySQL.Replication.MySQL.html -
༨ஊɿϨϓϦέʔγϣϯํࣜ ࠓճͷ Aurora MySQL 5.6 ޓͷ Aurora Λରͱ͍ͯ͠Δ MySQL
5.6 ͰɺGTID (Global Transaction ID) ʹΑΔϨϓϦέʔ γϣϯํ͕ࣜ࠾༻͞ΕɺࠓޙҰൠԽ͍ͯ͘͠Α͏ʹݟ͑Δ͕ɺRDS Ͱ MariaDB Ҏ֎ GTID Λ͑ͳ͍ͬΆ͍(※ͪΌΜͱௐͯͳ ͍) υΩϡϝϯτʹ͋Δ௨Γɺࠓճ binlog ํࣜͰͷϨϓϦέʔγϣ ϯΛ͢Δ͚ͩͳͷͰɺMySQL ʹ໌Δ͍ํʑʹɺͳΜͩͦΜͳ͜ ͱ͔ͱམͤͯ͞͠·ͬͨ͜ͱͰ͠ΐ͏ ਃ͠༁ͳ͍͆ -
ϙΠϯτ • ຊ൪༻ͱੳ༻ͰVPCΛ͚Δ • ͢Δ͜ͱͰΞΫηε੍ݶΛγϯϓϧʹ͠ ͍͢ • VPC Peering ͰΫϩʔζͳ௨৴ʹ͢Δ
• ֎෦͔Βׯব͞Εͳ͍ • ϨΠςϯγΛۃྗ૿͞ͳ͍ -
લఏ݅ • ҎԼׂѪ • VPC ࡞ͱ VPC Peering ͷઃఆ •
DB ଓ༻ͷ EC2 ͷ࡞ • ηΩϡϦςΟάϧʔϓͷ࡞ • ຊ൪༻ͷ Aurora Ϋϥελʔطʹ͋Γɺσʔλೖ͍ͬͯΔͷͱ͢Δ • ຊ൪༻ͷ Aurora Ϋϥελʔ࣍ทͷΑ͏ͳঢ়ଶͱ͢Δ • ࢦఆͷͳ͍߲ͳͲσϑΥϧτΛఆ(͘͠ҙͰઃఆ) -
લఏ݅ • VPC: “master-vpc” • DB Ϋϥελʔࣝผࢠ: “master-cluster” • Writer:
“master1”(AZ-a) • Reader: “master2”(AZ-c), “master3”(AZ-a) • Writer 1ɺReader 2ͷ Multi-AZ ߏ • σϑΥϧτ͔Βมߋͷͳ͍ “cluster-param-group” ͱ͍͏Ϋϥελʔ ύϥϝʔλάϧʔϓ • ύϒϦοΫΞΫηε: ͍͍͑ -
• σϑΥϧτ͕ "OFF" ͷͨΊඞͣมߋ͢Δ • ROW, STATEMENT Ͱྑ͍Α͏͕ͩɺެࣜυΩϡϝϯτͰɺಛʹඞཁੑ ͕ͳ͍߹ MIXED
Λਪ͍ͯ͠Δ • ͜ͷύϥϝʔλͷөʹ࠶ىಈ͕ඞཁ • ՔಇதͷΫϥελʔͷ߹ཁҙ • Multi-AZ ߏͰ 1 ະຬͷμϯλΠϜ • ݸਓతͳ࣮Ͱ20ඵߦ͔ͳ͍͜ͱ͕΄ͱΜͲ(ࢀߟ·Ͱ) binlog_format Λ MIXED ʹมߋ "cluster-param-group" Λฤू -
binlog ͷอ࣋ظؒΛઃఆ • “master-cluster” ͷΫϥελʔΤϯυϙΠϯτ MySQL Ϋϥ ΠΞϯτͰଓ • ࣍ทͷίϚϯυͰ
“binlog retention hours” ͷΛҙʹࢦ ఆ͢Δ • ࠓճ1िؒ(168࣌ؒ)Λࢦఆ • ͜ͷઃఆมߋͰμϯλΠϜൃੜ͠ͳ͍ -
mysql> CALL mysql.rds_set_configuration('binlog retention hours', 168); Query OK, 0 rows
affected (0.05 sec) mysql> mysql> CALL mysql.rds_show_configuration()\G *************************** 1. row *************************** name: binlog retention hours value: 168 description: binlog retention hours specifies the duration in hours before binary logs are automatically deleted. 1 row in set (0.00 sec) Query OK, 0 rows affected (0.00 sec) binlog ͷอ࣋ظؒΛઃఆ ࣌ؒʹઃఆ -
mysql> GRANT REPLICATION Slave ON *.* TO 'repl'@'%' IDENTIFIED BY
“hogehoge"; Query OK, 0 rows affected (0.03 sec) mysql> mysql> SELECT user,host FROM mysql.user where user = "repl"; +------+------+ | user | host | +------+------+ | repl | % | +------+------+ 1 row in set (0.00 sec) ϨϓϦέʔγϣϯ༻Ϣʔβ࡞ ࠓճlSFQMzϢʔβΛ࡞ -
Slave ΫϥελʔΛ༻ҙ • લఏ݅ͷΫϥελʔ Master ͱͳΔΫϥελʔ • ͔͜͜ΒϨϓϦέʔγϣϯઌͱͳΔ Slave ΫϥελʔΛ࡞
• طଘͷσʔλ͕͋Δͱ͍͏લఏͳͷͰɺʮಛఆ࣌ͷ෮ݩʯ Λͬͯۃྗ࠷৽ঢ়ଶͷσʔλΛ࣋ͬͨΫϥελʔΛ࡞ -
• DB Πϯελϯεࣝผࢠ: “slave1" • ͜͜Ͱࢦఆͨ͠ͷ͕ Writer Πϯελϯε໊ͱΫϥελʔ໊ʹͳΔ • ޙͰΫϥελʔ໊ϦωʔϜ͢Δ(ҙ)(ޙड़)
• ʮ෮ݩՄೳͳ࠷৽࣌ࠁΛ༻͢ΔʯΛબ • VPC: “slave-vpc” • ΞϕΠϥϏϦςΟʔκʔϯ: ap-northeast-1a • AZ “master-cluster” ͷΠϯελϯεͱ߹Θͤͱ͘ Slave ΫϥελʔΛ༻ҙ “master1” Ͱʮಛఆ࣌ͷ෮ݩʯΛ࣮ࢪ -
Slave ΫϥελʔΛ༻ҙ Reader ΠϯελϯεΛՃ (slave2, slave3) • "slave1" ΠϯελϯεͰʮAurora ϨϓϦΧͷ࡞ʯΛબ
• DB Πϯελϯεࣝผࢠ: “slave2” • ΞϕΠϥϏϦςΟʔκʔϯ: ap-northeast-1c • ༏ઌ: ൣғ -1 • DB Πϯελϯεࣝผࢠ:“slave3” • ΞϕΠϥϏϦςΟʔκʔϯ: ap-northeast-1a • ༏ઌ: ൣғ -2 -
Slave ΫϥελʔΛ༻ҙ Slave Ϋϥελʔ໊ΛϦωʔϜ(ҙ) • ͜ͷ࣌ͰɺSlave Ϋϥελʔ໊ “slave1-cluster” ͱͳ͍ͬͯΔ •
ඞਢͷ࡞ۀͰͳ͍͕ɺΫϥελʔ໊ʹ “1” ͱ͍͍ͯΔͷ͕ؾʹͳΔͷͰ ͓͖͍ͯͨ͠(Έͷ) • "slave1-cluster" ͰʮΫϥελʔͷมߋʯΛબ • DB Ϋϥελʔࣝผࢠ: “slave-cluster” • ʮ͙͢ʹద༻ʯʹνΣοΫ -
ϨϓϦέʔγϣϯͷઃఆ • ྆ΫϥελʔͷΫϥελʔΤϯυϙΠϯτʹ MySQL ଓ • "show binary logs;" Λ࣮ߦ
• ్த·Ͱͷϩάঢ়ଶ͕Ұக͍ͯ͠Δ͜ͱΛ֬ೝ • binlog ͷঢ়ଶʹ͕ࠩग़͍ͯΔͱ͜ΖΛ֬ೝ • Slave ͷ Log_name, File_size ͷΛϝϞ binlog ͷঢ়ଶΛ֬ೝ -
ϨϓϦέʔγϣϯͷઃఆ binlog ͷঢ়ଶΛ֬ೝ(Master) mysql> show binary logs; +----------------------------+-----------+ | Log_name
| File_size | +----------------------------+-----------+ | mysql-bin-changelog.000001 | 120 | | mysql-bin-changelog.000002 | 21660 | +----------------------------+-----------+ 2 rows in set (0.00 sec) -
ϨϓϦέʔγϣϯͷઃఆ binlog ͷঢ়ଶΛ֬ೝ(Slave) mysql> show binary logs; +----------------------------+-----------+ | Log_name
| File_size | +----------------------------+-----------+ | mysql-bin-changelog.000001 | 120 | | mysql-bin-changelog.000002 | 2484 | | mysql-bin-changelog.000003 | 120 | | mysql-bin-changelog.000004 | 120 | | mysql-bin-changelog.000005 | 704 | +----------------------------+-----------+ 5 rows in set (0.01 sec) ͜͜Ͱ͕ࠩग़ͯΔͷͰɺ ͜ͷߦͷΛϝϞ -
ϨϓϦέʔγϣϯͷઃఆ Slave ଆͰϨϓϦέʔγϣϯઃఆίϚϯυΛ࣮ߦ mysql> CALL mysql.rds_set_external_master ( mysql> 'master-cluster.cluster-xxxxxxxxxxxx.ap-northeast-1.rds.amazonaws.com', mysql>
3306, mysql> 'repl', mysql> 'xxxxxxxx', mysql> 'mysql-bin-changelog.000002', mysql> 2484, mysql> 0 mysql> ); Query OK, 0 rows affected (0.19 sec) NZTRMSET@TFU@FYUFSOBM@NBTUFSͰϨϓϦέʔγϣϯઃఆ Ҿ্͔Βɺ ɾNBTUFSDMVTUFSͷΫϥελʔΤϯυϙΠϯτ ɾNBTUFSDMVTUFSͷଓϙʔτ ɾNBTUFSDMVTUFSʹ࡞ͨ͠ϨϓϦέʔγϣϯ༻Ϣʔβ ɾϨϓϦέʔγϣϯ༻Ϣʔβͷύεϫʔυ ɾϝϞͨ͠CJOMPHͷϑΝΠϧ໊ ɾϝϞͨ͠CJOMPHͷϑΝΠϧαΠζ ϙδγϣϯ ɾ44-҉߸Խ ݱ࣌Ͱະ࣮ͱͷ͜ͱͳͷͰݻఆ ࢀߟ: https://docs.aws.amazon.com/ja_jp/AmazonRDS/latest/UserGuide/mysql_rds_set_external_master.html -
ϨϓϦέʔγϣϯͷঢ়ଶ֬ೝ Master ଆͷঢ়ଶΛ֬ೝ mysql> show master status\G *************************** 1. row
*************************** File: mysql-bin-changelog.000002 Position: 21660 Binlog_Do_DB: Binlog_Ignore_DB: Executed_Gtid_Set: 1 row in set (0.00 sec) CJOMPHϑΝΠϧ໊ CJOMPHϙδγϣϯ -
ϨϓϦέʔγϣϯͷঢ়ଶ֬ೝ Slave ଆͷঢ়ଶΛ֬ೝ mysql> show slave status\G *************************** 1. row
*************************** Slave_IO_State: Waiting for Master to send event Master_Host: master-cluster.cluster-xxxxxxxxxxxx.ap-northeast-1.rds.amazonaws.com Master_User: repl Master_Port: 3306 Connect_Retry: 60 Master_Log_File: mysql-bin-changelog.000002 Read_Master_Log_Pos: 21660 Relay_Log_File: relaylog.000002 Relay_Log_Pos: 19469 Relay_Master_Log_File: mysql-bin-changelog.000002 Slave_IO_Running: Yes Slave_SQL_Running: Yes .... .BTUFSଆͷCJOMPHϑΝΠϧ໊ͱҰக .BTUFSଆͷCJOMPHϙδγϣϯͱҰக ͜Ε͕:FTʹͳͬͯΕ0, -
ҎԼͷखॱͰ master-cluster ͷ F/O ޙͷঢ়ଶΛ֬ೝ͢Δ • master-clusterΛखಈͰϑΣΠϧΦʔόʔ • master-cluster ʹదʹॻ͖ࠐΉ(ׂѪ)
• MasterɺSlave ͦΕͧΕͰϨϓϦέʔγϣϯͷঢ়ଶ Λ֬ೝ master-cluster F/O -
ϨϓϦέʔγϣϯͷঢ়ଶΛ֬ೝ(Master) master-cluster F/O mysql> show master status\G *************************** 1. row
*************************** File: mysql-bin-changelog.000003 Position: 38257 Binlog_Do_DB: Binlog_Ignore_DB: Executed_Gtid_Set: 1 row in set (0.00 sec) CJOMPHϑΝΠϧ໊ CJOMPHϙδγϣϯ -
mysql> show slave status\G *************************** 1. row *************************** Slave_IO_State: Waiting
for master to send event Master_Host: master-cluster.cluster-xxxxxxxxxxxx.ap-northeast-1.rds.amazonaws.com Master_User: repl Master_Port: 3306 Connect_Retry: 60 Master_Log_File: mysql-bin-changelog.000003 Read_Master_Log_Pos: 38257 Relay_Log_File: relaylog.000008 Relay_Log_Pos: 38430 Relay_Master_Log_File: mysql-bin-changelog.000003 Slave_IO_Running: Yes Slave_SQL_Running: Yes .... .BTUFSଆͷCJOMPHϑΝΠϧ໊ͱҰக .BTUFSଆͷCJOMPHϙδγϣϯͱҰக ͜Ε͕:FTͷ··ͳͷͰ0, master-cluster F/O ϨϓϦέʔγϣϯͷঢ়ଶΛ֬ೝ(Slave) -
ҎԼͷखॱͰ slave-cluster ͷ F/O ޙͷঢ়ଶΛ֬ೝ͢Δ • slave-cluster ΛखಈͰϑΣΠϧΦʔόʔ • master-cluster
ʹదʹॻ͖ࠐΉ(ׂѪ) • MasterɺSlave ͦΕͧΕͰϨϓϦέʔγϣϯͷঢ়ଶ Λ֬ೝ slave-cluster F/O -
ϨϓϦέʔγϣϯͷঢ়ଶΛ֬ೝ(Master) slave-cluster F/O mysql> show master status\G *************************** 1. row
*************************** File: mysql-bin-changelog.000013 Position: 27917068 Binlog_Do_DB: Binlog_Ignore_DB: Executed_Gtid_Set: 1 row in set (0.00 sec) CJOMPHϑΝΠϧ໊ CJOMPHϙδγϣϯ -
mysql> show slave status\G *************************** 1. row *************************** Slave_IO_State: Waiting
for master to send event Master_Host: master-cluster.cluster-xxxxxxxxxxxx.ap-northeast-1.rds.amazonaws.com Master_User: repl Master_Port: 3306 Connect_Retry: 60 Master_Log_File: mysql-bin-changelog.000013 Read_Master_Log_Pos: 27917068 Relay_Log_File: relaylog.000099 Relay_Log_Pos: 4730917 Relay_Master_Log_File: mysql-bin-changelog.000013 Slave_IO_Running: Yes Slave_SQL_Running: Yes .... .BTUFSଆͷCJOMPHϑΝΠϧ໊ͱҰக .BTUFSଆͷCJOMPHϙδγϣϯͱҰக ͜Ε͕:FTͷ··ͳͷͰ0, slave-cluster F/O ϨϓϦέʔγϣϯͷঢ়ଶΛ֬ೝ(Slave)