ちょっぴりDiveDeepするAWSの時間 AWS Dev Day 2023 Tokyo 延長戦 実践データ移行 〜はてなダイアリーや魔法のiらんどの事例と共に〜

Transcript

1. DiveDeep AWS AWS Dev Day Tokyo i
2. 舅䄕磆☭ 2015 11 KADOKAWA GigaViewer
3. 舅䄕磆☭ 䌕飈׊磬塷 i
4. 儖仼ֽ鎇׊׌׾׆כ
5. 儖仼ֽ鎇׊׌׾׆כ 2020 4 i
6. i
7. i KADOKAWA 1999 2020 4
8. 2020 ˝ بتطّ⯇二 ˝ 二بتطّ׫ס㵸鐄ظ٭ذ璡ס燯车 ˝ ☪㍑╚מֽ鎇׊׌׾סע׆ה׼ס鎇갭
9. ظ٭ذ燯车 ˝ 仾بتطّ־׼二بتطّ׫סظ٭ذ燯Ⳃ ˝ ⶡמրظ٭ذي٭ت؅燯׌٬二׊ׂ׌׾ցכַֹ׻ֹם鎇ך עםַ ˝ 仾بتطّסظ٭ذ؅二بتطّך׵✳ֻ׾׻ֹמ燯Ⳃ
10. ր仾بتطّסظ٭ذ؅二بتطّך׵✳ֻ ׾׻ֹמ燯Ⳃցכע ˝ 仾بتطّכ二بتطّסت؞٭ُ؅ُشم٤ء׌׾ ˝ ُشم٤ء׊ג⩝מظ٭ذ؅燯Ⳃ ˝ ظ٭ذס㚺䬵 ˝ ❆㵸鐄ס鋗嫎ֿ二仾بتطّꝴך㚺؂זיַ׾
11. i 20 > >
12. ظ٭ذꝴס❣㰆꞊➟כ⭚杼סꯂ樑 -> ->
13. ׷׽גַ׆כ
14. ׷׽גַ׆כ ⾒
15. StepFunctions + AWS Batch + S AWS StepFunctions + AWS Batch StepFunctions AWS Batch S JSON S
16. 燯车ס⛼䡵 S S S
17. تط٭عُب٤
18. تط٭عُب٤ batch
19. Savepoint S / JSON S JSON batch_size
20. Savepoint S / / {$batch_type}/batch_id={$batch_id}/ status={$status}/{$uuid} batch_type: batch_id: ID status: pending/succeeded/failed uuid: ID
21. Savepoint /batch_id={$batch_id}/status={$status} status / failed pending
22. 磵冽 20 ⾒ 10h -> ->
23. 磵冽 savepoint status pending
24. ䷉״י◄❆־׼㰢שظ٭ذ燯车
25. 燯车嶖⤓ /
26. 燯车嶖⤓ ˝ ظ٭ذꄈ釤犉׽ ˝ ⪒⛮燯车侇ꝴס釤犉׽ ˝ ْ٤طػ٤تؗؕ٤غؗס吾鋀 ˝ 牊걉 ˝ ⛰؅燯׌־ ˝ 䣽ַ亠ֿ㚺؂׾׵סע㚺䬵
27. 燯车嶖⤓ bulk insert / )
28. ױכ״ AWS /
29. ֵ׽ֿכׇֹ׉ַױ׊ג