ベンチャーならではのRedshift低コスト運用

pairsでのRedshiftの運用方法について、その構成とコスト面での効果を説明します。

Transcript

1. CONFIDENTIAL Copyright © 2009-2014 eureka, Inc. All rights reserved. 2015/04/23 ͑ͼελʂ#2 ϕϯνϟʔͳΒͰ͸ͷ Redshiftͷ௿ίετӡ༻ Tamaki Tetsumoto
2. Copyright © 2009-2015 eureka, Inc. All rights reserved. • pairsαʔόʔαΠυ
 ΤϯδχΞ • PhpStorm • Πϯλʔϯ͔Βೖࣾ • ࣾձਓ3೥໨ • PHPer΋͏͙͢5೥໨ಥೖ • ͜Ε͔ΒGopher גࣜձࣾΤ΢ϨΧ మຊ ؀
3. ΤϯδχΞͷਓ਺ 29% 71% ΤϯδχΞ ඇΤϯδχΞ ϋΠϒϦουɿ21ਓ WebΤϯδχΞɿ10ਓ iOS/AndroidΤϯδχΞɿ16ਓ Copyright © 2009-2015 eureka, Inc. All rights reserved. 47ਓ 27.6 ࡀ ฏۉ೥ྸ
4. pairs Couples Copyright © 2009-2015 eureka, Inc. All rights reserved.
5. Copyright © 2009-2014 eureka, Inc. All rights reserved. pairs Couples
6. Copyright © 2009-2014 eureka, Inc. All rights reserved. iOS android Couples Target Users are 18-26
7. Copyright © 2009-2014 eureka, Inc. All rights reserved. DL਺ਪҠ Couples 562,500 1,125,000 1,687,500 2,250,000 2014/5 2014/6 2014/7 2014/8 2014/9 2014/10 2014/11 2014/12 2015/1 2015/2 2015/3 200ສ DLୡ੒
8. Copyright © 2009-2014 eureka, Inc. All rights reserved. pairs Couples
9. Copyright © 2009-2014 eureka, Inc. All rights reserved. PC Browser iOS android SP Browser pairs
10. Copyright © 2009-2014 eureka, Inc. All rights reserved. 500,000 1,000,000 1,500,000 2,000,000 2012/10 2012/12 2013/2 2013/4 2013/6 2013/8 2013/10 2013/12 2014/2 2014/4 2014/6 2014/8 2014/10 2014/12 2015/2 ྦྷܭϢʔβʔ਺ਪҠ pairs 220ສ Ϣʔβʔୡ੒
11. QBJSTͷΠϯϑϥߏ੒ Copyright © 2009-2015 eureka, Inc. All rights reserved.
12. Copyright © 2009-2015 eureka, Inc. All rights reserved. "84ϑϧ׆༻
    ൺֱతελϯμʔυͳߏ੒Ͱ͢
13. 3%4ʢ.Z42-ʣ
    w ϢʔβʔϓϩϑΟʔϧ
    w ചΓ্͛
    w Ϛονϯά
    FUD Copyright © 2009-2015 eureka, Inc. All rights reserved.
14. Copyright © 2009-2015 eureka, Inc. All rights reserved. %ZOBNP%#
    w ϩάΠϯΞΫγϣϯ
    w ࠓ೔ͷϐοΫΞοϓ
    w ଍͋ͱFUD
15. ڈΔɺ೥݄ Copyright © 2009-2015 eureka, Inc. All rights reserved.
16. ʕ̡̢̡ʘ̅͟ ͡ ͜ 㷌 â @ ʔ̢̡̢
    
    ؅ཧը໘Λվम͍ͨ͠ Copyright © 2009-2015 eureka, Inc. All rights reserved.
17. Copyright © 2009-2015 eureka, Inc. All rights reserved. ʕ̡̢̡ʘ̅͟ ͡ ͜ 㷌 â @ ʔ̢̡̢
    
    ؅ཧը໘Λվम͍ͨ͠ ,1*ݟ௚͠·͢ ΞϧΰϦζϜௐ੔ͷώϯτཉ͍͠ ചΓ্͛༧ଌཱ͍ͯͨ
18. બ୒ࢶ͸ͭ Copyright © 2009-2015 eureka, Inc. All rights reserved.
19.  (PPHMF
    #JH2VFSZ
     "NB[PO
    3FETIJGU
     "NB[PO
    &MBTUJD
    .BQ3FEVDF Copyright © 2009-2015 eureka, Inc. All rights reserved.
20. Copyright © 2009-2015 eureka, Inc. All rights reserved. ͦͷલʹɺ3FETIJGUͱ͸ʜ
21. w ྻࢦ޲ʢΧϥϜφʔʣ%#
    w ϚωʔδυαʔϏεʢࣗಈόοΫΞοϓͳͲʣ
    w ࣌ؒ՝ۚ
    w "NB[PO
    4͔Βͷσʔλసૹ͸ແྉ "NB[PO
    3FETIJGU Copyright © 2009-2015 eureka, Inc. All rights reserved.
22. ϫϯϥΠφʔͰσʔλΛऔΓࠐΊΔ
    ʢ4
    ͱ%ZOBNP%#͔Βʣ "NB[PO
    4 "NB[PO
    %ZOBNP%# "NB[PO
    3FETIJGU Copyright © 2009-2015 eureka, Inc. All rights reserved.
23. $ COPY [コピー先DB名] FROM ‘s3://[Bucket名]/[ディレクトリパス]/’ σΟϨΫτϦࢦఆͰ
    $01:
    Մೳ "NB[PO
    4
    ͔Βͷ$01: "NB[PO
    4 $01: "NB[PO
    3FETIJGU Copyright © 2009-2015 eureka, Inc. All rights reserved.
24. $ COPY pairs FROM ‘dynamodb://[テーブル名]’ "NB[PO
    %ZOBNP%#
    ͔Βͷ$01: Copyright © 2009-2015 eureka, Inc. All rights reserved. "NB[PO
    %ZOBNP%# $01: "NB[PO
    3FETIJGU ͨͩ͠ɺશ݅$01:ͷΈ
25. Copyright © 2009-2015 eureka, Inc. All rights reserved. Ͱ͸ɺൺֱͯ͠Έ·͢
26. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5&
    %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º
27. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5&
    %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º #JH2VFSZ͸ΫΤϦ՝ۚ
    ࣌ؒ՝ۚͰൺֱ͢Δͱ
    3FETIJGU
    
    &.3
28. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5&
    %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º σʔλసૹྉ͕ۚ
    #JH2VFSZͷJNQPSUͱ
    "84ͷPVUQVUͰ͔͔Δ 4͔Β3FETIJGU΁ͷ
    σʔλసૹ͸ແྉ
29. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5&
    %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˚ º ਂ໷όονͰूܭͳͷͰ
    ࠓճ͸଎͞͸ͦ͜·Ͱ
    ٻΊ͍ͯͳ͍
30. #JH2VFSZ 3FETIJGU &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5&
    %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º Copyright © 2009-2015 eureka, Inc. All rights reserved. ຖ೔61%"5&͍ͨ͠
    σʔλ͕͋ΔͷͰக໋తʜ
31. Copyright © 2009-2015 eureka, Inc. All rights reserved. #JH2VFSZ 3FETIJGU &.3 ಋೖίετ ˓ ˕ ˓ ӡ༻ίετ ˚ ˚ ˓ ଎͞ ˕ ˓ ˚ 61%"5&
    %&-&5& º ˓ º ෳࡶͳΫΤϦ ˚ ˓ º ܹ͍͠ςʔϒϧͷ
    ֻ͚߹Θ͕ͤ͋ΔͷͰ
    ؤுͬͯཉ͔ͬͨ͠ʂ
32. Copyright © 2009-2015 eureka, Inc. All rights reserved. 3FETIJGUʹܾΊ·ͨ͠ w 1PTUHSF42-
    ϕʔεɹ
    w 61%"5&
    %&-&5&ɹɹɹɹ
    w ෳࡶͳΫΤϦɹɹɹɹɹɹɹ
    w ӡ༻ίετ͸ઃܭͰΧόʔɹ ͷ42-͕࢖͑Δ
    ͕ൃߦͰ͖Δ
    ͕ൃߦͰ͖Δ
    ͢Δ
33. 3FETIJGUΛ࣮ࡍʹͲ͏࢖͍ͬͯΔ͔ Copyright © 2009-2015 eureka, Inc. All rights reserved.
34. Copyright © 2009-2015 eureka, Inc. All rights reserved. 4 3FETIJGU &$ 3%4.Z42- 3%4.Z42- %ZOBNP%#
    'MVFOUE 4OBQTIPU
35. 4 3FETIJGU &$ 3%4.Z42- 3%4 %ZOBNP%#
    'MVFOUE 
    σʔλநग़ ਂ໷όονͰ
    લ೔ͷσʔλΛநग़ɺ
    UTWϑΝΠϧग़ྗ 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved.
36. 4 3FETIJGU &$ 3%4
    'MVFOUE 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved. UTWϑΝΠϧΛ
    4΁อଘ 3%4 %ZOBNP%# 
    ϑΝΠϧΞοϓϩʔυ
37. 4 3FETIJGU &$ 3%4 3%4 %ZOBNP%#
    'MVFOUE "1*Ͱ4OBQTIPU͔Β
    $MVTUFSΛىಈ 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved. 
    3FETIJGUىಈ
38. 4 3FETIJGU &$ 3%4 3%4 %ZOBNP%#
    'MVFOUE $01:ίϚϯυͰ
    3FETIJGU͕4͔Β
    σʔλΛಡΈࠐΈ $01:ίϚϯυ࣮ߦ 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved. UTWϑΝΠϧͷ
    ಡΈࠐΈ 
    σʔλϩʔυ
39. 4 3FETIJGU &$ 3%4 3%4.Z42- %ZOBNP%#
    'MVFOUE "NB[PO
    3FETIJGU
    42-
    ʢ1PTUHSF42-
    ϕʔεʣ
    ΫΤϦ࣮ߦ 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved. ΫΤϦ࣮ߦ 
    ूܭ
40. 4 3FETIJGU &$ 3%4 3%4.Z42- %ZOBNP%#
    'MVFOUE 4OBQTIPU ूܭ݁Ռͷ
    อଘ Copyright © 2009-2015 eureka, Inc. All rights reserved. ूܭ݁ՌΛ
    ؅ཧը໘ઐ༻ͷ
    3%4΁อଘ 
    ूܭ݁Ռͷอଘ
41. 4 3FETIJGU &$ 3%4 3%4 %ZOBNP%#
    'MVFOUE "1*Ͱ4OBQTIPUʹ
    όοΫΞοϓΛอଘ
    $MVTUFSΛ࡟আ 4OBQTIPU "1*Ͱ
    4OBQTIPU΁
    อଘɾ࡟আ ˞"1*ͷҾ਺Ͱ$MVTUFS࡟আ࣌ʹ
    ɹόοΫΞοϓΛऔΔ͔ࢦఆՄೳ Copyright © 2009-2015 eureka, Inc. All rights reserved. 
    3FETIJGUͷऴྃ
42. Ͱɺ݁ہͲΕ͘Β͍௿ίετͰ
    ࣮ݱͰ͖ͨͷ͔ʁ Copyright © 2009-2015 eureka, Inc. All rights reserved.
43. Copyright © 2009-2015 eureka, Inc. All rights reserved.    ˞ίετ࡟ݮ෯ʹ͍ͭͯ͸σʔλྔ΍ܭࢉྔͳͲ
    ɹ࢖༻؀ڥɾ༻్ʹΑͬͯҟͳΓ·͢ɻ
44. Copyright © 2009-2015 eureka, Inc. All rights reserved. ΍ͬͨ͜ͱ
45. Copyright © 2009-2015 eureka, Inc. All rights reserved. ᶃ3FETIJGUىಈ͸ඞཁͳ͚࣌ͩ
46. Copyright © 2009-2015 eureka, Inc. All rights reserved. 3FETIJGUՔಇ࣌ؒ
    ࣌ؒ
    ˠ
    ࣌ؒ΁
47. Copyright © 2009-2015 eureka, Inc. All rights reserved. ᶄूܭ݁ՌΛ3%4΁อଘ
48. Copyright © 2009-2015 eureka, Inc. All rights reserved. ઐ༻؅ཧը໘ͳͷͰ
    খ͍͞ΠϯελϯεͰ࣌ؒՔಇ
49. 4 3FETIJGU &$ 3%4 %ZOBNP%#
    'MVFOUE 4OBQTIPU Copyright © 2009-2015 eureka, Inc. All rights reserved. EXMBSHF 3FETIJGU
    ৗ࣌Քಇ ˞౦ژ
    ΦϯσϚϯυྉۚ
    Ͱܭࢉ   I
    Քಇ ͍͍ͩͨ
50. 4 3FETIJGU &$ 3%4 3%4.Z42- %ZOBNP%#
    'MVFOUE 4OBQTIPU   Copyright © 2009-2015 eureka, Inc. All rights reserved. ˞౦ژ
    ΦϯσϚϯυྉۚ
    Ͱܭࢉ ௿ίετӡ༻ I
    OFX
    Քಇ 3FETIJGUɿEXMBSHF I
    ˣ
    
    Քಇ 3%4ɿUTNBMM  ͍͍ͩͨ
51. Copyright © 2009-2015 eureka, Inc. All rights reserved. ·ͱΊ
52. 3FETIJGU͕޲͍͍ͯΔ৚݅
    w "84ϑϧ׆༻ͷΠϯϑϥߏ੒
    w %ZOBNP%#ͷσʔλ΋࢖͏
    ɹɹɹˠશσʔλͳΒ௚઀ಡΈࠐΈ΋Մೳʂ
    ɹɹɹˠࠩ෼͚ͩऔΓࠐΈ͍ͨͳΒ4Λ࢖͓͏
    w ߋ৽ɾ࡟আ͍ͨ͠σʔλ͕͋Δ
    w ͳ͔ͳ͔ܹ͍͠+0*/ͷཛྷ Copyright © 2009-2015 eureka, Inc. All rights reserved.
53. ௿ίετӡ༻͕Ͱ͖Δ৚݅
    w σʔλूܭ͸ҰఆͷλΠϛϯάͰྑ͍
    w ूܭύλʔϯ͕ܾ·͍ͬͯΔ
    ɹɹɹˠઐ༻ͷ3%4Λ࢖ͬͯूܭ݁ՌͷΈอଘʂ Copyright © 2009-2015 eureka, Inc. All rights reserved.
54. ͜ͷ෼ੳج൫Ͱ
    QBJST͸੒௕தʂ Copyright © 2009-2015 eureka, Inc. All rights reserved.
55. େن໛Ϗοάσʔλ
 ղੳ ϚονϯάΞϧΰϦζϜ Big Data (PϑϧεΫϥον ϋΠϒϦου
    ΤϯδχΞ ✕ Engineering ʮੈքͰѪ͞ΕΔαʔϏεʯΛҰॹʹ࡞Γ·ͤΜ͔ʁ ྆Ϗδωε͕
 ηάϝϯτ/P άϩʔόϧల։த Business
56. CONFIDENTIAL Copyright © 2009-2014 eureka, Inc. All rights reserved. Thank you :)