Share
Embed
A survey of anomaly detection methodologies for web system
第 3 回 Web System Architecture 研究会 (2018/11/17) で発表したときのものです。
rrreeeyyy
November 17, 2018
Transcript
26 slides
-
A survey of anomaly detec2on methodologies for web system ΫοΫύουגࣜձࣾ
ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ ٢ ཽଠ ( @rrreeeyyy ) Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 1 -
!SSSFFFZZZ !SSSFFFZZZ IUUQTSSSFFFZZZDPN :PTIJLBXB3ZPUB Me • Yoshikawa Ryota ( @rrreeeyyy
[reɪ] ) • ΫοΫύουגࣜձࣾ (2017/01 ʙ) • ΠϯϑϥετϥΫνϟʔ෦ SRE άϧʔϓ • ڵຯྖҬ • ϞχλϦϯάɾ࣌ܥྻσʔλϕʔε • ࢄγεςϜɾϩʔυόϥϯα • झຯ • League of Legends, ΑΑ, FF14 Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 2 -
࣍ • എܠͱత • ௐࠪख๏ • ௐࠪ༰ͱ݁Ռ • ߟ •
·ͱΊ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 3 -
എܠ • SRE ۀͷओతͷͰ͋Δ Web γεςϜͷ৴པੑͷ্ • োͷະવͷ༧ͱฏۉ෮چ࣌ؒͷॖ͕ख๏ͷҰͭ • γεςϜͷϝτϦΫεͷҟৗΛਖ਼֬ʹૣ͘ݟ͚ͭΔඞཁ͕͋Δ
• ༷ʑͳϝτϦΫεΛߴղ૾ͰऔಘͰ͖Δج൫͕͖ͬͯͨ • ҰํͰݱϨϕϧͰͷϝτϦΫεͷղੳʹର͢ΔΞϓϩʔνະͩʹශऑ • ᮢϕʔεͷҟৗݕɾ୯७ͳճؼʹΑΔҟৗݕͳͲ... • Ұํɺ࣌ܥྻσʔλղੳࣗମͷ͋Δఔख़͍ͯ͠Δ/͠ଓ͚͍ͯΔ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 5 -
త • Web γεςϜͷϝτϦΫεͷಛੑΛੳ͢Δ • ಛੑ͔ΒͲ͏͍ͬͨղੳΛ͢Δͷ͕͍͍ͯΔͷ͔ௐࠪ͢Δ • ଞͷ࣌ܥྻσʔλղੳͷख๏ͷྑ͍ͱ͜ΖΛऔΓೖΕ͍ͨ • (ݸਓతͳཧ༝)
αʔόϝτϦΫεͱ͍͏࣌ܥྻσʔλΛ৮͖ͬͯͨ • ҰํͰ࣌ܥྻσʔλղੳͷΑ͏ͳֶज़తͳΞϓϩʔνʹແணͩͬͨ • ࠓճͷΑ͏ͳௐࠪΛ௨ͯ࣌͡ܥྻσʔλղੳʹৄ͘͠ͳ͍͖͍ͬͯͨ • SRE ͷΑ͏ͳ৬छͷਓશମͰ࣌ܥྻσʔλղੳͷ͜ͱΛߟ͍͑ͨ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 6 -
ௐࠪख๏ • Web αʔϏεʹݱΕΔϝτϦΫεΛز͔ͭͷύλʔϯʹྨ • චऀͷܦݧҰൠతͳ Web αʔϏεͷ͔Β • Web
αʔϏεʹݱΕΔҟৗʹ͍ͭͯز͔ͭͷύλʔϯʹྨ • ͪ͜ΒචऀͷܦݧҰൠతͳ Web αʔϏεͷ͔Β • ҟৗݕͷख๏ࣗମͷௐࠪจͷख๏ͱরΒ͠߹ΘͤͯΈΔ • ྨͨ͠ϝτϦΫεʹద͍ͯ͠Δ͔ • ൃੜ͠͏Δҟৗ͕ݕͰ͖ͦ͏͔ • Ͳ͏͍ͬͨछྨͷϝτϦΫεʹͲ͏͍ͬͨख๏ͷҟৗݕ͕͍͍ͯΔ͔·ͱΊΔ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 8 -
Web γεςϜͷϝτϦΫεύλʔϯ • Web γεςϜʹݱΕΔϝτϦΫεΛҎԼͷΑ͏ʹྨ͢Δ • Web αʔϏεʹΑ͘ݱΕΔมԽͷ֎తཁҼผ • ϢʔβͷΞΫηεʹͬͯେ͖͘มԽ͢ΔϝτϦΫε
• ಛఆͷॲཧ͕࣮ߦ͞Ε͍ͯΔࡍʹେ͖͘มԽ͢ΔϝτϦΫε • ΞΫηεಛఆͷॲཧʹؔΘΒͣมԽ͢ΔϝτϦΫε • ͪΖΜ֎తཁҼ͕ 1 ϝτϦΫεͰෳ߹తʹൃੜ͢Δύλʔϯ͋Δ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 10 -
ϢʔβͷΞΫηεʹͬͯେ͖͘มԽ͢ΔϝτϦΫε • ྫ͑ҎԼͷΑ͏ͳϝτϦΫεͳͲ͕ߟ͑ΒΕΔ • LB/Web/DB αʔόͷ CPU ༻, Traffic, αʔό...
ͳͲ • αʔϏεͷಛੑʹΑΔ͕ҎԼͷมಈཁҼΛ࣋ͭ͜ͱ͕ଟ͍ • มಈɾ॥มಈɾقઅมಈɾෆنଇมಈ • ͜ΕͦͦϢʔβͷΞΫηεʹมಈཁҼ͕͋ΔͨΊ • Web αʔϏεʹݱΕΔϝτϦΫεͷதͰ࠷ෳࡶʹมԽ͢Δͱߟ͑ΒΕΔ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 11 -
όονॲཧ͕࣮ߦ͞Ε͍ͯΔࡍʹେ͖͘มԽ͢ΔϝτϦΫε • ྫ͑ҎԼͷΑ͏ͳϝτϦΫε͕ߟ͑ΒΕΔ • όοναʔόͷ CPU ༻, Traffic, ... ͳͲ
• αʔϏεͷಛੑʹΑΔ͕ҎԼͷมಈཁҼΛ࣋ͭ͜ͱ͕ଟ͍ • มಈɾ॥มಈɾෆنଇมಈ • ಛఆͷपظͰॲཧ͕ߦΘΕΔͨΊ • όον࣌ؒதͷΈࢹ͢ΕΑ͍͕όονຖʹಛੑ͕ҟͳΔՄೳੑ͋Δ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 12 -
ΞΫηεόονॲཧʹؔΘΒͣมԽ͢ΔϝτϦΫε • ྫ͑ҎԼͷΑ͏ͳϝτϦΫε͕ߟ͑ΒΕΔ • σΟεΫ༻ྔ, Swap ༻ྔ, ... • σΟεΫ༻ྔαʔόͷಛੑʹΑΔ
• αʔϏεͷಛੑʹΑΔ͕ҎԼͷมಈཁҼΛ࣋ͭ͜ͱ͕ଟ͍ • มಈɾෆنଇมಈ • ظ͕Θ͔ΕΑ͍ɾେ͖͘มԽ͢Δͱͦͦҟৗͳ͜ͱ͕ଟ͍ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 13 -
Web γεςϜʹى͜ΓಘΔোύλʔϯ • ো࣌ʹϝτϦΫε͕औΓಘΔಈ͖ͱͯ͠ҎԼͷύλʔϯʹ͍ͭͯߟ͑Δ • Spike/Falling ύλʔϯ • Flapping/Stopping ύλʔϯ
• Satula1on ύλʔϯ • ϢʔβମݧʹӨڹ͕͋Δ࣌ԿΕ͔ͷϝτϦΫε্͕هͷಈ͖Λ͢ΔͱԾఆ • োதʹϝτϦΫεʹมԽ͕ى͖ͳ͍߹औಘରΛݟ͢ඞཁ͕͋Δ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 14 -
Web γεςϜʹى͜ΓಘΔোύλʔϯ • Spike/Falling ύλʔϯ • ϝτϦΫε͕ٸܹʹ্ঢ͘͠Լ߱͢ΔΑ͏ͳύλʔϯ • ओʹ֎ΕมԽ͕͔Δ͜ͱͰݕग़Մೳ •
Flapping/Stopping ύλʔϯ • ϝτϦΫε͕ٸʹ͍ظؒͰৼಈ࢝͠ΊΔΑ͏ͳύλʔϯ • पظӡಈ͕͘ͳ͚ͬͨͩͳͲͩͱ֎Ε͚ͩͰݕग़͕͍͠ • पظӡಈ͍ͯͨ͠ϝτϦΫε͕ٸʹҰఆ࣌ؒपظӡಈΛΊΔΑ͏ͳύλʔϯ • पظӡಈͷִ͕ؒ͘ͳ͚ͬͨͩͳͲͩͱ֎Ε͚ͩͰݕग़͕͍͠ • Satura2on ύλʔϯ • ϝτϦΫε͕ʢԿΒ͔ͷ੍ݶͰʣҰఆ্ݶͰఀͯ͠͠·͏ύλʔϯ • ୯ҰͷϝτϦΫε͚ͩͰͲͷཁҼͰఀ͍ͯ͠Δͷ͔ಛఆ͕ࠔ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 15 -
Spike ύλʔϯͷྫ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota
( @rrreeeyyy ) 16 -
Web γεςϜͷϝτϦΫεɾোಛੑ • ଟ͘ͷϝτϦΫεͰਓؒͷ࡞ۀͳͲʹΑΔසൟʹൃੜ͢Δෆنଇมಈ͕͋Δ • ྫ͑σϓϩΠɾΦϖϨʔγϣϯͳͲ ... • ςϨϏ์ө SNS
Ͱͷ֦ࢄͳͲʹΑΔΞΫηεεύΠΫ͕͋Δ߹͕͋Δ • ֶशʹ͔͔Δ࣌ؒ͋Δఔͯ͘ͳ͍͕ҟৗͷݕߴͰ͋Δඞཁ͕͋Δ • ෳͷϝτϦΫεΛಉ࣌ʹ֬ೝͯ͠ҟৗɾਖ਼ৗΛஅ͢Δ͜ͱଟ͍ • جຊతʹطͷҟৗσʔλेͰͳ͍͜ͱ͕ଟ͍ • ༩͑ΒΕͨਖ਼ৗσʔλΛϞσϦϯά͢ΔܗͰҟৗݕΛߦ͏ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 20 -
ҟৗݕͷख๏ • ΞΫηεόονॲཧʹؔΘΒͣมԽ͢ΔϝτϦΫε • قઅੑपظੑʹΑΔมಈ͕খ͍͞ͷͰ୯७ͳճؼϞσϧͰຬͰ͖Δέʔε͕ଟͦ͏ • όονॲཧ͕࣮ߦ͞Ε͍ͯΔࡍʹେ͖͘มԽ͢ΔϝτϦΫε • ಛʹपظੑʹΑΔมಈ͕େ͖͍ͷͰपظੑͷഉআΛߦ͏ •
पظੑͷഉআΛߦͬͯ͠·͑୯७ͳճؼϞσϧͰຬͰ͖Δέʔε͕ଟͦ͏ • ϢʔβͷΞΫηεʹͬͯେ͖͘มԽ͢ΔϝτϦΫε • ༷ʑͳมಈཁҼ͕͋ΔͨΊ୯७ͳճؼϞσϧʹམͱ͢ͷࠔͦ͏ • ϐʔΫ࣌ɾฏৗ࣌ͳͲͰLOF, GMMͳͲΛ༻͍Δέʔε͋Δ • Spike ύλʔϯͳͲेʹݕͰ͖Δέʔε͕ଟͦ͏ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 22 -
ҟৗݕͷख๏ • Ұํ Flapping/Stopping, Satura1on ύλʔϯʹ͍ͭͯͷݕ͍͠ • ͍ΘΏΔ contextual anomaly
ͱݺΕΔͰ͋Ζ͏ͷ • [1] ͷ (2008 ) ஈ֊Ͱ contextual anomaly ͷจݙগͳ͔ͬͨͱ͋Δ • ͜͏͍ͬͨ contextual anomaly ʹؔ͢ΔݚڀۙਐΜͰ͖͍ͯΔ • CNN ͳͲΛ༻͍ͨੜϞσϧͷֶश [6] • ࣌ܥྻσʔλΛʹղͯ͠ۂઢϑΟοςΟϯάͷͱͯ͠ղ͘ [7] Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 23 -
ߟ • ͜Ε·Ͱ୯ҰతʹʮαʔόϝτϦΫεʯͱ͍ͯͨ͠ͷΛߋʹࡉ͔͘ྨͨ͠ • ࡉ͔͘ྨ͢Δ͜ͱͰ୯७ͳϞσϧͰఆࣜԽͰ͖ͦ͏ͳϝτϦΫεͷଘࡏΛࣔͨ͠ • ҰํͰΦϖϨʔγϣϯͳͲʹΑΔෆنଇมಈΛͲ͏ѻ͏͔ཁݕ౼ • ࣮ࡍͷোମݧ͔ΒোύλʔϯΛز͔ͭʹྨͨ͠ •
࣮ࡍͷจͱԠੑͷ੍͔ΒબͰ͖Δҟৗݕͷख๏Λݕ౼ͨ͠ • ίϯςΩετΛؚΉҟৗݕͳͲʹؔͯ͠Ҿ͖ଓ͖ௐ͕ࠪඞཁ • ఆࣜԽ͕ेͱ͍͑ΔΘ͚Ͱͳ͍ͷͰࠓޙϝτϦΫεোύλʔϯΛݕ౼͢Δඞཁ • ߋʹ࣮ࡍʹ͏ͨΊʹֶशਪɾෛՙʹ͍ͭͯݕ౼͕ඞཁ • શͯͷϝτϦΫεʹରͯ͠ҟৗݕΛߦ͏ΑΓ steady-state ͷΑ͏ͳͷΛఆٛͨ͠΄͏͕ྑ͍͔ݕ౼ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 24 -
·ͱΊ • ͍͔ͭ͘ͷαʔόϝτϦΫεʹ͍ͭͯ·ͱΊΛࣔͨ͠ • αʔόϝτϦΫεͷ͔Βҟৗݕͷख๏ͷબʹ͍ͭͯߟͨ͠ • ো࣌ʹݱΕΔϝτϦΫεͷڍಈʹ͍ͭͯ·ͱΊΛࣔͨ͠ • ݱΕͦ͏ͳҟৗΛݕ͢ΔͨΊʹͲͷΑ͏ͳख๏Λ༻͍ΕΑ͍͔ߟͨ͠ •
ௐࠪΛ௨ͯ࣌͡ܥྻσʔλղੳʹ͔͚ᷮͩৄ͘͠ͳͬͨ • ࠓճௐࠪͨ͠ͰΓͳ͍ͷͰҾ͖ଓ͖ۙͷख๏ʹ͍ͭͯௐ͕ࠪඞཁ • ಛʹ contextual/collec-ve anomaly detec-on ʹ͍ͭͯ Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 25 -
ࢀߟจݙ 1. CHANDOLA, Varun; BANERJEE, Arindam; KUMAR, Vipin. Anomaly detecCon:
A survey. ACM compuCng surveys (CSUR), 2009, 41.3: 15. 2. KITAGAWA, G. Introducing to Time Series Modeling, Chapman & Hall. 2010. 3. HOCHENBAUM, Jordan; VALLIS, Owen S.; KEJARIWAL, Arun. AutomaCc anomaly detecCon in the cloud via staCsCcal learning. arXiv preprint arXiv:1704.07706, 2017. 4. ISLAM, Md Rafiqul, et al. A Comprehensive Survey of Time Series Anomaly DetecCon in Online Social Network Data. InternaConal Journal of Computer ApplicaCons, 2017, 180.3: 13-22. 5. HARVEY, Andrew C.; PETERS, Simon. EsCmaCon procedures for structural Cme series models. Journal of ForecasCng, 1990, 9.2: 89-108. 6. LAPTEV, Nikolay, et al. Time-series extreme event forecasCng with neural networks at uber. In: InternaConal Conference on Machine Learning. 2017. p. 1-5. 7. TAYLOR, Sean J.; LETHAM, Benjamin. ForecasCng at scale. The American StaCsCcian, 2018, 72.1: 37-45. Web System Architecture ݚڀձ (2018/11/17) | Yoshikawa Ryota ( @rrreeeyyy ) 26