Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
iclr2020deepsemi-supervisedanomalydetectionyama...
Search
Yamato.OKAMOTO
June 14, 2020
Technology
0
130
iclr2020deepsemi-supervisedanomalydetectionyamatookamoto-200531022507.pdf
Yamato.OKAMOTO
June 14, 2020
Tweet
Share
More Decks by Yamato.OKAMOTO
See All by Yamato.OKAMOTO
いまAI組織が求める企画開発エンジニアとは?
roadroller
2
1.5k
Slide ICCV2023 Constructing Image Text Pair Dataset from Books
roadroller
0
93
第11回 全日本コンピュータビジョン勉強会 CVPR2022 "A Self-Supervised Descriptor for Image Copy Detection"
roadroller
0
620
第9回 全日本コンピュータビジョン勉強会 発表資料
roadroller
0
610
第七回全日本コンピュータビジョン勉強会 A Multiplexed Network for End-to-End, Multilingual OCR
roadroller
1
940
部下のマネジメントはAI開発に学べ
roadroller
0
140
Domain Generalization via Model-Agnostic Learning of Semantic Features NeurIPS’19 読み会 in 京都
roadroller
0
260
ICML’2019 読み会in京都 Federated Learningの研究動向
roadroller
0
94
CVPR2019@Long Beach 参加速報(本会議)
roadroller
0
120
Other Decks in Technology
See All in Technology
AWS アーキテクチャ作図入門/aws-architecture-diagram-101
ma2shita
29
10k
rubygem開発で鍛える設計力
joker1007
2
180
Абьюзим random_bytes(). Фёдор Кулаков, разработчик Lamoda Tech
lamodatech
0
320
エンジニア向け技術スタック情報
kauche
1
230
初めてのAzure FunctionsをClaude Codeで作ってみた / My first Azure Functions using Claude Code
hideakiaoyagi
1
210
Witchcraft for Memory
pocke
1
210
Oracle Audit Vault and Database Firewall 20 概要
oracle4engineer
PRO
3
1.7k
TechLION vol.41~MySQLユーザ会のほうから来ました / techlion41_mysql
sakaik
0
170
MySQL5.6から8.4へ 戦いの記録
kyoshidaxx
1
170
A2Aのクライアントを自作する
rynsuke
1
170
2年でここまで成長!AWSで育てたAI Slack botの軌跡
iwamot
PRO
4
640
20250625 Snowflake Summit 2025活用事例 レポート / Nowcast Snowflake Summit 2025 Case Study Report
kkuv
1
290
Featured
See All Featured
Stop Working from a Prison Cell
hatefulcrawdad
270
20k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Designing for humans not robots
tammielis
253
25k
The Straight Up "How To Draw Better" Workshop
denniskardys
233
140k
GraphQLとの向き合い方2022年版
quramy
47
14k
Done Done
chrislema
184
16k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3k
Adopting Sorbet at Scale
ufuk
77
9.4k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.6k
Statistics for Hackers
jakevdp
799
220k
Fireside Chat
paigeccino
37
3.5k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
33
5.9k
Transcript
2020/6/14 Yamato OKAMOTO ICLRΦϯϥΠϯಡΈձ Deep Semi-supervised Anomaly Detection
ࣗݾհʢ͘!!ʣ ɹԬຊେʢ͓͔ͱ·ͱʣ • ژେֶඒೱݚڀࣨͰύλʔϯೝࣝΛݚڀͯ͠म࢜՝ఔमྃ • ΦϜϩϯͰ৽نࣄۀΛܦݧޙɺ͍·ࣾձγεςϜࣄۀ෦ͷݚڀॴϦʔμʔ • ເژΛϙετɾγϦίϯόϨʔʹ͢Δ͜ͱɺؔͷίϛϡχςΟΛڧԽ͍ͨ͠ ɹ㱺 ژͷมਓύϫʔΛੈքʹΒ͠Ί͍ͨ
Twitter : RoadRoller_DESU ҆৺҆શͳࣾձͷ࣮ݱʹ͚ͯɺ ࠷ۙ Anomaly Detection ʹڵຯΞϦ
Anomaly Detection ͋Δ͋Δ ఆٛࠔ • ҟৗʹ༷ʑͳόϦΤʔγϣϯ͕͋Δ • ҟৗݕग़͍͚ͨ͠ͲʮWhat is ҟৗʁʯ͕ఆٛͰ͖ͳ͍
ֶशσʔλ͕ೖखࠔ • ҟৗ໓ଟʹൃੜ͠ͳ͍ʢ※ සൟʹൃੜ͢ΔΠϕϯτҟৗ͡Όͳ༷ͯ͘ʣ • ѹతʹҟৗσʔλ͕ෆͯ͠ػցֶश͕ࠔ ैདྷख๏ɿਖ਼ৗΛఆٛ͢Δ • ʮWhat is ҟৗʁʯͷఆٛΛఘΊΔɺҟৗσʔλͷֶशఘΊΔ • ͦͷΘΓʮWhat is ਖ਼ৗʁʯͷఆٛΛֶशͯ͠ɺʮNot ਖ਼ৗʯΛҟৗͱఆ͢Δ
Anomaly Detection ͷैདྷݚڀ Deep One-Class Classification (ICML’18) • ਖ਼ৗσʔλͷΈΛ༻͍ͯɺClassifierͳΓAutoEncoderͳΓΛैདྷ௨Γʹֶश •
͜ͷͱ͖ɺಛྔ͕࣍ݩ෦ۭؒʹऩଋ͢ΔΑ͏LOSSΛՃ͑Δ • ਖ਼ৗσʔλͳΒٿʹ͢ΔͣͳͷͰɺٿ͔Β֎ΕͨσʔλΛҟৗͱఆ͢Δ ୈҰ߲ʹΑͬͯٿʹ͕ԡ͠ࠐ·ΕΔ cɿ ٿͷத৺ʢͨͩ͠≠0ʣ nɿֶश͢Δਖ਼ৗσʔλͷ
Anomaly Detection ͷධՁ؍ ͲΕ͚ͩਖ਼֬ʹҟৗΛݕͰ͖͔ͨʁ • ਖ਼ৗσʔλΛਖ਼ৗͱఆͯ͠ɺҟৗσʔλΛҟৗͱఆ͢Δਫ਼ ԼྲྀλεΫΛअຐ͠ͳ͍͔ʁ • ԼྲྀλεΫ͕͋Δ߹ɺҟৗݕػೳͷՃʹΑͬͯѱӨڹ͕ͳ͍͔Ͳ͏͔ •
ྫ͑ɺ10ΫϥεͷࣈࣝผثʹɺਤܗͳͲࣈҎ֎͕ೖྗ͞Εͨͱ͖ҟৗͱఆ͢Δػ ೳΛ͚Ճ͍͑ͨͤͰɺैདྷͷ10Ϋϥεࣝผੑೳ͕Լ͢ΔͱࠔΔ ad-hoc͔post-hoc͔ʁ • ҟৗݕ͢ΔͨΊʹϞσϧߏֶशํ๏·Ͱม͑Δඞཁ͕͋Δ͔ʁ • ·ͨɺLOSSΛޙ͔Β͚͚̍ͭͩͯ͠Ճֶश͢Δ͚ͩͰOK͔ʁ • ͲͪΒ͕ྑ͍ѱ͍ͳͲҰ֓ʹݴ͑ͳ͍͕ɺpost-hocͷํ͕ѻ͍͍͢ɻ
հจͷ֓ཁ ʮSemi-supervisedʹֶश͠Α͏ʂʯ Anomaly Detection ͷݚڀUnsupervised͕ओྲྀͷΑ͏ͩ Ͱɺֶश༻ͷҟৗσʔλ͕ೖखࠔͩͱͯ͠ɺ ӡ༻Λଓ͚ͯͨΒҟৗσʔλʹ͍ͣΕग़ձ͏ͣ ͳΒɺͦΕΒগྔͷҟৗσʔλΛͬͯɺ Semi-supervisedʹֶशͨ͠ํ͕ྑ͍ͷͰʁ ※Semi-supervisedͷAnomaly
Detectionݚڀඇৗʹগͳ͍
ఏҊख๏ ʮLOSSʹ߲Λ̍ͭՃ͠·ͨ͠ʯ Deep One-Class Classification (ICML’18) ͷLOSSʹSemi-supervisedͷ߲Λ̍ͭՃ • ࣮ಉ͡ஶऀͰͨ͠ɻࣗͷݚڀΛࣗͰΞοϓσʔτͨ͠ܗʹͳΔɻ ͠ҟৗσʔλʹग़ձͬͨΒɺ
ٿͷ֎ଆʹߦ͘Α͏ֶश͢Δ mɿsemi-supervisedʹֶश͢Δσʔλ yj ɿਖ਼ৗorҟৗͷϥϕϧ
࣮ݧ݁Ռ ॎ࣠ɿҟৗσʔλͷݕग़ੑೳ ʢHigher is Betterʣ Unsupervised Semi-supervised ԣ࣠ɿSemi-supervisedͰڭࢣ͖ͷҟৗσʔλΛֶशׂͨ͠߹ ఏҊख๏ MNISTɺFashion-MNISTɺCIFAR-10ͷσʔληοτͰධՁ
• ̍Ϋϥεͱਖ਼ৗͱఆٛͯ͠ɺAutoEncoderʴఏҊख๏ͰಛྔදݱΛֶश • Γͷ̕ΫϥεΛೖྗͨ͠ͱ͖ɺҟৗͱఆͰ͖Δ͔Ͳ͏͔ධՁ ੑೳվળΛ֬ೝ
·ͱΊͱߟ ਂֶशʹΑΔ Semi-supervised ͳ Anomaly Detection ख๏ΛఏҊ • ॳΊͯͰͳ͍ͱࢥ͏͕ɺਂֶशʹΑΔAnomaly DetectionͰsemi-supervised͍͠
• ͔ͨ͠ʹࣾձ࣮Λߟ͑Δͱɺ͜ͷઃఆద • ख๏γϯϓϧͰɺpost-hocͳͷͰѻ͍͍͢ • ࠓճԼྲྀλεΫ͕AE͕ͩͬͨɺClassificationͩͱͲ͏ͳΔ͔ʁ • Anomaly DetectionͷධՁσʔληοτͬͯଞʹͳ͍ͷ͔ͳɺɺɺɺ ʢ͍ͭ·ͰMNISTʹΑΔධՁ͕ଓ͘ͷͩΖ͏͔ʣ