Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
iclr2020deepsemi-supervisedanomalydetectionyama...
Search
Yamato.OKAMOTO
June 14, 2020
Technology
0
130
iclr2020deepsemi-supervisedanomalydetectionyamatookamoto-200531022507.pdf
Yamato.OKAMOTO
June 14, 2020
Tweet
Share
More Decks by Yamato.OKAMOTO
See All by Yamato.OKAMOTO
いまAI組織が求める企画開発エンジニアとは?
roadroller
2
1.5k
Slide ICCV2023 Constructing Image Text Pair Dataset from Books
roadroller
0
97
第11回 全日本コンピュータビジョン勉強会 CVPR2022 "A Self-Supervised Descriptor for Image Copy Detection"
roadroller
0
620
第9回 全日本コンピュータビジョン勉強会 発表資料
roadroller
0
610
第七回全日本コンピュータビジョン勉強会 A Multiplexed Network for End-to-End, Multilingual OCR
roadroller
1
950
部下のマネジメントはAI開発に学べ
roadroller
0
150
Domain Generalization via Model-Agnostic Learning of Semantic Features NeurIPS’19 読み会 in 京都
roadroller
0
260
ICML’2019 読み会in京都 Federated Learningの研究動向
roadroller
0
97
CVPR2019@Long Beach 参加速報(本会議)
roadroller
0
120
Other Decks in Technology
See All in Technology
The Madness of Multiple Gemini CLIs Developing Simultaneously with Jujutsu
gunta
1
2.8k
AI時代の知識創造 ─GeminiとSECIモデルで読み解く “暗黙知”と創造の境界線
nyagasan
0
160
経験がないことを言い訳にしない、 AI時代の他領域への染み出し方
parayama0625
0
260
少人数でも回る! DevinとPlaybookで支える運用改善
ishikawa_pro
4
1.7k
Railsの限界を超えろ!「家族アルバム みてね」の画像・動画の大規模アップロードを支えるアーキテクチャの変遷
ojima_h
4
520
MCPと認可まわりの話 / mcp_and_authorization
convto
2
290
大規模組織にAIエージェントを迅速に導入するためのセキュリティの勘所 / AI agents for large-scale organizations
i35_267
6
320
モバイルゲームの開発を支える基盤の歩み ~再現性のある開発ラインを量産する秘訣~
qualiarts
0
600
Expertise as a Service via MCP
yodakeisuke
1
160
Wasmで社内ツールを作って配布しよう
askua
0
150
【CEDEC2025】LLMを活用したゲーム開発支援と、生成AIの利活用を進める組織的な取り組み
cygames
PRO
1
1.6k
DatabricksのOLTPデータベース『Lakebase』に詳しくなろう!
inoutk
0
160
Featured
See All Featured
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
8
720
What's in a price? How to price your products and services
michaelherold
246
12k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
A Modern Web Designer's Workflow
chriscoyier
695
190k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
29
9.6k
BBQ
matthewcrist
89
9.8k
Music & Morning Musume
bryan
46
6.7k
Designing for Performance
lara
610
69k
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.6k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
130
19k
Designing for humans not robots
tammielis
253
25k
Rails Girls Zürich Keynote
gr2m
95
14k
Transcript
2020/6/14 Yamato OKAMOTO ICLRΦϯϥΠϯಡΈձ Deep Semi-supervised Anomaly Detection
ࣗݾհʢ͘!!ʣ ɹԬຊେʢ͓͔ͱ·ͱʣ • ژେֶඒೱݚڀࣨͰύλʔϯೝࣝΛݚڀͯ͠म࢜՝ఔमྃ • ΦϜϩϯͰ৽نࣄۀΛܦݧޙɺ͍·ࣾձγεςϜࣄۀ෦ͷݚڀॴϦʔμʔ • ເژΛϙετɾγϦίϯόϨʔʹ͢Δ͜ͱɺؔͷίϛϡχςΟΛڧԽ͍ͨ͠ ɹ㱺 ژͷมਓύϫʔΛੈքʹΒ͠Ί͍ͨ
Twitter : RoadRoller_DESU ҆৺҆શͳࣾձͷ࣮ݱʹ͚ͯɺ ࠷ۙ Anomaly Detection ʹڵຯΞϦ
Anomaly Detection ͋Δ͋Δ ఆٛࠔ • ҟৗʹ༷ʑͳόϦΤʔγϣϯ͕͋Δ • ҟৗݕग़͍͚ͨ͠ͲʮWhat is ҟৗʁʯ͕ఆٛͰ͖ͳ͍
ֶशσʔλ͕ೖखࠔ • ҟৗ໓ଟʹൃੜ͠ͳ͍ʢ※ සൟʹൃੜ͢ΔΠϕϯτҟৗ͡Όͳ༷ͯ͘ʣ • ѹతʹҟৗσʔλ͕ෆͯ͠ػցֶश͕ࠔ ैདྷख๏ɿਖ਼ৗΛఆٛ͢Δ • ʮWhat is ҟৗʁʯͷఆٛΛఘΊΔɺҟৗσʔλͷֶशఘΊΔ • ͦͷΘΓʮWhat is ਖ਼ৗʁʯͷఆٛΛֶशͯ͠ɺʮNot ਖ਼ৗʯΛҟৗͱఆ͢Δ
Anomaly Detection ͷैདྷݚڀ Deep One-Class Classification (ICML’18) • ਖ਼ৗσʔλͷΈΛ༻͍ͯɺClassifierͳΓAutoEncoderͳΓΛैདྷ௨Γʹֶश •
͜ͷͱ͖ɺಛྔ͕࣍ݩ෦ۭؒʹऩଋ͢ΔΑ͏LOSSΛՃ͑Δ • ਖ਼ৗσʔλͳΒٿʹ͢ΔͣͳͷͰɺٿ͔Β֎ΕͨσʔλΛҟৗͱఆ͢Δ ୈҰ߲ʹΑͬͯٿʹ͕ԡ͠ࠐ·ΕΔ cɿ ٿͷத৺ʢͨͩ͠≠0ʣ nɿֶश͢Δਖ਼ৗσʔλͷ
Anomaly Detection ͷධՁ؍ ͲΕ͚ͩਖ਼֬ʹҟৗΛݕͰ͖͔ͨʁ • ਖ਼ৗσʔλΛਖ਼ৗͱఆͯ͠ɺҟৗσʔλΛҟৗͱఆ͢Δਫ਼ ԼྲྀλεΫΛअຐ͠ͳ͍͔ʁ • ԼྲྀλεΫ͕͋Δ߹ɺҟৗݕػೳͷՃʹΑͬͯѱӨڹ͕ͳ͍͔Ͳ͏͔ •
ྫ͑ɺ10ΫϥεͷࣈࣝผثʹɺਤܗͳͲࣈҎ֎͕ೖྗ͞Εͨͱ͖ҟৗͱఆ͢Δػ ೳΛ͚Ճ͍͑ͨͤͰɺैདྷͷ10Ϋϥεࣝผੑೳ͕Լ͢ΔͱࠔΔ ad-hoc͔post-hoc͔ʁ • ҟৗݕ͢ΔͨΊʹϞσϧߏֶशํ๏·Ͱม͑Δඞཁ͕͋Δ͔ʁ • ·ͨɺLOSSΛޙ͔Β͚͚̍ͭͩͯ͠Ճֶश͢Δ͚ͩͰOK͔ʁ • ͲͪΒ͕ྑ͍ѱ͍ͳͲҰ֓ʹݴ͑ͳ͍͕ɺpost-hocͷํ͕ѻ͍͍͢ɻ
հจͷ֓ཁ ʮSemi-supervisedʹֶश͠Α͏ʂʯ Anomaly Detection ͷݚڀUnsupervised͕ओྲྀͷΑ͏ͩ Ͱɺֶश༻ͷҟৗσʔλ͕ೖखࠔͩͱͯ͠ɺ ӡ༻Λଓ͚ͯͨΒҟৗσʔλʹ͍ͣΕग़ձ͏ͣ ͳΒɺͦΕΒগྔͷҟৗσʔλΛͬͯɺ Semi-supervisedʹֶशͨ͠ํ͕ྑ͍ͷͰʁ ※Semi-supervisedͷAnomaly
Detectionݚڀඇৗʹগͳ͍
ఏҊख๏ ʮLOSSʹ߲Λ̍ͭՃ͠·ͨ͠ʯ Deep One-Class Classification (ICML’18) ͷLOSSʹSemi-supervisedͷ߲Λ̍ͭՃ • ࣮ಉ͡ஶऀͰͨ͠ɻࣗͷݚڀΛࣗͰΞοϓσʔτͨ͠ܗʹͳΔɻ ͠ҟৗσʔλʹग़ձͬͨΒɺ
ٿͷ֎ଆʹߦ͘Α͏ֶश͢Δ mɿsemi-supervisedʹֶश͢Δσʔλ yj ɿਖ਼ৗorҟৗͷϥϕϧ
࣮ݧ݁Ռ ॎ࣠ɿҟৗσʔλͷݕग़ੑೳ ʢHigher is Betterʣ Unsupervised Semi-supervised ԣ࣠ɿSemi-supervisedͰڭࢣ͖ͷҟৗσʔλΛֶशׂͨ͠߹ ఏҊख๏ MNISTɺFashion-MNISTɺCIFAR-10ͷσʔληοτͰධՁ
• ̍Ϋϥεͱਖ਼ৗͱఆٛͯ͠ɺAutoEncoderʴఏҊख๏ͰಛྔදݱΛֶश • Γͷ̕ΫϥεΛೖྗͨ͠ͱ͖ɺҟৗͱఆͰ͖Δ͔Ͳ͏͔ධՁ ੑೳվળΛ֬ೝ
·ͱΊͱߟ ਂֶशʹΑΔ Semi-supervised ͳ Anomaly Detection ख๏ΛఏҊ • ॳΊͯͰͳ͍ͱࢥ͏͕ɺਂֶशʹΑΔAnomaly DetectionͰsemi-supervised͍͠
• ͔ͨ͠ʹࣾձ࣮Λߟ͑Δͱɺ͜ͷઃఆద • ख๏γϯϓϧͰɺpost-hocͳͷͰѻ͍͍͢ • ࠓճԼྲྀλεΫ͕AE͕ͩͬͨɺClassificationͩͱͲ͏ͳΔ͔ʁ • Anomaly DetectionͷධՁσʔληοτͬͯଞʹͳ͍ͷ͔ͳɺɺɺɺ ʢ͍ͭ·ͰMNISTʹΑΔධՁ͕ଓ͘ͷͩΖ͏͔ʣ