Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
顔認証・顔識別周りのサーベイ
Search
Shintaro Yoshida
March 02, 2021
3
38
顔認証・顔識別周りのサーベイ
Shintaro Yoshida
March 02, 2021
Tweet
Share
More Decks by Shintaro Yoshida
See All by Shintaro Yoshida
人が注目する箇所を当てるSaliency Detectionの最新モデル UCNet(CVPR2020)
shintaro202020
1
220
Grad-CAMの始まりのお話
shintaro202020
0
85
The Origin of Grad-CAM
shintaro202020
0
130
Featured
See All Featured
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
20
1.3k
Embracing the Ebb and Flow
colly
86
4.7k
Documentation Writing (for coders)
carmenintech
71
4.9k
How to train your dragon (web standard)
notwaldorf
92
6.1k
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
35
2.3k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
Building Adaptive Systems
keathley
43
2.6k
Scaling GitHub
holman
459
140k
Fireside Chat
paigeccino
37
3.5k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
32
5.9k
How GitHub (no longer) Works
holman
314
140k
Transcript
٢ా ৻ଠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)
ࠓͷѻ͏༰ • DeepFakeͷ • 2014Ҏ߱ͷจ DeepFace, FaceNet, ArcFace • ະղܾͷ՝
• ࣮
DeepFake • DeepFakeΛ༻͍ͨੈքॳͷٗ ΠΪϦεͷΤωϧΪʔձ͕ࣾ ձࣾͷϘε͔ΒͷిͰ2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe
RoganͷΛDeep FakeͰ࡞ (Χφμͷ Dessaͱ͍͏AIձࣾ) https://www.youtube.com/watch?v=DWK_iYBl8cA
إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূͱσʔληοτ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূٕज़ͷਐԽ
إೝূٕज़ͷਐԽ ࠓίί!!
ϞσϧͱLossͷਐԽ
DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ
3D Aligned ը૾༻
DeepFace(2014) • ֶशͷࡍʹɺྨ(Cross Entropy Loss, 4030 Class, SFC Dataset) •
ධՁͷࡍʹɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥεྨ (Face Veri fi cationͷͨΊ)
DeepFace(2014) • ಛྔϕʔεͱൺͯ1%ͷੑೳ্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰධՁ
FaceNet (2015) • ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛྔΛׂΓͯ • Triplet LossΛ༻ • ࣮ࡍʹɺHardest PositiveͰͳ͘ɺશϖΞͷΈ߹ΘͤΛ༻͍͍ͯΔ
Better Convergence
FaceNet (2015) • 1ͭͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭͷ݁Ռ : LFWσʔληοτͰSOTA
FaceNet (2015) • ਪͷྲྀΕ FaceNet L2Norm 160x160 ը૾A 512D Feature
FaceNet 160x160 ը૾B 512D Feature 1.3
FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮
ArcFace (2015) • Softmax ؔ + Cross Entropy ಉ͡ը૾ؒͷڑΛখ͘͞ɺ ҟͳΔը૾ؒͷڑΛେ͖͘͢Δ
Α͏ʹઃܭ͞Ε͍ͯͳ͍
ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s?
usp=sharing
ݱঢ়Α͘ΘΕΔσʔληοτ • LFW 6000ਓͰ1ສຕ • VGGFace2 Celebͷࣸਅ Crop
Bounding Box͖ ެ։͞Ε͍͕ͯͨɺআ VGG FaceͷΈ༻Մೳ • MS-Celeb-1M 69ສͷਓؒ 500ສຕ Ұൠͷਓ͓ࣸͬͯΓݱࡏඇެ։
ݱঢ়ͷσʔληοτͷ 1 • (1) Cross-Pose Face Recogntion ਖ਼໘Λ͍ͨը૾͕গͳ͍ •
(2) Cross-Age Face Recognition ܦมԽ ྸΛߟྀͨ͠σʔληοτ͕࡞ • (3) Makeup Face Recognition ϝʔΫΛ͢Δͱఆ͕͍͠ • (4) NIR-VIC Face Recognition ҉͍γʔϯͰͷFRͷ
ݱঢ়ͷσʔληοτͷ 2 • (5) Low-Resolution Face Recognition ը࣭͕͍ͱ͍͠ •
(6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition ಈըͰͷԠ༻͍͠
ݱঢ়ͷσʔληοτͷ 3 • (10) 3D Face Recognition • (11) Partial
Face Recognition إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
࠷ޙʹ ͍͓ؒੈʹͳΓ·ͨ͠ɻ