Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
顔認証・顔識別周りのサーベイ
Search
Shintaro Yoshida
March 02, 2021
0
31
顔認証・顔識別周りのサーベイ
Shintaro Yoshida
March 02, 2021
Tweet
Share
More Decks by Shintaro Yoshida
See All by Shintaro Yoshida
人が注目する箇所を当てるSaliency Detectionの最新モデル UCNet(CVPR2020)
shintaro202020
0
200
Grad-CAMの始まりのお話
shintaro202020
0
70
The Origin of Grad-CAM
shintaro202020
0
90
Featured
See All Featured
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
26
2.1k
Statistics for Hackers
jakevdp
796
220k
Typedesign – Prime Four
hannesfritz
40
2.4k
How GitHub (no longer) Works
holman
310
140k
A Philosophy of Restraint
colly
203
16k
The Pragmatic Product Professional
lauravandoore
31
6.3k
Build The Right Thing And Hit Your Dates
maggiecrowley
33
2.4k
Building a Scalable Design System with Sketch
lauravandoore
459
33k
[RailsConf 2023] Rails as a piece of cake
palkan
52
4.9k
Fashionably flexible responsive web design (full day workshop)
malarkey
405
65k
A designer walks into a library…
pauljervisheath
204
24k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
6
410
Transcript
٢ా ৻ଠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)
ࠓͷѻ͏༰ • DeepFakeͷ • 2014Ҏ߱ͷจ DeepFace, FaceNet, ArcFace • ະղܾͷ՝
• ࣮
DeepFake • DeepFakeΛ༻͍ͨੈքॳͷٗ ΠΪϦεͷΤωϧΪʔձ͕ࣾ ձࣾͷϘε͔ΒͷిͰ2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe
RoganͷΛDeep FakeͰ࡞ (Χφμͷ Dessaͱ͍͏AIձࣾ) https://www.youtube.com/watch?v=DWK_iYBl8cA
إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূͱσʔληοτ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূٕज़ͷਐԽ
إೝূٕज़ͷਐԽ ࠓίί!!
ϞσϧͱLossͷਐԽ
DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ
3D Aligned ը૾༻
DeepFace(2014) • ֶशͷࡍʹɺྨ(Cross Entropy Loss, 4030 Class, SFC Dataset) •
ධՁͷࡍʹɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥεྨ (Face Veri fi cationͷͨΊ)
DeepFace(2014) • ಛྔϕʔεͱൺͯ1%ͷੑೳ্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰධՁ
FaceNet (2015) • ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛྔΛׂΓͯ • Triplet LossΛ༻ • ࣮ࡍʹɺHardest PositiveͰͳ͘ɺશϖΞͷΈ߹ΘͤΛ༻͍͍ͯΔ
Better Convergence
FaceNet (2015) • 1ͭͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭͷ݁Ռ : LFWσʔληοτͰSOTA
FaceNet (2015) • ਪͷྲྀΕ FaceNet L2Norm 160x160 ը૾A 512D Feature
FaceNet 160x160 ը૾B 512D Feature 1.3
FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮
ArcFace (2015) • Softmax ؔ + Cross Entropy ಉ͡ը૾ؒͷڑΛখ͘͞ɺ ҟͳΔը૾ؒͷڑΛେ͖͘͢Δ
Α͏ʹઃܭ͞Ε͍ͯͳ͍
ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s?
usp=sharing
ݱঢ়Α͘ΘΕΔσʔληοτ • LFW 6000ਓͰ1ສຕ • VGGFace2 Celebͷࣸਅ Crop
Bounding Box͖ ެ։͞Ε͍͕ͯͨɺআ VGG FaceͷΈ༻Մೳ • MS-Celeb-1M 69ສͷਓؒ 500ສຕ Ұൠͷਓ͓ࣸͬͯΓݱࡏඇެ։
ݱঢ়ͷσʔληοτͷ 1 • (1) Cross-Pose Face Recogntion ਖ਼໘Λ͍ͨը૾͕গͳ͍ •
(2) Cross-Age Face Recognition ܦมԽ ྸΛߟྀͨ͠σʔληοτ͕࡞ • (3) Makeup Face Recognition ϝʔΫΛ͢Δͱఆ͕͍͠ • (4) NIR-VIC Face Recognition ҉͍γʔϯͰͷFRͷ
ݱঢ়ͷσʔληοτͷ 2 • (5) Low-Resolution Face Recognition ը࣭͕͍ͱ͍͠ •
(6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition ಈըͰͷԠ༻͍͠
ݱঢ়ͷσʔληοτͷ 3 • (10) 3D Face Recognition • (11) Partial
Face Recognition إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
࠷ޙʹ ͍͓ؒੈʹͳΓ·ͨ͠ɻ