Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
顔認証・顔識別周りのサーベイ
Search
Shintaro Yoshida
March 02, 2021
7
38
顔認証・顔識別周りのサーベイ
Shintaro Yoshida
March 02, 2021
Tweet
Share
More Decks by Shintaro Yoshida
See All by Shintaro Yoshida
人が注目する箇所を当てるSaliency Detectionの最新モデル UCNet(CVPR2020)
shintaro202020
4
220
Grad-CAMの始まりのお話
shintaro202020
0
87
The Origin of Grad-CAM
shintaro202020
0
130
Featured
See All Featured
The Cult of Friendly URLs
andyhume
79
6.6k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
31
9.7k
Unsuck your backbone
ammeep
671
58k
Balancing Empowerment & Direction
lara
4
680
Designing Experiences People Love
moore
142
24k
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
The World Runs on Bad Software
bkeepers
PRO
71
11k
How GitHub (no longer) Works
holman
315
140k
Designing for Performance
lara
610
69k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
9
850
How To Stay Up To Date on Web Technology
chriscoyier
791
250k
How to Ace a Technical Interview
jacobian
280
23k
Transcript
٢ా ৻ଠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)
ࠓͷѻ͏༰ • DeepFakeͷ • 2014Ҏ߱ͷจ DeepFace, FaceNet, ArcFace • ະղܾͷ՝
• ࣮
DeepFake • DeepFakeΛ༻͍ͨੈքॳͷٗ ΠΪϦεͷΤωϧΪʔձ͕ࣾ ձࣾͷϘε͔ΒͷిͰ2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe
RoganͷΛDeep FakeͰ࡞ (Χφμͷ Dessaͱ͍͏AIձࣾ) https://www.youtube.com/watch?v=DWK_iYBl8cA
إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূͱσʔληοτ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূٕज़ͷਐԽ
إೝূٕज़ͷਐԽ ࠓίί!!
ϞσϧͱLossͷਐԽ
DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ
3D Aligned ը૾༻
DeepFace(2014) • ֶशͷࡍʹɺྨ(Cross Entropy Loss, 4030 Class, SFC Dataset) •
ධՁͷࡍʹɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥεྨ (Face Veri fi cationͷͨΊ)
DeepFace(2014) • ಛྔϕʔεͱൺͯ1%ͷੑೳ্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰධՁ
FaceNet (2015) • ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛྔΛׂΓͯ • Triplet LossΛ༻ • ࣮ࡍʹɺHardest PositiveͰͳ͘ɺશϖΞͷΈ߹ΘͤΛ༻͍͍ͯΔ
Better Convergence
FaceNet (2015) • 1ͭͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭͷ݁Ռ : LFWσʔληοτͰSOTA
FaceNet (2015) • ਪͷྲྀΕ FaceNet L2Norm 160x160 ը૾A 512D Feature
FaceNet 160x160 ը૾B 512D Feature 1.3
FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮
ArcFace (2015) • Softmax ؔ + Cross Entropy ಉ͡ը૾ؒͷڑΛখ͘͞ɺ ҟͳΔը૾ؒͷڑΛେ͖͘͢Δ
Α͏ʹઃܭ͞Ε͍ͯͳ͍
ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s?
usp=sharing
ݱঢ়Α͘ΘΕΔσʔληοτ • LFW 6000ਓͰ1ສຕ • VGGFace2 Celebͷࣸਅ Crop
Bounding Box͖ ެ։͞Ε͍͕ͯͨɺআ VGG FaceͷΈ༻Մೳ • MS-Celeb-1M 69ສͷਓؒ 500ສຕ Ұൠͷਓ͓ࣸͬͯΓݱࡏඇެ։
ݱঢ়ͷσʔληοτͷ 1 • (1) Cross-Pose Face Recogntion ਖ਼໘Λ͍ͨը૾͕গͳ͍ •
(2) Cross-Age Face Recognition ܦมԽ ྸΛߟྀͨ͠σʔληοτ͕࡞ • (3) Makeup Face Recognition ϝʔΫΛ͢Δͱఆ͕͍͠ • (4) NIR-VIC Face Recognition ҉͍γʔϯͰͷFRͷ
ݱঢ়ͷσʔληοτͷ 2 • (5) Low-Resolution Face Recognition ը࣭͕͍ͱ͍͠ •
(6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition ಈըͰͷԠ༻͍͠
ݱঢ়ͷσʔληοτͷ 3 • (10) 3D Face Recognition • (11) Partial
Face Recognition إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
࠷ޙʹ ͍͓ؒੈʹͳΓ·ͨ͠ɻ