Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
顔認証・顔識別周りのサーベイ
Search
Shintaro Yoshida
March 02, 2021
0
35
顔認証・顔識別周りのサーベイ
Shintaro Yoshida
March 02, 2021
Tweet
Share
More Decks by Shintaro Yoshida
See All by Shintaro Yoshida
人が注目する箇所を当てるSaliency Detectionの最新モデル UCNet(CVPR2020)
shintaro202020
0
210
Grad-CAMの始まりのお話
shintaro202020
0
81
The Origin of Grad-CAM
shintaro202020
0
110
Featured
See All Featured
Automating Front-end Workflow
addyosmani
1369
200k
A Modern Web Designer's Workflow
chriscoyier
693
190k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
5
550
ReactJS: Keep Simple. Everything can be a component!
pedronauck
666
120k
Measuring & Analyzing Core Web Vitals
bluesmoon
7
390
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
13
1.4k
The Cult of Friendly URLs
andyhume
78
6.3k
Making the Leap to Tech Lead
cromwellryan
133
9.2k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.1k
Embracing the Ebb and Flow
colly
85
4.6k
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
3.8k
How to train your dragon (web standard)
notwaldorf
90
6k
Transcript
٢ా ৻ଠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)
ࠓͷѻ͏༰ • DeepFakeͷ • 2014Ҏ߱ͷจ DeepFace, FaceNet, ArcFace • ະղܾͷ՝
• ࣮
DeepFake • DeepFakeΛ༻͍ͨੈքॳͷٗ ΠΪϦεͷΤωϧΪʔձ͕ࣾ ձࣾͷϘε͔ΒͷిͰ2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe
RoganͷΛDeep FakeͰ࡞ (Χφμͷ Dessaͱ͍͏AIձࣾ) https://www.youtube.com/watch?v=DWK_iYBl8cA
إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূͱσʔληοτ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূٕज़ͷਐԽ
إೝূٕज़ͷਐԽ ࠓίί!!
ϞσϧͱLossͷਐԽ
DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ
3D Aligned ը૾༻
DeepFace(2014) • ֶशͷࡍʹɺྨ(Cross Entropy Loss, 4030 Class, SFC Dataset) •
ධՁͷࡍʹɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥεྨ (Face Veri fi cationͷͨΊ)
DeepFace(2014) • ಛྔϕʔεͱൺͯ1%ͷੑೳ্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰධՁ
FaceNet (2015) • ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛྔΛׂΓͯ • Triplet LossΛ༻ • ࣮ࡍʹɺHardest PositiveͰͳ͘ɺશϖΞͷΈ߹ΘͤΛ༻͍͍ͯΔ
Better Convergence
FaceNet (2015) • 1ͭͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭͷ݁Ռ : LFWσʔληοτͰSOTA
FaceNet (2015) • ਪͷྲྀΕ FaceNet L2Norm 160x160 ը૾A 512D Feature
FaceNet 160x160 ը૾B 512D Feature 1.3
FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮
ArcFace (2015) • Softmax ؔ + Cross Entropy ಉ͡ը૾ؒͷڑΛখ͘͞ɺ ҟͳΔը૾ؒͷڑΛେ͖͘͢Δ
Α͏ʹઃܭ͞Ε͍ͯͳ͍
ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s?
usp=sharing
ݱঢ়Α͘ΘΕΔσʔληοτ • LFW 6000ਓͰ1ສຕ • VGGFace2 Celebͷࣸਅ Crop
Bounding Box͖ ެ։͞Ε͍͕ͯͨɺআ VGG FaceͷΈ༻Մೳ • MS-Celeb-1M 69ສͷਓؒ 500ສຕ Ұൠͷਓ͓ࣸͬͯΓݱࡏඇެ։
ݱঢ়ͷσʔληοτͷ 1 • (1) Cross-Pose Face Recogntion ਖ਼໘Λ͍ͨը૾͕গͳ͍ •
(2) Cross-Age Face Recognition ܦมԽ ྸΛߟྀͨ͠σʔληοτ͕࡞ • (3) Makeup Face Recognition ϝʔΫΛ͢Δͱఆ͕͍͠ • (4) NIR-VIC Face Recognition ҉͍γʔϯͰͷFRͷ
ݱঢ়ͷσʔληοτͷ 2 • (5) Low-Resolution Face Recognition ը࣭͕͍ͱ͍͠ •
(6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition ಈըͰͷԠ༻͍͠
ݱঢ়ͷσʔληοτͷ 3 • (10) 3D Face Recognition • (11) Partial
Face Recognition إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
࠷ޙʹ ͍͓ؒੈʹͳΓ·ͨ͠ɻ