Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
顔認証・顔識別周りのサーベイ
Search
Shintaro Yoshida
March 02, 2021
2
37
顔認証・顔識別周りのサーベイ
Shintaro Yoshida
March 02, 2021
Tweet
Share
More Decks by Shintaro Yoshida
See All by Shintaro Yoshida
人が注目する箇所を当てるSaliency Detectionの最新モデル UCNet(CVPR2020)
shintaro202020
1
210
Grad-CAMの始まりのお話
shintaro202020
0
84
The Origin of Grad-CAM
shintaro202020
0
120
Featured
See All Featured
Bash Introduction
62gerente
614
210k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
137
34k
Site-Speed That Sticks
csswizardry
7
590
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
180
53k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
8
750
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.3k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.6k
Product Roadmaps are Hard
iamctodd
PRO
53
11k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
52
2.8k
Large-scale JavaScript Application Architecture
addyosmani
512
110k
[RailsConf 2023] Rails as a piece of cake
palkan
55
5.6k
Transcript
٢ా ৻ଠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)
ࠓͷѻ͏༰ • DeepFakeͷ • 2014Ҏ߱ͷจ DeepFace, FaceNet, ArcFace • ະղܾͷ՝
• ࣮
DeepFake • DeepFakeΛ༻͍ͨੈքॳͷٗ ΠΪϦεͷΤωϧΪʔձ͕ࣾ ձࣾͷϘε͔ΒͷిͰ2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe
RoganͷΛDeep FakeͰ࡞ (Χφμͷ Dessaͱ͍͏AIձࣾ) https://www.youtube.com/watch?v=DWK_iYBl8cA
إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূͱσʔληοτ • Face Identi fi cation إࣝผ 1 ର
ଟͷྨࣅఆ Ex) Google PhotoFacebookͷը૾ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 1 ର 1ͷྨࣅఆ Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
إೝূٕज़ͷਐԽ
إೝূٕज़ͷਐԽ ࠓίί!!
ϞσϧͱLossͷਐԽ
DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ
3D Aligned ը૾༻
DeepFace(2014) • ֶशͷࡍʹɺྨ(Cross Entropy Loss, 4030 Class, SFC Dataset) •
ධՁͷࡍʹɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥεྨ (Face Veri fi cationͷͨΊ)
DeepFace(2014) • ಛྔϕʔεͱൺͯ1%ͷੑೳ্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰධՁ
FaceNet (2015) • ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛྔΛׂΓͯ • Triplet LossΛ༻ • ࣮ࡍʹɺHardest PositiveͰͳ͘ɺશϖΞͷΈ߹ΘͤΛ༻͍͍ͯΔ
Better Convergence
FaceNet (2015) • 1ͭͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭͷ݁Ռ : LFWσʔληοτͰSOTA
FaceNet (2015) • ਪͷྲྀΕ FaceNet L2Norm 160x160 ը૾A 512D Feature
FaceNet 160x160 ը૾B 512D Feature 1.3
FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮
ArcFace (2015) • Softmax ؔ + Cross Entropy ಉ͡ը૾ؒͷڑΛখ͘͞ɺ ҟͳΔը૾ؒͷڑΛେ͖͘͢Δ
Α͏ʹઃܭ͞Ε͍ͯͳ͍
ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s?
usp=sharing
ݱঢ়Α͘ΘΕΔσʔληοτ • LFW 6000ਓͰ1ສຕ • VGGFace2 Celebͷࣸਅ Crop
Bounding Box͖ ެ։͞Ε͍͕ͯͨɺআ VGG FaceͷΈ༻Մೳ • MS-Celeb-1M 69ສͷਓؒ 500ສຕ Ұൠͷਓ͓ࣸͬͯΓݱࡏඇެ։
ݱঢ়ͷσʔληοτͷ 1 • (1) Cross-Pose Face Recogntion ਖ਼໘Λ͍ͨը૾͕গͳ͍ •
(2) Cross-Age Face Recognition ܦมԽ ྸΛߟྀͨ͠σʔληοτ͕࡞ • (3) Makeup Face Recognition ϝʔΫΛ͢Δͱఆ͕͍͠ • (4) NIR-VIC Face Recognition ҉͍γʔϯͰͷFRͷ
ݱঢ়ͷσʔληοτͷ 2 • (5) Low-Resolution Face Recognition ը࣭͕͍ͱ͍͠ •
(6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition ಈըͰͷԠ༻͍͠
ݱঢ়ͷσʔληοτͷ 3 • (10) 3D Face Recognition • (11) Partial
Face Recognition إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
࠷ޙʹ ͍͓ؒੈʹͳΓ·ͨ͠ɻ