Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Ideas for defeating Anti-Deep-Fakes
Search
Ren Kimura
November 14, 2024
Programming
0
40
Ideas for defeating Anti-Deep-Fakes
[email protected]
Ren Kimura
November 14, 2024
Tweet
Share
More Decks by Ren Kimura
See All by Ren Kimura
セキュリティベンチャーのリスク管理
rkx1209
0
83
ファジング+トリアージ技術を用いた脆弱性解析自動化
rkx1209
0
71
Introduction to Fuzzing
rkx1209
6
4.2k
ARM TrustZone エクスプロイト入門
rkx1209
7
8k
The Game is Over. Nintendo switch has been totally compromised
rkx1209
9
5.1k
インサイドNintendo Switch
rkx1209
18
13k
More efficient remote debugging with Thin Hypervisor
rkx1209
3
2.5k
Reverse Debugging with radare2
rkx1209
6
1.9k
カーネルエクスプロイトによるシステム権限奪取
rkx1209
13
7.7k
Other Decks in Programming
See All in Programming
リストビュー画面UX改善の振り返り
splcywolf
0
150
ComposeでWebアプリを作る技術
tbsten
0
110
サービスクラスのありがたみを発見したときの思い出 #phpcon_odawara
77web
4
680
PHPで書いたAPIをGoに書き換えてみた 〜パフォーマンス改善の可能性を探る実験レポート〜
koguuum
0
170
State of Namespace
tagomoris
4
1.8k
生成AIを使ったQAアプリケーションの作成 - ハンズオン補足資料
oracle4engineer
PRO
3
240
AWSで雰囲気でつくる! VRChatの写真変換ピタゴラスイッチ
anatofuz
0
160
Making TCPSocket.new "Happy"!
coe401_
1
1.6k
ミリしらMCP勉強会
watany
4
770
AI Coding Agent Enablement - エージェントを自走させよう
yukukotani
14
6.1k
七輪ライブラリー: Claude AI で作る Next.js アプリ
suneo3476
1
110
国漢文混用体からHolloまで
minhee
1
190
Featured
See All Featured
How STYLIGHT went responsive
nonsquared
99
5.5k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
104
19k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
KATA
mclloyd
29
14k
Adopting Sorbet at Scale
ufuk
76
9.3k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
47
2.7k
How to Think Like a Performance Engineer
csswizardry
23
1.5k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
23
2.6k
Imperfection Machines: The Place of Print at Facebook
scottboms
267
13k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
178
53k
Being A Developer After 40
akosma
91
590k
Practical Orchestrator
shlominoach
186
11k
Transcript
Ideas for defeating Anti-Deep-Fakes Ren Kimura (@RKX1209) AVTOKYO 2024.11.14 Prepare
for the next cyber threat
2 whoami Founder & CEO of Ricerca Security, Inc. Product
Manager (PdM) Ren Kimura (X: @RKX1209) Interested in : Bizdev and Vulnerability Research (VR)
Face Synthesis 3 What is the “Deep Fake” = Techniques
to generate fake media (video, image, voice…) Face manipulation techniques for generating fake videos/images. Face Swap Attribute Manipulation Expression Swap
Name cosine dist login Admin’s voice 0.0 N/A Text to
Speach 0.08 ✔ Another person’s voice 0.69 ☓ 4 DeepFake demo Login_With_Voice_Verification Voice Cloning
5 Any perfect verifier exists? Media data movie.mp4 image.jpg voice.wav
verifier “Real” “Fake”
6 Verification methods Detection Science & Tech Spotlight: Combating Deepfakes
(GAO-24-107292) Authentication • Bit patterns • Color abnormalities • Facial/Vocal inconsistencies “Recorded by camera.”
7 C2PA (Coalition for Content Provenance and Authenticity) original.jpg •
2024-09-04 21:00 • Created: Canon EOS R1 … C2PA meta data c2pa.actions hash function encrypt function encrypted hash Private key in EOS R1
8 edited.jpg C2PA meta data c2pa.actions c2pa.ingredients • original.jpg hash
function encrypt function encrypted hash Private key in Adobes account • 2024-09-10 12:54 • Edited: Adobe Photoshop • Actions: Crop, Frame… … Chain of metadata
9 Chain of trust original.jpg edited.jpg C2PA metadata “Recorded by
Canon EOS R1“ X.509 certificate chain “Edited by Adobe Photoshop“ parent Editor (adobe account)
10 C2PA signing by Generative AI services image.webp image.webp C2PA
metadata “Created by DALL-E“ X.509 certificate chain “Use original one as an ingredient“ parent
11 "Captured with a camera" (~2024.10.15) “I am really at
the zoo” https://www.youtube.com/watch?v=gfjgRHtDa38
12 Guessing from their official help page. original.mp4 “Recorded by
Canon EOS R1“ upload ・・・・ Whitelist “They are cameras” How does it work
13 ❌ Generative AI: “No camera” gen_by_sora.mp4 “Created by OpenAIs
SORA“ upload C2PA metadata X.509 certificate chain ・・・・ Whitelist “They are cameras” Not matched!
14 ✔"Captured with a camera" “Recorded by Canon EOS R1
“ “Edited by Adobe Premiere Pro“ ・・・・ Whitelist “They are cameras” upload Get original mp4 by social engineering, crawling…
15 Air gapping scenario edited.mp4 faked.mp4 C2PA metadata “Recorded by
Canon EOS R1 “ X.509 certificate chain Record over the air
16 ❌ “No camera” edited.mp4 faked.mp4 C2PA metadata “Recorded by
Sony α7 IV “ X.509 certificate chain SONY metadata “It may record 2D flattened area“ Record 3d-depth over the air
17 My approach:
18 Perfect verifier doesn’t exist Media data movie.mp4 image.jpg voice.wav
verifier “Real” “Fake”
19 What should Blue/White-team do? “A Guide to Preparing and
Responding to Deepfake Events” OWASP TOP10 LLM App&GenAI (2024.10)
20 What should Blue/White-team do? Financial gain through fraud by
impersonation. Impersonation for cyberattacks Job Interview Fraud Mis/Dis/Mal Information
21 Conclusion Detection and Authentication methods are not perfect Proposed
a new technique to bypass C2PA authentication Defense-in-depth and layered controls are required.
None