Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Synthesizing Human Images in SIGGRAPH Asia 2021
Search
Udon
February 27, 2022
Technology
0
180
Synthesizing Human Images in SIGGRAPH Asia 2021
SIGGRAPH Asia 2021の「Synthesizing Human Images」セッションに採択された5本の論文を紹介します.
Udon
February 27, 2022
Tweet
Share
More Decks by Udon
See All by Udon
MIRU2024_招待講演_RALF_in_CVPR2024
udonda
1
400
[CVPR24 Oral] Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation
udonda
0
330
Survey of Image Editing with GANs in SIGGRAPH'21
udonda
2
900
Network-to-Network Translation with Conditional Invertible Neural Networks
udonda
1
300
DARTS: Differentiable Architecture Search
udonda
0
150
Other Decks in Technology
See All in Technology
AIのグローバルトレンド 2025 / ai global trend 2025
kyonmm
PRO
1
120
人に寄り添うAIエージェントとアーキテクチャ #BetAIDay
layerx
PRO
8
2k
【Λ(らむだ)】最近のアプデ情報 / RPALT20250729
lambda
0
230
LLMでAI-OCR、実際どうなの? / llm_ai_ocr_layerx_bet_ai_day_lt
sbrf248
0
430
データ基盤の管理者からGoogle Cloud全体の管理者になっていた話
zozotech
PRO
0
350
「Roblox」の開発環境とその効率化 ~DAU9700万人超の巨大プラットフォームの開発 事始め~
keitatanji
0
110
Strands Agents & Bedrock AgentCoreを1分でおさらい
minorun365
PRO
6
240
ビジネス文書に特化した基盤モデル開発 / SaaSxML_Session_2
sansan_randd
0
260
マルチモーダル基盤モデルに基づく動画と音の解析技術
lycorptech_jp
PRO
4
530
dipにおけるSRE変革の軌跡
dip_tech
PRO
1
230
Perlアプリケーションで トレースを実装するまでの 工夫と苦労話
masayoshi
1
410
反脆弱性(アンチフラジャイル)とデータ基盤構築
cuebic9bic
3
160
Featured
See All Featured
How to Think Like a Performance Engineer
csswizardry
25
1.8k
Intergalactic Javascript Robots from Outer Space
tanoku
272
27k
Designing Experiences People Love
moore
142
24k
The Cost Of JavaScript in 2023
addyosmani
51
8.7k
YesSQL, Process and Tooling at Scale
rocio
173
14k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Optimising Largest Contentful Paint
csswizardry
37
3.4k
GraphQLの誤解/rethinking-graphql
sonatard
71
11k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
The Invisible Side of Design
smashingmag
301
51k
For a Future-Friendly Web
brad_frost
179
9.9k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.4k
Transcript
%BJDIJ)PSJUBൃද 4*((3"1)"TJB Synthesizing Human Images Session
୭ʁ 2
Synthesizing Human Images Session • URL: https://sa2021.siggraph.org/jp/attend/technical-papers/8/session/73 • 5ຊͷจ͕࠾ •
Barbershop • EyelashNet • Neural Actor • Pose with Style • SketchHairSalon 3
4
Barbershop ઃఆ — GAN inversion-based hair editing 5 Face identity
Generated image Hair color condition Hair texture condition Hair shape condition
• ͱإͷؒͷϒϨϯυΞʔςΟϑΝΫτΛੜͤ͡͞ͳ͍ੜ Barbershop ݁Ռ 6
Barbershop ख๏ 7 ͷલΛ” ” W+ F ͷޙΛ” ” W+
S C = (F, S) Face Hair ೖྗ ࠶ߏ Swap S ֤ೖྗ݅ ͷద༻ Blend ݟͨͷ࠷దԽ Face Identity Hair style
Barbershop ੍ݶ 8 • ᶃϚεΫ͕ͳ͍෦͋·Γ៉ྷʹ ͳΒͳ͍ • ᶄᶆϐΞεͷΑ͏ͳαϯϓϧ ແཧ •
ᶅᶇإΛःΔΑ͏ͳੜແཧ
9
EyelashNet ಈػ 10 ·ͭ͛ͷ3D࠶ߏࠔ ʢमਖ਼ʹ5࣌ؒఔඞཁʣ ·ͭ͛ͷMattingΛߦ͍ আڈ͔ͯ͠Βͷ3D࠶ߏ៉ྷʹͰ͖Δ with ·ͭ͛ w/o
·ͭ͛
EyelashNet ·ͭ͛σʔληοτ࡞ͷ 11 • ·ͭ͛άϦʔϯόοΫࡱӨͷΑ͏ͳํ๏ͰࡱӨͰ͖ͳ͍ • എܠʹͰͳ͘ɼલܠʹʢ·ͭ͛ʹܬޫృྉΛృͬͯࡱӨʣ
EyelashNet ·ͭ͛σʔληοτ࡞ͷ 12 • 2ຕͷࡱӨͷؒʹਓಈ͍ͯ͠·͏ͷͰ…ʁʁ • Optical flowͰҐஔ߹Θͤ XPҐஔ߹Θͤ XҐஔ߹Θͤ
EyelashNet ݁Ռ 13
14
Neural Actor ֓ཁ • ҙͷࢹɾ੍ޚՄೳͳϙʔζͰͷߴ࣭ͳਓؒ߹ͷͨΊͷख๏ • ϙʔζ<->ඪ४ۭؒͷมΛֶश 15
16 Neural Actor ܇࿅
NeuralActor ৽نࢹ߹࣮ݧ 17 ఆྔൺֱ ʢFID͕ۃʹྑ͍; γʔέϯεͰݟͨ࣌ʹ༏ΕΔʣ ఆੑൺֱ
18
Pose with Style ֓ཁ 19 • UVϚοϓ͕݅ͳStyleGAN2ʹΑΔશը૾ੜ ೖྗ ग़ྗ ਓੜ
Ծࢼண ೖྗ ग़ྗ
Pose with Style ܇࿅ 20 Ґஔ߹Θͤ 5BSHFUDPPSE HFOFSBUPS
Pose with Style ࣮ݧ — vs. Img-to-imgมϞσϧͱͷൺֱ 21 • ߴप៉ྷʹ
ੜ • ͷ༷ • إͷৄࡉ
Pose with Style ࣮ݧ — vs. StyleGAN-basedϞσϧͱͷൺֱ 22 • StylePoseGAN[Liu+
arXiv21] • Pose with StyleͷUVϚοϓʹର͢ ΔΛ΄ͱΜͲແͨ͘͠Α͏ͳ ख๏ • UVϚοϓΛ࠷େݶར༻͢Εߴ࣭
23
SketchHairSalon σʔληοτ࡞ 24 ೖྗ soft mask ࣗಈੜ खಈ •
soft maskMattingख๏Ͱ ਪ • ࣗಈੜͰฤΈࠐΈͳͲΛ දݱͰ͖ͳ͍ • खಈσʔληοτ͕ඞਢ
SketchHairSalon σʔληοτ࡞ 25 • ਪ࣌ʹ{ฤΈࠐΈ, ςΫενϟ}Λॻ͔ͤΔͷඇৗʹ໘͍͘͞ͷͰ…? • ύϥϝτϦοΫͳදݱؔΛఏҊ ฤΈࠐΈ ඇฤΈࠐΈ
SketchHairSalon ख๏ 26
SketchHairSalon ࣮ݧ 27
SketchHairSalon ੍ݶ 28 • Ԟߦ͖͕ඞཁͳܕݫ͍͠ • ແݶໟଋܕϑϥοτ ͳੜ • רࢴֶशαϯϓϧͱಉ͡
ੜ • Ԟߦ͖ߟྀͨ͠ੜͰղܾ(?)
·ͱΊ • ਓυϝΠϯͷΛѻ͏5ຊͷจΛհ • ฤू • Animatable NeRF • ·ͭ͛
• શੜ • ݻ༗ͷΛͲ͏ղܾ͢Δ͔ʁΛ͔ͳΓ۩ମతͳΞϓϩʔνͰղܾ͍ͯ͠Δ จ͕ଟ͔ͬͨ 29 Synthesizing Human Images Session