Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
GNeRF: GAN-based Neural Radiance Field without ...
Search
peisuke
December 12, 2021
Technology
1
690
GNeRF: GAN-based Neural Radiance Field without Posed Camera
第9回全日本コンピュータビジョン勉強会
ICCV2021論文読み回発表資料
GNeRF: GAN-based Neural Radiance Field without Posed Camera
peisuke
December 12, 2021
Tweet
Share
More Decks by peisuke
See All by peisuke
LangGraphで始めるマルチエージェントシステム
peisuke
13
3.7k
AutoGenで作るLLM Agen
peisuke
1
1.2k
Self-RAG: Learning to Retrieve, Generate and Critique through Self-Reflections
peisuke
9
1.4k
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
peisuke
0
7.9k
LangChain Toolsの運用と改善
peisuke
4
2.5k
TTS Skins: Speaker Conversion via ASR
peisuke
0
360
A Quantum Computational Approach to Correspondence Problems on Point Sets
peisuke
0
650
F0-Consistent Many-to-many Non-parallel Voice Conversion via Conditional Autoencoder
peisuke
0
160
YOLACT real-time instance segmentation
peisuke
1
230
Other Decks in Technology
See All in Technology
20分で分かるIAM全機能 (拡大版) / 20240903-jawsug-yokohama-iam
opelab
3
120
実践的なバグバウンティ入門
scgajge12
4
2.1k
エンジニア採用ノウハウ0から継続的な採用に至るまで / Try recruiting engineers
ohageeq
0
130
AWS IAM Identity Center議論会 〜 認証認可結合モデルと認証認可分離モデル / 20240827-jawsug-arch-iam_identity_center
opelab
3
320
データウェアハウス製品のSnowflakeでPythonが動くって知ってました?
foursue
1
150
[RSJ24] Task Success Prediction for Open-Vocabulary Manipulation Based on Multi-Level Aligned Representations
keio_smilab
PRO
0
220
Dive Deep in Cloud Run: Automatic Base Image update
aoto
PRO
0
900
waitany と waitall を作った話
mrkn
0
110
いまからでも遅くない! コンテナでWebアプリケーションを 動かしてみよう(1)Gitハンズオン
nomu
0
280
LLM を現場で評価する
asei
4
680
歴史と背景から改めて振り返るVPC
shotashiratori
2
220
FastlyとfalcoでNode.jsレスな Webサーバー構築 : IPTV版 ABEMAアプリインフラ刷新 / Building web server using Fastly and falco without Node.js for IPTV ABEMA app
nodaguti
0
240
Featured
See All Featured
GraphQLとの向き合い方2022年版
quramy
43
13k
Build The Right Thing And Hit Your Dates
maggiecrowley
29
2.2k
Principles of Awesome APIs and How to Build Them.
keavy
125
16k
A Tale of Four Properties
chriscoyier
155
22k
No one is an island. Learnings from fostering a developers community.
thoeni
18
2.9k
Gamification - CAS2011
davidbonilla
79
4.9k
Music & Morning Musume
bryan
46
6k
Making Projects Easy
brettharned
113
5.8k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
363
22k
Keith and Marios Guide to Fast Websites
keithpitt
408
22k
Visualization
eitanlees
142
15k
How to Think Like a Performance Engineer
csswizardry
15
910
Transcript
GNeRF: GAN-based Neural Radiance Field without Posed Camera @peisuke 9
ABEJA Twitter @peisuke Github https://github.com/peisuke Qiita https://qiita.com/peisuke SlideShare https://www.slideshare.net/FujimotoKeisuke
• • GNeRF: GAN-based Neural Radiance Field without Posed Camera
• • NeRF • • • GAN Radiance Field • RF
NeRF • / 5 •
• • (x,y,z)T (φ1,θ1)T (φ2,θ2)T (x,y,z) φ2,θ2 (x,y,z) φ1,θ1
NeRF • • •
NeRF • NeRF in the Wild • NeRF • iNeRF
• iNeRF NeRF in the Wild BP
条件 iNeRF NeRF-- IDR GNeRF(提案⼿法) 事前学習 必要 不要 不要 不要
粗いカメラ座標 必要 必要 必要 不要 前⽅のみの制約 不要 必要 不要 不要 マスク 不要 不要 必要 不要 • •
• • • • • GAN Radiance Field • RF
• Phase A Phase B
RF • D E 3
GAN Real • • Discriminator Real • Dynamic Patch Sampling
/ 16x16 • Dynamic Patch Sampling
GAN Fake • • NeRF 16x16 • G
• 6 𝑹 = 𝑟!! 𝑟!" 𝑟!# 𝑟"! 𝑟"" 𝑟"#
𝑟#! 𝑟#" 𝑟## 𝒓 = 𝑟!! 𝑟!" 𝑟!# 𝑟"! 𝑟"" 𝑟"# $ • SO(3) NN • On the Continuity of Rotation Representations in Neural Networks
• Inversion network • Static Patch Sampling • E •
Static Patch Sampling
G G D G
• • Inversion network • refinement
• Refinement
• • • • • Photometric loss
• • Generator • NeRF • Discriminator • Instance Normalization
Spectral Normalization • Inversion network • Vision Transformer • • A • A B 1 iteration • B
• • COLMAP NeRF C+n • Refine C+r • Ground
Truth NeRF G+n • • Synthetic-NeRF image size: 400x400 DTU 500x400 • 100 • • Peak Signal-to-Noise Ratio SSIM LPIPS • / • Single TAITAN GPU 30
COLMAP •
• COLMAP Drums
難しいシーン 特徴の少ない シーン
IDR • 3D IDR • IDR • PNSR •
• COLMAP • Drums Lego COLMAP
Ablation Study • • GAN InvNet. PhaseB • • A
B A ABABABAB B
• • • COLMAP • •
• NeRF • • GAN RF • RF • •
• COLMAP