Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
GNeRF: GAN-based Neural Radiance Field without ...
Search
peisuke
December 12, 2021
Technology
1
770
GNeRF: GAN-based Neural Radiance Field without Posed Camera
第9回全日本コンピュータビジョン勉強会
ICCV2021論文読み回発表資料
GNeRF: GAN-based Neural Radiance Field without Posed Camera
peisuke
December 12, 2021
Tweet
Share
More Decks by peisuke
See All by peisuke
AI for Kids:小学生に画像認識を教えてみた話
peisuke
1
17
LangGraphで始めるマルチエージェントシステム
peisuke
13
4.3k
Self-RAG: Learning to Retrieve, Generate and Critique through Self-Reflections
peisuke
9
1.5k
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
peisuke
0
11k
LangChain Toolsの運用と改善
peisuke
4
2.6k
TTS Skins: Speaker Conversion via ASR
peisuke
0
400
A Quantum Computational Approach to Correspondence Problems on Point Sets
peisuke
0
710
F0-Consistent Many-to-many Non-parallel Voice Conversion via Conditional Autoencoder
peisuke
0
190
YOLACT real-time instance segmentation
peisuke
1
290
Other Decks in Technology
See All in Technology
ここはMCPの夜明けまえ
nwiizo
28
9.8k
サーバレス、コンテナ、データベース特化型機能をご紹介。CloudWatch をもっと使いこなそう!
o11yfes2023
0
180
日経電子版 for Android の技術的課題と取り組み(令和最新版)/android-20250423
nikkei_engineer_recruiting
0
410
AWSLambdaMCPServerを使ってツールとMCPサーバを分離する
tkikuchi
1
3k
Ops-JAWS_Organizations小ネタ3選.pdf
chunkof
2
170
システムとの会話から生まれる先手のDevOps
kakehashi
PRO
0
290
4/16/25 - SFJug - Java meets AI: Build LLM-Powered Apps with LangChain4j
edeandrea
PRO
2
120
Cross Data Platforms Meetup LT 20250422
tarotaro0129
1
690
LiteXとオレオレCPUで作る自作SoC奮闘記
msyksphinz
0
690
コスト最適重視でAurora PostgreSQLのログ分析基盤を作ってみた #jawsug_tokyo
non97
0
380
ソフトウェア開発現代史: "LeanとDevOpsの科学"の「科学」とは何か? - DORA Report 10年の変遷を追って - #DevOpsDaysTokyo
takabow
0
390
Running JavaScript within Ruby
hmsk
3
330
Featured
See All Featured
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
331
21k
Faster Mobile Websites
deanohume
306
31k
Building Applications with DynamoDB
mza
94
6.3k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
9
760
Unsuck your backbone
ammeep
670
57k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
30
2k
Why You Should Never Use an ORM
jnunemaker
PRO
55
9.3k
Documentation Writing (for coders)
carmenintech
69
4.7k
Bash Introduction
62gerente
611
210k
Code Reviewing Like a Champion
maltzj
522
40k
Transcript
GNeRF: GAN-based Neural Radiance Field without Posed Camera @peisuke 9
ABEJA Twitter @peisuke Github https://github.com/peisuke Qiita https://qiita.com/peisuke SlideShare https://www.slideshare.net/FujimotoKeisuke
• • GNeRF: GAN-based Neural Radiance Field without Posed Camera
• • NeRF • • • GAN Radiance Field • RF
NeRF • / 5 •
• • (x,y,z)T (φ1,θ1)T (φ2,θ2)T (x,y,z) φ2,θ2 (x,y,z) φ1,θ1
NeRF • • •
NeRF • NeRF in the Wild • NeRF • iNeRF
• iNeRF NeRF in the Wild BP
条件 iNeRF NeRF-- IDR GNeRF(提案⼿法) 事前学習 必要 不要 不要 不要
粗いカメラ座標 必要 必要 必要 不要 前⽅のみの制約 不要 必要 不要 不要 マスク 不要 不要 必要 不要 • •
• • • • • GAN Radiance Field • RF
• Phase A Phase B
RF • D E 3
GAN Real • • Discriminator Real • Dynamic Patch Sampling
/ 16x16 • Dynamic Patch Sampling
GAN Fake • • NeRF 16x16 • G
• 6 𝑹 = 𝑟!! 𝑟!" 𝑟!# 𝑟"! 𝑟"" 𝑟"#
𝑟#! 𝑟#" 𝑟## 𝒓 = 𝑟!! 𝑟!" 𝑟!# 𝑟"! 𝑟"" 𝑟"# $ • SO(3) NN • On the Continuity of Rotation Representations in Neural Networks
• Inversion network • Static Patch Sampling • E •
Static Patch Sampling
G G D G
• • Inversion network • refinement
• Refinement
• • • • • Photometric loss
• • Generator • NeRF • Discriminator • Instance Normalization
Spectral Normalization • Inversion network • Vision Transformer • • A • A B 1 iteration • B
• • COLMAP NeRF C+n • Refine C+r • Ground
Truth NeRF G+n • • Synthetic-NeRF image size: 400x400 DTU 500x400 • 100 • • Peak Signal-to-Noise Ratio SSIM LPIPS • / • Single TAITAN GPU 30
COLMAP •
• COLMAP Drums
難しいシーン 特徴の少ない シーン
IDR • 3D IDR • IDR • PNSR •
• COLMAP • Drums Lego COLMAP
Ablation Study • • GAN InvNet. PhaseB • • A
B A ABABABAB B
• • • COLMAP • •
• NeRF • • GAN RF • RF • •
• COLMAP