当前位置: X-MOL 学术arXiv.cs.GR › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting
arXiv - CS - Graphics Pub Date : 2024-04-01 , DOI: arxiv-2404.01168
Jiarui Meng, Haijie Li, Yanmin Wu, Qiankun Gao, Shuzhou Yang, Jian Zhang, Siwei Ma

3D Gaussian Splatting (3DGS) has marked a significant breakthrough in the realm of 3D scene reconstruction and novel view synthesis. However, 3DGS, much like its predecessor Neural Radiance Fields (NeRF), struggles to accurately model physical reflections, particularly in mirrors that are ubiquitous in real-world scenes. This oversight mistakenly perceives reflections as separate entities that physically exist, resulting in inaccurate reconstructions and inconsistent reflective properties across varied viewpoints. To address this pivotal challenge, we introduce Mirror-3DGS, an innovative rendering framework devised to master the intricacies of mirror geometries and reflections, paving the way for the generation of realistically depicted mirror reflections. By ingeniously incorporating mirror attributes into the 3DGS and leveraging the principle of plane mirror imaging, Mirror-3DGS crafts a mirrored viewpoint to observe from behind the mirror, enriching the realism of scene renderings. Extensive assessments, spanning both synthetic and real-world scenes, showcase our method's ability to render novel views with enhanced fidelity in real-time, surpassing the state-of-the-art Mirror-NeRF specifically within the challenging mirror regions. Our code will be made publicly available for reproducible research.

中文翻译:

Mirror-3DGS:将镜面反射纳入 3D 高斯泼溅

3D 高斯溅射 (3DGS) 标志着 3D 场景重建和新颖视图合成领域的重大突破。然而,3DGS 与其前身神经辐射场 (NeRF) 非常相似,难以准确模拟物理反射,尤其是在现实世界场景中无处不在的镜子中。这种疏忽错误地将反射视为物理上存在的独立实体,导致不同视点之间的重建不准确和反射特性不一致。为了解决这一关键挑战,我们引入了 Mirror-3DGS,这是一种创新的渲染框架,旨在掌握镜子几何形状和反射的复杂性,为生成逼真的镜子反射铺平道路。 Mirror-3DGS巧妙地将镜子属性融入到3DGS中,利用平面镜成像原理,打造出镜后观察的镜像视点,丰富了场景渲染的真实感。涵盖合成场景和真实世界场景的广泛评估展示了我们的方法能够以增强的实时保真度渲染新颖的视图,特别是在具有挑战性的镜像区域中超越了最先进的 Mirror-NeRF。我们的代码将公开用于可重复的研究。
更新日期:2024-04-02
down
wechat
bug