UW-3DGS: Unveiling Underwater Scenes and Scattering Media through 3D Gaussian Splatting

Curasao

RedSea (L: Underwater R: No water)

Panama

Abstract

3D Gaussian Splatting (3DGS) have set new benchmarks in reconstructing scenes from multi-view images. However, its application to scenes with scattering media like water or fog has been underexplored. Reconstructing images or scenes affected by scattering media is an ill-posed problem, as rendering the image requires knowing multiple physical attributes. In this paper, we propose a novel pipeline, UW-3DGS, to efficiently approximate the physical attributes of scattering media by learning an underwater image formation model and reconstructing underwater 3D scenes without water interference using a proposed Self-Pruning Supervision Branch with 3DGS. Experiments on real underwater scenes demonstrate its ability to render State-of-The-Art high-quality novel views of underwater scenes (with water optionally present), including essential details like seabed topography and vegetation, which are crucial for marine engineering. Quantitatively, our method is approximately 100 times more efficient in training and achieves a PSNR of 0.836 higher than SeaThru-NeRF, providing a more effective pipeline for underwater scene reconstruction and potential robotics applications.

Overall Pipeline of UW-3DGS

overview



Online Demo Scenes (Click below buttons to render in real-time)
Curasao reconstructed by 3DGS
Panamas reconstructed by 3DGS
JapaneseGradens-RedSea reconstructed by 3DGS
Curasao reconstructed by Ours (For 3D reconstruction and no water image rendering)
Panama reconstructed by Ours (For 3D reconstruction and no water image rendering)
JapaneseGradens-RedSea reconstructed by Ours (For 3D reconstruction and no water image rendering)
Curasao reconstructed by Ours w/ postp. Self-Pruning Supervision Loss (For ablation study)
Panama reconstructed by Ours w/ postp. Self-Pruning Supervision Loss (For ablation study)
JapaneseGradens-RedSea reconstructed by Ours w/ postp. Self-Pruning Supervision Loss (For ablation study)
Curasao reconstructed by Ours (For underwater image rendering)
Panama reconstructed by Ours (For underwater image rendering)
JapaneseGradens-RedSea reconstructed by Ours (For underwater image rendering)