Splats in Splats: Embedding Invisible 3D Watermark within Gaussian Splatting

Yijia Guo1*, Wenkai Huang2,3*, Yang Li1, Gaolei Li2,3,, Hang Zhang5, Liwen Hu1, Jianhua Li2,3, Tiejun Huang1, Lei Ma1,4,
1National Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University 2School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University 3Shanghai Key Laboratory of Integrated Administration Technologies for Information Security, Shanghai Jiao Tong University 4National Biomedical Imaging Center, Peking University 5Cornell University *Equal Contribution, Corresponding Author

Abstract

3D Gaussian splatting (3DGS) has demonstrated impressive 3D reconstruction performance with explicit scene representations. Given the widespread application of 3DGS in 3D reconstruction and generation tasks, there is an urgent need to protect the copyright of 3DGS assets. However, existing copyright protection techniques for 3DGS overlook the usability of 3D assets, posing challenges for practical deployment. Here we describe WaterGS, the first 3DGS watermarking framework that embeds 3D content in 3DGS itself without modifying any attributes of the vanilla 3DGS. To achieve this, we take a deep insight into spherical harmonics (SH) and devise an importance-graded SH coefficient encryption strategy to embed the hidden SH coefficients. Furthermore, we employ a convolutional autoencoder to establish a mapping between the original Gaussian primitives' opacity and the hidden Gaussian primitives' opacity. Extensive experiments indicate that WaterGS significantly outperforms existing 3D steganography techniques, with 5.31% higher scene fidelity and 3X faster rendering speed, while ensuring security, robustness, and user experience.

Overview of WaterGS

Interpolate start reference image.

Comparison With Baselines

Interpolate start reference image.

Hidden NVS Results

Original NVS Results