IGSW

Multi-Weather Urban Scene Reconstructionwith Intrinsic-Decoupled Gaussian Splatting

Zhongquan Wang, Long Cao, Peijia Xie, Senlei Ma, Jie Li, Guofa Li

College of Mechanical and Vehicle Engineering, Chongqing University

Comparison Display

Abstract

High-fidelity weather editing of 4D scenes can support end-to-end training and closed-loop simulation for autonomous driving. Combining generative image editing with dynamic Gaussian representations enables multi-weather scene reconstruction, but weather-edited images often contain structural distortions. Directly fitting their appearance may propagate errors from teacher images into the reconstructed 4D scene, compromising the original scene structure and temporal continuity. To address these challenges, we propose IGSW, a two-stage framework that combines intrinsic-decoupled 4D Gaussian scene modeling with structure-preserving weather refinement. In Stage I, background Gaussian appearance is decomposed into weather-shared albedo and normals and weather-specific irradiance and residuals. Weather teacher images generated by a diffusion-based image editing model and intrinsic maps estimated by a diffusion-based inverse renderer provide feature-level soft supervision for stable structure and illumination changes. In Stage II, a structure-preservation gate combines semantic conflicts with cross-weather intrinsic discrepancies to suppress unreliable teacher regions. Per-Gaussian weather transport variables and target-weather branches then strengthen the desired weather appearance over the intrinsic-decoupled scene. Experiments on nuScenes and Waymo show that IGSW achieves the highest content similarity and semantic consistency and the lowest temporal error among the compared methods, while retaining pronounced weather-dependent illumination and atmosphere.

Pipeline

IGSW overview. First, (a) we use Qwen-Image as a text-guided image weather background editor to generate teacher images that transform original driving-scene images into weather-edited images. Then, (b) we adopt a diffusion-based inverse-rendering model built on Stable Diffusion 3.5 to obtain inverse-rendering outputs for both original and weather-edited images, including albedo, normal, and irradiance maps, which serve as supervisory inputs for our intrinsic-decoupled Gaussians. Next, (c) we intrinsically decompose the 4DGS scene and introduce an intrinsic-decoupled Gaussian representation, separating the intrinsic 4DGS appearance into weather-shared albedo and normal and weather-specific irradiance and residual. Finally, (d) on top of this intrinsic-decoupled 4DGS representation, we propose intrinsic-preserving Gaussian weather refinement. A geometric structure gate maintains geometric consistency between the original and weather scenes, while weather-transport parameters further enhance weather changes and illumination variations in the intrinsic-decoupled Gaussian scene.

Main comparison

Ablation Experiments

Module ablation

Component ablation