Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation

1Keio University, 2The University of Tokyo
*Equal contribution
Comparison with existing methods. Existing approaches optimize each camera location independently and suffer from blur and geometric inconsistency in sparse multi-location settings. In contrast, Stitch4D reconstructs a unified 4D representation across locations.

Sparse multi-location 4D reconstruction with Stitch4D. Existing methods produce spatially fragmented reconstructions from distributed urban panoramas, while Stitch4D bridges missing regions to recover a unified 4D scene for novel-view rendering.

Reconstruction Videos

Free-viewpoint Rendering — Urban Area 1

Free-viewpoint Rendering — Urban Area 2

Scalability to Multiple Videos

Stitch4D scales to an arbitrary number of input videos, enabling 4D reconstruction over larger spatial regions by stitching additional panoramic observations.

Free-viewpoint Rendering — Urban Area 1 (Additional)

Free-viewpoint Rendering — Urban Area 2 (Additional View 1)

Free-viewpoint Rendering — Urban Area 2 (Additional View 2)

Abstract

Dynamic urban environments are often captured by cameras placed at spatially separated locations with little or no view overlap. However, most existing 4D reconstruction methods assume densely overlapping views and struggle under sparse multi-location observations, producing unstable reconstructions in unobserved intermediate regions. To address this practical yet underexplored setting, we propose Stitch4D, a unified 4D reconstruction framework that compensates for missing spatial coverage in sparsely observed urban environments. Stitch4D synthesizes intermediate bridge views between distant camera locations and jointly optimizes real and synthesized observations in a unified coordinate frame with inter-location consistency constraints. By recovering intermediate spatial coverage before optimization, Stitch4D mitigates geometric collapse and improves reconstruction stability in sparse regions. To evaluate this setting, we introduce Urban Sparse 4D (U-S4D), a controlled CARLA-based benchmark for free-viewpoint reconstruction under sparse multi-location configurations. Experiments on U-S4D show that Stitch4D consistently outperforms representative 4D reconstruction baselines in image-quality metrics. These results suggest that recovering intermediate spatial coverage is an effective strategy for stabilizing 4D reconstruction in sparse urban environments.

SP4DR: Sparse Multi-Location 4D Reconstruction

Example of the SP4DR problem.

Method

Overall architecture of Stitch4D

Overall architecture of Stitch4D.

Overview of MVBM

Multi-View Bridging Module (MVBM).

Structural overview of MVJOM

Multi-Video Joint Optimization Module (MVJOM).

U-S4D Benchmark

Overview of the U-S4D benchmark

Quantitative Results

Full Reconstruction Setting

Method Trajectory Interpolation Seen-viewpoints
PSNR [dB] ↑ SSIM ↑ LPIPS ↓ PSNR [dB] ↑ SSIM ↑ LPIPS ↓
Urban scene reconstruction methods
PVG 12.84 0.58 0.76 13.76 0.69 0.57
Street Gaussians 11.85 0.56 0.75 16.18 0.72 0.54
General 4D reconstruction methods
4DGS 11.51 0.28 0.84 15.79 0.58 0.84
SpacetimeGS 12.91 0.55 0.67 17.75 0.79 0.33
FreeTimeGS 11.75 0.52 0.75 16.70 0.71 0.41
Stitch4D (Ours) 15.31 0.60 0.51 26.34 0.92 0.13

Temporal Split Setting

Method Trajectory Interpolation Seen-viewpoints
PSNR [dB] ↑ SSIM ↑ LPIPS ↓ PSNR [dB] ↑ SSIM ↑ LPIPS ↓
Urban scene reconstruction methods
PVG 12.67 0.57 0.77 13.81 0.69 0.58
Street Gaussians 11.49 0.53 0.75 17.38 0.73 0.51
General 4D reconstruction methods
4DGS 10.54 0.25 0.80 13.78 0.52 0.64
SpacetimeGS 12.47 0.54 0.69 17.49 0.78 0.33
FreeTimeGS 11.84 0.53 0.74 16.53 0.71 0.41
Stitch4D (Ours) 14.88 0.59 0.52 24.63 0.90 0.15

Qualitative Results

Trajectory Interpolation (Full Reconstruction)

Qualitative results for trajectory interpolation

Temporal Split (Seen-viewpoints) — Urban Area 1

Qualitative results for temporal split UA1

Temporal Split (Seen-viewpoints) — Urban Area 3

Qualitative results for temporal split UA3

Real-world Qualitative Results

Real-world qualitative results

Additional Qualitative Results

Trajectory Interpolation (Additional)

Additional trajectory interpolation

Seen-viewpoints — Urban Area 1 (Additional)

UA1 seen viewpoints

Seen-viewpoints — Urban Area 2

UA2 seen viewpoints

Free-viewpoint Trajectory — Urban Area 1

Rotateshow UA1

Free-viewpoint Trajectory — Urban Area 2

Rotateshow UA2

Full Trajectory — Urban Area 1

UA1 trajectory

Full Trajectory — Urban Area 2

UA2 trajectory

Three-Input Reconstruction — Rotateshow

3-input rotateshow

Three-Input Reconstruction — LBRF

3-input LBRF

Real-world qualitative results — Additional

Real-world qualitative results

BibTeX

@article{kogure2026stitch4d,
  title={Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation},
  author={Kogure, Hina and Katsumata, Kei and Miyanishi, Taiki and Sugiura, Komei},
  journal={arXiv preprint arXiv:2604.07923},
  year={2026}
}