Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation
Reconstruction Videos
Free-viewpoint Rendering — Urban Area 1
Free-viewpoint Rendering — Urban Area 2
Scalability to Multiple Videos
Stitch4D scales to an arbitrary number of input videos, enabling 4D reconstruction over larger spatial regions by stitching additional panoramic observations.
Free-viewpoint Rendering — Urban Area 1 (Additional)
Free-viewpoint Rendering — Urban Area 2 (Additional View 1)
Free-viewpoint Rendering — Urban Area 2 (Additional View 2)
Abstract
Dynamic urban environments are often captured by cameras placed at spatially separated locations with little or no view overlap. However, most existing 4D reconstruction methods assume densely overlapping views and struggle under sparse multi-location observations, producing unstable reconstructions in unobserved intermediate regions. To address this practical yet underexplored setting, we propose Stitch4D, a unified 4D reconstruction framework that compensates for missing spatial coverage in sparsely observed urban environments. Stitch4D synthesizes intermediate bridge views between distant camera locations and jointly optimizes real and synthesized observations in a unified coordinate frame with inter-location consistency constraints. By recovering intermediate spatial coverage before optimization, Stitch4D mitigates geometric collapse and improves reconstruction stability in sparse regions. To evaluate this setting, we introduce Urban Sparse 4D (U-S4D), a controlled CARLA-based benchmark for free-viewpoint reconstruction under sparse multi-location configurations. Experiments on U-S4D show that Stitch4D consistently outperforms representative 4D reconstruction baselines in image-quality metrics. These results suggest that recovering intermediate spatial coverage is an effective strategy for stabilizing 4D reconstruction in sparse urban environments.
SP4DR: Sparse Multi-Location 4D Reconstruction
Method
Overall architecture of Stitch4D.
Multi-View Bridging Module (MVBM).
Multi-Video Joint Optimization Module (MVJOM).
U-S4D Benchmark
Quantitative Results
Full Reconstruction Setting
| Method | Trajectory Interpolation | Seen-viewpoints | ||||
|---|---|---|---|---|---|---|
| PSNR [dB] ↑ | SSIM ↑ | LPIPS ↓ | PSNR [dB] ↑ | SSIM ↑ | LPIPS ↓ | |
| Urban scene reconstruction methods | ||||||
| PVG | 12.84 | 0.58 | 0.76 | 13.76 | 0.69 | 0.57 |
| Street Gaussians | 11.85 | 0.56 | 0.75 | 16.18 | 0.72 | 0.54 |
| General 4D reconstruction methods | ||||||
| 4DGS | 11.51 | 0.28 | 0.84 | 15.79 | 0.58 | 0.84 |
| SpacetimeGS | 12.91 | 0.55 | 0.67 | 17.75 | 0.79 | 0.33 |
| FreeTimeGS | 11.75 | 0.52 | 0.75 | 16.70 | 0.71 | 0.41 |
| Stitch4D (Ours) | 15.31 | 0.60 | 0.51 | 26.34 | 0.92 | 0.13 |
Temporal Split Setting
| Method | Trajectory Interpolation | Seen-viewpoints | ||||
|---|---|---|---|---|---|---|
| PSNR [dB] ↑ | SSIM ↑ | LPIPS ↓ | PSNR [dB] ↑ | SSIM ↑ | LPIPS ↓ | |
| Urban scene reconstruction methods | ||||||
| PVG | 12.67 | 0.57 | 0.77 | 13.81 | 0.69 | 0.58 |
| Street Gaussians | 11.49 | 0.53 | 0.75 | 17.38 | 0.73 | 0.51 |
| General 4D reconstruction methods | ||||||
| 4DGS | 10.54 | 0.25 | 0.80 | 13.78 | 0.52 | 0.64 |
| SpacetimeGS | 12.47 | 0.54 | 0.69 | 17.49 | 0.78 | 0.33 |
| FreeTimeGS | 11.84 | 0.53 | 0.74 | 16.53 | 0.71 | 0.41 |
| Stitch4D (Ours) | 14.88 | 0.59 | 0.52 | 24.63 | 0.90 | 0.15 |
Qualitative Results
Trajectory Interpolation (Full Reconstruction)
Temporal Split (Seen-viewpoints) — Urban Area 1
Temporal Split (Seen-viewpoints) — Urban Area 3
Real-world Qualitative Results
Additional Qualitative Results
Trajectory Interpolation (Additional)
Seen-viewpoints — Urban Area 1 (Additional)
Seen-viewpoints — Urban Area 2
Free-viewpoint Trajectory — Urban Area 1
Free-viewpoint Trajectory — Urban Area 2
Full Trajectory — Urban Area 1
Full Trajectory — Urban Area 2
Three-Input Reconstruction — Rotateshow
Three-Input Reconstruction — LBRF
Real-world qualitative results — Additional
BibTeX
@article{kogure2026stitch4d,
title={Stitch4D: Sparse Multi-Location 4D Urban Reconstruction via Spatio-Temporal Interpolation},
author={Kogure, Hina and Katsumata, Kei and Miyanishi, Taiki and Sugiura, Komei},
journal={arXiv preprint arXiv:2604.07923},
year={2026}
}