Martine Hero Background

Martine

Benchmarking Multi-View 3D Surface Reconstruction
Across Viewpoint Coverage, Resolution, and Lighting

1Department of Quantitative Biomedicine, University of Zurich (UZH)     2IRIT, University of Toulouse, France
3ROCS, Balgrist University Hospital     4Independent Researcher
*Equal contribution (joint first authors)

NeurIPS 2026 — Evaluations & Datasets Track

Controlled acquisition setups are widely used for high-accuracy multi-view 3D surface reconstruction, as they allow sensor configuration, image resolution, viewpoint distribution, and illumination to be specified. Yet benchmarking remains difficult, since reconstruction accuracy depends jointly on the reconstruction paradigm, object properties, and acquisition regime. Existing benchmarks often restrict viewpoint coverage, resolution, or illumination, which can bias comparisons towards methods suited to the chosen setting. Others lack accurate 3D ground truth or quantified image-to-geometry alignment, limiting their use for metric surface evaluation. We introduce Martine, a benchmark for controlled 3D object surface reconstruction. Martine comprises 28 objects, including transparent materials and fine structures, captured at 9568×6376 pixels from 84 views over a spherical cap under both single-light and multi-light regimes. It provides object-independent camera calibration, accurate 3D ground-truth scans, calibration and image-to-geometry accuracy quantified on test images, and 3D property masks for analysing errors by material properties, visibility, curvature and fine structures. Experiments across photogrammetry, classical multi-view stereo, neural implicit surfaces, Gaussian-splatting-based reconstruction, and multi-view photometric stereo show that Martine enables regime-aware evaluation with explicit control over reference-data accuracy. The benchmark resolves sub-millimetric reconstruction differences, with a best observed Chamfer distance of 0.058 mm over the evaluated visible surface.


Acquisition Setup

Our capture rig combines a Kuka robotic arm, a Sony Alpha 7RV camera, and controlled lighting.

Cinematic montage of the acquisition process

Blender render illustrating the setup geometry

Qualitative Results

Accuracy heatmaps show the distance from each reconstructed point to the nearest ground-truth point (viridis colormap, 0–4 mm). Drag the slider to compare two methods side by side.

Challenge Taxonomy

Every object is annotated with 3D masks marking the surface regions that make reconstruction hard. These challenge categories define the axes used in the benchmark results below. Pick an object to inspect its annotated regions — drag to rotate, scroll to zoom.

Lambertian Specular Transparent Textureless Fine Structure

Toggle a category to show or hide its highlighted regions.

Results by Challenge

F-score at τ = 0.5 mm across the 7 challenge axes. For each axis, the point-to-surface distances of all objects annotated with that challenge are pooled as a single mesh before scoring (objects that fail to reconstruct are counted as missed). Toggle methods to compare how they behave across challenge types.

Methods

Citation

@inproceedings{martine2026,
  title={Martine: Benchmarking Multi-View 3D Surface Reconstruction
         Across Viewpoint Coverage, Resolution, and Lighting},
  author={Bruneau, Robin and Brument, Baptiste and Giraud, Frederic and Sigrist, Bastian and Jecklin, Sascha and Fürnstahl, Philipp and Menze, Bjoern and Calvet, Lilian},
  booktitle={NeurIPS Evaluations \& Datasets (E\&D) Track},
  year={2026}
}