CrossSDF: 3D Reconstruction of Thin Structures From Cross-Sections

Thomas Walker*1 Salvatore Esposito*1 Daniel Rebain2 Amir Vaxman1 Arno Onken1 Changjian Li1 Oisin Mac Aodha1
1University of Edinburgh 2University of British Columbia
*Equal Contribution
In arXiv
CrossSDF Teaser

Abstract

CrossSDF introduces a novel approach for reconstructing 3D signed-distance fields from 2D cross-sections, addressing a fundamental challenge in medical imaging, manufacturing, and topography. While existing point cloud reconstruction methods struggle with sparse data between slicing planes, and current specialized approaches have difficulty with thin structures and topological consistency, CrossSDF excels at reconstructing complex geometries from planar cross-sections.

Our method uniquely combines contour-aware neural SDF training with specialized losses designed for known 2D slice geometry. This results in significantly improved reconstruction quality, particularly for thin structures, while avoiding the interpolation artifacts and over-smoothing common in previous approaches. The method is particularly valuable for medical applications where accurate reconstruction of thin vessel structures from CT and MRI scans is crucial.

Method Overview

CrossSDF transforms 2D cross-sectional data into complete 3D neural SDF representations through a sophisticated pipeline that ensures accurate reconstruction of thin structures. Our approach integrates three key innovations: adaptive sampling focused on thin structures, a hybrid encoding combining hash-grid and Fourier features for detail preservation, and a novel symmetric difference loss that maintains topological consistency between slices. This comprehensive approach enables robust reconstruction of complex geometries while preserving fine structural details.

Comparison of 3D Reconstruction of synthetic medical structures

Ground Truth
CrossSDF
OReX
Poisson
POCO

CrossSDF Training Progress

Armadillo
Pulmonaries

Visualization of CrossSDF's reconstruction process, showing convergence from initial predictions to final detailed models for both synthetic and medical structures.

Qualitative results on thin medical structures

Reconstruction results on thin structures featuring the Heart (top row) and Pulmonary (bottom row) for various methods. Results are presented using both input-aligned and non-aligned planes, displayed on the ground truth meshes.

BibTeX

@article{tomandsal2024_crosssdf,
    title={CrossSDF: 3D Reconstruction of Thin Structures From Cross-Sections},
    author={Walker, Thomas and Esposito, Salvatore and Rebain, Daniel and Vaxman, Amir and Onken, Arno and Li, Changjian and Mac Aodha, Oisin},
    journal={arXiv preprint arXiv:2407.06938},
    year={2024}
}