SIGGRAPH Asia 2026

PIE-PS Photometric Stereo from Physical Irradiance Event Streams

Dense surface-normal reconstruction from raw event streams captured under moving illumination.

Overview

Recovering surface orientation from asynchronous visual measurements

Event cameras provide microsecond-level measurements and high dynamic range, but their sparse outputs depend on an unknown contrast threshold. PIE-PS learns to recover dense surface normals directly from raw events and known moving-light directions.

The framework builds physical irradiance observations from adjacent events, shares information across space and time, and learns to reduce the influence of unreliable measurements. Experiments on synthetic benchmarks and real captures consistently improve over prior event-based photometric stereo methods and a direct physics-only solver.

Video Results

Moving illumination, asynchronous events, and the reconstructed normal map are shown side by side as observations accumulate.

DiLiGenT-Sim Fine surface structures emerge from asynchronous measurements.
PIE-Sim Dense normals remain smooth across curved object geometry.

Qualitative Comparison

Normal predictions are paired with angular-error maps using the same 0°–30° scale. Darker error maps indicate lower error.

Qualitative comparison from the paper across PIE-Sim, DiLiGenT-Sim, EventPS real scenes, and captured scenes
Qualitative comparison across PIE-Sim, DiLiGenT-Sim, EventPS real scenes, and our captured scenes. Each method cell shows the normal prediction and angular error.

Quantitative Results

Mean angular error (MAE) in degrees. Lower is better.

DiLiGenT-Sim

Quantitative comparison on DiLiGenT-Sim.
Method Ball Buddha Cat Cow Goblet Harvest Pot1 Pot2 Reading Average
EventUPS 8.8612.2110.7818.5812.97 23.328.7015.1316.7114.14
EventPS-OP 10.9918.7312.7426.5118.43 36.0613.7815.7524.6119.73
EventPS-FCN 7.4918.1311.4220.6118.07 26.0512.8316.5915.1616.26
EventPS-CNN 10.4416.7911.8820.6016.44 25.2612.9315.5418.1916.45
Direct Solver 15.3615.0913.7514.5515.62 20.0713.5914.6717.7215.60
PIE-PS 3.938.675.1512.907.81 12.916.338.3412.258.70

PIE-Sim

Results by object family and lighting trajectory on PIE-Sim.
Method Blobby
Circle
Blobby
Hypo.
Blobby
DiLiGenT
Sculpture
Circle
Sculpture
Hypo.
Sculpture
DiLiGenT
Average
EventPS-FCN 28.8316.8321.7331.6326.4329.5925.84
EventPS-CNN 43.5042.1126.0848.3146.8528.0839.15
Direct Solver 27.0817.2413.0226.6024.6822.6721.88
PIE-PS 10.686.414.8117.1712.0912.7710.66

Real-world Scenes

Results on EventPS real scenes and our captures.
Method Real-1 Real-2 Real-3 Bunny Rectangle Flower Average
EventPS-FCN 15.7919.659.4226.1418.7035.7620.91
EventPS-CNN 17.6520.1614.8548.7848.1143.1432.12
Direct Solver 21.0821.1020.5023.4632.2225.0223.90
PIE-PS 6.516.095.9212.6911.5219.5710.38

Resources

Code, data, and the pretrained checkpoint are available below.

Paper (arXiv) Code Data Pretrained checkpoint

Citation

BibTeX will be added with the final publication record.