Monday, December 14, 2015

Depth Map Automatic Generator 9b (DMAG9b)

DMAG9b is an implementation of The Fast Bilateral Solver by Jonathan T. Barron and Ben Poole used to improve the quality of (noisy) depths maps. Given a depth map to improve, DMAG9b computes a confidence map which indicates, for each pixel, the reliability of the depth in the depth map. Outliers in the depth map are given very low confidence while "large" areas of equal depth are given very high confidence. Boundaries between areas of different depths are also given a low confidence. DMAG9b maintains the reliable depths while smoothing out the unreliable depths in an edge-preserving way. DMAG9b is referred as an automatic depth map generator but it's really an edge preserving smoother.

The manual for DMAG9b (dmag9b_manual.pdf) is in the ugosoft3d-9x64.rar archive. There is also a test case you can try under dmag9b_test.

The behavior of DMAG9b is controlled by an input file called "dmag9b_input.txt". What the parameters mean and do is explained in the DMAG9b manual. The parameters that have the highest impact on depth map quality are the spatial sample rate (try 4, 8, 16, 32, etc), the range (color) sample rate (try 4, 8, 16, 32, etc), and lambda. The others don't matter so much but feel free to read the DMAG9b manual and experiment with those other less important parameters (especially the ones that control the confidence map). There is no one set of default parameters that will work equally well for all images, so it is best to run default parameters and then experiment to get an idea of what the various parameters do.

Here's an example:

Left image of the Tsukuba stereo pair.

Depth map obtained with Depth Map Automatic Generator 5b (DMAG5b) using radius = 2.

Confidence map (internally computed by DMAG9b). White means reliable while black means unreliable.

Depth map smoothed out by DMAG9b.

Here is a video tutorial:

Interested readers may want to consult Depth Map Improvement Using The Fast Bilateral Solver for a more in-depth look into DMAG9b.

The windows executable (guaranteed to be virus free) is available for free via the 3D Software Page.

Source code: DMAG9b on github.

No comments:

Post a Comment