Thursday, June 4, 2020

Winslow Homer's "The Adirondack Guide" - 2d to 3d image conversion using the3dconverter2

This post presents a 2d to 3d image conversion of Winslow Homer's "The Adirondack Guide". I undertook this tedious process mostly in order to make a video tutorial showing the whole process from beginning to end. As you can see/hear in the video, it's not that easy to make 2d to 3d conversions.


Reference image.


Dense depth map generated by the3dconverter2.

It took me about 2 hours of trial and error and I must say that I was completely drained when I decided it was time to quit and call it a day. This depth map has obvious errors which I am just discovering now. I completely forgot about the hole around where the left oar holder is. Also, I put the hole between the left arm and leg of the guide at the wrong depth. Last but not least, I completely ignored the depth discontinuity on the right side of the boat leaving a gigantic hole, which would prevent any boat from floating, I think.

The so-called Gimp paths are used to provide dynamic depth clues to the3dconverter2, as opposed to the static depth clues given in the sparse depth. I call the clues given in the Gimp paths dynamic because they can be easily changed either by modifying the path itself or by changing the path's name and hence its associated depth clue. Now, what does the3dconverter2 does with those Gimp paths? For the3dconverter2, any pixel along the path is assigned the depth given to the path itself (via its name). For any pixel with unknown depth (not along a Gimp path or not drawn in the sparse depth map), the3dconverter2 will give the best possible depth value by propagating the depth of pixels which are at known depths.

3d wiggle/wobble made with wigglemaker.

Video showing the whole process:


Follow me on youtube if you want more in-depth videos since those are a bit painful to make.