- create depth maps from stereo pairs (stereo matching),
- generate intermediate synthetic views (lenticular),
- create depth maps from multiple views (multi-view stereo matching),
- create dense 3D reconstruction (point cloud) from multiple views (structure from motion and multi-view stereo),
- perform 2D to 3D image conversion (stereo conversion),
- perform edge-preserving smoothing,
- rectify/align stereo pairs, and
- much more
is available on dropbox in rar archive form, totally free of any charge.
If you like my blog and the software I provide, please subscribe to my youtube channel by visiting ugo capeto 3d on youtube and/or friend me on facebook by visiting ugo capeto on facebook. Thank you in advance.
The executables are for the pc windows operating system in 32 bit or 64 bit flavor. It is highly recommended to use 64 bit execs because 32 bit execs can only address 4 gigabytes of memory and are not updated anymore. So, if your machine is 64 bit, please use the 64 bit archives, not the 32 bit archives. The programs were developed on a linux machine using Qt for the graphical interface. The port to windows was done rather painlessly thanks to the MinGW compiling environment.
Given an executable (for example, DMAG5), the number (5 for DMAG5) used after the acronym (DMAG for DMAG5) is not a version number. For example, in the DMAG line of software, DMAG, DMAG2, DMAG3, DMAG4, DMAG5, DMAG6, and DMAG7 have very little to do with each other. In particular, DMAG7 is certainly not better than the rest.
The executables without GUI (Graphical User Interface) are run via a .bat file (batch file). When you unzip any of the archives containing GUI-less executables, there will be a manual for the program of interest called *_manual.pdf (where * is the name of the program) which explains how to use the program. There will also be a directory called *_test (where * is the name of the program) that contains a sample test case which can be run directly by double-clicking on the batch file after having made sure the path to the .exe executable in the batch file is correct. Typically, to run any of the GUI-less executables, one would create a directory which contains the input images, copy the batch file (*.bat) and the input file (*_input.txt) from the *_test directory, edit the batch file so that the path to the .exe executable is correct, possibly edit the input file to modify the parameters, and then double-click on the batch file to launch the program of interest. Personally, to edit a file, I use a program called Notepad++ but any other text editor can be used. If you are experiencing problems running the GUI-less executables, please send me you batch file (*.bat file) and input file (*_input.txt) where * is the name of the program you want to use.
For some executables, the image size doesn't matter too much, in other words, you can use pixel heavy stuff but, in general, it's better to take it easy on the image size and start with images that are relatively small (under two mega pixels for instance). If it looks like the executable is not completely hogging the machine, then you can try using larger images. If you really don't want to reduce the size of the images, you can make use of the downsampling factor that's available in some of the executables.
Recommendations on what to use depending on what you are looking for:
Two-view epipolar rectification:
- Use ER9b to rectify the images. Note that the input two views may be completely misaligned. The quality of the rectification process is given by the mean vertical disparity error (it's usually close to perfect if below 0.5 pixels) written out to the output. If ER9b appears to be too aggressive (large zooming effect and/or large white framing areas), please use ER9c. I strongly recommend using ER9b or ER9c prior to generating depth maps. ER9b and ER9c give the min and max disparities in the output (please, use the 2nd line) which are used in the input of most automatic depth map generators on offer here.
Generation of depth map from two views:
- To get the depth map or the depth maps (left and right), I have implemented (in chronological order): DMAG, DMAG2 (please, use downsampling if images are large), DMAG3 (please, use downsampling if images are large), DMAG5, DMAG6 (please, use downsampling if images are large), and DMAG7. In most cases, I recommend using DMAG5 or DMAG5b followed by DMAG9b. If the stereo baseline (distance between the lenses) is small, I would actually recommend using DMAG5b over DMAG5. Check A Qualitative Comparison of Selected Automatic Depth Map Generators for a link to an academic looking paper that attempts to compare DMAG2, DMAG5, DMAG6, and DMAG7. Check Depth Map Generation using Optical Flow for an in-depth look at DMAG. Check Depth Map Generation using Graph Cuts for an in-depth look at DMAG3. To improve depth map quality (whatever the origin), I (highly) recommend using DMAG9b.
Generation of intermediate synthetic views (tweeners) between the left and right images:
- Use FSG6 to get the intermediate frames. Input is the left image, left depth map, right image, and right depth map. Make sure that the right depth map is such that foreground is white and background is black (just like the left depth map). If the right depth map comes from a depth map generator that produces two depth maps (left and right), it will need to be color inverted before using FSG6. If you have only have one reference image and one depth map or if you want to increase the stereo effect of a stereo pair, you can use FSG4 to get synthetic frames on either side of the reference image. I believe it's better if the object boundaries in the depth map are crisp (use the symmetric nearest neighbor noise reducer under Filters->Enhance in gimp). I believe it's a good idea to grow the lighter areas in the depth map (use the dilate option under Filters->Generic in gimp). As an alternative to FSG4, I recommend using StereoPhoto Maker. Once you have loaded your image and depth map, click on Edit->Depth Map->Create Multiple Images from 2D+Depth Map and you will be able get your synthetic images (there is even a preview mode that will show an animated gif of the synthetic images).
Generation of depth map from multiple views:
- Use SfM10 (Structure from Motion) to get the nvm file and then DMAG8b to get the depth map. I don't recommend using DMAG8 which is based on DMAG7. Make sure the viewpoints are not too different, in other words, make sure the camera is not moved too much between shots. I think it's better to get the 3D scene (with MVS10) than to get a depth map from multiple views.
3D scene reconstruction from multiple views:
- Use SfM10 (Structure from Motion) to get the nvm file and then MVS10 (Multi-View Stereo) to get the dense 3D reconstruction. The main output is a point cloud representing the 3D scene in ply format. This process is referred to as photogrammetry.
2D to 3D image conversion:
- Use DMAG4, DMAG11, or the3dconverter2 (preferred). DMAG4 and DMAG11 relies on a so-called sparse depth map where depth clues are given by making a few brush strokes for the different "known" depths. DMAG4 uses a so-called "edge image" so that the depths can not bleed across object boundaries (use a low beta, like beta = 10, to get very smooth depths within the edges defined by the "edge image"). To know more about DMAG4, check 2D to 3D Image Conversion using DMAG4. DMAG11 may be used as an alternative to DMAG4 with very similar results but you can't use an "edge image". If you are well versed in gimp (in particular, gimp paths), you can use the3dconverter2 for the ultimate experience in 2d to 3d image conversion. The3dconverter2 relies on gimp paths to drive the depth map densification process although you can certainly also scribble depth clues just like with DMAG4 and DMAG11. I personally recommend using the3dconverter2 for all your 2d to 3d conversion needs.
Edge-preserving smoothing:
- Not sure it's needed since the depth map generators on offer here all have some kind of edge-preserving safeguards built in. If you have depth maps with outliers (tiny specks at the wrong depths), EPS9 is good at removing them. To smooth depth maps while preserving object boundaries, you can use EPS2, EPS5, or EPS7. You can see them in action in 3D Photos - Reindeer. I personally tend to prefer EPS2 which is a "true" (as opposed to approximated) bilateral filter. Personally, I do not use any of them as I prefer to use DMAG9b for all my depth map improvement needs.
Depth map improvement:
- To improve the quality of any depth map, DMAG9b is what you want to use. It is a very powerful tool, much more potent than a mere edge preserving smoother. DMAG9b is more a depth map "improver" than a depth map generator. To see DMAG9b in action against EPS2, EPS5, and EPS7, check 3D Photos - Reindeer. For more info about DMAG9b, consult Depth Map Improvement Using The Fast Bilateral Solver. If you want to improve a depth map semi-manually, I would recommend using either DMAG4 or DMAG11. For more info on how to improve depth maps with DMAG4, check Case Study - How to improve depth map quality with DMAG9b and DMAG4.
Generation of an animated 3d gif (smooth wiggle/wobble not to be confused with the migraine inducing two-view wiggle) from a reference image and depth map:
- Use Wiggle Maker to get the animated gif. As an alternative, you can also use depthy.me but the depth map will need to be inverted (in depthy.me, black is foreground and white is background).
Depth map visualization:
- Use Depth Player to display the 3d scene given a reference image and a depth map. As an alternative, you can also use Depth Map Viewer to visualize depth maps in 3d.
What follows is the complete list of all the executables that you can download. The executables which are grouped into archives (in the rar format) are hosted on dropbox. I strongly recommend not to use the 32-bit archives as they are not updated.
The executables contained in the 32-bit archive ugosoft3d.rar and 64-bit archive ugosoft3d-x64.rar are described in the following posts:
- Depth Map Automatic Generator (DMAG), and
- Frame Sequence Generator (FSG).
The executables contained in the 32-bit archive ugosoft3d-2.rar and 64-bit archive ugosoft3d-2-x64.rar are described in the following posts:
- Depth Map Automatic Generator 2 (DMAG2),
- Disparity Finder 2 (DF2),
- Frame Sequence Generator 2 (FSG2), and
- Edge Preserving Smoothing 2 (EPS2).
If you would prefer executables with no Graphical User Interface (GUI), download the 64-bit archive ugosoft3d-2-nogui-x64.rar (contains DMAG2).
If you would prefer executables with no Graphical User Interface (GUI) and have a linux box, download the 64-bit linux archive ugosoft3d-2-nogui-x86_64-linux.tar.gz (contains DMAG2).
The executables contained in the 32-bit archive ugosoft3d-3.rar and 64-bit archive ugosoft3d-3-x64.rar are described in the following posts:
- Depth Map Automatic Generator 3 (DMAG3), and
- Frame Sequence Generator 3 (FSG3).
The executables contained in the 32-bit archive ugosoft3d-4.rar and 64-bit archive ugosoft3d-4-x64.rar are described in the following posts:
- Depth Map Automatic Generator 4 (DMAG4), and
- Frame Sequence Generator 4 (FSG4).
The executables contained in the 32-bit archive ugosoft3d-5.rar and 64-bit archive ugosoft3d-5-x64.rar are described in the following posts:
- Depth Map Automatic Generator 5 (DMAG5),
- Depth Map Automatic Generator 5b (DMAG5b),
- Depth Map Automatic Generator 5c (DMAG5c),
- Edge Preserving Smoothing 5 (EPS5), and
- Frame Sequence Generator 5 (FSG5).
If you would prefer executables with no Graphical User Interface (GUI), download the 64-bit archive ugosoft3d-5-nogui-x64.rar (contains DMAG5 and DMAG5b).
If you would prefer executables with no Graphical User Interface (GUI) and have a linux box, download the 64-bit linux archive ugosoft3d-5-nogui-x86_64-linux.tar.gz (contains DMAG5 and DMAG5b).
The executables contained in the 32-bit archive ugosoft3d-6.rar and 64-bit archive ugosoft3d-6-x64.rar are described in the following posts:
- Depth Map Automatic Generator 6 (DMAG6) and
- Frame Sequence Generator 6 (FSG6).
If you would prefer executables with no Graphical User Interface (GUI), download the 64-bit archive ugosoft3d-6-nogui-x64.rar (contains DMAG6 and FSG6).
If you have a linux box, download the 64-bit linux archive ugosoft3d-6-x86_64-linux.tar.gz (contains DMAG6 and FSG6).
From now on, I will not support 32 bit any longer as it is safe to say that nobody uses (or should use) Windows xp anymore. Everything is going to be 64 bit. Also, I will not bother with a graphical interface any longer. There is no point having a graphical interface when any parameter that is needed can be read from a file. Also, it is plain easier for me not to have to worry about Qt on Linux (where I develop everything) and Windows. Within each archive and for each piece of software, there is a manual (for example, dmag7_manual.pdf for dmag7) which I strongly recommend you read and a test directory (for example, dmag7_test for dmag7) where you can check that the piece of software you are interesting in runs correctly on your machine. If you are having any problems, send me an email and I will help you.
The executables contained in the 64-bit archive ugosoft3d-7-x64.rar are described in the following posts:
- Depth Map Automatic Generator 7 (DMAG7) and
- Edge Preserving Smoothing 7 (EPS7).
The executables contained in the 64-bit archive ugosoft3d-8-x64.rar are described in the following posts:
- Depth Map Automatic Generator 8 (DMAG8),
- Depth Map Automatic Generator 8b (DMAG8b),
- Depth Finder 8 (DF8), and
- Camera Remover 8 (CR8).
The executables contained in the 64-bit archive ugosoft3d-9-x64.rar are described in the following posts:
- Depth Map Automatic Generator 9 (DMAG9),
- Depth Map Automatic Generator 9b (DMAG9b),
- Edge Preserving Smoothing 9 (EPS9),
- Epipolar Rectification 9 (ER9),
- Epipolar Rectification 9b (ER9b), and
- Epipolar Rectification 9c (ER9c).
If you have a linux box, download the 64-bit linux archive ugosoft3d-9-x86_64-linux.tar.gz (contains DMAG9b, ER9b, and ER9c).
The executables contained in the 64-bit archive ugosoft3d-10-x64.rar are described in the following posts:
- Structure from Motion 10 (SfM10), and
- Multi View Stereo 10 (MVS10).
The executables contained in the 64-bit archive ugosoft3d-11-x64.rar are described in the following posts:
- Shallow Depth-of-Field Generator 11 (SDOFG11),
- Point Cloud Maker 11 (PCM11),
- Depth Map Automatic Generator 11 (DMAG11),
- Depth Map Automatic Generator 11b (DMAG11b), and
- Frame Sequence Generator 11 (FSG11).
The executables contained in the 64-bit archive the3dconverter-x64.rar are described in the following posts:
- 2d to 3d Image Conversion - the3dconverter.
The executables contained in the 64-bit archive the3dconverter2-x64.rar are described in the following posts:
- 2d to 3d Image Conversion - the3dconverter2.
But wait! There's more ...
Websites (web apps) related to automatic depth map creation:
- Wiggle Maker. For more info, visit Wiggle Maker blog post. As an alternative, you can also use depthy.me but the depth map will need to be inverted (in depthy.me, black is foreground and white is background).
- Depth Map Viewer. For more info, visit Depth Map Viewer blog post.
- Depth Player. For more info, visit Depth Player blog post.
If you have any questions, want to give me some feedback/suggestions, or just want to let me know that you are using my software (successfully I hope), send me an email (ugocapetodifrancia3d
When the manual says to put the correct path to the executable in the .bat file, the way to get the proper path is as follows:
- using the file explorer, go to the directory where you have extracted the archive (where the executables are),
- click on the folder symbol to the left of the current "symbolic" path,
- copy/paste that path (should already be selected) into the .bat file.
Directory path (in blue) used in .bat files.
Program loads, but when I attempt to open an image it says "Cannot load c:\users....jpg etc.
ReplyDeleteTried several images some large, some small, same result.
This is Windows 7 64 bit 6gb ram.
Does it only work in 32 bit?
it's because the graphics formats that are supported at the moment are: BMP, PNG, PPM, XBM, XPM. Please, use GIMP or similar to convert to PNG.
DeleteAll the usual graphics formats are now supported.
Deletei couldn't find this Disparity Finder 2 (DF2) program link to download.. pls provide link,.. thanks.
ReplyDeleteDF2 is in ugosoft3d-2.rar
DeleteThe link is right there in the above post.
Thanks for this! I haven't tried it yet, but it looks exactly like what I need. I've been wanting to create some gifs with more frames from my fuji w3 and maybe even do some lenticular prints with the added frames. Keep up the good work! - J
ReplyDeleteWell, I hope they are useful to you in your endeavors. thanks for the kind words.
DeleteI'm using Windows 8, and it throws an error every time I try to use it. I'm using .png files. Does it only work in previous versions of Windows?
ReplyDeleteit should work on all flavors of windows that support 32 bit, windows 8, windows 7, etc. If it crashes, it's probably because it's running out of memory (images are too big). Try to use smaller size images.
DeleteIt's good! I'm a student working on the same concepts. Is your code for this implementation also an open source? If not can you briefly just walk me through your approach or algorithms you used?, that would help me lot through my work.
ReplyDeleteThank you very much.
Dear Prateek:
DeleteThank you. The code is not open source. Each dmag version is based on a different academic approach, from optic flow to graph cuts. For each dmag version, I've tried to explain the algorithm as best as I could, usually explaining in detail the paper it comes from. if you have specific questions, just let me know.
Hi Ugo,
ReplyDeleteI realy appreciate your work but I'm stock... Can you help me?
FATAL ERROR detect occlusion... any ideas? I use Win7 64bit and I was try ver. 32 and 64 bit.
Thanks in advance.
Which program are you using? Send me an email (to address that's on the right side) with the image files and tell me whatever parameters you were using. It may take a while before I can answer though.
DeleteYou might be interested in this Yahoo group for lenticular artists:
ReplyDeletehttps://groups.yahoo.com/neo/groups/lenticular_art/
cool. this link works better though:
Deletehttps://groups.yahoo.com/neo/groups/lenticular_art/info
Please I want to download the follow software,can you help me?Depth Map Automatic Generator 5 (DMAG5)
ReplyDeleteHi:
DeleteDMAG5 is part of ugosoft3d-5.rar
Hi Ugo, great work. Do you have any plans to publish a 64 bit version of EPS5 and FSG6?
ReplyDeleteare they crashing? it's a bit of work to create 64-bit versions.
DeleteYes, they crash.
DeleteI use to generate depth maps from 1/4 resolution as you suggest, and then scale them back, but for generating intermediate views for lenticular, I wanted the high resolution images.
Maybe it is stupid to use so much resolution after all.
Have a happy new year!
ok. i'll try to create 64 bit versions this week-end then.
DeleteWow! Thanks!
DeleteI will give it a try when you publish it and will give you feedback. Do not hurry though!!
Hi:
DeleteI have uploaded 64 bit versions of eps5 and fsg6. Don't guarantee anything though.
thanks! I will give a try later on tonight
DeleteTested both and they work very well!! at least on the images that crashed on my computer with the 32bit version. Thanks and keep up with the good work!!
DeleteTried to use the 64 bit fsg6. Runs ok, but asks for two depth maps. When I run DMAG5 it only creates 1 depth map. How do I get the second depth map?
ReplyDeleteThanks
You flip (horizontally) the right image, that becomes your new image1. You flip the left image, that becomes image2. You give that to DMAG5 with the exact same parameters. You flip the depth map that's obtained, it's your right depth map. it's explained here in more details: http://3dstereophoto.blogspot.com/2014/11/3d-photos-pipes.html
DeleteOK, that worked. A lot of steps, but interesting. Thanks!
ReplyDeleteHi! I just came across this post. Great share! Will it work for left and right images with resolution 3856(H) X 2764(V) each?
ReplyDeletethat's a bit much. it should work with 64 bit version although it's probably gonna be slow. i recommend reducing image size though and enlarge the depth map back to proper size.
DeleteHello there Ugo, I was wondering, is there an easy way to generate depth maps using DMAG4 for a sequence of images, like a video, to create 3D film from a 2D one?
ReplyDeleteHmm, no. For video where you need tracking, you'd probably be better off with gimpel3d or the pro programs like flame, flare, maya from autodesk but those cost a pretty penny. Maybe you can do things with Blender with I doubt it.
DeleteWhy not put a download for the linux version??
ReplyDeletei probably will at some point. thanks for your interest.
DeleteHi there Ugo, there's some great stuff here. I too would love a linux or osx build. Any word on its availability?
DeleteI know of at last 1 person that runs the 32 bit execs on wine linux. Not sure about 64 bit wine linux though.
DeleteHello there Ugo, great software's! What do you think about a low resolution 2d to 3d, whit depth map from defocus(single image, no focus stacking); because i read some of that, and sounds great!
ReplyDeleteCould you elaborate since I am not sure I understand?
DeleteIt is a method that extracts depth maps, from a single photograph, the photograph requirement is that count with depth on field. finally a depth is extracted after calculating the amount of blurring at the edges of objects. more distant objects have a greater blur. I think, is really good implementation for 2d to 3d vídeos; Pretty than best to something looks like depth propagación.
DeleteAre some papers in internet, if do you want try search"depth from defocus single image"
oh ok, I know what you mean now. No, I have never looked into extracting depth from blurring clues. Will have to look into it but i am not too confident on the outcome.
DeleteDear Sir:
ReplyDeletemy name is Li,I am a DMAG user,I also use DMAG4 to make 3D gif,I know DMAG9 is a Latest version of DMAG4.
so I try to download and open the .RAR file of DMAG9 by "BANDZIP",but I can not open DMAG9 normally,and did not find the cause of the problem.
DMAG9 is used differently than DMAG4 as it doesn't have a graphical user interface. There's a file called dmag9_manual.pdf that explains how to use DMAG9. By the way, DMAG4 is probably superior to DMAG9 but it is slower. So you don't really need DMAG9 if you already have DMAG4.
DeleteCan't run in Win10 x64
ReplyDeletei don't have win10 so can't really check myself. Which program are you using?
DeleteComplains then runs away when you try to help in less than hour. Very bad. Maybe he learn his mistake because every program I test runs in Win10 x64.
Deleteha, that's no problem. Thanks for confirming that it indeed runs on win10 x64 (as it should).
DeleteHello, is possibly use EPS7 in vídeos?
ReplyDeleteno, sorry.
DeleteSalut, je voudrais essayer de convertir des fichiers video 2d en 3d, Je cherche un programme gratuit, (pourquoi pas open source) pour faire exactement ce que fait ce petit logiciel "https://www.youtube.com/watch?v=jszPDQWoszc&feature=youtu.be" 3dcombine : on met une video, et le logiciel genere des keyframes, ensuite grace a DMAG4, on cree une depth map pour chaque key frame, et puis le logiciel entre 2 key frame se debrouille pour adapter le depth map. Ya til donc un logiciel en open/free pour ca? merci.
ReplyDeleteBonjour: je ne connais pas de tel programme mais je dois avouer que je n'ai guere d'experience avec la video. Il faudrait chercher sur github des codes de "tracking". Tracking est un sujet classique en Computer Vision, donc il doit bien exister des programmes open sur github et autres pour le faire.
DeleteEstimated ugo, none of the files of 64 bits me work. I have win7 of 64 bits. Them of 32 bits work perfectly. Some suggestion?
ReplyDeleteRegards and congratulations for your work.
The 64 bit exectuables are not graphical so they need to be run differently from the 32 bit executables that are all graphical. Say, you want to run dmag7 on a set of images in a directory on your computer. Make sure you follow the directions given in the file called dmag7_manual.pdf. The simplest way is to look at the directory called dmag7_test and copy the .bat file to the directory where your images are and make sure the path to the executable is correct. You also need to copy the input file called dmag7_input.txt. If you still have problems, send me your .bat file and your input file.
DeleteTo run dmag7, then you simply double click on the .bat file.
DeleteHi! Amazing softwares! I Have been playing with each Depth Map Generator for a while now. WHich depth map do you feel gives the best results for Stereo Pairs?
ReplyDeleteI have had the most success with DMAG5?
Thanks!
dmag5 works for most stereo pairs. if the edges are not crisp, you can use dmag9b to improve depth map. in some cases, you may have to use a different depth map generator like dmag3, for instance. it depends.
DeleteThanks Ugo! I will check out DMAG9 and 3.
DeleteI am having an issue with the ground and sky not being captured for the depth map?
I believe the ground is not matching as it gets a little bit warped toward the bottom of the image?
But the sky is mostly blue so I am unsure why it isnt just pure black?
Any ideas?
THanks!
Areas with no texture have unknown depths, so you can end up with whatever depth for those. if you're planning on creating lenticulars or wobbles/wiggles, it really doesn't matter if the depth is wrong for those areas. Anyways, try to increase the radius and see if that helps. also, make sure the stereo pair is properly aligned/rectified.
DeleteThanks for the speedy response Ugo,
DeleteThe issue is I am trying to create geometry from the depth map, so the sky will look extremely wrong if it has random depths?
Is there a way that I can make the generator recognize that the sky has no depth thus render it black?
Thanks
Couldn't load that, Tryagain
ReplyDeleteError code: 0X80004005
What am I doing wrong?
which program are you trying to use? what operating system do you have? For non graphical programs, you need an input file, so that might be missing. check the pdf manuals that are in the directory where you extracted the .rar archive.
Deleteugosoft3d-11-x64 (PC Windows 10 x64). I do not understand this is:The le pcm11.bat must be modi ed so that the path to pcm11.exe is the correct one for your computer.
DeleteWhen you go into the directory where dmag11.exe using the file explorer, click on the yellow folder icon that's to the left of the space at the top that shows the current directory, it will display the full path (something that starts with C:\). that path needs to be copied to the .bat file.
DeleteHi, can I use your tools to create a anaglyph 3D picture from a depth map and a picture?
ReplyDeleteYou can use FSG4 to create either a left or right image with reference image being at the center (you use either the lefty image + center image or center image + right image to make the anaglyph). Then use stereophotomaker to actually make the anaglyph. You can also use https://sourceforge.net/projects/two2three/ to create the anaglyph directly from image and depth map. The differences will be in the quality of the inpainting.
DeleteHi,
ReplyDeleteDo you plan on posting source code for your apps at some point? Would be nice to see them ported to other platforms.
No. I don't see it happening.
DeleteUgo, since many years I am using your software. And I'm really surprised that you are always working on it and provide us with updates. But sometimes I've got the problem that your tools doesn't accept the (sparse) depthmaps created in Gimp because of their transparence. I found out that the default value for the alpha-threshhold that is in my Gimp 127 sometimes doesn't work and I have to reduce it to 100 to make it working. Can you suggest a value that always works? It happens, too that in DMAG4 the red background - as a rule indication for the right alpha-value - appears and the tool refuses to work even so. No problem, if you wish some proves in the forme of files. Thank you and best wishes from Germany.
ReplyDeleteOk, send me the files via email and I will look. You are talking about the 64 bit version, I hope, because I don't update the 32 bit version anymore?
DeleteImpressive !!
ReplyDeleteI would be quite interested on a OSX DMAG7 terminal version.
I am sorry I don't have versions for the Mac operating system. Thanks a million anyway for the kind words.
DeleteThis software is amazing. Hopefully I will show you some good results soon.
ReplyDeleteOne suggestion: If you have the time, I would love a FSG6 nogui version because it is very annoying to use the GUI in wine/linux.
Greetings Ugo, my name is Justin...I've a question to ask you. Can DMAG generate good depth maps from stereo pairs that are created using the converged / toed-in setup? As you likely know, the converged / toed-in setup has some problems unique to it. These are depth plane curvature, keystone distortion...and a "baked in" convergence point fixed always at the center of the 3d image. The convergence point always has no parallax. About depth map generation, I am a beginner...so I am using DMAG1 because of it's simpler user interface. Anyway, I hope you can help...thanks Ugo.
ReplyDeleteDepth map generation in the case of a stereo pair assumes no toe-in. It's usually a good idea to rectify the stereo pair prior to using the depth map using ER9b. I also suggest using DMAG5 or DMAG6 (possibly followed by DMAG9b) to get depth maps from stereo pairs.
DeleteGreetings Ugo, my name is Justin...I've a question to ask you. Can DMAG generate good depth maps from stereo pairs that are created using the converged / toed-in setup? As you likely know, the converged / toed-in setup has some problems unique to it. These are depth plane curvature, keystone distortion...and a "baked in" convergence point fixed always at the center of the 3d image. The convergence point always has no parallax. About depth map generation, I am a beginner...so I am using DMAG1 because of it's simpler user interface. Anyway, I hope you can help...thanks Ugo.
ReplyDeleteHello
ReplyDeleteI have following problem:
For a project we would like to measure the distance of an moving object to a pair of cameras. Is there a software not only producing nice 3D images, but actual 3D information (eg as text/dxf file?), on how far an object is away.
There is access to the site, so we can make reference measurements of distances and angles and the like from the surrounding scene. Basically the data come from HD/FHD movie cameras, but a full motion analyses is not intended.
Accuracy does not need to be very high, in the range of 10 -20 cm would be cool.
Best and thanks a lot for the help
Fabian Haas
From the disparity, you can get the actual distance to the object if you know the geometry of the camera setup (focal length and baseline). it's a very simple linear equation, something like Z (depth) = fB/d where B is the baseline and d the disparity. As far as software, usually, they just compute the disparity map and you'll have to get the actual depths yourself (that's what pcm11 does: creating point cloud in 3d space from depth map).
DeleteIs there some way I can run this on a Linux machine, without using virtual machines? Do you have a linux compatible export?
ReplyDeleteNo, sorry, there's no linux version of the software that's available for download.
DeleteHi,
ReplyDeleteI've got problems with DMAG8 and 10 creating a depthmap with SFM. No matter, if using a larger number of images or just 2 or 3. I downloaded your examples (pump), but in all cases I get an error e.g. "Can't find camera corresponding to ref image!" or the output is an image without content.
When using SFM as standalone I always get the known error about the initialization pair. In most cases the workaround described in your help files is succesful, but df8 doesn't accept them, nevertheless. Years ago I had got acceptable results testing sfm, so I am sure and I know that I don't make any mistake in handling the tool. Working on Win10 64.
thx
Bernd
Bernd:
DeleteLooks like some kind of input error. Please send me your picture set and input file you use for sfm10 and dmag8. Note that i recommend using dmag8b over dmag8. Cheers!
Hello Ugo, Congratulations on your work. I am not a technologist or scientist, but an artist. My problem is as follows, I create art digitally, but want to 3D print with texture, so that the finished product looks like a painting. Can I do this with GIMP and your DMAG4 program? (which I have not yet mastered) What printer will give good professional looking, painterly results? Thanks in advance. All the best, Alexis
ReplyDeletehey i a, using win 7 32 bit and it is crashing sometimes only reaches to iter 2 aand then does not produce any depth image.ned your help
ReplyDeletedoesnot even work with lower size image
I'm having an issue with dmag9b. I get an appcrash in module msvcrt.dll right after the program finishes solving the last iteration (currently set to 32). It writes the con_map.tiff file to the source directoryand finishes all 32 iterations then crashes. Any idea how to fix this?
ReplyDeleteThank You,
Eric
Try to have a look at what the program prints at the beginning of the run. It will print the parameters it's reading from the input file. If you see something weird printed out for a given parameter, then there's something wrong with that line in the input file. My guess is that there is something wrong with one of the file names in the input file. Most likely the name of the output depth map. Make sure there's no space in the name or weird symbols. If you still have problems, send me your input file and the 2 images (reference image and input depth map).
DeleteI checked the readout and don't see any irregularities. I will email you the files. Thanks.
DeleteEric
how to download the software?
ReplyDeleteyou click on the .rar file you want. That will take you to dropbox. Then you click on the "Download" tab at upper right using "Direct Download".
DeleteHello there. I have two stereo videos. one of these frames is attached to your mail adress.(0 is left, 1 is right). I could not calculate their max and min disparities. Can you help me? Can you tell me how to do with df2? How do I calculate disparity map with dmag2? I also want to obtain disparity map video from left and right videos. Could you help me with this? Do you know about matlab code? thanks.
ReplyDeletehow to use df2: you just pick a point in the foreground, click on it in the left image then click on it in the right image, the disparity should appear in the main window at the bottom. Do the same thing for a point in the background.
Deleteinstead of using df2, you can use er9b or er9c to get the min and max disparities automatically. Look for the line in the output that says min/max disparities. There should be 2 lines with that information. Use the second line.
any way to get GLB 3d files using pic and depth map ? finding since ages unable to find,i need glb,not gif :(
ReplyDeletethanks love you. god bless
hmm, i am afraid not. pcm11 outputs a .ply file, not a glb file.
DeleteHi Ugo,
ReplyDeleteIs it OK for you to make a viewer like this (this one is for google lens blur images)?
https://www.clicktorelease.com/code/depth-player/
We can just provide the left or right image with depth map to see the 3D, without generating the point cloud file.
Thank you.
Gordon
I am pretty sure you can combine image and depth map into a lens blur image (maybe with exiftool or depthy.me) and then use that viewer as is. Otherwise, yeah, that viewer could be modified to load an image + depth map instead of a lens blur image.
DeleteOk, I have just tried combining an image and a depth mao using depthy.me and it works just fine. Once you have uploaded the 2 files, click on the "Share" button and "Save as JPG". That will get you a lens blur image. Make sure the depth map is such that black is near and white is far. Then you can use https://www.clicktorelease.com/code/depth-player/ to visualize the scene and possibly export to sketchfab.
DeleteHi Ugo,
DeleteI just tried and it works great!
I didn't know depthy.me can generate lens blur image ><
Thank you very much for the help!
Gordon
Gordon: I am gonna try to adapt the depth viewer so that you can load the reference image and the depth map directly, without having to combine them first in depthy.me. Do you use the "export to sketchfab" feature or do you just use the "export to obj" and then load that in sketchfab? If you want, reply by sending me an email, that might be easier to communicate.
DeleteEmail sent, thanks!
Deletehello, i was just wondering where fsg4's output area was, its works super good and wiggle maker keeps crashing(i think due to the resolution of the pictures)
ReplyDeleteWhat do you mean by output area?
DeleteSo when you create the depth map using dmag4(works amazing btw) after it compiles you click file>save depth map, but when I try to use fsg4(to create a stereoscopic effect to use with 3d or vr viewers) it works great except I cant save the result anywhere. Screen shots wont work because I'm using too high a resolution.
ReplyDeleteThe files are dumped in whatever directory you are working on. The names should be frame01.xxx, frame02.xxx, etc where xxx is the extension of your reference image.
Deletei need help please help me ..i'm trying to make Facebook 3D photo ...i saw tutorial and follow the step as you did but my depth map goes full grey ...i hope you get my issue
ReplyDeleteCould you also get similar results with your tools as in SPM when using the "Looking Glass" method?
ReplyDeleteBernd: I don't have a "Looking Glass" and i don't really use spm so I am really not sure what the looking glass method in spm is.
DeleteI'm using Windows 10 x86 (because of older driver compatibility) and can't use the x64 files. :'(
ReplyDeleteWill you add 32 bit versions? PUH-LEASE! ;)
no sorry, I won't maintain the 32-bit executables and I won't add any more 32-bit stuff. Not that the 32-bit execs that are offered to download (up to dmag6) are almost the same as the 64 bit ones. So those should work just fine and they have a gui.
DeleteRecently I found these articles and executables by you Ugo. For some days I have studied the different tools for making depth maps with great interest and even made some useful results. I will for sure continue and hopefully get even better results after some exercise. My respect for all your work and to let us enthusiasts use your software!
ReplyDeletethank you for the kind words and you are quite welcome.
DeleteHello, I discovered Wiggle Maker a few days ago as I was trying to make a GIF as Facebook 3D does. The pictures I work with are taken by Curiosity rover on Mars. I obtained good results such as https://twitter.com/thomas_appere/status/1256688139646783488?s=20
DeleteI mentioned your website in the comments but I'll mention your name in copyrights in further publications.
I'd like to know if your 3D software to generate depth maps is available on Mac OS X?
Thanks,
Cheers,
Thomas
Cool. Glad to see a program of mine is somewhat useful. The software on offer here may work on Mac OS X but not natively. So you'll have to use a win 64 emulator. I know some pple got them to work on macs but i don't know which mac os they were using.
DeleteTutorial for Mac?
ReplyDeleteI don't have a mac so i can't really make one. You should be able to use wine64 or similar emulators but that may not work for all mac os.
DeleteGreat work but the array of options leaves me a bit flummoxed. I wish to convert the stereo pair of "Noctulicent Clouds" seen at https://spaceweather.com/images2020/12jun20/xeye.jpg to a depth map suitable for creating a Facebook 3D image. (Main post with a flip image display gif included is at https://spaceweather.com/archive.php?view=1&day=11&month=06&year=2020 ) WHICH of the 11 DMAG versions would work best for this?
ReplyDeleteProbably dmag5b. Before that though, make sure the 2 images are well aligned/rectified. If the 2 images are not aligned, using Stereophotomaker is probably the easier to use for alignment purposes. Maybe go into Edit->Preferences->Adjustment and check the "Better Precision (slow)" before you align in SPM.
DeleteTHANKS!
DeleteHi Ugo, I tried to find a page that explains DMAG5d (which I found in the ugosoft3d-5-x64.rar for Windows) but couldn't find it. Could you please elaborate what you have implemented in this particular version?
ReplyDeleteI don't recall what dmag5d is. if it's not explained anywhere, it's probably not good. I would have to look at the code to see what is going on there. i will let you know later. Cheers.
Deletedmag5d is dmag5b but using the cost function of dmag5c, which is based on sift descriptors. So, it should behave like dmag5b and have a tendency to fatten object boundaries.
DeleteHello Ugo, I really like this tool, would it be possible to improve it to make the result more accurate and detailed?
ReplyDeletehttp://stereo.jpn.org/jpn/stphmkr/google/colabe.html
The only thing i can suggest is to try improve the depth map quality using a joint bilateral filter like dmag9b. This should make the object boundaries more crisp. Play with "sample rate spatial" and "lambda" to control how much the depth map is allowed to be changed. The lower the sample rate spatial and the lower lambda, the less the depth map will be changed.
DeleteAlso, if you want to edit the depth map semi-automatically in case the errors are large, I suggest uisng the3dconverter2 (see this video https://youtu.be/nv1T-0jGQ_I). You can also edit the depth map manually in SPM if you want.
DeleteHey Ugo, nice tool. But i stuck at the point where I have to find DMAG folder https://prnt.sc/uj5cur and get this https://prnt.sc/uj5d79. What to do? I follow exactly all the instructions.
ReplyDeleteyou are talking about SPM? Follow these instructions: http://stereo.jpn.org/eng/stphmkr/makedm/index.html. Once you have it working, try to follow what I am saying in this video: https://youtu.be/KCvTgfopwE0 or this blog post: http://3dstereophoto.blogspot.com/2019/05/a-quick-guide-on-using-stereophoto.html. For your particular stereo pair, you may get depths in the background because there is no texture. so you may have to manually edit the depth map when you are done. If you are still having problems, send me an email.
DeleteIs you stereo pair a left and right image? meaning, the 2 pictures are different viewpoints of the same scene. Just want to make sure you are not trying to get a depth map from 2 identical images. If you want to get a depth map from a single image, you need to use a different tool like the3dconverter2 but it's semi-automatic. Cheers!
Deletehave you thought about using dmag in colab and creating a notebook advantage of colab is the use of a powerful computer
ReplyDeletebrother, this is TOTALLY beyond my level of comprehension and implementation. I have an iMac. All I want to do is to take a stereo pair and turn it into a depth map for use in another application. Is there some way to do this? Thanks
ReplyDeletewill maybe work on an a mac if you use winebottler.
DeleteThis page is terrible, can't you organize a bit the various versions of DMAG, each one with its page, description, screenshots,...?
ReplyDeleteA very good software with a terrible documentation is a terrible software.
I think you are a being a little bit harsh here. For each downloadable archive, I give a link to a blog post that explains what the executable is about and how to use it. At some point (starting with archive 7), I even give a manual in pdf form and an example test case for each piece of software that's in the archive.
DeleteDjee JumpJack, be greatfull for all the work that was done!
DeleteHow to run Linux version under Linux Mint (Ubuntu)? After unpacking I can not see any make or configure files? Does Linux version utilise multicore CPU more efficiently?
ReplyDeletethe linux stuff should run directly and it's pretty much all single threaded. Note that I don't maintain the linux execs so it is given as is.
DeleteVery nice. Thanks for that!
ReplyDeletethe dmag dont work any of them ive tired it. trying to create depthmap but the dmag will only find the test dmag which has no exe. it will not find the dmag.exe.
ReplyDeleteFor the execs with no UI, you need to read the manual for them that's in the archive. Basically, you can run anywhere but you have to make sure the path to the executable is correct in the .bat file. You always double click on the .bat file, not the execs themselves.
Deletethe dmag dont work any of them ive tired it. trying to create depthmap but the dmag will only find the test dmag which has no exe. it will not find the dmag.exe.
ReplyDeletehi Ugo, great work here but my efforts do not go beyond where i need to point SPM to the folder where the downloaded DMAG 5 &9 are. what i get is, .exe not found. please, how can i resolve this challenge? thank
ReplyDeleteFollow this tutorial by the SPM creator: https://stereo.jpn.org/eng/stphmkr/makedm/index.html. In step 4, use his dmag5/dmag9b zip file.
DeleteIs the depth map in dep format? How do I use it if I have png
ReplyDeleteUsually depth maps are 1 channel image files where black is far and white is near. Or 3 channels with same values on all three channels. Most used format is probably png.
DeleteIs the depth map in dep format? How do I use it if I have png
ReplyDeletehi ! i am working on a project to create 3d human body mesh.
ReplyDeleteCould you please help me with this ??
Thanks and regards
Best bet is scan a body to get a point cloud, then use something like Poisson surface reconstruction to get a mesh. That should be available in MeshLab and CloudCompare. That's all I know and can do.
Delete