TELECOMMUNICATIONS AND RADIO ENGINEERING - 2010 Vol. 69,
No 5 		 

 

 

 

3D Color Video Conversion Using Depth Map Estimation


E. Ramos & V. Ponomaryov
National Polytechnic Institute of Mexico, Mexico-city, Mexico
Address all correspondence to V. Ponomaryov E-mail: kvf@pochta.ru

Abstract
Color video algorithm, which permits to convert 2D video sequence to 3D one, is presented. Optical flow approach based on differential technique and warping theory is used, obtaining the disparity estimation from two frames in a color video sequence, and finally, the estimation of the depth map. Formed depth map is employed in construction of 3D video sequence by means of an anaglyph employment. The depth map manipulation via P-th law compression is used permitting to avoid ghosting in anaglyph synthesis. The results of the proposed 3D reconstruction method are compared with the same obtained by Photoshop algorithm demonstrating better performance of the proposal. Numerous simulation experiments with several color video sequences have confirmed good visual performance of novel framework in reconstruction of 3D sequences.

KEY WORDS: stereovision, anaglyph, depth map, image warping technique



References
  1. Halle, M., (2007), Auto-stereoscopic displays and computer graphics, Compt. Graphics, ACM, 31(2):58-62.
  2. Blundell, B. and Schwartz, A., (2000), Volumetric three-dimensional display systems, Wiley Publishers, USA.
  3. Ideses, I.A., Yaroslavsky, L.P., Fishbain, B., and Vistuch, R., (2007), 3D from Compressed 2D Video, Proc. of  SPIE 6490, pp 28-35.
  4. Kravchenko, V.F., Perez-Meana, H., and Ponomaryov, V.I., (2009), Adaptive Digital Processing of Multidimensional Signals with Applications, FizMatLit Edit., Moscow (in Russian).
  5. Ideses, I. and Yaroslavsky, L., (2002), A method for generating 3D video from a single video stream. Vision Modeling and Visualization, pp. 435-438.
  6. Barron, J.L., Fleet, D.J., Beauchemin, S.S., and Burkitt, T., (1992), Performance of optical flow techniques. IEEE Conf. CVPR, pp. 236-242.
  7. Horn, B.K.P., and Schunk, B.G., (1981), Determining optical flow. AI 17(1-3):185-204.
  8. Shkvarko Y.V., (2010), Unifying Experiment Design and Convex Regularization Techniques for Enhanced Imaging With Uncertain Remote Sensing Data-Part I: Theory, IEEE Trans. on Geos. Rem. DOI: 10.1109/TGRS.2009.2027695 (in press)
  9. Lucas, B. and Kanade, T., (1981), An iterative image registration technique with an application to stereovision. Proc. DARPA IU Workshop, pp. 121-130.
  10. Anandan, P., (1989), A computational framework and an algorithm for the measurement of visual motion. Int. J. Comp. Vision, 2(3):283-310.
  11. Heeger, D.J., (1987), Model for the extraction of image flow. J. Opt. Soc. Am., 4(8):1455-1471.
  12. Heeger, D.J., (1988), Optical flow using spatiotemporal filters, Int. J. Comp. Vision, 1(4):279-302.
  13. Alagoz, B.B., (2008). Obtaining depth maps form color images by region based stereo matching algorithms. OncuBilim Algorithm and Systems Labs, 8(4):1-12.
  14. Bhatti, A. and Nahavandi, S., (2008), Stereo Correspondence estimation based on wavelets and multi-wavelets analysis. Stereo vision, I-Tech, Austria.
  15. Brox, T., Bruhn, A., Papenberg N., and Weickert J., (2004), High accuracy optical flow estimation based on a theory for warping. 8th Proc. European on Computer Vision, Lecture Notes on Computer Science 3024(4):25-36.
  16. Uras, S., Girosi, F., Verri, A., and Torre, V., (1988), A computational approach to motion perception, Biological Cybernetics, 60(2):79-87.
  17. Black, M.J. and Anandan, P., (1996), The robust estimation of multiple motions: parametric and piecewise smooth flow fields. Computer vision and image understanding, Academic Press, 63(1):75-104.
  18. Cohen, I., (1993), Nonlinear variational method of optical flow computation. Int. Proc. SCIA, pp.523-530.
  19. Ideses, I.A., Yaroslavsky, L.P., and Fishbain, B., (2007), Real time 2D to 3D video conversion. J. Real Time Image Proc., 2(1):3-9.
  20. Yaroslavsky, L., Campos, J., Espinola, M., and Ideses, I., (2005), Redundancy of stereoscopy images: experimental evaluation, Opt. Express, 13(26):10895-10907.
  21. Goshtasby, A., (2005), 2D and 3D image registration, Wiley Publishers, USA.
  22. Sanders W. and McAllister D., (2003), Producing anaglyphs from synthetic images. Conf. 5005, A stereoscopic displays and applications XIV. Proc. SPIE, 5006:pp.348-358.


pages 459-471

Back