Multiple ray cluster rendering for interactive integral imaging system |
Optics Express, Vol. 21, Issue 8, pp. 10070-10086 (2013)
http://dx.doi.org/10.1364/OE.21.010070
Acrobat PDF (6625 KB)
Abstract
In this paper, we present an efficient Computer Generated Integral Imaging (CGII) method, called multiple ray cluster rendering (MRCR). Based on the MRCR, an interactive integral imaging system is realized, which provides accurate 3D image satisfying the changeable observers’ positions in real time. The MRCR method can generate all the elemental image pixels within only one rendering pass by ray reorganization of multiple ray clusters and 3D content duplication. It is compatible with various graphic contents including mesh, point cloud, and medical data. Moreover, multi-sampling method is embedded in MRCR method for acquiring anti-aliased 3D image result. To our best knowledge, the MRCR method outperforms the existing CGII methods in both the speed performance and the display quality. Experimental results show that the proposed CGII method can achieve real-time computational speed for large-scale 3D data with about 50,000 points.
© 2013 OSA
1. Introduction
2. J.-H. Park, G. Baasantseren, N. Kim, G. Park, J. M. Kang, and B. Lee, “View image generation in perspective and orthographic projection geometry based on integral imaging,” Opt. Express 16(12), 8800–8813 (2008), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-16-12-8800. [CrossRef] [PubMed]
3. Y. Igarashi, H. Murata, and M. Ueda, “3D display system using a computer generated integral photography,” Jpn. J. Appl. Phys. 17(9), 1683–1684 (1978). [CrossRef]
5. S.-W. Min, J. Kim, and B. Lee, “New characteristics equation of three-dimensional integral imaging system and its applications,” Jpn. J. Appl. Phys. 44(2), L71–L74 (2005). [CrossRef]
7. S.-W. Min, K. S. Park, B. Lee, Y. Cho, and M. Hahn, “Enhanced image mapping algorithm for computer-generated integral imaging system,” Jpn. J. Appl. Phys. 45(28), L744–L747 (2006). [CrossRef]
10. F. P. Brooks, “What’s real about virtual reality?” IEEE Comput. Graph. Appl. 19(6), 16–27 (1999). [CrossRef]
11. K.-C. Kwon, C. Park, M.-U. Erdenebat, J.-S. Jeong, J.-H. Choi, N. Kim, J.-H. Park, Y.-T. Lim, and K.-H. Yoo, “High speed image space parallel processing for computer-generated integral imaging system,” Opt. Express 20(2), 732–740 (2012), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-20-2-732. [CrossRef] [PubMed]
12. R. Fukushima, K. Taira, T. Saishu, and Y. Hirayama, “Novel viewing zone control method for computer generated integral 3-D imaging,” Proceedings of SPIE – IS&T Electronic Imaging, SPIE Vol. 5291, 81–92, (2004). [CrossRef]
13. G. Park, J.-H. Jung, K. Hong, Y. Kim, Y.-H. Kim, S.-W. Min, and B. Lee, “Multi-viewer tracking integral imaging system and its viewing zone analysis,” Opt. Express 17(20), 17895–17908 (2009), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-19-5-4129. [CrossRef] [PubMed]
2. Multiple ray cluster rendering method
2.1 Configuration of the interactive integral imaging system
15. PrimerSense 3D sensor: http://www.primesense.com/solutions/sensor/.
13. G. Park, J.-H. Jung, K. Hong, Y. Kim, Y.-H. Kim, S.-W. Min, and B. Lee, “Multi-viewer tracking integral imaging system and its viewing zone analysis,” Opt. Express 17(20), 17895–17908 (2009), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-19-5-4129. [CrossRef] [PubMed]
16. H. Choi, Y. Kim, J.-H. Park, S. Jung, and B. Lee, “Improved analysis on the viewing angle of integral imaging,” Appl. Opt. 44(12), 2311–2317 (2005). [CrossRef] [PubMed]
2.2 Multiple ray cluster calculation
12. R. Fukushima, K. Taira, T. Saishu, and Y. Hirayama, “Novel viewing zone control method for computer generated integral 3-D imaging,” Proceedings of SPIE – IS&T Electronic Imaging, SPIE Vol. 5291, 81–92, (2004). [CrossRef]
12. R. Fukushima, K. Taira, T. Saishu, and Y. Hirayama, “Novel viewing zone control method for computer generated integral 3-D imaging,” Proceedings of SPIE – IS&T Electronic Imaging, SPIE Vol. 5291, 81–92, (2004). [CrossRef]
12. R. Fukushima, K. Taira, T. Saishu, and Y. Hirayama, “Novel viewing zone control method for computer generated integral 3-D imaging,” Proceedings of SPIE – IS&T Electronic Imaging, SPIE Vol. 5291, 81–92, (2004). [CrossRef]
2.3 Rapid calculation of EIA on GPU
20. F. de Sorbier, V. Nozick, and H. Saito, “Multi-view rendering using GPU for 3-D displays,” Computer Games, Multimedia and Allied Technology (CGAT’10), April. 2010, (2010). [CrossRef]
3. Experimental results
4. Conclusion
Acknowledgments
References and links
1. | G. Lippmann, “La photographie integrale,” C.R. Acad. Sci. 146, 446–451 (1908). |
2. | J.-H. Park, G. Baasantseren, N. Kim, G. Park, J. M. Kang, and B. Lee, “View image generation in perspective and orthographic projection geometry based on integral imaging,” Opt. Express 16(12), 8800–8813 (2008), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-16-12-8800. [CrossRef] [PubMed] |
3. | Y. Igarashi, H. Murata, and M. Ueda, “3D display system using a computer generated integral photography,” Jpn. J. Appl. Phys. 17(9), 1683–1684 (1978). [CrossRef] |
4. | M. Halle, “Multiple viewpoint rendering,” SIGGRAPH’98, Proceedings of 25th annual conference on Computer graphics and interactive techniques, 243–254 (1998). |
5. | S.-W. Min, J. Kim, and B. Lee, “New characteristics equation of three-dimensional integral imaging system and its applications,” Jpn. J. Appl. Phys. 44(2), L71–L74 (2005). [CrossRef] |
6. | R. Yang, X. Huang, and S. Chen, “Efficient rendering of integral images,” SIGGRAPH’05, Proceedings of 32nd Annual Conference on Computer Graphics and Interactive Techniques, 44 (2005). |
7. | S.-W. Min, K. S. Park, B. Lee, Y. Cho, and M. Hahn, “Enhanced image mapping algorithm for computer-generated integral imaging system,” Jpn. J. Appl. Phys. 45(28), L744–L747 (2006). [CrossRef] |
8. | B.-N.-R. Lee, Y. Cho, K. S. Park, S.-W. Min, J.-S. Lim, M. C. Whang, and K. R. Park, “Design and implementation of a fast integral image rendering method,” International Conference on Electronic Commerce, 135–140 (2006). [CrossRef] |
9. | K. S. Park, S.-W. Min, and Y. Cho, “Viewpoint vector rendering for efficient elemental image generation,” IEICE Trans. Inf. Syst. E 90-D, 231–241 (2007). |
10. | F. P. Brooks, “What’s real about virtual reality?” IEEE Comput. Graph. Appl. 19(6), 16–27 (1999). [CrossRef] |
11. | K.-C. Kwon, C. Park, M.-U. Erdenebat, J.-S. Jeong, J.-H. Choi, N. Kim, J.-H. Park, Y.-T. Lim, and K.-H. Yoo, “High speed image space parallel processing for computer-generated integral imaging system,” Opt. Express 20(2), 732–740 (2012), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-20-2-732. [CrossRef] [PubMed] |
12. | R. Fukushima, K. Taira, T. Saishu, and Y. Hirayama, “Novel viewing zone control method for computer generated integral 3-D imaging,” Proceedings of SPIE – IS&T Electronic Imaging, SPIE Vol. 5291, 81–92, (2004). [CrossRef] |
13. | G. Park, J.-H. Jung, K. Hong, Y. Kim, Y.-H. Kim, S.-W. Min, and B. Lee, “Multi-viewer tracking integral imaging system and its viewing zone analysis,” Opt. Express 17(20), 17895–17908 (2009), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-19-5-4129. [CrossRef] [PubMed] |
14. | G. Park, J. Hong, Y. Kim, and B. Lee, “Enhancement of viewing angle and viewing distance in integral imaging by head tracking,” Digital Holography and Three-Dimensional Imaging, OSA Technical Digest, DWB27 (1990). |
15. | PrimerSense 3D sensor: http://www.primesense.com/solutions/sensor/. |
16. | H. Choi, Y. Kim, J.-H. Park, S. Jung, and B. Lee, “Improved analysis on the viewing angle of integral imaging,” Appl. Opt. 44(12), 2311–2317 (2005). [CrossRef] [PubMed] |
17. | J.-D. Foley, D. Van, Feiner, and Hughes, Computer Graphics: Principles and Practice, 2nd ed. (Addison-Wesley, 1990). |
18. | R. Fernando, GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics (Addison-Wesley, 2004). |
19. | F. de Sorbier, V. Nozick, and V. Biri, “GPU rendering for autostereoscopic displays,” 4th International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT’ 08), Jun. 2008, (2008). |
20. | F. de Sorbier, V. Nozick, and H. Saito, “Multi-view rendering using GPU for 3-D displays,” Computer Games, Multimedia and Allied Technology (CGAT’10), April. 2010, (2010). [CrossRef] |
OCIS Codes
(100.6890) Image processing : Three-dimensional image processing
(120.2040) Instrumentation, measurement, and metrology : Displays
ToC Category:
Image Processing
History
Original Manuscript: January 23, 2013
Revised Manuscript: March 25, 2013
Manuscript Accepted: April 10, 2013
Published: April 16, 2013
Virtual Issues
Vol. 8, Iss. 5 Virtual Journal for Biomedical Optics
Citation
Shaohui Jiao, Xiaoguang Wang, Mingcai Zhou, Weiming Li, Tao Hong, Dongkyung Nam, Jin-Ho Lee, Enhua Wu, Haitao Wang, and Ji-Yeun Kim, "Multiple ray cluster rendering for interactive integral imaging system," Opt. Express 21, 10070-10086 (2013)
http://www.opticsinfobase.org/vjbo/abstract.cfm?URI=oe-21-8-10070
Sort: Year | Journal | Reset
References
- G. Lippmann, “La photographie integrale,” C.R. Acad. Sci.146, 446–451 (1908).
- J.-H. Park, G. Baasantseren, N. Kim, G. Park, J. M. Kang, and B. Lee, “View image generation in perspective and orthographic projection geometry based on integral imaging,” Opt. Express16(12), 8800–8813 (2008), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-16-12-8800 . [CrossRef] [PubMed]
- Y. Igarashi, H. Murata, and M. Ueda, “3D display system using a computer generated integral photography,” Jpn. J. Appl. Phys.17(9), 1683–1684 (1978). [CrossRef]
- M. Halle, “Multiple viewpoint rendering,” SIGGRAPH’98, Proceedings of 25th annual conference on Computer graphics and interactive techniques, 243–254 (1998).
- S.-W. Min, J. Kim, and B. Lee, “New characteristics equation of three-dimensional integral imaging system and its applications,” Jpn. J. Appl. Phys.44(2), L71–L74 (2005). [CrossRef]
- R. Yang, X. Huang, and S. Chen, “Efficient rendering of integral images,” SIGGRAPH’05, Proceedings of 32nd Annual Conference on Computer Graphics and Interactive Techniques, 44 (2005).
- S.-W. Min, K. S. Park, B. Lee, Y. Cho, and M. Hahn, “Enhanced image mapping algorithm for computer-generated integral imaging system,” Jpn. J. Appl. Phys.45(28), L744–L747 (2006). [CrossRef]
- B.-N.-R. Lee, Y. Cho, K. S. Park, S.-W. Min, J.-S. Lim, M. C. Whang, and K. R. Park, “Design and implementation of a fast integral image rendering method,” International Conference on Electronic Commerce, 135–140 (2006). [CrossRef]
- K. S. Park, S.-W. Min, and Y. Cho, “Viewpoint vector rendering for efficient elemental image generation,” IEICE Trans. Inf. Syst. E 90-D, 231–241 (2007).
- F. P. Brooks, “What’s real about virtual reality?” IEEE Comput. Graph. Appl.19(6), 16–27 (1999). [CrossRef]
- K.-C. Kwon, C. Park, M.-U. Erdenebat, J.-S. Jeong, J.-H. Choi, N. Kim, J.-H. Park, Y.-T. Lim, and K.-H. Yoo, “High speed image space parallel processing for computer-generated integral imaging system,” Opt. Express20(2), 732–740 (2012), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-20-2-732 . [CrossRef] [PubMed]
- R. Fukushima, K. Taira, T. Saishu, and Y. Hirayama, “Novel viewing zone control method for computer generated integral 3-D imaging,” Proceedings of SPIE – IS&T Electronic Imaging, SPIE Vol. 5291, 81–92, (2004). [CrossRef]
- G. Park, J.-H. Jung, K. Hong, Y. Kim, Y.-H. Kim, S.-W. Min, and B. Lee, “Multi-viewer tracking integral imaging system and its viewing zone analysis,” Opt. Express17(20), 17895–17908 (2009), http://www.opticsinfobase.org/oe/abstract.cfm?uri=oe-19-5-4129 . [CrossRef] [PubMed]
- G. Park, J. Hong, Y. Kim, and B. Lee, “Enhancement of viewing angle and viewing distance in integral imaging by head tracking,” Digital Holography and Three-Dimensional Imaging, OSA Technical Digest, DWB27 (1990).
- PrimerSense 3D sensor: http://www.primesense.com/solutions/sensor/ .
- H. Choi, Y. Kim, J.-H. Park, S. Jung, and B. Lee, “Improved analysis on the viewing angle of integral imaging,” Appl. Opt.44(12), 2311–2317 (2005). [CrossRef] [PubMed]
- J.-D. Foley, D. Van, Feiner, and Hughes, Computer Graphics: Principles and Practice, 2nd ed. (Addison-Wesley, 1990).
- R. Fernando, GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics (Addison-Wesley, 2004).
- F. de Sorbier, V. Nozick, and V. Biri, “GPU rendering for autostereoscopic displays,” 4th International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT’ 08), Jun. 2008, (2008).
- F. de Sorbier, V. Nozick, and H. Saito, “Multi-view rendering using GPU for 3-D displays,” Computer Games, Multimedia and Allied Technology (CGAT’10), April. 2010, (2010). [CrossRef]
Cited By |
Alert me when this paper is cited |
OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.
Figures
Fig. 1 | Fig. 2 | Fig. 3 |
Fig. 4 | Fig. 5 | Fig. 6 |
Fig. 7 | Fig. 8 | Fig. 9 |
Fig. 10 | Fig. 11 | Fig. 12 |
Fig. 13 | Fig. 14 | Fig. 15 |
Fig. 16 | Fig. 17 | |
« Previous Article | Next Article »
OSA is a member of CrossRef.