OSA's Digital Library

Journal of Display Technology

Journal of Display Technology

| A JOINT IEEE/OSA PUBLICATION

  • Vol. 4, Iss. 4 — Dec. 1, 2008
  • pp: 451–467

Advanced Medical Displays: A Literature Review of Augmented Reality

Tobias Sielhorst, Marco Feuerstein, and Nassir Navab

Journal of Display Technology, Vol. 4, Issue 4, pp. 451-467 (2008)


View Full Text Article

Acrobat PDF (4851 KB)





Browse Journals / Lookup Meetings

Browse by Journal and Year


   


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

Share
Citations
  • Export Citation/Save Click for help

Abstract

The impressive development of medical imaging technology during the last decades provided physicians with an increasing amount of patient specific anatomical and functional data. In addition, the increasing use of non-ionizing real-time imaging, in particular ultrasound and optical imaging, during surgical procedures created the need for design and development of new visualization and display technology allowing physicians to take full advantage of rich sources of heterogeneous preoperative and intraoperative data. During 90's, medical augmented reality was proposed as a paradigm bringing new visualization and interaction solutions into perspective. This paper not only reviews the related literature but also establishes the relationship between subsets of this body of work in medical augmented reality. It finally discusses the remaining challenges for this young and active multidisciplinary research community.

© 2008 IEEE

Citation
Tobias Sielhorst, Marco Feuerstein, and Nassir Navab, "Advanced Medical Displays: A Literature Review of Augmented Reality," J. Display Technol. 4, 451-467 (2008)
http://www.opticsinfobase.org/jdt/abstract.cfm?URI=jdt-4-4-451


Sort:  Year  |  Journal  |  Reset

References

  1. H. Steinhaus, "Sur la localisation au moyen des rayons x," Comptes Rendus de L'Acad. des Sci. 206, 1473-1475 (1938).
  2. I. Sutherland, "A head-mounted three dimensional display," Proc. Fall Joint Computer Conf. (1968) pp. 757-764.
  3. D. Roberts, J. Strohbehn, J. Hatch, W. Murray, H. Kettenberger, "A frameless stereotaxic integration of computerized tomographic imaging and the operating microscope," J. Neurosurg. 65, 545-549 (1986).
  4. T. Caudell, D. Mizell, "Augmented reality: An application of heads-up display technology to manual manufacturing technology augmented reality," Proc. Hawaii Int. Conf. on Syst. Sci. (1992).
  5. W. Mackay, G. Velay, K. Carter, C. Ma, D. Pagani, "Augmenting reality: Adding computational dimensions to paper," Commun. ACM 36, 96-97 (1993).
  6. S. Feiner, B. Macintyre, D. Seligmann, "Knowledge-based augmented reality," Commun. ACM 36, 53-62 (1993).
  7. P. Wellner, W. Mackay, R. Gold, "Computer augmented environments: Back to the real world," Commun. ACM 36, 24-26 (1993).
  8. P. Milgram, F. Kishino, "A taxonomy of mixed reality visual displays," IEICE Trans. Inf. Syst. 1321-1329 (1994).
  9. R. T. Azuma, "A survey of augmented reality," Presence: Teleoperators and Virtual Environments 6, 355-385 (1997).
  10. R. T. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, B. MacIntyre, "Recent advances in augmented reality," IEEE Comput. Graphics Appl. 21, 34-47 (2001).
  11. F. P. Brooks, "The computer scientist as toolsmith ii," Commun. ACM 39, 61-68 (1996).
  12. M. Bajura, H. Fuchs, R. Ohbuchi, "Merging virtual objects with the real world: Seeing ultrasound imagery within the patient," Proc. 19th Annu. Conf. on Computer Graphics and Interactive Techniques (1992) pp. 203-210.
  13. M. Bajura, U. Neumann, "Dynamic registration correction in video-based augmented reality systems," IEEE Comput. Graph. Appl. 15, 52-60 (1995).
  14. M. C. Jacobs, M. A. Livingston, A. State, "Managing latencyin complex augmented reality systems," Proc. ACM 1997 Symp. on Interactive 3D Graphics (1997) pp. 49-54.
  15. A. State, M. A. Livingston, W. F. Garrett, G. Hirota, M. C. Whitton, E. D. Pisano, H. Fuchs, "Technologies for augmented reality systems: Realizing ultrasound-guided needle biopsies," SIGGRAPH'96: Proc. 23rd Annu. Conf. on Computer Graphics and Interactive Techniques (1996) pp. 439-446.
  16. M. Rosenthal, A. State, J. Lee, G. Hirota, J. Ackerman, E. D. P. K. Keller, M. Jiroutek, K. Muller, H. Fuchs, "Augmented reality guidance for needle biopsies: An initial randomized, controlled trial in phantoms," Medical Image Anal. 6, 313-320 (2002).
  17. F. Sauer, F. Wenzel, S. Vogt, Y. Tao, Y. Genc, A. Bani-Hashemi, "Augmented workspace: Designing an AR testbed," Proc. IEEE and ACM Int. Symp. on Augmented Reality (2000) pp. 47-53.
  18. W. A. Hoff, T. L. Vincent, "Analysis of head pose accuracy in augmented reality," IEEE Trans. Visualiz. Computer Graphics 6, (2000).
  19. D. L. Wright, J. P. Rolland, A. R. Kancherla, "Using virtual reality to teach radiographic positioning," Radiologic Int. Technol. 66, 233-238 (1995).
  20. Y. Argotti, L. Davis, V. Outters, J. Rolland, "Dynamic superimpo-sition of synthetic objects on rigid and simple-deformable real objects," Computers & Graphics 26, 919-930 (2002).
  21. T. Sielhorst, T. Blum, N. Navab, "Synchronizing 3d movements for quantitative comparison and simultaneous visualization of actions," Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR) (2005).
  22. G. Luo, E. Peli, "Use of an augmented-vision device for visual search by patients with tunnel vision," Investigative Ophthalmology & Visual Science 47, 4152-4159 (2006).
  23. J. P. Rolland, H. Fuchs, "Optical versus video see-through head-mounted displays in medical visualization," Presence 9, 287-309 (2000).
  24. O. Cakmakci, J. Rolland, "Head-worn displays: A review," Int. J. Display Int. Technol. 2, 199-216 (2006).
  25. P. J. Kelly, G. Alker, S. Goerss, "Computer-assisted stereotactic laser microsurgery for the treatment of intracranial neoplasms," Neurosurgery 10, 324-331 (1982).
  26. J. Hatch, J. S. D. W. Roberts, "Reference-display system for the integration of CT scanning and the operating microscope," Proc. 11th Annu. Northeast Bioeng. Conf. (1985).
  27. E. M. Friets, J. W. Strohbehn, J. F. Hatch, D. W. Roberts, "A frameless stereotaxic operating microscope for neurosurgery," IEEE Trans. Biomed. Eng. 36, (1989).
  28. P. J. Edwards, D. D. Hill, D. D. Hawkes, D. A. Colchester, "Neurosurgical guidance using the stereo microscope," Proc. First Int. Conf. Computer Vision, Virtual Reality and Robotics in Medicine (CVRMed'95) (1995).
  29. A. P. King, P. J. Edwards, C. R. Maurer, Jr.D. A. de Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, M. R. Fenlon, A. J. Strong, C. L. Chandler, A. Richards, M. J. Gleeson, "Design and evaluation of a system for microscope-assisted guided interventions," IEEE Trans. Med. Imag. 19, 1082-1093 (2000).
  30. J. Berger, D. Shin, "Computer-vision-enabled augmented reality fundus biomicroscopy," Ophthalmology 106, 1935-1941 (1999).
  31. W. Birkfellner, M. Figl, K. Huber, F. Watzinger, F. Wanschitz, J. Hummel, R. Hanel, W. Greimel, P. Homolka, R. Ewers, H. Bergmann, "A head-mounted operating binocular for augmented reality visualization in medicine—Design and initial evaluation," IEEE Trans. Med. Imag. 21, 991-997 (2002).
  32. W. Birkfellner, K. Huber, F. Watzinger, M. Figl, F. Wanschitz, R. Hanel, D. Rafolt, R. Ewers, H. Bergmann, "Development of the varioscopear—A see-through hmd for computer-aided surgery," Proc. IEEE and ACM Int. Symp. on Augmented Reality (2000) pp. 54-59.
  33. M. Figl, C. Ede, J. Hummel, F. Wanschitz, R. Ewers, H. Bergmann, W. Birkfellner, "A fully automated calibration method for an optical see-through head-mounted operating microscope with variable zoom and focus," IEEE Trans. Med. Imag. 24, 1492-1499 (2005).
  34. R. Holloway, "Registration error analysis for augmented reality," Presence: Teleoperators and Virtual Env. 6, 413-432 (1997).
  35. Y. Masutani, M. Iwahara, O. Samuta, Y. Nishi, N. Suzuki, M. Suzuki, T. Dohi, H. Iseki, K. Takakura, "Development of integral photography-based enhanced reality visualization system for surgical support," Proc. lSCAS 95, 16-17 (1995).
  36. H. Liao, S. Nakajima, M. Iwahara, E. Kobayashi, I. Sakuma, N. Yahagi, T. Dohi, "Intra-operative real-time 3-D information display system based on integral videography," Proc. Int. Conf. Med. Image Computing and Computer Assisted Intervention (MICCAI) (2001) pp. 392-400.
  37. H. Liao, N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, T. Dohi, "Surgical navigation by autostereoscopic image overlay of integral videography," IEEE Trans. Int. Technol. Biomed. 8, 114-121 (2004).
  38. M. Blackwell, C. Nikou, A. M. D. Gioia, T. Kanade, "An image overlay system for medical data visualization," Proc. First Int. Conf. of Medical Image Computing and Computer-Assisted Intervention (MICCAI) Lecture Notes in Comput. Sci. (1998) pp. 232-240.
  39. G. Goebbels, K. Troche, M. Braun, A. Ivanovic, A. Grab, K. von Lübtow, R. Sader, F. Zeilhofer, K. Albrecht, K. Praxmarer, "Arsystricorder—development of an augmented reality system for intraoperative navigation in maxillofacial surgery," Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR) (2003).
  40. S. Wesarg, E. Firle, B. Schwald, H. Seibert, P. Zogal, S. Roeddiger, R. L. Galloway, Jr."Accuracy of needle implantation in brachytherapy using a medical AR system: A phantom study," Proc. 2004 SPIE Medical Imaging: Visualization, Image-Guided Procedures, and Display 5367, 341-352 (2004).
  41. W. Lorensen, H. Cline, C. Nafis, R. Kikinis, D. Altobelli, L. Gleason, G. Co, N. Schenectady, "Enhancing reality in the operating room," IEEE Conf. on Visualization (1993) pp. 410-415.
  42. W. E. L. Grimson, T. Lozano-Perez, W. M. Wells III, G. J. Ettinger, S. J. White, R. Kikinis, "An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization," IEEE Trans. Med. Imag. 15, 129-140 (1996).
  43. Y. Sato, M. Nakamoto, Y. Tamaki, T. Sasama, I. Sakita, Y. Nakajima, M. Monden, S. Tamura, "Image guidance of breast cancer surgery using 3-d ultrasound images and augmented reality visualization," IEEE Trans. Med. Imag. 17, (1998).
  44. S. Nicolau, X. Pennec, L. Soler, N. Ayache, "An accuracy certified augmented reality system for therapy guidance," Proc. 8th Eur. Conf. on Computer Vision (ECCV 04) (2004) pp. 79-91.
  45. W. Lau, "History of endoscopic and laparoscopic surgery," World Int. J.f Surgery 21, 444-453 (1997).
  46. G. Litynski, "Endoscopic surgery: The history, the pioneers," World Int. J. Surgery 23, 745-753 (1999).
  47. G. Berci, K. A. Forde, "History of endoscopy—What lessons have we learned from the past?," Surgical Endoscopy 14, 5-15 (2002).
  48. W. Freysinger, A. Gunkel, W. Thumfart, "Image-guided endoscopicent surgery," Eur. Archives of Otorhinolaryngology 254, 343-346 (1997).
  49. R. Shahidi, B. Wang, M. Epitaux, R. Grzeszczuk, J. Adler, "Volumetric image guidance via a stereotactic endoscope," Proc. First Int. Conf. Med. Image Computing and Computer-Assisted Intervention (MICCAI) (1998) pp. 241-252.
  50. M. Scholz, W. Konen, S. Tombrock, B. Fricke, L. Adams, "Development of an endoscopic navigation system based on digitalimage processing," Computer Aided Surgery 3, 134-143 (1998).
  51. F. Mourgues, È. Coste-Manière, "Flexible calibration of actuated stereoscopic endoscope for overlay in robot assisted surgery," Proc. Int. Conf. Med. Image Computing and Computer Assisted Intervention (MICCAI) (2002) pp. 25-34.
  52. R. Khadem, M. R. Bax, J. A. Johnson, E. P. Wilkinson, R. Shahidi, "Endoscope calibration and accuracy testing for 3d/2d image registration," Proc. Int. Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI) (2001) pp. 1361-1362.
  53. W. E. Smith, N. Vakil, S. A. Maislin, "Correction of distortion in endoscope images," IEEE Trans. Med. Imag. 11, 117-122 (1992).
  54. S. De Buck, J. Van Cleynenbreuge, I. Geys, T. Koninckx, P. R. Koninck, P. Suetens, "A system to support laparoscopic surgery by augmented reality visualization," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2001) pp. 691-698.
  55. R. Shahidi, M. R. Bax, C. R. Maurer, Jr.J. A. Johnson, E. P. Wilkinson, B. Wang, J. B. West, M. J. Citardi, K. H. Manwaring, R. Khadem, "Implementation, calibration and accuracy testing of an image-enhanced endoscopy system," IEEE Trans. Med. Imag. 21, 1524-1535 (2002).
  56. J. Heikkilä, O. Silvén, "A four-step camera calibration procedure with implicit image correction," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR) (1997) pp. 1106-1112.
  57. R. Tsai, "A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE Int. J. Robot. Autom. RA-3, 323-344 (1987).
  58. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. .Pattern Anal. Mach. Intell. 22, 1330-1334 (2000).
  59. D. Stoyanov, A. Darzi, G. Z. Yang, "Laparoscope self-calibration for robotic assisted minimally invasive surgery," Proc. Int. Conf. Med. Image Computing and Computer Assisted Intervention (MIC-CAI) (2005) pp. 114-121.
  60. R. Willson, Modeling and calibration of automated zoom lenses. Ph.D. dissertation Robotics Inst. Carnegie Mellon Univ.PittsburghPA (1994).
  61. G. Bianchi, C. Wengert, M. Harders, P. Cattin, G. Székely, "Camera-marker alignment framework and comparison with hand-eye calibration for augmented reality applications 2005," ISMAR 188-189 (2005).
  62. S. Nicolau, L. Goffin, L. Soler, "A low cost and accurate guidance system for laparoscopic surgery: Validation on an abdominal phantom," ACM Symp. on Virtual Reality Software and Int. Technol. (2005) pp. 124-133.
  63. M. Scheuering, A. Schenk, A. Schneider, B. Preim, G. Greiner, "Intraoperative augmented reality for minimally invasive liver interventions," Proc. 2003 SPIE Medical Imag.: Visualization, Image-Guided Procedures, and Display, (2003).
  64. J. Schmidt, F. Vogt, H. Niemann, "Robust hand-eye calibration of an endoscopic surgery robot using dual quaternions," 25th DAGM Symp. Pattern Recogn. (2003) pp. 548-556.
  65. G. Marti, V. Bettschart, J.-S. Billiard, C. Baur, "Hybrid method forboth calibration and registration of an endoscope with an active optical tracker," Comput. Assisted Radiology and Surgery (2004).
  66. T. Yamaguchi, M. Nakamoto, Y. Sato, K. Konishi, M. Hashizume, N. Sugano, H. Yoshikawa, S. Tamura, "Development of a camera model and calibration procedure for oblique-viewing endoscopes," Computer Aided Surgery 9, 203-214 (2004).
  67. S. De Buck, F. Maes, A. D'Hoore, P. Suetens, "Evaluation of a novel calibration technique for optically tracked oblique laparoscopes," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2007) pp. 467-474.
  68. I. Bricault, G. Ferretti, P. Cinquin, "Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy," IEEE Trans. Med. Imag. 17, 703-714 (1998).
  69. K. Mori, D. Deguchi, J. Ichi Hasegawa, Y. Suenaga, J. ichiro Toriwaki, H. Takabatake, H. Natori, "A method for tracking the camera motion of real endoscope by epipolar geometry analysis and virtual endoscopy system," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2001) pp. 1-8.
  70. K. Mori, D. Deguchi, K. Akiyama, T. Kitasaka, C. R. Maurer Jr., Y. Suenaga, H. Takabatake, M. Mori, H. Natori, "Hybrid bronchoscope tracking using a magnetic tracking sensor and image registration," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2005) pp. 543-550.
  71. I. Wegner, M. Vetter, M. Schoebinger, I. Wolf, H. Meinzer, "Development of a navigation system for endoluminal brachytherapy in human lungs," Proc. SPIE Medical Imaging 2006: Visualization, Image-Guided Procedures, and Display (2006) pp. 23-30.
  72. T. Klein, J. Traub, H. Hautmann, A. Ahmadian, N. Navab, "Fiducial free registration procedure for navigated bronchoscopy," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2007).
  73. S. Krüger, F. Vogt, W. Hohenberger, D. Paulus, H. Niemann, C. H. Schick, "Evaluation of computer-assisted image enhancementin minimal invasive endoscopic surgery," Methods Inf. Med. 43, 362-366 (2004).
  74. H. Fuchs, M. A. Livingston, R. Raskar, D. Colucci, K. Keller, A. State, J. R. Crawford, P. Rademacher, S. H. Drake, A. A. Meyer, "Augmented reality visualization for laparoscopic surgery," Proc. First Int. Conf. of Medical Image Computing and Computer-Assisted Intervention (MICCAI) (1998) pp. 934-943.
  75. D. Dey, D. Gobbi, P. Slomka, K. Surry, T. Peters, "Automatic fusion of freehand endoscopic brain images to three-dimensional surfaces: Creating stereoscopic panoramas," IEEE Trans. Med. Imag. 21, 23-30 (2002).
  76. T. Kawamata, H. Iseki, T. Shibasaki, T. Hori, "Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: Technical note," Neurosurgery 50, 1393-1397 (2002).
  77. J. Ellsmere, J. Stoll, D. W. Rattner, D. Brooks, R. Kane, W. M. Wells III, R. Kikinis, K. Vosburgh, "A navigation system for augmenting laparoscopic ultrasound," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2003) pp. 184-191.
  78. N. Navab, M. Mitschke, A. Bani-Hashemi, "Merging visible and invisible: Two camera-augmented mobile C-arm (CAMC) applications," Proc. IEEE and ACM Int. Workshop on Augmented Reality (1999) pp. 134-141.
  79. G. Fichtinger, A. Deguet, K. Masamune, E. Balogh, G. S. Fischer, H. Mathieu, R. H. Taylor, S. J. Zinreich, L. M. Fayad, "Image overlay guidance for needle insertion in ct scanner," IEEE Trans. Biomed. Engi. 52, 1415-1424 (2005).
  80. K. Masamune, Y. Masutani, S. Nakajima, I. Sakuma, T. Dohi, H. Iseki, K. Takakura, "Three-dimensional slice image overlay system with accurate depth perception for surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2000) pp. 395-402.
  81. G. Fischer, A. Deguet, D. Schlattman, L. Fayad, S. Zinreich, R. Taylor, G. Fichtinger, "Image overlay guidance for mri arthrography needle insertion," Computer Aided Surgery 12, 2-4 (2007).
  82. G. D. Stetten, V. S. Chib, "Overlaying ultrasound images on direct vision," Int. J. Ultrasound in Medicine 20, 235-240 (2001).
  83. G. Stetten, V. Chib, R. Tamburo, "Tomographic reflection to merge ultrasound images with direct vision," IEEE Proc. Applied Imagery Pattern Recognition (AIPR) Annu. Workshop (2000) pp. 200-205.
  84. N. Glossop, Z. Wang, "Laser projection augmented reality system for computer assisted surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2003) pp. 239-246.
  85. T. Sasama, "A novel laser guidance system for alignment of linear surgical tools: Its principles and performance evaluation as a man-machine system," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2002) pp. 125-132.
  86. T. Wendler, J. Traub, S. Ziegler, N. Navab, "Navigated threedimensional beta probe for optimal cancer resection," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) vol. 4190 of Lecture Notes in Computer Science (2006) pp. 561-569.
  87. D. A. Bowman, E. Kruijff, J. J. LaViola, I. Poupyrev, 3D UserInterfaces: Theory and Practice (Addison Wesley Longman Publishing Co., Inc., 2004).
  88. J. Traub, P. Stefan, S.-M. Heining, T. Sielhorst, C. Riquarts, E. Eu-ler, N. Navab, "Hybrid navigation interface for orthopedic and trauma surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2006) pp. 373-380.
  89. T. Peters, C. Henri, P. Munger, A. Takahashi, A. Evans, B. Davey, A. Olivier, "Integration of stereoscopic DSA and 3D MRI for image-guided neurosurgery," Comput Med Imaging Graph. 18, 289-299 (1994).
  90. C. Calvano, M. Moran, L. Tackett, P. Reddy, K. Boyle, M. Pankra-tov, "New visualization techniques for in utero surgery: Amnioscopy with a three-dimensional head-mounted display and a computer-controlled endoscope.," J. Endourol. 12, 407-410 (1998).
  91. G. Hanna, S. Shimi, A. Cuschieri, "Task performance in endoscopic surgery is influenced by location of the image display," Ann. Surg. 227, 481-484 (1998).
  92. J. B. A. Maintz, M. A. Viergever, "A survey of medical image registration," Medical Image Analysis 2, 1-36 (1998).
  93. M. Tuceryan, D. S. Greer, R. T. Whitaker, D. E. Breen, C. Crampton, E. Rose, K. H. Ahlers, "Calibration requirements and proceduresfor a monitor-based augmented reality system," IEEE Trans. Visualiz. Computer Graphics 1, 255-273 (1995).
  94. C. R. Maurer Jr., J. M. Fitzpatrick, M. Y. Wang, J. Robert, L. Galloway, R. J. Maciunas, G. S. Allen, "Registration of head volume images using implantable fiducial markers," IEEE Trans. Med. Imag. 16, 447-462 (1997).
  95. J. D. Stefansic, A. J. Herline, Y. Shyr, W. C. Chapman, J. M. Fitzpatrick, R. L. Galloway, "Registration of physical space to laparoscopic image space for use in minimally invasive hepatic surgery," IEEE Trans. Medical Imaging 19, 1012-1023 (2000).
  96. M. Feuerstein, S. M. Wildhirt, R. Bauernschmitt, N. Navab, "Automatic patient registration for port placement in minimally invasive endoscopic surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2005) pp. 287-294.
  97. M. Feuerstein, T. Mussack, S. M. Heining, N. Navab, "Intra-operative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection," IEEE Trans. Med. Imag. 27, 355-369 (2008).
  98. M. Baumhauer, T. Simpfendörfer, R. Schwarz, M. Seitel, B. Müller-Stich, C. Gutt, J. Rassweiler, H.-P. Meinzer, I. Wolf, "Soft tissue navigation for laparoscopic prostatectomy: Evaluation of camera pose estimation for enhanced visualization," Proc. SPIE Medical Imaging 2007: Visualization and Image-Guided Procedures (2007).
  99. R. U. Thoranaghatte, G. Zheng, F. Langlotz, L.-P. Nolte, "Endoscope-based hybrid navigation system for minimally invasive ventral spine surgeries," Computer Aided Surgery 10, 351-356 (2005).
  100. J. M. Fitzpatrick, J. B. West, C. R. Maurer Jr., "Predicting error in rigid-body point-based registration," IEEE Trans. Med. Imag. 14, 694-702 (1998).
  101. R. Grzeszczuk, S. Chin, R. Fahrig, H. Abassi, H. Holz, J. A. Daniel Kiml, R. Shahidi, "A fluoroscopic x-ray registration processfor three-dimensional surgical navigation," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2000).
  102. M. J. Murphy, "An automatic six-degree-of-freedom image registration algorithm for image-guided frameless stereotaxic radiosurgery," Medical Phys. 24, 857-866 (1997).
  103. M. Feuerstein, T. Mussack, S. M. Heining, N. Navab, "Registration-free laparoscope augmentation for intra-operative liver resection planning," Medical Imaging 2007: Visualization and Image-Guided Procedures, Proc. SPIE (2007).
  104. P. A. Grützner, A. Hebecker, H. Waelti, B. Vock, L.-P. Nolte, A. Wentzensen, "Clinical sludy for registration-free 3d-navigation with the siremobil iso-c$^{3{\rm D}}$ mobile C-arm," Electromedica 71, 7-16 (2003).
  105. D. Burschka, M. Li, R. Taylor, G. D. Hager, "Scale-invarianlregistration of monocular endoscopic images to ct-scans for sinus surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2004) pp. 413-421.
  106. C. Wengert, P. Cattin, J. M. Duff, C. Baur, G. Székely, "Markerless endoscopic registration and referencing," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2006).
  107. C. Maurer, Jr."Investigation of intraopera live brain deformation using a 1.5-T interventional MR system: Preliminary results," IEEE Trans. Med. Imag. 17, 817 (1998).
  108. M. Nakamoto, Y. Sato, M. Miyamoto, Y. Nakamjima, K. Konishi, M. Shimada, M. Hashizume, S. Tamura, "3d ultrasound system using a magneto-optic hybrid tracker for augmented reality visualization in laparoscopic liver surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2002) pp. 148-155.
  109. J. Leven, D. Burschka, R. Kumar, G. Zhang, S. Blumenkranz, X. D. Dai, M. Awad, G. D. Hager, M. Marohn, M. Choli, C. Hasser, R. H. Taylor, "Davinci canvas: A teterobotic surgical system wilh integrated, robot-assisted, laparoscopic ultrasound capability," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI), Vol. 3749 of Lecture Notes in Computer Science (2005) pp. 811-818.
  110. M. Feuerstein, T. Reichl, J. Vogel, A. Schneider, H. Feussner, N. Navab, "Magneto-optic tracking of a flexible laparoscopic ultrasound transducer for laparoscope augmentation," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2007) pp. 458-466.
  111. F. S. Azar, D. N. Metaxas, M. D. Schnall, "Methods for modeling and predicting mechanical deformations of the breast under external perturbations," Medical Image Analysis 6, 1-27 (2002).
  112. J. W. Wong, M. B. Sharpe, D. A. Jaffray, V. R. Kini, J. M. Robertson, J. S. Stromberg, A. A. Martinez, "The use of active breathing control (abc) to reduce margin for breathing motion," Int. Int. J. Radiation Oncology*Biology*Phys. 44, 911-919 (1999).
  113. J. M. Bailer, L. A. Dawson, S. Kazanjian, C. McGinn, K. K. Brock, T. Lawrence, R. T. Haken, "Determination of ventilatory liver movement via radiographic evaluation of diaphragm position," Int.. J. Radiation Oncology*Biology*Phys. 51, 267-270 (2001).
  114. M. Baumhauer, M. Feuerstein, H.-P. Meinzer, J. Rassweiler, "Nav-igation in endoscopic soft tissue surgery: Perspectives and limitations," Int. J. Endourology 22, 1-16 (2008).
  115. F. Vogl, Augmented light field visualization and real-time image enhancement for computer assisted endoscopic surgery Ph.D. dissertation Universilal Erlangen-Nürnberg (2005).
  116. C. Ware, R. Balakrishnan, "Reaching for objects in VR displays: Lag and frame rate," ACM Trans. Computer-Human Interaction 1, 331-356 (1994).
  117. T. Sielhorst, C. Bichlmeier, S. M. Heining, N. Navab, "Depth perception a major issue in medical ar: Evaluation study by twenty surgeons," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2006).
  118. T. Sielhorst, W. Sa, A. Khamene, F. Sauer, N. Navab, "Measurement of absolute latency for video see through augmented reality," Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR) (2007).
  119. B. Mactntyre, E. M. Coelho, S. Julier, "Estimating and adapting to registration errors in augmented reality systems," Proc. IEEE Virtual Reality (VR) (2002).
  120. T. Sielhorst, M. A. Bauer, O. Wenisch, G. Klinker, N. Navab, "Online estimation of the target registration error for n-ocular opticaltracking systems," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2007).
  121. C. Nafis, V. Jensen, L. Beauregard, P. Anderson, "Method for estimating dynamic em tracking accuracy of surgical navigation tools," Proc. SPIE Medical Imaging 2006: Visualization, Image Guided Procedures, and Display (2006).
  122. P. Jannin, J. Fitzpatrick, D. Hawkes, X. Pennec, R. Shahidi, M. Vannier, "Validation of medical image processing in image-guided therapy," IEEE Trans. Med. Imag. 21, 1445-1449 (2002).
  123. D. Drascic, P. Milgram, "Perceptual issues in augmented reality," SPIE Volume 2653: Stereoscopic Displays and Virtual Reality Syst. 2653, 123-134 (1996).
  124. J. E. Cutting, P. M. Vishton, W. Epstein, S. Rogers, "Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth," Perception of Space and Motion 69-117 (1995).
  125. L. G. Johnson, P. Edwards, D. Hawkes, Medicine Meets Virtual Reality (MMVR), Vol. 94 of Studies in Health Int. Technol. and Inf. (IOS Press, 2002) pp. 131-136.
  126. C. Furmanski, R. Azuma, M. Daily, "Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information," Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR) (2002).
  127. M. Livingston, I. JE, H. JL, H. TH, S. D. Julier, "Resolving multiple occluded layers in augmented reality," Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR) (2003) pp. 56-65.
  128. M. Lerotic, A. J. Chung, G. Mylonas, G.-Z. Yang, "pq-space based non-photorealistic rendering for augmented reality," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2007) pp. 102-109.
  129. F. A. Biocca, J. P. Rolland, "Virtual eyes can rearrange your body: Adaptation to visual displacement in see-through, head-mounted displays," Presence: Teleoperators and Virtual Env. 7, 262-277 (1998).
  130. E. M. Kolasinski, S. L. Goldberg, J. H. Hiller, Simulator sickness in virtual environments U.S. Army Research Institute—Simulator Syst. Research Unit Technical Report 1027 (1995).
  131. G. Riccio, "An ecological theory of motion and postural instability," Ecological Psychology 3, 195-240 (1991).
  132. W. E. Lorensen, H. E. Cline, "Marching cubes: A high resolution 3d surface construction algorithm," Proc. 14th Annu. Conf. on SIGGRAPH'87: Computer Graphics and Interactive Techniques (1987) pp. 163-169.
  133. J. Krüger, R. Westermann, "Acceleration techniques for GPU-based volume rendering," Proceedings IEEE Visualization 2003 (2003).
  134. M. Levoy, "Display of surfaces from volume data," IEEE Computer Graphics and Appl. 8, 29-37 (1988).
  135. A. Van Gelder, K. Kim, "Direct volume rendering with shading via three-dimensional textures," Proc. 1996 Symp. on Volume Visualization (1996) pp. 23-30.
  136. B. Reitinger, A. Bornik, R. Beichel, D. Schmalstieg, "Liver surgery planning using virtual reality," IEEE Computer Graphics and Applications 26, 36-47 (2006).
  137. N. Navab, M. Feuerstein, C. Bichlmeier, "Laparoscopic virtual mirror—New interaction paradigm for monitor based augmented reality," Virtual Reality (2007) pp. 43-50.
  138. S.-A. Ahmadi, T. Sielhorst, R. Stauder, M. Horn, H. Feussner, N. Navab, "Recovery of surgical workflow without explicit models," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2006) pp. 420-428.
  139. C. Bichlmeier, F. Wimmer, H. S. Michael, N. Nassir, "Con-textual anatomic mimesis: Hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality," Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR) (2007) pp. 129-138.
  140. D. Kalkofen, E. Mendez, D. Schmalstieg, "Interactive focus and context visualization for augmented reality," Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR) (2007).
  141. C. Pettey, L. Goasduff, Emerging Technologies Hype Cycle (Gartner, 2006).

Cited By

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited