OSA's Digital Library

Journal of Display Technology

Journal of Display Technology


  • Vol. 4, Iss. 4 — Dec. 1, 2008
  • pp: 483–490

Advanced Display and Visualization Concepts for Image Guided Surgery

Joerg Traub, Tobias Sielhorst, Sandro-Michael Heining, and Nassir Navab

Journal of Display Technology, Vol. 4, Issue 4, pp. 483-490 (2008)

View Full Text Article

Acrobat PDF (804 KB)

Browse Journals / Lookup Meetings

Browse by Journal and Year


Lookup Conference Papers

Close Browse Journals / Lookup Meetings

Article Tools

  • Export Citation/Save Click for help


Thanks to its rapid development in the last decades, image guided surgery (IGS) has been introduced successfully in many modern operating rooms. Current IGS systems provide their navigation information on a standard computer monitor. Alternatively, one could enhance the direct sight of the physician by an overlay of the virtual data onto the real patient view. Such in situ visualization methods have been proposed in the literature for providing a more intuitive visualization, improving the ergonomics as well as the hand-eye coordination. In this paper, we first discuss the fundamental issues and the recent endeavors in advanced display and visualization for IGS. We then present some of our recent work comparing two navigation systems: 1) a classical monitor based navigation and 2) a new navigation system we had developed based on in situ visualization. As both solutions reveal shortcomings as well as complementary advantages, we introduce a new solution that combines both concepts into one hybrid user interface. Finally, experimental results report on the performance of several surgeons using an external monitor as well as a stereo video see-through head-mounted display (HMD). The experiments consist of drilling into a phantom in order to reach planted deep-seated targets only visible in Computed Tomography (CT) data. We evaluate several visualization techniques, including the new hybrid solution, and study their influence on the performance of the participant surgeons.

© 2008 IEEE

Joerg Traub, Tobias Sielhorst, Sandro-Michael Heining, and Nassir Navab, "Advanced Display and Visualization Concepts for Image Guided Surgery," J. Display Technol. 4, 483-490 (2008)

Sort:  Year  |  Journal  |  Reset


  1. Image-Guided Interventions—Technology and Applications (Springer, 2008).
  2. F. Langlotz, L. Nolte, Minimally Invasive Spine Surgery—A Surgical Manual (Springer, 2006) pp. 26-32.
  3. F. Langlotz, E. Keeve, "Minimally invasive approaches in orthopaedic surgery," Minimally Invasive Therapy and Allied Technologies 12, 19-24 (2003).
  4. N. Navab, M. Mitschke, A. Bani-Hashemi, "Merging visible and invisible: Two camera-augmented mobile C-arm (CAMC) applications," Proceedings of International Workshop on Augmented Reality (IWAR) (1999) pp. 134-141.
  5. G. D. Stetten, V. S. Chib, "Overlaying ultrasound images on direct vision," J. Ultrasound in Medicine 20, 235-240 (2001).
  6. G. Fichtinger, A. Deguet, K. Masamune, E. Balogh, G. S. Fischer, H. Mathieu, R. H. Taylor, S. J. Zinreich, L. M. Fayad, "Image overlay guidance for needle insertion in CT scanner," IEEE Trans. Biomed. Eng. 52, 1415-1424 (2005).
  7. G. S. Fischer, A. Deguet, D. Schlattman, R. Taylor, L. Fayad, S. J. Zinreich, G. Fichtinger, "MRI image overlay: Applications to arthrography needle insertion," Medicine Meets Virtual Reality (MMVR) 14 (2006).
  8. H. Fuchs, M. A. Livingston, R. Raskar, D. Colucci, K. Keller, A. State, J. R. Crawford, P. Rademacher, S. H. Drake, A. A. Meyer, "Augmented reality visualization for laparoscopic surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (1998) pp. 934-943.
  9. Y. Argotti, L. Davis, V. Outters, J. Rolland, "Dynamic superimposition of synthetic objects on rigid and simple-deformable real objects," Computers & Graphics 26, 919-930 (2002).
  10. W. Birkfellner, M. Figl, K. Huber, F. Watzinger, F. Wanschitz, J. Hummel, R. Hanel, W. Greimel, P. Homolka, R. Ewers, H. Bergmann, "A head-mounted operating binocular for augmented reality visualization in medicine-design and initial evaluation," IEEE Trans. Med. Imag. 21, 991-997 (2002).
  11. M. Figl, C. Ede, J. Hummel, F. Wanschitz, R. Ewers, H. Bergmann, W. Birkfellner, "A fully automated calibration method for an optical see-through head-mounted operating microscope with variable zoom and focus," name of periodical??? 24, 1492-1499 (2005).
  12. A. P. King, P. J. Edwards, C. R. Maurer, Jr.D. A. de Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, M. R. Fenlon, A. J. Strong, C. L. Chandler, A. Richards, M. J. Gleeson, "A system for microscope-assisted guided interventions," IEEE Trans. Med. Imag. 19, 1082-1093 (2000).
  13. D. L. Hill, P. G. Batchelor, M. Holden, D. J. Hawkes, "Medical image registration," Phys. Med. Biol. 46, R1-R45 (2001).
  14. J. Rolland, L. Davis, Y. Baillot, A Survey of Tracking Technology for Virtual Environments (2001) pp. 67-112.
  15. T. Sielhorst, M. A. Bauer, O. Wenisch, G. Klinker, N. Navab, "Online estimation of the target registration error for n-ocular optical tracking systems," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2007).
  16. N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier, "Action- and workflow-driven augmented reality for computer-aided medical procedures," IEEE Computer Graphics and Animations 27, 10-14 (2007).
  17. S.-A. Ahmadi, T. Sielhorst, R. Stauder, M. Horn, H. Feussner, N. Navab, "Recovery of surgical workflow without explicit models," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2006) pp. 420-428.
  18. N. Padoy, T. Blum, I. Essa, H. Feussner, M.-O. Berger, N. Navab, "A boosted segmentation method for surgical workflow analysis," International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) (2007).
  19. P. Jannin, X. Morandi, "Surgical models for computer-assisted neurosurgery," NeuroImage 37, 783-791 (2007).
  20. T. Wendler, J. Traub, S. Ziegler, N. Navab, "Navigated three dimensional beta probe for optimal cancer resection," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2006) pp. 561-569.
  21. F. Sauer, F. Wenzel, S. Vogt, Y. Tao, Y. Genc, A. Bani-Hashemi, "Augmented workspace: Designing an AR testbed," Proc. IEEE and ACM ISAR (2000) pp. 47-53.
  22. S. Heining, P. Stefan, F. Sauer, E. Euler, N. Navab, J. Traub, Evaluation of an in situ visualization system for navigated trauma surgery MontrealCanada (2006).
  23. J. Traub, P. Stefan, S. M. Heining, T. Sielhorst, C. Riquarts, E. Euler, N. Navab, "Stereoscopic augmented reality navigation for trauma surgery: Cadaver experiment and usability study," Proc. CARS 2006 (2006).
  24. J. Traub, P. Stefan, S.-M. Heining, T. Sielhorst, C. Riquarts, E. Euler, N. Navab, Medical Imaging and Augmented Reality (Springer, 2006) pp. 179-186.
  25. M. Y. Wang, C. R. Maurer, Jr.J. M. Fitzpatrick, R. J. Maciunas, "An automatic technique for finding and localizing externally attached markers in ct and mr volume images of the head," IEEE Trans. Biomed. Eng. 43, 627-637 (1996).
  26. S. Gold, A. Rangarajan, "A graduated assignment algorithm for graph matching," IEEE Trans. Pattern Anal. Mach. Intell. 18, 377-388 (1996).
  27. S. Umeyama, "Least-squares estimation of transformation parameters between two point patterns," IEEE Trans. Pattern Anal. Mach. Intell. 13, 376-380 (1991).
  28. F. Sauer, A. Khamene, B. Bascle, G. J. Rubino, "A head-mounted display system for augmented reality image guidance: Towards clinical evaluation for iMRI-guided neurosurgery," Proc. MICCAI (2001) pp. 707-716.
  29. W. A. Hoff, T. L. Vincent, "Analysis of head pose accuracy in augmented reality," IEEE Trans. Visualiz. Computer Graphics 6, (2000).
  30. S. Vogt, A. Khamene, F. Sauer, H. Niemann, "Single camera tracking of marker clusters: Multiparameter cluster optimization and experimental verification," Proc. IEEE and ACM ISMAR (2002) pp. 127-136.
  31. M. Hadwiger, J. M. Kniss, C. Rezksalama, D. Weiskopf, Real-Time Volume Graphics (A.K. Peters, 2006).
  32. J. Traub, P. Stefan, S.-M. Heining, T. Sielhorst, C. Riquarts, E. Euler, N. Navab, "Hybrid navigation interface for orthopedic and trauma surgery," Proc. Int. Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI) (2006) pp. 373-380.

Cited By

OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.

« Previous Article  |  Next Article »

OSA is a member of CrossRef.

CrossCheck Deposited