Dipl.-Inf. Univ. Tobias Blum I have been with the Chair for Computer Aided Medical Procedures & Augmented Reality as PhD student and research assistant between 2007 and 2013. As of March 2013 I moved to Ferchau Engineering and I am currently working for BMW Research and Technology on head-up displays and navigation systems. email:

My work in the public and media

My work has been shown in the public at many events such as the IdeenPark and was featured several times in magazines and in TV.

Research projects

mirracle Using the metaphor of a magic mirror, mirracle shows an augmented reality overlay of a CT dataset onto a user standing in front of a big screen. We track the person using Microsoft Kinect. The system could be used for anatomy education or patient consulting. See http://www.mirracle.de for more information.

Surgical Workflow Analysis in Laparoscopy for Monitoring and Documentation Surgical workflow recovery is a crucial step towards the development of intelligent support systems in surgical environments. The objective of the project is to create a system which is able to recognize automatically the current steps of a surgical laparoscopic procedure using a set of signals recorded from the OR. The project adresses several issues such as the simultaneous recordings of various signals within the OR, the design of methods and algorithms for processing and interpreting the information, and finally the development of a convenient user interface to display context sensitive information inside the OR. The current clinical focus is on laparoscopic cholecystectomies but the concepts developed in the project also apply to laparoscopic surgeries of other kinds.

Analysis and Modeling of Actions for Advanced Medical Training Systems Providing feedback to trainees is one of the most important issues to support learning. This project researches how to give quantitative and visual feedback on the performance of a student when training on simulators or phantoms. Statistical analysis and probabilistic models are used to compare the performance of students and experts. Augmented Reality and video is used to give visual feedback like a synchronized replay of the student’s and the expert’s performance.

Simulated Ultrasound We are simulating Ultrasound images from CT volumes by assuming a correlation between Hounsfield units and acoustic impedance. Rays are cast trough the CT volume to simulate the US image formation. Simulated Ultrasound from CT can be used for CT/Ultrasound registration by comparing a real US image to simulated ones. Another application of simulated US is training.

Publications

Software error:

/srv/www/htdocs/publications//pub/: Input/output error at /srv/www/cgi-bin/pub/list.pl line 22.

For help, please send mail to the webmaster (/Main/MartinHorn), giving this error message and the time and date of the error.

Awards

	Science4Life Business Plan Competition 2011 Our team SmartSurgicalSolutions was one of ten awarded teams at the Science4Life business plan competition
	Munich Business Plan Competition 2011 for the business plan on AXSight together with the other members of SmartSurgicalSolutions: Lejing Wang, Dr. med. Simon Weidert and Prof. Nassir Navab
	Werner von Siemens Excellence Award 2008 for my diploma thesis Surgical Workflow Analysis: Representation and Application to Monitoring supervised by Nicolas Padoy & advised by Prof. Nassir Navab
	NDI Best Student Paper Award on ISMAR 2005 together with Tobias Sielhorst for our paper Synchronizing 3D movements for quantitative comparison and simultaneous visualization of actions

Teaching

• Medical Augmented Reality und User Interfaces: Proseminar (2012SoSe)
• Medical Technology Entrepreneurship: Lecture (2012SoSe)
• Medical Imaging Entrepreneurship: Lecture (2011WiSe)
• Medical Imaging Entrepreneurship: Lecture (2011SoSe)
• Lab Course / Praktikum: Kinect Programming for Computer Vision: Praktikum (2011SoSe)
• Recent Advances in Computer Assisted Surgery: Hauptseminar (2010WiSe)
• Medical Augmented Reality: Praktikum (2010SoSe)
• Augmented Reality in Medicine: Hauptseminar (2010SoSe)
• Bildverarbeitung und Computer-Graphik mit C++: Programmierpraktikum (2009WiSe)
• Recent Advances in Computer Assisted Surgery: Hauptseminar (2009WiSe)
• Medical Simulation and Training: Hauptseminar (2009SoSe)
• Computational Photography: Praktikum (2009SoSe)
• Computer Assisted Surgery: Proseminar (2009SoSe)
• History of Computational Science, Vision, and Medical Science: Proseminar (2009SoSe)
• Bildverarbeitung und Computer-Graphik mit C++: Projekt Systementwicklung (2008WiSe)
• Recent Advances in Computer Assisted Surgery: Hauptseminar (2008WiSe)
• Bildverarbeitung und Computer-Graphik mit C++: Projekt Systementwicklung (2008SoSe)
• Recent Advances in Computer Assisted Surgery: Hauptseminar (2008SoSe)
• History of Computational Science, Vision, and Medical Science: Proseminar (2008SoSe)
• Action Recognition and Analysis: From Signals to Models: Hauptseminar (2008SoSe)
• Computer Aided Medical Procedures : Lecture (2007WiSe)
• Information Processing in the Operating Room of the Future: Hauptseminar (2007WiSe)

Theses I have supervised

• Augmented Reality Game for Teaching Medical Skills by Andreas Spurny (DA/MA/BA)
• IDP: Visualization of Medical Cryosections for Augmented Reality by Stefan Hessel (IDP)
• Ultrasound Training Simulator using a Haptic Feedback Device by Hongming Huai (DA/MA/BA)
• BOOPS: Breast RegistratiOn fOr Plastic Surgery by Martin Sälzle (DA/MA/BA)
• 3D Interaction Methods for Medical Applications using Low-Cost Hardware by Korbinian Schwinger (DA/MA/BA)

Previous projects I've done

• Scientific consultant for the CAMDASS project done by the European Space Agency and Space Applications (2009-2011)
• Diploma Thesis: Surgical Workflow Analysis: Representation and Application to Monitoring
• Research Paper / IDP: Economic Assessment of Using Augmented Reality in the Construction of Power Plants (At the chair for information systems and in cooperation with Siemens CT)
• Participation in the course for medical imaging at the Moscow-Bavarian Joint Advanced Student School - MB-JASS'2006 in Moscow.
• Research Paper / SEP: Synchronizing 3D Movements for Quantitative Comparison and Simultaneous Visualization of Actions
• Lab Course: Intra-operative Imaging & Visualization - DelivARy

Videos

Superman-like X-ray Vision: Towards Brain-Computer Interfaces for Medical Augmented Reality - ISMAR 2012

First Deployments of Augmented Reality in Operating Rooms - IEEE Computer, 45(7)

mirracle: An Augmented Reality Magic Mirror System for Anatomy Education - VR 2012

Augmented Reality Magic Mirror for Medical Data Visualization

Augmented Reality Magic Mirror using Kinect

The effect of out-of-focus blur on visual discomfort when using stereo displays - ISMAR 2010

Modeling and Segmentation of Surgical Workflow from Laparoscopic Video - MICCAI 2010

Advanced Training Methods using an Augmented Reality Ultrasound Simulator - ISMAR 2009

Workflow Mining for Visualization and Analysis of Surgeries - IJCARS 2008

Synchronizing 3D movements for quantitative comparison and simultaneous visualization of actions - ISMAR 2005