Development of Image Overlay System with Head-tracking for VR-based Injection Training

Takeshi KOISHI, Nobuhiko TAMURA, Toshiya NAKAGUCHI, Norimichi TSUMURA, Yoichi MIYAKE

Department of Information and Image Sciences, Chiba University
1-33, Yayoi-cho, Inage-ku, Chiba 263-8522 Japan

The Japanese Journal for Medical Virtual Reality, Vol.4, No.1, pp.18-24(2006)

Abstract
The system overlaying the stereoscopic images onto the haptic interface is proposed. In order to develop the training systems based on virtual reality medical doctors to experience medical treatments, it is important to improve the reality that visual and haptic information are synchronized. Our training system proposed in a previous paper for central venous injection uses the stereoscopic glasses and the haptic interface. This system has a palpation phase and an injection phase. During the injection phase, it is important that the user can see 3D injector images and the stylus of the haptic interface corresponding. In the proposed system, the user can look down the images projected from the display and reflected on the half mirror, and the haptic interface through the mirror. Using infrared LEDs wirelessly attached to the stereoscopic glasses and the infrared camera set under the display, the proposed system can show the 3D images considering with the face position in real-time. This system can achieve higher reality and more effectiveness than our conventional system. This system is evaluated by the experienced medical doctor as effective one.

Full paper ( to appeare )
[PDF]( in Japanese )

Back