Mixed Reality Annotation of Robotic-Assisted Surgery videos with real- time tracking and stereo matching
Robotic-Assisted Surgery (RAS) is beginning to unlock its potential. However, despite the latest advances in RAS, the steep learning curve of RAS devices remains a problem. A common teaching resource in surgery is the use of videos of previous procedures, which in RAS are almost always stereoscopic. It is important to be able to add virtual annotations onto these videos so that certain elements of the surgical process are tracked and highlighted during the teaching session. Including virtual annotations in stereoscopic videos turns them into Mixed Reality (MR) experiences, in which tissues, tools and procedures are better observed. However, an MR-based annotation of objects requires trackin…
On the Objective Evaluation of Motion Cueing in Vehicle Simulations
Motion-based simulators are used for a variety of applications, such as research, education, entertainment and training. In fact, motion cues are required to achieve the highest regulatory certifications in training vehicle simulators. Nonetheless, the reproduction of self-motion cues presents technological and economic limitations that are not present in the generation of audiovisual cues. For this reason, the generated motion does not generally match the expected one. Therefore, it is necessary to define means to assess the suitability/fidelity of the generated motion cues. After more than 50 years of motion-based vehicle simulation, no mechanism has been universally accepted as the stand…
A Comparative Evaluation of a Virtual Reality Table and a HoloLens-Based Augmented Reality System for Anatomy Training
Anatomy training with real cadavers poses many practical problems for which new training and educational solutions have been developed making use of technologies based on real-time 3-D graphics. Although virtual reality (VR) and augmented reality (AR) have been previously used in the medical field, it is not easy to select the right 3-D technology or setup for each particular problem. For this reason, this article presents a comprehensive comparative study with 82 participants between two different 3-D interactive setups: an optical-based AR setup, implemented with a Microsoft HoloLens device, and a semi-immersive setup based on a VR Table. Both setups are tested using an anatomy training s…