0000000000092363
AUTHOR
Raabid Hussain
Augmented reality based middle and inner ear surgical procedures
Otologic procedures involve manipulation of small, delicate and complex structures in the temporal bone anatomy which are in close proxmity of critical nerves and blood vessels. Augmented reality (AR) can highly benefit the otological domain by providing supplementary anatomical and navigational information unified on a single display. However, despite being composed of mainly rigid bony structures, the awareness and acceptance of possibilities of AR systems in otology is fairly low. This project aims at developing video-based AR solutions for middle and inner ear surgical procedures.We propose two applications of AR in this regard. In the first application, information about middle ear cle…
Deep Generative Model-Driven Multimodal Prostate Segmentation in Radiotherapy
Deep learning has shown unprecedented success in a variety of applications, such as computer vision and medical image analysis. However, there is still potential to improve segmentation in multimodal images by embedding prior knowledge via learning-based shape modeling and registration to learn the modality invariant anatomical structure of organs. For example, in radiotherapy automatic prostate segmentation is essential in prostate cancer diagnosis, therapy, and post-therapy assessment from T2-weighted MR or CT images. In this paper, we present a fully automatic deep generative model-driven multimodal prostate segmentation method using convolutional neural network (DGMNet). The novelty of …
Automatic Myocardial Infarction Evaluation from Delayed-Enhancement Cardiac MRI using Deep Convolutional Networks
In this paper, we propose a new deep learning framework for an automatic myocardial infarction evaluation from clinical information and delayed enhancement-MRI (DE-MRI). The proposed framework addresses two tasks. The first task is automatic detection of myocardial contours, the infarcted area, the no-reflow area, and the left ventricular cavity from a short-axis DE-MRI series. It employs two segmentation neural networks. The first network is used to segment the anatomical structures such as the myocardium and left ventricular cavity. The second network is used to segment the pathological areas such as myocardial infarction, myocardial no-reflow, and normal myocardial region. The segmented …
3D landmark detection for augmented reality based otologic procedures
International audience; Ear consists of the smallest bones in the human body and does not contain significant amount of distinct landmark points that may be used to register a preoperative CT-scan with the surgical video in an augmented reality framework. Learning based algorithms may be used to help the surgeons to identify landmark points. This paper presents a convolutional neural network approach to landmark detection in preoperative ear CT images and then discusses an augmented reality system that can be used to visualize the cochlear axis on an otologic surgical video.
Stereo calibration of non-overlapping field of view heterogeneous cameras for calibrating surgicalmicroscope with external tracking camera
International audience
Automatic Myocardial Infarction Evaluation from Delayed-Enhancement Cardiac MRI Using Deep Convolutional Networks
In this paper, we propose a new deep learning framework for an automatic myocardial infarction evaluation from clinical information and delayed enhancement-MRI (DE-MRI). The proposed framework addresses two tasks. The first task is automatic detection of myocardial contours, the infarcted area, the no-reflow area, and the left ventricular cavity from a short-axis DE-MRI series. It employs two segmentation neural networks. The first network is used to segment the anatomical structures such as the myocardium and left ventricular cavity. The second network is used to segment the pathological areas such as myocardial infarction, myocardial no-reflow, and normal myocardial region. The segmented …
Augmented Reality of the Middle Ear Combining Otoendoscopy and Temporal Bone Computed Tomography
International audience; HYPOTHESIS:Augmented reality (AR) may enhance otologic procedures by providing sub-millimetric accuracy and allowing the unification of information in a single screen.BACKGROUND:Several issues related to otologic procedures can be addressed through an AR system by providing sub-millimetric precision, supplying a global view of the middle ear cleft, and advantageously unifying the information in a single screen. The AR system is obtained by combining otoendoscopy with temporal bone computer tomography (CT).METHODS:Four human temporal bone specimens were explored by high-resolution CT-scan and dynamic otoendoscopy with video recordings. The initialization of the system…
Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge
Surgical data science is revolutionizing minimally invasive surgery by enabling context-aware applications. However, many challenges exist around surgical data (and health data, more generally) needed to develop context-aware models. This work - presented as part of the Endoscopic Vision (EndoVis) challenge at the Medical Image Computing and Computer Assisted Intervention (MICCAI) 2020 conference - seeks to explore the potential for visual domain adaptation in surgery to overcome data privacy concerns. In particular, we propose to use video from virtual reality (VR) simulations of surgical exercises in robotic-assisted surgery to develop algorithms to recognize tasks in a clinical-like sett…
Real-Time Augmented Reality for Ear Surgery
International audience; Transtympanic procedures aim at accessing the middle ear structures through a puncture in the tympanic membrane. They require visualization of middle ear structures behind the eardrum. Up to now, this is provided by an oto endoscope. This work focused on implementing a real-time augmented reality based system for robotic-assisted transtympanic surgery. A preoperative computed tomography scan is combined with the surgical video of the tympanic membrane in order to visualize the ossciles and labyrinthine windows which are concealed behind the opaque tympanic membrane. The study was conducted on 5 artificial and 4 cadaveric temporal bones. Initially, a homography framew…
Contribution of Augmented Reality to Minimally Invasive Computer-Assisted Cranial Base Surgery.
Cranial base procedures involve manipulation of small, delicate and complex structures in the fields of otology, rhinology, neurosurgery and maxillofacial surgery. Critical nerves and blood vessels are in close proximity of these structures. Augmented reality is an emerging technology that can revolutionize the cranial base procedures by providing supplementary anatomical and navigational information unified on a single display. However, the awareness and acceptance of possibilities of augmented reality systems in cranial base domain is fairly low. This article aims at evaluating the usefulness of augmented reality systems in cranial base surgeries and highlights the challenges that current…