6533b859fe1ef96bd12b776f

RESEARCH PRODUCT

Depth Enhancement by Fusion for Passive and Active Sensing

Hashim Kemal AbdellaBruno MirbachDjamila AouadaThomas SolignacBjorn OtterstenFrederic Garcia

subject

Homogeneous regionsComputer scienceActive SensingComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONSensing systemsTime-of-flight camerasPassive and active sensing: Electrical & electronics engineering [C06] [Engineering computing & technology]Depth mapTriangulation methodComputer vision: Computer science [C05] [Engineering computing & technology]: Ingénierie électrique & électronique [C06] [Ingénierie informatique & technologie]Signal processingStereo camerasPassive sensingbusiness.industrySensorsPassive filtersTriangulation (computer vision)Depth enhancementData fusionSensor fusionCameras: Sciences informatiques [C05] [Ingénierie informatique & technologie]Depth sensingSpecial treatmentsDepth valueRGB color modelComputer visionArtificial intelligenceEnhanced Data Rates for GSM EvolutionDepth MapbusinessDepth measurementsStereo cameraStereo cameras

description

This paper presents a general refinement procedure that enhances any given depth map obtained by passive or active sensing. Given a depth map, either estimated by triangulation methods or directly provided by the sensing system, and its corresponding 2-D image, we correct the depth values by separately treating regions with undesired effects such as empty holes, texture copying or edge blurring due to homogeneous regions, occlusions, and shadowing. In this work, we use recent depth enhancement filters intended for Time-of-Flight cameras, and adapt them to alternative depth sensing modalities, both active using an RGB-D camera and passive using a dense stereo camera. To that end, we propose specific masks to tackle areas in the scene that require a special treatment. Our experimental results show that such areas are satisfactorily handled by replacing erroneous depth measurements with accurate ones. © 2012 Springer-Verlag.

http://orbilu.uni.lu/handle/10993/10621