6533b82efe1ef96bd1292610

RESEARCH PRODUCT

Three-Dimensional Integral-Imaging Display From Calibrated and Depth-Hole Filtered Kinect Information

Seokmin HongJ.c. BarreiroGenaro SaavedraManuel Martínez-corralAdrian Dorado

subject

0209 industrial biotechnologyIntegral imagingbusiness.industryComputer scienceComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION02 engineering and technologyCondensed Matter PhysicsStereo display01 natural sciencesElectronic Optical and Magnetic Materials010309 optics020901 industrial engineering & automationDepth mapCamera auto-calibrationComputer graphics (images)0103 physical sciencesRGB color modelComputer visionBilateral filterArtificial intelligenceElectrical and Electronic EngineeringbusinessParallaxComputingMethodologies_COMPUTERGRAPHICSCamera resectioning

description

We exploit the Kinect capacity of picking up a dense depth map, to display static three-dimensional (3D) images with full parallax. This is done by using the IR and RGB camera of the Kinect. From the depth map and RGB information, we are able to obtain an integral image after projecting the information through a virtual pinhole array. The integral image is displayed on our integral-imaging monitor, which provides the observer with horizontal and vertical perspectives of big 3D scenes. But, due to the Kinect depth-acquisition procedure, many depthless regions appear in the captured depth map. These holes spread to the generated integral image, reducing its quality. To solve this drawback we propose here, both, an optimized camera calibration technique, and the use of an improved hole-filtering algorithm. To verify our method, we performed an experiment where we generated and displayed the integral image of a room size 3D scene.

https://doi.org/10.1109/jdt.2016.2594076