6533b860fe1ef96bd12c2f34

RESEARCH PRODUCT

Robust Depth Estimation for Light Field Microscopy

Luca PalmieriGabriele ScrofaniGenaro SaavedraNicolò IncardonaReinhard KochManuel Martínez-corral

subject

MicroscopemicroscopeComputer scienceComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION02 engineering and technologylcsh:Chemical technologyBiochemistryArticleAnalytical Chemistrylaw.inventionsymbols.namesakelawDepth mapMicroscopy0202 electrical engineering electronic engineering information engineeringdepth estimationlight fieldlcsh:TP1-1185Computer visionElectrical and Electronic Engineeringstereo matchingInstrumentationLight field microscopydefocusbusiness.industryÒptica021001 nanoscience & nanotechnologyAtomic and Molecular Physics and OpticsField (geography)MicroscòpiaFourier transformsymbols020201 artificial intelligence & image processingArtificial intelligenceNoise (video)0210 nano-technologybusinessLight field

description

Light field technologies have seen a rise in recent years and microscopy is a field where such technology has had a deep impact. The possibility to provide spatial and angular information at the same time and in a single shot brings several advantages and allows for new applications. A common goal in these applications is the calculation of a depth map to reconstruct the three-dimensional geometry of the scene. Many approaches are applicable, but most of them cannot achieve high accuracy because of the nature of such images: biological samples are usually poor in features and do not exhibit sharp colors like natural scene. Due to such conditions, standard approaches result in noisy depth maps. In this work, a robust approach is proposed where accurate depth maps can be produced exploiting the information recorded in the light field, in particular, images produced with Fourier integral Microscope. The proposed approach can be divided into three main parts. Initially, it creates two cost volumes using different focal cues, namely correspondences and defocus. Secondly, it applies filtering methods that exploit multi-scale and super-pixels cost aggregation to reduce noise and enhance the accuracy. Finally, it merges the two cost volumes and extracts a depth map through multi-label optimization.

10.3390/s19030500http://dx.doi.org/10.3390/s19030500