GPU-accelerated integral imaging and full-parallax 3D display using stereo-plenoptic camera system
Abstract In this paper, we propose a novel approach to produce integral images ready to be displayed onto an integral-imaging monitor. Our main contribution is the use of commercial plenoptic camera, which is arranged in a stereo configuration. Our proposed set-up is able to record the radiance, spatial and angular, information simultaneously in each different stereo position. We illustrate our contribution by composing the point cloud from a pair of captured plenoptic images, and generate an integral image from the properly registered 3D information. We have exploited the graphics processing unit (GPU) acceleration in order to enhance the integral-image computation speed and efficiency. We…
Machine Learning-Based View Synthesis in Fourier Lightfield Microscopy
Current interest in Fourier lightfield microscopy is increasing, due to its ability to acquire 3D images of thick dynamic samples. This technique is based on simultaneously capturing, in a single shot, and with a monocular setup, a number of orthographic perspective views of 3D microscopic samples. An essential feature of Fourier lightfield microscopy is that the number of acquired views is low, due to the trade-off relationship existing between the number of views and their corresponding lateral resolution. Therefore, it is important to have a tool for the generation of a high number of synthesized view images, without compromising their lateral resolution. In this context we investigate h…
The Lightfield Microscope Eyepiece
Lightfield microscopy has raised growing interest in the last few years. Its ability to get three-dimensional information about the sample in a single shot makes it suitable for many applications in which time resolution is fundamental. In this paper we present a novel device, which is capable of converting any conventional microscope into a lightfield microscope. Based on the Fourier integral microscope concept, we designed the lightfield microscope eyepiece. This is coupled to the eyepiece port, to let the user exploit all the host microscope’s components (objective turret, illumination systems, translation stage, etc.) and get a 3D reconstruction of the sample. After the optical design, …
Capture and visualization of biological 3D samples through lightfield imaging and display techniques
La microscopía óptica convencional proporciona imágenes de alta resolución de muestras microscópicas. Sin embargo, su escasa profundidad de campo y su falta de seccionado óptico hacen que sea inadecuada para la observación de especímenes tridimensionales. Para solucionar este problema, se han propuesto varias técnicas de microscopía 3D, la mayoría de ellas basadas en procedimientos de escaneo. La microscopía lightfield, en cambio, es una técnica de reciente desarrollo, que es capaz de capturar información 3D de muestras gruesas en una sola toma. Esto se consigue registrando de forma simultánea la información espacial y angular de los rayos procedentes de cada punto del objeto. Esta caracter…
Robust Depth Estimation for Light Field Microscopy
Light field technologies have seen a rise in recent years and microscopy is a field where such technology has had a deep impact. The possibility to provide spatial and angular information at the same time and in a single shot brings several advantages and allows for new applications. A common goal in these applications is the calculation of a depth map to reconstruct the three-dimensional geometry of the scene. Many approaches are applicable, but most of them cannot achieve high accuracy because of the nature of such images: biological samples are usually poor in features and do not exhibit sharp colors like natural scene. Due to such conditions, standard approaches result in noisy depth ma…
New Method of Microimages Generation for 3D Display
In this paper, we propose a new method for the generation of microimages, which processes real 3D scenes captured with any method that permits the extraction of its depth information. The depth map of the scene, together with its color information, is used to create a point cloud. A set of elemental images of this point cloud is captured synthetically and from it the microimages are computed. The main feature of this method is that the reference plane of displayed images can be set at will, while the empty pixels are avoided. Another advantage of the method is that the center point of displayed images and also their scale and field of view can be set. To show the final results, a 3D InI dis…
3D Integral Microscopy based in far-field detection
Lately, Integral-Imaging systems have shown very promising capabilities of capturing the 3D structure of micro- scopic and macroscopic scenes. The aim of this work is to provide an optimal design for 3D-integral microscopy with extended depth of field and enhanced lateral resolution. By placing an array of microlenses at the aperture stop of the objective, this setup provides a set of orthographic views of the 3D sample. Adopting well known integral imaging reconstruction algorithms it can be shown that the depth of field as well as spatial resolution are improved with respect to conventional integral microscopy imaging. Our claims are supported on theoretical basis and experimental images …
Fast and robust wave optics-based reconstruction protocol for Fourier lightfield microscopy
Fourier lightfield microscopy (FLMic) is a powerful technique to record 3D images of thick dynamic samples. Belonging FLMic to the general class of computational imaging techniques, its efficiency is determined by several factors, like the optical system, the calibration process, the reconstruction algorithm, or the computation architecture. In the case of FLMic the calibration and the reconstruction algorithm should be fully adapted to the singular features of the technique. To this end, and concerning the reconstruction, we discard the use of experimental PSFs, and propose the use of a synthetic one, which is calculated on the basis of paraxial optics and taking into account the equal inf…