0000000000326159

AUTHOR

Pierre-jean Lapray

0000-0003-2230-0955

showing 15 related works from this author

A 1.3 megapixel FPGA-based smart camera for high dynamic range real time video

2013

International audience; A camera is able to capture only a part of a high dynamic range scene information. The same scene can be fully perceived by the human visual system. This is true especially for real scenes where the difference in light intensity between the dark areas and bright areas is high. The imaging technique which can overcome this problem is called HDR (High Dynamic Range). It produces images from a set of multiple LDR images (Low Dynamic Range), captured with different exposure times. This technique appears as one of the most appropriate and a cheap solution to enhance the dynamic range of captured environments. We developed an FPGA-based smart camera that produces a HDR liv…

[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image ProcessingComputer science[INFO.INFO-TS] Computer Science [cs]/Signal and Image ProcessingComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONVideo camera02 engineering and technologyTone mapping[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processinglaw.invention[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processinglaw0202 electrical engineering electronic engineering information engineeringComputer visionSmart cameraHigh dynamic range[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processingCMOS sensorbusiness.industry020206 networking & telecommunicationsFrame rateLight intensityHuman visual system model020201 artificial intelligence & image processingArtificial intelligencebusiness[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
researchProduct

Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition

2016

International audience; Multispectral acquisition improves machine vision since it permits capturing more information on object surface properties than color imaging. The concept of spectral filter arrays has been developed recently and allows multispectral single shot acquisition with a compact camera design. Due to filter manufacturing difficulties, there was, up to recently, no system available for a large span of spectrum, i.e., visible and Near Infra-Red acquisition. This article presents the achievement of a prototype of camera that captures seven visible and one near infra-red bands on the same sensor chip. A calibration is proposed to characterize the sensor, and images are captured…

EngineeringMachine visionMultispectral imageComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONAutomotive industry[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processing02 engineering and technologylcsh:Chemical technologysensors01 natural sciencesBiochemistryArticleAnalytical ChemistryMultispectral pattern recognition010309 optics[SPI]Engineering Sciences [physics]0103 physical sciencesmultispectral imaging[ SPI ] Engineering Sciences [physics]0202 electrical engineering electronic engineering information engineeringCalibrationlcsh:TP1-1185Computer visionElectrical and Electronic EngineeringInstrumentationComputingMilieux_MISCELLANEOUSspectral filter arraybusiness.industrymultispectral imaging; spectral filter array; sensorsRoboticsChipAtomic and Molecular Physics and OpticsFilter (video)[SPI.OPTI]Engineering Sciences [physics]/Optics / Photonic020201 artificial intelligence & image processing[ SPI.OPTI ] Engineering Sciences [physics]/Optics / PhotonicArtificial intelligencebusiness[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processingSensors
researchProduct

Multispectral filter arrays: Recent advances and practical implementation

2014

Thanks to some technical progress in interferencefilter design based on different technologies, we can finally successfully implement the concept of multispectral filter array-based sensors. This article provides the relevant state-of-the-art for multispectral imaging systems and presents the characteristics of the elements of our multispectral sensor as a case study. The spectral characteristics are based on two different spatial arrangements that distribute eight different bandpass filters in the visible and near-infrared area of the spectrum. We demonstrate that the system is viable and evaluate its performance through sensor spectral simulation. Multispectral filter arrays: Recent advan…

snapshotmultispectral imaging[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image ProcessingComputer scienceMultispectral imageComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION02 engineering and technologylcsh:Chemical technologycomputer.software_genre01 natural sciencesBiochemistryArticleAnalytical Chemistry010309 opticsBand-pass filter[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing0103 physical sciencesElectronic engineeringlcsh:TP1-1185Electrical and Electronic EngineeringInstrumentationsnapshot multispectral imaging021001 nanoscience & nanotechnologyAtomic and Molecular Physics and Opticssingle solid state sensorspatio-spectral scene samplingComputingMethodologies_PATTERNRECOGNITIONFilter (video)multispectral and color filter arraysData mining0210 nano-technologycomputer
researchProduct

HDR Imaging Pipeline for Spectral Filter Array Cameras

2017

Multispectral single shot imaging systems can benefit computer vision applications in needs of a compact and affordable imaging system. Spectral filter arrays technology meets the requirement, but can lead to artifacts due to inhomogeneous intensity levels between spectral channels due to filter manufacturing constraints, illumination and object properties. One solution to solve this problem is to use high dynamic range imaging techniques on these sensors. We define a spectral imaging pipeline that incorporates high dynamic range, demosaicing and color image visualization. Qualitative evaluation is based on real images captured with a prototype of spectral filter array sensor in the visible…

medicine.medical_specialtyDemosaicingColor imageComputer sciencebusiness.industryMultispectral imageComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION020206 networking & telecommunications02 engineering and technologyReal imageSpectral imagingHigh-dynamic-range imagingFilter (video)Computer Science::Computer Vision and Pattern Recognition0202 electrical engineering electronic engineering information engineeringmedicine020201 artificial intelligence & image processingComputer visionArtificial intelligencebusinessHigh dynamic range
researchProduct

High Dynamic Range Real-time Vision System for Robotic Applications

2012

International audience; Robotics applications often requires vision systems capable of capturing a large amount of information related to a scene. With many camera sensors, the perception of information is limited in areas with strong contrasts. The High Dynamic Range (HDR) vision system can deal with these limitations. This paper describes the HDR-ARtiSt hardware platform (High Dynamic Range Advanced Real-time imaging System), a FPGA-based architecture that can produce a real- time high dynamic range video from successive image acquisition.

[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image Processing[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing[INFO.INFO-TS] Computer Science [cs]/Signal and Image ProcessingComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processing
researchProduct

HDR-ARtiSt: High Dynamic Range Advanced Real-Time Imaging System

2012

International audience; This paper describes the HDR-ARtiSt hardware platform, a FPGA-based architecture that can produce a real- time high dynamic range video from successive image acquisition. The hardware platform is built around a standard low dynamic range (LDR) CMOS sensor and a Virtex 5 FPGA board. The CMOS sensor is a EV76C560 provided by e2v. This 1.3 Megapixel device offers novel pixel integration/readout modes and em- bedded image pre-processing capabilities including multiframe acquisition with various exposure times. Our approach consists of a hardware architecture with different algorithms: double exposure control during image capture, building of an HDR image by combining the…

[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image Processing[INFO.INFO-TS] Computer Science [cs]/Signal and Image ProcessingComputer scienceHardware platformReal-time computingComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONImage processingVideo camera02 engineering and technologyTone mapping[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processinglaw.invention[INFO.INFO-TS]Computer Science [cs]/Signal and Image ProcessinglawHistogram0202 electrical engineering electronic engineering information engineeringHigh dynamic rangeFPGA[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processingHardware architectureCMOS sensorLiquid-crystal displayreal timePixelbusiness.industryDynamic range020207 software engineeringHigh Dynamic RangeFrame rate[SPI.TRON] Engineering Sciences [physics]/Electronics[ SPI.TRON ] Engineering Sciences [physics]/Electronicsimage processing[SPI.TRON]Engineering Sciences [physics]/ElectronicsIEEE020201 artificial intelligence & image processingbusiness[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processingComputer hardware
researchProduct

HDR-ARtiSt : une caméra intelligente dédiée à la vidéo à grande dynamique en temps réel

2013

International audience; Une caméra vidéo standard n'est capable de capturer qu'une partie de l'information contenue dans une scène de gamme dynamique élevée. La même scène peut être presque entièrement perçue par le système visuel humain. Cela est particulièrement vrai pour les scènes réelles où la différence d'intensité lumineuse entre les zones sombres et les zones claires est élevée. La technique d'imagerie qui peut surmonter ce problème est appelé HDRi (High Dynamic Range imaging). Elle produit des images à partir d'un ensemble de plusieurs images LDRs (Low Dynamic Range), capturées avec différents temps d'exposition. Cette technique apparaît comme l'une des solutions la plus appropriée…

[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image Processing[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing[INFO.INFO-TS] Computer Science [cs]/Signal and Image Processing[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processing
researchProduct

Nouvelle génération de systèmes de vision temps réel à grande dynamique

2013

This thesis is a part of the EUREKA European project called "High Dynamic Range - Low NoiseCMOS imagers", which developped new approaches to design high performance CMOS sensors.The purpose of this thesis is to design a real-time high dynamic range (HDR) vision system. Themain focus will be the real-time video reconstruction at 60 frames/sec in an embedded architecture.Most of the sensors produce a digital image that is not able to reproduce the real world light inten-sities. Similarly, monitors, printers and current displays do not recover of a wide tonal range. Theapproach proposed in this thesis is multiple acquisitions, taken with different exposure times, to over-come the limitations o…

[INFO.INFO-OH] Computer Science [cs]/Other [cs.OH]Vidéo[INFO.INFO-OH]Computer Science [cs]/Other [cs.OH][ INFO.INFO-OH ] Computer Science [cs]/Other [cs.OH]No english keywordHdrSystème embarquéGrande dynamiqueFpgaTemps réel
researchProduct

High Dynamic Range Spectral Imaging Pipeline For Multispectral Filter Array Cameras

2017

Spectral filter arrays imaging exhibits a strong similarity with color filter arrays. This permits us to embed this technology in practical vision systems with little adaptation of the existing solutions. In this communication, we define an imaging pipeline that permits high dynamic range (HDR)-spectral imaging, which is extended from color filter arrays. We propose an implementation of this pipeline on a prototype sensor and evaluate the quality of our implementation results on real data with objective metrics and visual examples. We demonstrate that we reduce noise, and, in particular we solve the problem of noise generated by the lack of energy balance. Data are provided to the community…

medicine.medical_specialtySimilarity (geometry)Computer sciencePipeline (computing)Multispectral imageComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONspectral imaging02 engineering and technology[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processinglcsh:Chemical technology01 natural sciencesBiochemistryArticleAnalytical Chemistry010309 optics[SPI]Engineering Sciences [physics]Color gel0103 physical sciences[ INFO.INFO-TI ] Computer Science [cs]/Image Processing0202 electrical engineering electronic engineering information engineeringmedicine[ SPI ] Engineering Sciences [physics]Computer visionlcsh:TP1-1185Electrical and Electronic EngineeringInstrumentationHigh dynamic rangeComputingMilieux_MISCELLANEOUSbusiness.industryhigh dynamic rangespectral filter arraysAtomic and Molecular Physics and Opticsspectral imaging; spectral filter arrays; high dynamic range; image databaseSpectral imagingNoiseFilter (video)[INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV]020201 artificial intelligence & image processingArtificial intelligencebusiness[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processingimage database
researchProduct

Overview of ghost correction for HDR video stream generation

2015

International audience; Most digital cameras use low dynamic range image sensors, these LDR sensors can capture only a limited luminance dynamic range of the scene[1], to about two orders of magnitude (about 256 to 1024 levels). However, the dynamic range of real-world scenes varies over several orders of magnitude (10.000 levels). To overcome this limitation, several methods exist for creating high dynamic range (HDR) image (expensive method uses dedicated HDR image sensor and low-cost solutions using a conventional LDR image sensor). Large number of low-cost solutions applies a temporal exposure bracketing. The HDR image may be constructed with a HDR standard method (an additional step ca…

exposure bracketingComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONbitmapGraph-Cuts[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processingGeneralLiterature_MISCELLANEOUSghost detectionsmart camerahigh dynamic rageentropyreal-time algorithm[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processingComputingMethodologies_COMPUTERGRAPHICS
researchProduct

HDR-­ARtiSt: a FPGA-­based Smart Camera for High Dynamic Range color video from multiple exposures

2014

International audience; A camera is able to capture only a part of a high dynamic range scene information. The same scene can be fully perceived by the human visual system. This is true especially for real scenes where the difference in light intensity between the dark areas and bright areas is high. The imaging technique which can overcome this problem is called HDR (High Dynamic Range). It produces images from a set of multiple LDR images (Low Dynamic Range), captured with different exposure times. This technique appears as one of the most appropriate and a cheap solution to enhance the dynamic range of captured environments. We developed an FPGA-based smart camera that produces a HDR liv…

parallel processingFPGA implementationComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONSmart cameraHigh dynamic rangeimage enhancement[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processingimage reconstruction[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processing
researchProduct

HDR-ARtiSt: A 1280x1024-pixel Adaptive Real-time Smart camera for High Dynamic Range video

2014

International audience; Standard cameras capture only a fraction of the information that is visible to the human visual system. This is specifically true for natural scenes including areas of low and high illumination due to transitions between sunlit and shaded areas. When capturing such a scene, many cameras are unable to store the full Dynamic Range (DR) resulting in low quality video where details are concealed in shadows or washed out by sunlight.The imaging technique that can overcome this problem is called HDR (High Dynamic Range) imaging. This paper describes a complete smart camera built around a standard off-the-shelf LDR (Low Dynamic Range) sensor and a Virtex 6 FPGA board. This …

ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processingComputingMethodologies_COMPUTERGRAPHICS
researchProduct

A smart camera for High Dynamic Range imaging

2013

International audience; A camera or a video camera is able to capture only a part of a high dynamic range scene information. The same scene can be almost totally perceived by the human visual system. This is true especially for real scenes where the difference in light intensity between the dark areas and bright areas is high. The imaging technique which can overcome this problem is called HDR (High Dynamic Range). It produces images from a set of multiple LDR images (Low Dynamic Range), captured with different exposure times. This technique appears as one of the most appropriate and a cheap solution to enhance the dynamic range of captured environments. We developed an FPGA-based smart cam…

[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image Processing[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processingsmart camera[INFO.INFO-TS] Computer Science [cs]/Signal and Image ProcessingComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONHigh dynamic range[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processing
researchProduct

A Database of Spectral Filter Array Images that Combine Visible and NIR

2017

International audience; Spectral filter array emerges as a multispectral imaging technology, which could benefit several applications. Although several instantiations are prototyped and commercialized, there are yet only a few raw data available that could serve research and help to evaluate and design adequate related image processing and algorithms. This document presents a freely available spectral filter array database of images that combine visible and near infra-red information.

Image database DemosaickingSpectral filter arraysbusiness.industryComputer scienceMultispectral imageComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONImage processing02 engineering and technology01 natural sciencesArray DBMSMultispectral imagingAlgorithm010309 opticsFilter (video)[INFO.INFO-TI]Computer Science [cs]/Image Processing [eess.IV]0103 physical sciences[SPI.OPTI]Engineering Sciences [physics]/Optics / Photonic0202 electrical engineering electronic engineering information engineering[INFO]Computer Science [cs]020201 artificial intelligence & image processingComputer visionArtificial intelligencebusinessSensor
researchProduct

Smart camera design for realtime High Dynamic Range imaging

2011

International audience; Many camera sensors suffer from limited dynamic range. The result is that there is a lack of clear details in displayed images and videos. This paper describes our approach to generate high dynamic range (HDR) from an image sequence while modifying exposure times for each new frame. For this purpose, we propose an FPGA-based architecture that can produce a real-time high dynamic range video from successive image acquisition. Our hardware platform is build around a standard low dynamic range CMOS sensor and a Virtex 5 FPGA board. The CMOS sensor is a EV76C560 provided by e2v. This 1.3 Megapixel device offers novel pixel integration/readout modes and embedded image pre…

[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image Processing[INFO.INFO-TS] Computer Science [cs]/Signal and Image ProcessingComputer scienceComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION02 engineering and technology[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processingACM IEEEImagingVideosHardware[INFO.INFO-TS]Computer Science [cs]/Signal and Image ProcessingHigh-dynamic-range imaging0202 electrical engineering electronic engineering information engineeringComputer visionSmart cameraImage sensorImage resolutionHigh dynamic range[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processingPipelinesCMOS sensorDynamic rangePixelbusiness.industrySensors020208 electrical & electronic engineeringReal time systems020207 software engineeringFrame rate[SPI.TRON]Engineering Sciences [physics]/Electronics[ SPI.TRON ] Engineering Sciences [physics]/ElectronicsArtificial intelligencebusiness[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
researchProduct