6533b826fe1ef96bd128351b

RESEARCH PRODUCT

An optimized algorithm of image stitching in the case of a multi-modal probe for monitoring the evolution of scars

Rami KassabChristian PieralliJean-christophe LapayreSylvie TreuilletFranck Marzani

subject

[ INFO.INFO-TS ] Computer Science [cs]/Signal and Image ProcessingMatching (graph theory)Panorama[INFO.INFO-TS] Computer Science [cs]/Signal and Image ProcessingComputer scienceComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONScale-invariant feature transform[ SPI.SIGNAL ] Engineering Sciences [physics]/Signal and Image processing02 engineering and technologyautofluorescence010501 environmental sciences01 natural sciencesImage stitching[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processingstitchingmulti-modal probe0202 electrical engineering electronic engineering information engineeringComputer visionProjection (set theory)[SPI.SIGNAL] Engineering Sciences [physics]/Signal and Image processing0105 earth and related environmental sciencesbusiness.industryFluorescenceScars evolutionmonitoringAutofluorescenceTransformation (function)020201 artificial intelligence & image processingArtificial intelligencebusiness[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processingAlgorithm

description

International audience; We propose a new system that makes possible to monitor the evolution of scars after the excision of a tumorous dermatosis. The hardware part of this system is composed of a new optical innovative probe with which two types of images can be acquired simultaneously: an anatomic image acquired under a white light and a functional one based on autofluorescence from the protoporphyrin within the cancer cells. For technical reasons related to the maximum size of the area covered by the probe, acquired images are too small to cover the whole scar. That is why a sequence of overlapping images is taken in order to cover the required area. The main goal of this paper is to describe the creation of two panoramic images (anatomic and functional). Fluorescence images do not have enough salient information for matching the images; stitching algorithms are applied over each couple of successive white light images to produce an anatomic panorama of the entire scar. The same transformations obtained from this step are used to register and stitch the functional images. Several experiments have been implemented using different stitching algorithms (SIFT, ASIFT and SURF), with various transformation parameters (angles of rotation, projection, scaling, etc...) and different types of skin images. We present the results of these experiments that propose the best solution. Thus, clinician has two panoramic images superimposed and usable for diagnostic support. A collaborative layer is added to the system to allow sharing panoramas among several practitioners over different places.

https://doi.org/10.1117/12.2002016