6533b835fe1ef96bd129ed41

RESEARCH PRODUCT

Experiencing with electronic image stabilization and PRNU through scene content image registration

Fabio BellaviaCarlo ColomboMarco FanfaniAlessandro Piva

subject

Computer scienceElectronic image stabilizationImage registrationContext (language use)Camera and video source identification02 engineering and technology01 natural sciencesMultimedia forensicsArtificial Intelligence0103 physical sciences0202 electrical engineering electronic engineering information engineeringComputer vision010306 general physicsImage registrationSettore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniNative resolutionImage registration Electronic Image Stabilization PRNU Camera and video source identification Multimedia forensicsSettore INF/01 - Informaticabusiness.industryPRNUTracking systemScale factorImage stabilizationIdentification (information)Transformation (function)Signal Processing020201 artificial intelligence & image processingComputer Vision and Pattern RecognitionArtificial intelligencebusinessSoftware

description

Abstract This paper explores content-based image registration as a means of dealing with and understanding better Electronic Image Stabilization (EIS) in the context of Photo Response Non-Uniformity (PRNU) alignment. A novel and robust solution to extrapolate the transformation relating the different image output formats for a given device model is proposed. This general approach can be adapted to specifically extract the scale factor (and, when appropriate, the translation) so as to align native resolution images to video frames, with or without EIS on, and proceed to compare PRNU patterns. Comparative evaluations show that the proposed approach outperforms those based on brute-force and particle swarm optimization in terms of reliability, accuracy and speed. Furthermore, a tracking system able to revert back EIS in controlled environments is designed. This allows one to investigate the differences between the existing EIS implementations. The additional knowledge thus acquired can be exploited and integrated in order to design and implement better future PRNU pattern alignment methods, aware of EIS and suitable for video source identification in multimedia forensics applications.

10.1016/j.patrec.2021.01.014http://hdl.handle.net/2158/1223559