A Robust Color Circle-Marker Detection Algorithm based on Color information and Hough Transformation

International audience

RGB-Event Fusion for Moving Object Detection in Autonomous Driving

Moving Object Detection (MOD) is a critical vision task for successfully achieving safe autonomous driving. Despite plausible results of deep learning methods, most existing approaches are only frame-based and may fail to reach reasonable performance when dealing with dynamic traffic participants. Recent advances in sensor technologies, especially the Event camera, can naturally complement the conventional camera approach to better model moving objects. However, event-based works often adopt a pre-defined time window for event representation, and simply integrate it to estimate image intensities from events, neglecting much of the rich temporal information from the available asynchronous ev…

Development of a fast panoramic face mosaicking and recognition system

We present some development results on a system that per- forms mosaicking of panoramic faces. Our objective is to study the fea- sibility of panoramic face construction in real time. To do so, we built a simple acquisition system composed of five standard cameras, which together can take simultaneously five views of a face at different angles. Then, we chose an easily hardware-achievable algorithm, consisting of successive linear transformations, in order to compose a panoramic face from these five views. The method has been tested on a large number of faces. In order to validate our system, we also conducted a preliminary study on panoramic face recognition, based on the principal-compone…

Automatic analyzis of droplet impact by high speed imaging

International audience; The impact of agricultural activities on the water quality is the consequence of the loss of fertilisers (chemical fertilisers, livestock effluent, also referred to as farm fertiliser, food-processing effluent and sludge) and crop treatment products (phytosanitary products). This pollution may prevent certain uses of water, notably its use for human and animal food (groundwater and surface water), and leads to a deterioration in aquatic environments. In the domain of vineyard precision spraying research, one of the most important objectives is to minimize the volume of phytosanitary products. It is also to be more environmentally respectful with more effective vine l…

Remote heart rate variability for emotional state monitoring

International audience; Several researches have been conducted to recognize emotions using various modalities such as facial expressions , gestures, speech or physiological signals. Among all these modalities, physiological signals are especially interesting because they are mainly controlled by the autonomic nervous system. It has been shown for example that there is an undeniable relationship between emotional state and Heart Rate Variability (HRV). In this paper, we present a methodology to monitor emotional state from physiological signals acquired remotely. The method is based on a remote photoplethysmography (rPPG) algorithm that estimates remote Heart Rate Variability (rHRV) using a …

Modular VLIW processor based on FPGA for real-time image processing

National audience

A Review of Recent Advances in Ear Recognition

International audience

HDR image generation from LDR image with highlight removal

The emergency of High Dynamic Range (HDR) display device impels the study of generating HDR image from Low Dynamic Range (LDR) image. Most existing generation methods apply complicated handing to highlight areas in image, which perplexes the algorithm and introduces the probability of generating artifacts. In this paper, we investigate a separated scheme: instead of sophisticated treatment to the highlight areas during expanding, the processing to the highlight areas is separated from the dynamic range expansion, which facilitates the framework and reduces the artifacts. The image quality metric shows that the separated scheme reveals more details with little artifacts compared to the algor…

Video-Based Depression Detection Using Local Curvelet Binary Patterns in Pairwise Orthogonal Planes

International audience; Depression is an increasingly prevalent mood disorder. This is the reason why the field of computer-based depression assessment has been gaining the attention of the research community during the past couple of years. The present work proposes two algorithms for depression detection, one Frame-based and the second Video-based, both employing Curvelet transform and Local Binary Patterns. The main advantage of these methods is that they have significantly lower computational requirements, as the extracted features are of very low dimensionality. This is achieved by modifying the previously proposed algorithm which considers Three-Orthogonal-Planes, to only Pairwise-Ort…

Fast Image Restoration Algorithms Based on PDE Models Using Modified Hopfield Neural Network

Two image restoration algorithms based on modified Hop field neural network and variational partial differential equations (PDE) were proposed in our previous work [1, 2]. But the convergence rate of the proposed algorithms was slow. In this paper, we develop a fast update rule based on modified Hop field neural network (MHNN) of continuous state change and two fast image restoration algorithms. Experimental results show that, when compared with the previous algorithms, our proposed algorithms have better performance both in convergence rate and in image restoration quality.

Fuzzy selecting local region level set algorithm

In this work, we introduced a novel localized region based level set model which is simultaneously effective for heterogeneous object or/and background and robust against noise. As such, we propose to minimize an energy functional based on a selective local average, i.e., when computing the local average, instead to use the intensity of all the pixels surrounding a given pixel, we first give a local Gaussian fuzzy membership to be a background or an object pixel to each of these surrounding pixels and then, we use the fuzzy weighted local average of these pixels to replace the traditional local average. With the graphics processing units' acceleration, the local lattice Boltzmann method is …

Research on Color based Ball Detection under Various Illuminations

International audience

LDR Image to HDR Image Mapping with Overexposure Preprocessing

International audience; Due to the growing popularity of High Dynamic Range (HDR) images and HDR displays, a large amount of existing Low Dynamic Range (LDR) images are required to be converted to HDR format to benefit HDR advantages, which give rise to some LDR to HDR algorithms. Most of these algorithms especially tackle overexposed areas during expanding, which is the potential to make the image quality worse than that before processing and introduces artifacts. To dispel these problems, we . present a new,LDR to HDR approach, unlike the existing techniques, it focuses on avoiding sophisticated treatment to overexposed areas in dynamic range expansion step. Based on a separating principl…

<title>Fast motion estimation based on spatio-temporal Gabor filters: parallel implementation on multi-DSP</title>

The aim of our work is to implement a system of motion estimation in image sequences processing on DSP's: fast motion estimation based on Gabor spatio-temporal filters. Our approach consists to calculate optical flow using an energy-based method, named combined filtering which associates the energetic responses of Gabor spatio- temporal filters organized in triads. For this purpose, we applicate a technique developed by the Laboratory LIS in France, inspired from the architecture of Heeger. To reduce the computation time, we present also a parallel implementation of the algorithm on a multi-DSP architecture using SynDEx tool which is a programming environment to generate optimized distribut…

Palmprint and Face Score Level Fusion for Contactless Small Sample Biometric Recognition and Verification

International audience

Image boundaries detection: from thresholding to implicit curve evolution

The development of high dimensional large-scale imaging devices increases the need of fast, robust and accurate image segmentation methods. Due to its intrinsic advantages such as the ability to extract complex boundaries, while handling topological changes automatically, the level set method (LSM) has been widely used in boundaries detection. Nevertheless, their computational complexity limits their use for real time systems. Furthermore, most of the LSMs share the limit of leading very often to a local minimum, while the effectiveness of many computer vision applications depends on the whole image boundaries. In this paper, using the image thresholding and the implicit curve evolution fra…

Correction to: Prevalence, associated factors and outcomes of pressure injuries in adult intensive care unit patients: the DecubICUs study (Intensive Care Medicine, (2021), 47, 2, (160-169), 10.1007/s00134-020-06234-9)

The original version of this article unfortunately contained a mistake. The members of the ESICM Trials Group Collaborators were not shown in the article but only in the ESM. The full list of collaborators is shown below. The original article has been corrected.

Fast Image Mosaicing for Panoramic Face Recognition

In this article, we present some development results of a system that performs mosaicing (or mosaicking) of panoramic faces. Our objective is to study the feasibility of panoramic face construction in real-time. To do so, we built a simple acquisition system composed of 5 standard cameras which, together, can take simultaneously 5 views of a face at different angles. Then, we chose an easily hardware-achievable algorithm, consisting of successive linear transformations, in order to compose a panoramic face from these 5 views. The method has been tested on a relatively large number of faces. In order to validate our system of panoramic face mosaicing, we also conducted a preliminary study on…

Face tracking and recognition: from algorithm to implementation

This paper describes a system capable of realizing a face detection and tracking in video sequences. In developing this system, we have used a RBF neural network to locate and categorize faces of different dimensions. The face tracker can be applied to a video communication system which allows the users to move freely in front of the camera while communicating. The system works at several stages. At first, we extract useful parameters by a low-pass filtering to compress data and we compose our codebook vectors. Then, the RBF neural network realizes a face detection and tracking on a specific board.

Multiscale Edges Detection by Wavelet Transform for Model of Face Recognition

Publisher Summary The linear auto-associator is a particular case of the linear-associator. The goal of this network is to associate a set of stimuli to itself, which could be used to store and retrieve face images and it also could be applied as a pre-processing device to simulate some psychological tasks—such as categorizing face according to their gender. A technique of learning based on the wavelet transform can improve recognition capability when the pattern images are with a great noise. One of the ways to store and recall face images uses the linear auto-associative memory. This connectionist model is in conjunction with a pixel-based coding of the faces. The image processing using t…

A LDR image expansion method for displaying on HDR screen

International audience

Palmprint and face score level fusion: hardware implementation of a contactless small sample biometric system

Including multiple sources of information in personal identity recognition and verification gives the opportunity to greatly improve performance. We propose a contactless biometric system that combines two modalities: palmprint and face. Hardware implementations are proposed on the Texas Instrument Digital Signal Processor and Xilinx Field-Programmable Gate Array (FPGA) platforms. The algorithmic chain consists of a preprocessing (which includes palm extraction from hand images), Gabor feature extraction, comparison by Hamming distance, and score fusion. Fusion possibilities are discussed and tested first using a bimodal database of 130 subjects that we designed (uB database), and then two …

Adaptive Backstepping Control of Nonlinear Uncertain Systems With Quantized States

This paper investigates the stabilization problem for uncertain nonlinear systems with quantized states. All states in the system are quantized by a static bounded quantizer, including uniform quantizer, hysteresis-uniform quantizer, and logarithmic-uniform quantizer as examples. An adaptive backstepping-based control algorithm, which can handle discontinuity, resulted from the state quantization and a new approach to stability analysis are developed by constructing a new compensation scheme for the effects of the state quantization. Besides showing the global ultimate boundedness of the system, the stabilization error performance is also established and can be improved by appropriately adj…

A Review of Recent Advances in Ear Recognition

Ear recognition has become a rapidly growing research area in recent years. This paper gives an up-to-date review of research works in ear recognition based on 3D data and 2D ear images. For ear recognition in 3D, recent works on 3D feature extraction and model matching are presented and discussed. For 3D ear recognition based on 2D images, 3D ear model reconstruction is mainly discussed. For ear recognition in 2D, main research works on ear detection, ear feature extraction and classification are presented and discussed. Some possible future research interests are proposed in the end.

Automatic Acoustic Target Detecting and Tracking on the Azimuth Recording Diagram with Image Processing Methods

International audience; Passive acoustic target detection has been a hot research topic for a few decades. Azimuth recording diagram is one of the most promising techniques to estimate the arrival direction of the interested signal by visualizing the sound wave information. However, this method is challenged by the random ambient noise, resulting in low reliability and short effective distance. This paper presents a real-time postprocessing framework for passive acoustic target detection modalities by using a sonar array, in which image processing methods are used to automate the target detecting and tracking on the azimuth recording diagram. The simulation results demonstrate that the prop…

Comparison of region of interest segmentation methods for video-based heart rate measurements

International audience; Conventional contact photoplethysmography (PPG) sensors are not suitable in situations of skin damage or when unconstrained movement is required. As a consequence, remote photoplethysmography (rPPG) has recently emerged because it provides remote physiological measurements without expensive hardware and improves comfort for long-term monitoring. RPPG estimation methods use the spatially averaged RGB values of pixels in a Region Of Interest (ROI) to generate a temporal RGB signal. The selection of ROI is a critical first step to obtain reliable pulse signals and must contain as many skin pixels as possible with a low percentage of non-skin pixels. In this paper, we ex…

Flexible VLIW processor based on FPGA for real-time image processing

International audience

Depression Assessment by Fusing High and Low Level Features from Audio, Video, and Text

International audience; Depression is a major cause of disability world-wide. The present paper reports on the results of our participation to the depression sub-challenge of the sixth Audio/Visual Emotion Challenge (AVEC 2016), which was designed to compare feature modalities ( audio, visual, interview transcript-based) in gender-based and gender-independent modes using a variety of classification algorithms. In our approach, both high and low level features were assessed in each modality. Audio features were extracted from the low-level descriptors provided by the challenge organizers. Several visual features were extracted and assessed including dynamic characteristics of facial elements…

VLIW architecture compilation-simulation and its implementation into FPGA

International audience; Embedded systems present a tremendous opportunity to customize designs by exploiting the application behavior. Shrinking time-to-market, coupled with short product lifetimes, create a critical need for rapid exploration and evaluation of candidate architectures achievement of these constraint. In the recent years, these systems have grown to the new concepts with inner computing processing for improving the performance that will be known as embedded computing system. Embedded computing with VLIW (Very Long Instruction Word) based architecture has been alternative choice to implement the target application into electronics devices in many areas such as digital image p…

Treatment with human umbilical cord-derived mesenchymal stem cells for COVID-19 patients with lung damage: a randomised, double-blind, placebo-controlled phase 2 trial

AbstractBACKGROUNDTreatment of severe Corona Virus Disease 2019 (COVID-19) is challenging. We performed a phase 2 trial to assess the efficacy and safety of human umbilical cord-mesenchymal stem cells (UC-MSCs) to treat severe COVID-19 patients with lung damage, based on our phase 1 data.METHODSIn this randomized, double-blind, and placebo-controlled trial, we recruited 101 severe COVID-19 patients with lung damage. They were randomly assigned to receive either UC-MSCs (4 × 107 cells per infusion) or placebo on day 0, 3, and 6. The primary endpoint was an altered proportion of whole lung lesion volumes from baseline to day 28. Other imaging outcomes, 6-minute walk test, maximum vital capaci…

Time Unification on Local Binary Patterns Three Orthogonal Planes for Facial Expression Recognition

International audience; Machine learning has known a tremendous growth within the last years, and lately, thanks to that, some computer vision algorithms started to access what is difficult or even impossible to perceive by the human eye. While deep learning based computer vision algorithms have made themselves more and more present in the recent years, more classical feature extraction methods, such as the ones based on Local Binary Patterns (LBP), still present a non negligible interest, especially when dealing with small datasets. Furthermore, this operator has proven to be quite useful for facial emotions and human gestures recognition in general. Micro-Expression (ME) classification is…

Search forBs0→μ+μ−andB0→μ+μ−Decays with CDF II

A search has been performed for B{sub s}{sup 0} {yields} {mu}{sup +}{mu}{sup -} and B{sup 0} {yields} {mu}{sup +}{mu}{sup -} decays using 7 fb{sup -1} of integrated luminosity collected by the CDF II detector at the Fermilab Tevatron collider. The observed number of B{sup 0} candidates is consistent with background-only expectations and yields an upper limit on the branching fraction of {Beta}(B{sup 0} {yields} {mu}{sup +}{mu}{sup -}) < 6.0 x 10{sup -9} at 95% confidence level. We observe an excess of B{sub s}{sup 0} candidates. The probability that the background processes alone could produce such an excess or larger is 0.27%. The probability that the combination of background and the expe…

Fast and Robust Face Detection on a Parallel Optimized Architecture implemented on FPGA

In this paper, we present a parallel architecture for fast and robust face detection implemented on FPGA hardware. We propose the first implementation that meets both real-time requirements in an embedded context and face detection robustness within complex backgrounds. The chosen face detection method is the Convolutional Face Finder (CFF) algorithm, which consists of a pipeline of convolution and subsampling operations, followed by a multilayer perceptron. We present the design methodology of our face detection processor element (PE). This methodology was followed in order to optimize our implementation in terms of memory usage and parallelization efficiency. We then built a parallel arch…

Inverse Tone Mapping Based upon Retina Response

International audience; The development of high dynamic range (HDR) display arouses the research of inverse tone mapping methods, which expand dynamic range of the low dynamic range (LDR) image to match that of HDR monitor. This paper proposed a novel physiological approach, which could avoid artifacts occurred in most existing algorithms. Inspired by the property of the human visual system (HVS), this dynamic range expansion scheme performs with a low computational complexity and a limited number of parameters and obtains high-quality HDR results. Comparisons with three recent algorithms in the literature also show that the proposed method reveals more important image details and produces …

Small Sample Biometric Recognition Based on Palmprint and Face Fusion

Contactless biometrics provide high comfort and hygiene in person recognition. Because of this, such systems are better accepted by the general public. This paper proposes an adaptive, contactless, biometric system which combines two modalities: palmprint and face. The processing chain has been designed to overcome embedded system constraints and small sample set problem: after a palmprint is extracted from a hand image, Gabor filters are applied to both the palmprint and face in order to extract parameters, which are then used for classification. Fusion possibilities are also discussed and tested using a multimodal database of 130 people designed by the authors. High recognition performanc…

Species composition and richness of aphid parasitoid wasps in cotton fields in northern China

AbstractThe cotton aphid, Aphis gossypii (Hemiptera: Aphididae), is a serious pest of cotton across the globe, particularly in the cotton agroecosystems of northern China. Parasitic wasps are deemed to be important natural enemies of A. gossypii, but limited information exists about their species composition, richness and seasonal dynamics in northern China. In this study, we combine sampling over a broad geographical area with intensive field trials over the course of three cropping seasons to describe parasitoid-hyperparasitoid communities in cotton crops. We delineate a speciose complex of primary parasitoids and hyperparasitoids associated with A. gossypii. Over 90% of the primary paras…

Concept and Development of Modular VLIW Processor Based on FPGA

Modern FPGA chips, with their larger memory capacity and reconfigurability potential, are opening new frontiers in rapid prototyping of embedded systems. With the advent of high density FPGAs it is now possible to implement a high performance VLIW processor core in an FPGA. Architecture based on Very Long Instruction Word (VLIW) processors are an optimal choice in the attempt to obtain high performance level in embedded system. In VLIW architecture, the effectiveness of these processors depends on the ability of compilers to provide sufficient instruction level parallelism(ILP) in program code. Using advanced compiler technology could take these functions, This paper describes research resu…

Prefiltering for pattern recognition using wavelet transform and neural networks

Publisher Summary Neural networks are built from simple units interlinked by a set of weighted connections. Generally, these units are organized in layers. Each unit of the first layer (input layer) corresponds to a feature of a pattern that is to be analyzed. The units of the last layer (output layer) produce a decision after the propagation of information. Before feeding the computational data to neural networks, the signal must undergo a preprocessing in order to (1) define the initial transformation to represent the measured signal, (2) retain important features for class discrimination and discard that is irrelevant, and (3) reduce the volume of data to be processed, for example, data …

An inverse tone mapping method for displaying images on HDR monitor

International audience

Parallel implementation of a multiscale edges detection algorithm

We present in this paper an implementation of a multiscale edges detection algorithm on multiprocessor using SYnDEx which is a programming environment to generate optimized distributed real-time executives. The implementation has been done on three TMS320C40 and the acceleration in comparison with one processor is 2.2.

[Regular Paper] Detection of H. pylori Induced Gastric Inflammation by Diffuse Reflectance Analysis

Spectral acquisitions contain rich information and thus, are promising modalities for early detection of gastric diseases. In this study, we analyze the diffuse reflectance of the gastric inflammatory lesions induced by the bacterium H. pylori in the mouse stomach. A pipeline has been designed to characterize and classify spectra acquired on mice. The pipeline is based on a band clustering algorithm followed by the computation of meaningful division and subtraction features and by classification with a linear SVM classifier. Currently, the pipeline is able to recognize inflamed stomach's spectra with an accuracy of 98%. These results are promising and the same pipeline could be adapted for …

Facial geometry and speech analysis for depression detection.

Depression is one of the most prevalent mental disorders, burdening many people world-wide. A system with the potential of serving as a decision support system is proposed, based on novel features extracted from facial expression geometry and speech, by interpreting non-verbal manifestations of depression. The proposed system has been tested both in gender independent and gender based modes, and with different fusion methods. The algorithms were evaluated for several combinations of parameters and classification schemes, on the dataset provided by the Audio/Visual Emotion Challenge of 2013 and 2014. The proposed framework achieved a precision of 94.8% for detecting persons achieving high sc…

Design of a Real-time face detection parallel architecture using High-Level Synthesis

Abstract We describe a High-Level Synthesis implementation of a parallel architecture for face detection. The chosen face detection method is the well-known Convolutional Face Finder (CFF) algorithm, which consists of a pipeline of convolution operations. We rely on dataflow modelling of the algorithm and we use a high-level synthesis tool in order to specify the local dataflows of our Processing Element (PE), by describing in C language inter-PE communication, fine scheduling of the successive convolutions, and memory distribution and bandwidth. Using this approach, we explore several implementation alternatives in order to find a compromise between processing speed and area of the PE. We …

Un novel opérateur multispectral pour la détection des coins

National audience

High-speed motion estimation of fertilizer granules with Gabor filters

In the context of fertilizer supply reduction, the understanding of the whole centrifugal spreading process became essential. Since few years we focused our research on the determination by image processing of the ejection conditions of flight of the granules, that is the trajectories and ejection angles, used as input data for ballistic flight to predict the fertilizer repartition on the ground. Due to relative high speed of the fertilizer granules (around 40 m.s -1 ), the previous parameters were evaluated using a specific high speed imaging system and image processing based on motion estimation method using Markov Random Fields method (MRFs). Even if the results were good (90% of correct…

Quantitative comparison of motion history image variants for video-based depression assessment

Abstract Depression is the most prevalent mood disorder and a leading cause of disability worldwide. Automated video-based analyses may afford objective measures to support clinical judgments. In the present paper, categorical depression assessment is addressed by proposing a novel variant of the Motion History Image (MHI) which considers Gabor-inhibited filtered data instead of the original image. Classification results obtained with this method on the AVEC’14 dataset are compared to those derived using (a) an earlier MHI variant, the Landmark Motion History Image (LMHI), and (b) the original MHI. The different motion representations were tested in several combinations of appearance-based …

Vineyard leaf roughness characterization by computer vision and cloud computing technics

International audience; In the context of vineyard leaf roughness analysis for precision spraying applications, this article deals with its characterization by computer vision and cloud computing techniques. The techniques merge feature extraction, linear or nonlinear dimensionality reduction techniques and several kinds of classification methods. Different combinations are processed and their performances compared in terms of classification error rate, in order to find the best association. However these combinations are hardly processed because of the lack of computing power and the prohibitive time consumption of the algorithms. To overcome these difficulties, we propose a solution: the …

A predictive function optimization algorithm for multi-spectral skin lesion assessment

The newly introduced Kubelka-Munk Genetic Algorithm (KMGA) is a promising technique used in the assessment of skin lesions. Unfortunately, this method is computationally expensive due to its function inverting process. In the work of this paper, we design a Predictive Function Optimization Algorithm in order to improve the efficiency of KMGA by speeding up its convergence rate. Using this approach, a High-Convergence-Rate KMGA (HCR-KMGA) is implemented onto multi-core processors and FPGA devices respectively. Furthermore, the implementations are optimized using parallel computing techniques. Intensive experiments demonstrate that HCR-KMGA can effectively accelerate KMGA method, while improv…

Automated Characterization of Mouth Activity for Stress and Anxiety Assessment

International audience; Non-verbal information portrayed by human facial expression, apart from emotional cues also encompasses information relevant to psychophysical status. Mouth activities in particular have been found to correlate with signs of several conditions; depressed people smile less, while those in fatigue yawn more. In this paper, we present a semi-automated, robust and efficient algorithm for extracting mouth activity from video recordings based on Eigen-features and template-matching. The algorithm was evaluated for mouth openings and mouth deformations, on a minimum specification dataset of 640x480 resolution and 15 fps. The extracted features were the signals of mouth expa…

Multiple modular very long instruction word processors based on field programmable gate arrays

Modern field programmable gate array (FPGA) chips, with their large memory capacity and reconfigurability potential, are opening new frontiers in rapid prototyping of embedded systems. With the advent of high-density FPGAs, it is now possible to implement a high-performance very long instruction word (VLIW) processor core in an FPGA. This paper describes research results about enabling the DSP TMS320 C6201 model for real-time image processing applications by exploiting FPGA technology. We present a modular DSP C6201 VHDL model with a variable instruction set. We call this new development a minimum mandatory modules (M3) approach. Our goals are to keep the flexibility of DSP in order to shor…

Designing a framework for assisting depression severity assessment from facial image analysis

Depression is one of the most common mental disorders affecting millions of people worldwide. Developing adjunct tools aiding depression assessment is expected to impact overall health outcomes and treatment cost reduction. To this end, platforms designed for automatic and non-invasive depression assessment could help in detecting signs of the disease on a regular basis, without requiring the physical presence of a mental health professional. Despite the different approaches that can be found in the literature, both in terms of methods and algorithms, a fully satisfactory system for the automatic assessment of depression severity has not been presented as yet. This paper describes a propose…

A CKIA ACTIVATOR PENETRATES THE BRAIN, AND SHOWS EFFICACY AGAINST DRUG-RESISTANT METASTATIC MEDULLOBLASTIOMA

Multi-Kernel Implicit Curve Evolution for Selected Texture Regions Segmentation in VHR Satellite Images

Very high resolution (VHR) satellite images provide a mass of detailed information which can be used for urban planning, mapping, security issues, or environmental monitoring. Nevertheless, the processing of this kind of image is timeconsuming, and extracting the needed information from among the huge quantity of data is a real challenge. For some applications such as natural disaster prevention and monitoring (typhoon, flood, bushfire, etc.), the use of fast and effective processing methods is demanded. Furthermore, such methods should be selective in order to extract only the information required to allow an efficient interpretation. For this purpose, we propose a texture region segmentat…

A pre-processing technique based on the wavelet transform for linear autoassociators with applications to face recognition

In order to improve the performance of a linear autoassociator (which is a neural network model), we explore the use of several preprocessing techniques. The gist of our approach is to store, in addition to the original pattern, one or several pre-processed (i.e. filtered) versions of the patterns to be stored in a neural network. First, we compare the performance of several pre-processing techniques (a plain vanilla version of the autoassociator as a control, a Sobel operator, a Canny-Deriche operator, and a multiscale Canny-Deriche operator) on an example of a pattern completion task using a noise degraded version of a face stored in an autoassociator. We found that the multiscale Canny-D…

Observation of the rare B(s)(0) + decay from the combined analysis of CMS and LHCb data.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported licence.-- et al.

A starting point for real-time human action detection

Analyzing videos of human actions involves understanding the spatial and temporal context of the scenes. State-of-the-art approaches have demonstrated impressive results using Convolution Neural Networks (CNNs). However, most of them operate in a non-real-time, offline fashion and are not well-equipped for many emerging real-world scenarios, such as autonomous driving and public surveillance. In addition, they are computationally demanding to be deployed on devices with limited power resources (e.g., embedded systems). This paper reviews state-of-the-art methods based on CNN for human action detection and related topics. Following that, we propose an initial framework to efficiently address…

Embedded multi-spectral image processing for real-time medical application

International audience; The newly introduced Kubelka-Munk Genetic Algorithm (KMGA) is a promising technique for the assessment of skin lesions from multi-spectral images. Using five skin parameter maps such as concentration or epidermis/dermis thickness, this method combines the Kubelka-Munk Light-Tissue interaction model and Genetic Algorithm optimization process to produce a quantitative measure of cutaneous tissue. Up to the present, variant improved KMGA implementations have been successfully realized using the recent parallel computing techniques. However, all these achievements are based on the multi-core CPUs. This results in a quite high cost and low practicability for the hardware …

LPA1, LPA2, LPA4, and LPA6receptor expression during mouse brain development

Background:LPA is a small bioactive phospholipid that acts as an extracellularsignaling molecule and is involved in cellular processes, including cell prolifera-tion, migration, and differentiation. LPA acts by binding and activating at least sixknown G protein–coupled receptors: LPA1–6. In recent years, LPA has beensuggested to play an important role both in normal neuronal development andunder pathological conditions in the nervous system. Results:We show the expression pattern of LPA receptors during mouse braindevelopment by using qRT-PCR, in situ hybridization, and immunocytochemistry.Only LPA1,LPA2,LPA4,and LPA6 mRNA transcripts were detected throughoutdevelopment stages from embryoni…

UBFC-Phys: A Multimodal Database For Psychophysiological Studies of Social Stress

As humans, we experience social stress in countless everyday-life situations. Giving a speech in front of an audience, passing a job interview, and similar experiences all lead us to go through stress states that impact both our psychological and physiological states. Therefore, studying the link between stress and physiological responses had become a critical societal issue, and recently, research in this field has grown in popularity. However, publicly available datasets have limitations. In this article, we propose a new dataset, UBFC-Phys, collected with and without contact from participants living social stress situations. A wristband was used to measure contact blood volume pulse (BVP…

Automatic Assessment of Depression Based on Visual Cues: A Systematic Review

International audience; Automatic depression assessment based on visual cues is a rapidly growing research domain. The present exhaustive review of existing approaches as reported in over sixty publications during the last ten years focuses on image processing and machine learning algorithms. Visual manifestations of depression, various procedures used for data collection, and existing datasets are summarized. The review outlines methods and algorithms for visual feature extraction, dimensionality reduction, decision methods for classification and regression approaches, as well as different fusion strategies. A quantitative meta-analysis of reported results, relying on performance metrics r…

Advanced 3D movement analysis algorithms for robust functional capacity assessment.

SummaryObjectives: We developed a novel system for in home functional capacities assessment in frail older adults by analyzing the Timed Up and Go movements. This system aims to follow the older people evolution, potentially allowing a forward detection of motor decompensation in order to trigger the implementation of rehabilitation. However, the pre-experimentations conducted on the ground, in different environments, revealed some problems which were related to KinectTM operation. Hence, the aim of this actual study is to develop methods to resolve these problems.Methods: Using the KinectTM sensor, we analyze the Timed Up and Go test movements by measuring nine spatio-temporal parameters, …

Multiple Modular VLIW Processors based on FPGA

International audience

Design Space Exploration for a Custom VLIW Architecture: Direct Photo Printer Hardware Setting Using VEX Compiler

Increasingly more computing power is demanded for contemporary applications such as multimedia, 3D visualization, and telecommunication. This paper presents a design space exploration (DSE) experience for an embedded VLIW processor that allows finding out the best architecture for given application. The proposed method has been implemented and tested using an image processing chain for direct photo printer. Our results show a considerable improvement in hardware cost and performance. After the best architecture is identified, we applied a technique to optimize the code in VEX system that uses ?inlining? function in order to reduce execution time.

An Embedded Solution for Multispectral Palmprint Recognition

Palmprint based identification has attracted much attention in the past decades. In some real-life applications, portable personal authentication systems with high accuracy and speed efficiency are required. This paper presents an embedded palmprint recognition solution based on the multispectral image modality. We first develop an effective recognition algorithm by using partial least squares regression, then a FPGA prototype is implemented and optimized through high-level synthesis technique. The evaluation experiments demonstrate that the proposed system can achieve a higher recognition rate at a lower running cost comparing to the reference implementations.

Parallel implementation on DSPs of a face detection algorithm

In order to localize the face in an image, our approach consists of approximating the face oval shape with an ellipse and to compute coordinates of the center of the ellipse. For this purpose, we explore a new version of the Hough transformation: the fuzzy generalized Hough transformation. To reduce the computation time, we present also a parallel implementation of the algorithm on 2 digital signal processors and we show that an acceleration of a factor of 1.62 has been obtained.

Detection of H. pylori induced gastric inflammation by diffuse reflectance analysis

International audience; Spectral acquisitions contain rich information and thus, are promising modalities for early detection of gastric diseases. In this study, we analyze the diffuse reflectance of the gastric inflammatory lesions induced by the bacterium H. pylori in the mouse stomach. A pipeline has been designed to characterize and classify spectra acquired on mice. The pipeline is based on a band clustering algorithm followed by the computation of meaningful division and subtraction features and by classification with a linear SVM classifier. Currently, the pipeline is able to recognize inflamed stomachs spectra with an accuracy of 98%. These results are promising and the same pipelin…

An improved spatial feature-based detection algorithm for vertical scratches in old film

International audience

Flexible VLIW processor based on FPGA for real-time image processing

Modern FPGA chips, with their larger memory capacity and reconfigurability potential, are opening new frontiers in rapid prototyping of embedded systems. With the advent of high density FPGAs it is now possible to implement a high performance Very Long Instruction Word (VLIW) processor core in an FPGA. With VLIW architecture, the processor effectiveness depends on the ability of compilers to provide sufficient Instruction Level Parallelism (ILP) from program code. This paper describes research result about enabling the VLIW processor model for real-time processing applications by exploiting FPGA technology. Our goals are to keep the flexibility of processors in order to shorten the developm…

Implémentations matérielles d'un système biométrique bimodal

National audience

Kinematic analysis of motor strategies in frail aged adults during the Timed Up and Go: how to spot the motor frailty?

Asma Hassani,1 Alexandre Kubicki,2,3 Vincent Brost,1 France Mourey,2,4 Fan Yang1 1Laboratoire LE2I CNRS 6306, Universit&amp;eacute; de Bourgogne, Dijon, France; 2Institut National de la Sant&amp;eacute; et de la Recherche M&amp;eacute;dicale (INSERM), Cognition Action et Plasticit&amp;eacute; Sensori-Motrice, Campus Universitaire, Universit&amp;eacute; de Bourgogne, Dijon, France; 3Centre Hospitalier Universitaire de Dijon, H&amp;ocirc;pital de Champmaillot, Dijon, France; 4Facult&amp;eacute; de M&amp;eacute;decine, Universit&amp;eacute; de Bourgogne, Dijon, France Objective: The purpose of this work was to analyze and compare the movement kinematics of sit-to-stand (STS) and back-to-sit (B…

Détection de la dépression par l’analyse de la géométrie faciale et de la parole

Depression is one of the most prevalent mental disorders, burdening many people world-wide. A system with the potential of serving as a decision support system is proposed, based on novel features extracted from facial expression geometry and speech, by interpreting non-verbal manifestations of depression. The proposed system has been tested both in gender independent and gender based modes, and with different fusion methods. The algorithms were evaluated for several combinations of parameters and classification schemes, on the dataset provided by the Audio/Visual Emotion Challenge of 2013 and 2014. The proposed framework achieved a precision of 94.8% for detecting persons achieving high sc…

&lt;title&gt;Real-time face tracking and recognition for video conferencing&lt;/title&gt;

This paper describes a system of vision in real time, allowing to detect automatically the faces presence, to localize and to follow them in video sequences. We verify also the faces identities. These processes are based by combining technique of image processing and methods of neural networks. The tracking is realized with a strategy of prediction-verification using the dynamic information of the detection. The system has been evaluated quantitatively on 8 video sequences. The robustness of the method has been tested on various lightings images. We present also the analysis of complexity of this algorithm in order to realize an implementation in real time on a FPGA based architecture.

Architecture-Driven Level Set Optimization: From Clustering to Sub-pixel Image Segmentation

Thanks to their effectiveness, active contour models (ACMs) are of great interest for computer vision scientists. The level set methods (LSMs) refer to the class of geometric active contours. Comparing with the other ACMs, in addition to subpixel accuracy, it has the intrinsic ability to automatically handle topological changes. Nevertheless, the LSMs are computationally expensive. A solution for their time consumption problem can be hardware acceleration using some massively parallel devices such as graphics processing units (GPUs). But the question is: which accuracy can we reach while still maintaining an adequate algorithm to massively parallel architecture? In this paper, we attempt to…

A Parallel Face Detection System Implemented on FPGA

In this paper, we introduce a methodology for designing a system for face detection and its implementation on FPGA. The chosen face detection method is the well-known convolutional face finder (CFF) algorithm, which consists in a pipeline of convolutions and subsampling operations. Our goal is to define a parallel architecture able to process efficiently this algorithm. We present a dataflow based architecture algorithm adequation (AAA) methodology implemented using the SynDEx software, in order to find the best compromise between the processing power and functionality requirement of each processor element (PE), and the efficiency of algorithm parallelization. We describe a first implementa…

Vertical scratches detection based on edge detection for old film

Automatic detection of image damaged regions is the key to automatic video image inpainting. Vertical scratches are the common damages in the old film. In this paper, a vertical scratches detection algorithm based on edge detection is proposed. The proposed algorithm first uses the operator which has the largest response to the vertical edge in Sobel operator to detect edges, and then uses canny operator to detect edges further. Third, we detect vertical lines in the image through probabilistic Hough transform. Finally, we obtain the true locations of the vertical lines scratches through morphology and width constraints. Many experiments show that our method can detect vertical line scratch…

Implementation of pattern recognition algorithm based on RBF neural network

In this paper, we present implementations of a pattern recognition algorithm which uses a RBF (Radial Basis Function) neural network. Our aim is to elaborate a quite efficient system which realizes real time faces tracking and identity verification in natural video sequences. Hardware implementations have been realized on an embedded system developed by our laboratory. This system is based on a DSP (Digital Signal Processor) TMS320C6x. The optimization of implementations allow us to obtain a processing speed of 4.8 images (240x320 pixels) per second with a correct rate of 95% of faces tracking and identity verification.