0000000000060015
AUTHOR
Christophe Stolz
Online detection and removal of eye blink artifacts from electroencephalogram
Abstract The most prominent type of artifact contaminating electroencephalogram (EEG) signals are the eye blink (EB) artifacts, which could potentially lead to misinterpretation of the EEG signal. Online identification and elimination of eye blink artifacts are crucial in applications such a Brain-Computer Interfaces (BCI), neurofeedback, and epilepsy diagnosis. In this paper, algorithms that combine unsupervised eye blink artifact detection (eADA) with modified Empirical Mode Decomposition (FastEMD) and Canonical Correlation Analysis (CCA) are proposed, i.e., FastEMD-CCA2 and FastCCA, to automatically identify eye blink artifacts and remove them in an online setting. The average accuracy, …
Modality-Guided Subnetwork for Salient Object Detection
Recent RGBD-based models for saliency detection have attracted research attention. The depth clues such as boundary clues, surface normal, shape attribute, etc., contribute to the identification of salient objects with complicated scenarios. However, most RGBD networks require multi-modalities from the input side and feed them separately through a two-stream design, which inevitably results in extra costs on depth sensors and computation. To tackle these inconveniences, we present in this paper a novel fusion design named modality-guided subnetwork (MGSnet). It has the following superior designs: 1) Our model works for both RGB and RGBD data, and dynamically estimating depth if not availabl…
Wood fiber orientation assessment based on punctual laser beam excitation: A preliminary study
International audience; The EU imposes standards for the use of wood in structural applications. Local singularities such as knots affect the wood mechanical properties. They can be revealed by looking at the wood fiber orientation. For this reason, many methods were proposed to estimate the orientation of wood fiber using optical means, X-rays, or scattering measurement techniques. In this paper, an approach to assess the wood fiber orientation based on thermal ellipsometry is developed. The wood part is punctually heated with a Nd-YAG Laser and the thermal response is acquired by an infrared camera. The thermal response is elliptical due to the propagation of the heat through and along th…
Imagerie polarimétrique : principes et applications.
National audience
Characterization of the 3D information of Calyptogena shells
We propose in this paper an application of multiresolution analysis techniques to extract information contained in the growth increments of a bivalve mollusk called: Calyptogena . The first stage consists in extracting a range image of the mollusk’s shell using a 3-D scanner. Applying a multiresolution analysis enables us to localize precisely those growth increments by preserving relevant details. Moreover, interesting spatial and frequency properties of the multiresolution analysis underline information contained on the shell. Intra-individual variation and inter-individual variations are compared to assume some conclusions as for the ontogenetic evolution of the animal such as periodicit…
3D reconstruction of external and internal surfaces of transparent objects from polarization state of highlights
A vision-based method is proposed to measure the 3D shape of external and internal surfaces (not accessible) of smooth transparent objects. Looking at the reflections of point sources on a specular surface with a polarimetric camera, we combine the measurements of two techniques: shape from distortion and shape from polarization. It permits us to recover the position and orientation of the specular surface for each detected point. The internal surface of transparent objects exhibiting as well a specular component, the same technique is used on the highlights coming from the back surface, taking into account the refraction by using polarimetric ray tracing.
Real time polarization imaging of weld pool surface
The search for an efficient on-line monitoring system focused on the real-time analysis of arc welding quality is an active area of research. The topography and the superficial temperature field of the weld pool can provide important information which can be used to regulate the welding parameters for depositing consistent welds. One difficulty relies on accessing this information despite the bright dazzling welding arc. In the present work, Stokes polarimetry and associated shape-from-polarization methods are applied for the analysis of the weld pool through its 810 nm-wavelength infrared emissions. The obtained information can provide a better understanding of the process, such as the usa…
Weld pool surface temperature measurement from polarization state of thermal emission
This paper presents a passive polarimetry method using a division of aperture optical device in order to measure the temperature distribution at the weld pool surface. Thermal emission from a hot liquid metal was investigated at a near-infrared wavelength corresponding to a blind spectral window of a helium plasma generated during gas tungsten arc welding process. The refractive index of liquid metal and the surface radiance are deduced from the polarisation state of thermal emissions. Based upon the knowledge of both characteristics, the temperature distribution can be calculated. Conseil Régional de Bourgogne
“Scanning from Heating” and “Shape from Fluorescence”
3D surface acquisition is a subject which has been studied to a large extent. A significant number of techniques for acquiring shape have been proposed, and a wide range of commercial solutions are available. Nevertheless, today’s systems still have difficulties when digitizing objects with non-Lambertian surfaces in the visible light spectrum, as is the case of transparent, semi-transparent or highly reflective materials (e.g. glass, crystals, some plastics and shiny metals). In this chapter, some of the issues of traditional scanning systems are addressed by considering various approaches using the radioactive properties of materials, the polarization information of the reflected light as…
Region-based segmentation on depth images from a 3D reference surface for tree species recognition.
International audience; The aim of the work presented in this paper is to develop a method for the automatic identification of tree species using Terrestrial Light Detection and Ranging (T-LiDAR) data. The approach that we propose analyses depth images built from 3D point clouds corresponding to a 30 cm segment of the tree trunk in order to extract characteristic shape features used for classifying the different tree species using the Random Forest classifier. We will present the method used to transform the 3D point cloud to a depth image and the region based segmentation method used to segment the depth images before shape features are computed on the segmented images. Our approach has be…
Optimization of a polarization imaging system for 3D measurements of transparent objects
This paper presents a multispectral imaging system for 3D reconstruction of transparent objects based on "shape from polarization" technique. The originality of this work relies on a multispectral active lighting system which enables to cope with the two ambiguities on the zenith angle and azimuth angle. A calibration step allows optimising the polarimetric measurements. Example of a reconstructed transparent object is presented.
Depth reconstruction by means of defocused light from incomplete measurements
National audience
Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging
International audience; In the field of industrial vision, the three-dimensional inspection of highly reflective metallic objects is still a delicate task. We deal with a new automated three-dimensional inspection system based on polarization analysis. We first present an extension of the shape-from-polarization method for dielectric surfaces to metallic surfaces. Then, we describe what we believe to be a new way of solving the ambiguity concerning the normal orientation with an active lighting system. Finally, applications to shape-defect detection are discussed, and the efficiency of the system to discriminate defects on specular metallic objects made by stamping and polishing is presente…
Characterizing weld pool surfaces from polarization state of thermal emissions
International audience; In this Letter, a vision-based remote sensing methodology is proposed to measure the topography of weld pool surfaces from one single view. Thermal radiations emitted by the hot liquid metal at a wavelength within the arc plasma blind spectral window are acquired by a wavefront division polarimetric system. The refractive index of the liquid metal and the topography of the weld pool surface are inferred from the polarimetric state of the thermal radiations.
Automated and Online Eye Blink Artifact Removal from Electroencephalogram
Eyeblink artifacts often contaminates electroencephalogram (EEG) signals, which could potentially confound EEG's interpretation. A lot offline methods are available to remove this artifact, but an online solution is required to remove eyeblink artifacts in near real time for EEG signal to be beneficial in applications such as brain computer interface, (BCI). In this work, approaches that combines unsupervised eyeblink artifact detection with Empirical Mode Decomposition (EMD) and Canonical Correlation Analysis (CCA) are proposed to automatically identify eyeblink artifacts and remove them in an online setting. The proposed approaches are analysed and evaluated in terms of artifact removal a…
Unsupervised Eye Blink Artifact Identification in Electroencephalogram
International audience; The most prominent type of artifact contaminating electroencephalogram (EEG) signals is the eye blink (EB) artifact. Hence, EB artifact detection is one of the most crucial pre-processing step in EEG signal processing before this artifact can be removed. In this work, an approach that identifies EB artifacts without human supervision and automated varying threshold setting is proposed and evaluated. The algorithm functions on the basis of correlation between two EEG electrodes, Fp1 and Fp2, followed by EB artifact threshold determination utilizing the amplitude displacement from the mean. The proposed approach is validated and evaluated in terms of accuracy and error…
A combined three-dimensional digitisation and subsurface defect detection data using active infrared thermography
International audience; In recent years, NonDestructive Testing (NDT) systems have been upgraded with three-dimensional information. Indeed, combine the three-dimensional and thermal information allows a more meaningful analysis. In the literature, the data for NDT and three-dimensional (3D) reconstruction analysis are commonly acquired from independent systems. However, the use of two such systems leads to error analysis during the data registration. In an attempt to overcome such problems, we propose a single system based on active thermography approach using heat point-source stimulation to get the 3D digitization as well as subsurface defect detection. The experiments are conducted on s…
Surface Reconstruction of Transparent Objects by Polarization Imaging
This paper focuses a method to acquire the surface of transparent objects for 3D measurement. The technique relies on the so called ?Shape from Polarization? technique. The principle of this polarization imaging technique is as follows: after being reflected, an unpolarized light becomes partially linearly polarized. The surface normals can be evaluated by analyzing their polarization parameters and by knowing the refractive index of the object to be controlled. Finally, the 3D shape is obtained by integrating the normals field. After an introduction to expose the problematic, section 2 exposes the principles of polarization technique. The third and the last section deal with the polarimetr…
Optimal Gabor Filters and Haralick Features for Industrial Polarization Imaging
International audience; During the past decade, computer vision methods for inline inspection became an important tool in a lot of industrial processes. During the same time polarization imaging techniques rapidly evolved with the development of electro-optic components, as e.g. the polarization cameras, now available on the market. This paper is dedicated to the application of polarization techniques for visually inspecting complex metallic surfaces. As we will shortly recall, this consists of a direct image interpretation based on the measurement of the polarization parameters of the light reflected by the inspected object. The proposed image interpretation procedure consists of a Gabor p…
Identification des espèces d'arbres à partir de données T-LiDAR Tree species identification using T-LiDAR data
National audience; En raison de l'utilisation croissante des scanners LiDAR terrestre (T-LiDAR) dans le domaine forestier, le développement d'outils logiciels pour la mesure automatique d'attributs d'inventaire forestier est devenu un domaine de recherche important. De nombreux travaux portant sur la localisation des arbres dans un nuage de points, la mesure du diamètre à hauteur de poitrine (DHP) ou la mesure de la hauteur des arbres ont été décrits dans la littérature. Cependant, le problème de l'identification des espèces d'arbres à partir de données T-LiDAR a été peu abordé. La plupart des travaux utilisent des données LiDAR aéroportées et les espèces des arbres sont déterminées à l'éch…
Éclairage structuré et vision active pour le contrôle qualité de surfaces métalliques réfléchissantes
Dans le domaine de la vision artificielle, l’inspection de surfaces parfaitement reflechissantes est une tâche particulierement delicate, car elle implique de maitriser completement l’eclairage de la scene. Nous proposons dans ce papier, deux methodes complementaires permettant le controle qualite de surfaces metalliques reflechissantes. La premiere methode est un systeme d’acquisition utilisant un eclairage dynamique a franges. Elle permet de reveler les defauts d’aspect sur les surfaces a faible courbure. Dans des zones locales a plus forte courbure, il devient necessaire d’avoir acces a des informations tridimensionnelles afin de pouvoir segmenter les defauts. Nous proposons ainsi une me…
Depth-Adapted CNN for RGB-D cameras
Conventional 2D Convolutional Neural Networks (CNN) extract features from an input image by applying linear filters. These filters compute the spatial coherence by weighting the photometric information on a fixed neighborhood without taking into account the geometric information. We tackle the problem of improving the classical RGB CNN methods by using the depth information provided by the RGB-D cameras. State-of-the-art approaches use depth as an additional channel or image (HHA) or pass from 2D CNN to 3D CNN. This paper proposes a novel and generic procedure to articulate both photometric and geometric information in CNN architecture. The depth data is represented as a 2D offset to adapt …
Active Lighting Applied to Shape from Polarization
We present a new way of solving the ambiguity that appears in the shape from polarization method. This ambiguity, concerning the normals orientation of the surface, was previously solved thanks to a propagation algorithm. In this paper, the ambiguity is solved thanks to a special active lighting. This method is less time computing and is more robust to noise acquisition. We first demonstrate how to compute the right normals on the whole surface. Then, we show an application on the 3D reconstruction of a specular metallic object made by stamping and polishing.
Variance Thresholded EMD-CCA Technique for Fast Eye Blink Artifacts Removal in EEG
International audience; Eye blink (EB) artifacts generated during eye blinks often contaminate electroencephalogram (EEG) signal. Previously Empirical Mode Decomposition (EMD) and Canonical Correlation Analysis (CCA), hybrid EMD-CCA were developed for EB artifact removal in EEG. However, EMD restricts the hybrid algorithm for real time implementation due to its slow processing nature, hence the algorithm has to be enhanced so that it can be a viable solution for real-time EB artifact removal. In this research work, to avoid applying EMD repetitively as and when EB artifacts occur, a method to use EMD minimally is approached. A suitable EB artifact region is detected through a variance thres…
Shape from polarization: a method for solving zenithal angle ambiguity
International audience; We report a multispectral based method that permits the evolution of shape from polarization setup applied to 3D shape estimation of transparent objects. The setup is based on a polarization imaging technique which is a recent imaging method based on the analysis of the polarization state of the light in the observed scene. The technique has rapidly evolved with the development of electro-optic components and some polarization cameras are now available on the market. Shape from polarization consists in measuring the azimuthal and zenithal angles characterizing the normal of each point of the observed surface. We focus on the ambiguity in the measurement of the zenith…
FastEMD–CCA algorithm for unsupervised and fast removal of eyeblink artifacts from electroencephalogram
Abstract Online detection and removal of eye blink (EB) artifacts from electroencephalogram (EEG) would be very useful in medical diagnosis and brain computer interface (BCI). In this work, approaches that combine unsupervised eyeblink artifact detection with empirical mode decomposition (EMD), and canonical correlation analysis (CCA), are proposed to automatically identify eyeblink artifacts and remove them in an online manner. First eyeblink artifact regions are automatically identified and an eyeblink artifact template is extracted via EMD, which incorporates an alternate interpolation technique, the Akima spline interpolation. The removal of eyeblink artifact components relies on the el…
3D reconstruction of transparent objects exploiting surface fluorescence caused by UV irradiation
In this paper, we present a novel approach exploiting fluorescence imaging to estimate the shape of transparent objects. Classical inspection systems require users to coat transparent objects with some powder before measurement. Methods suggested in literature through non contact measurement do not effectively deal with the refraction problem, thus, providing inaccuracies. The proposed method handles the scanning of transparent objects without using any powder and solving the refraction problem using UV environment. A classical triangulation method based on stereovision scheme using fixed stereoscopic visible range cameras with a fixed UV (Ultra Violet) laser source is implemented. Transpar…