Search results for "speech"

Virtual conversation with a real talking head

2008

A talking head is system performing an animated face model synchronized with a speech synthesis module. It is used as a presentation layer of a conversational Agent which provide an answer. It provides an answer when a query is written as an input by the user. The textual answer is converted into facial movements of a 3D face model whose lips and tongue movements are synchronized with the sound of the synthetic voice. The Client-Server paradigm has been used for the WEB infrastructure delegating the animation and synchronization to the client, so that the server can satisfy multiple requests from clients; while the Chatbot, the Digital Signal Processing and the Natural language Processing a…

Adaptive independent vector analysis for multi-subject complex-valued fMRI data.

2017

Abstract Background Complex-valued fMRI data can provide additional insights beyond magnitude-only data. However, independent vector analysis (IVA), which has exhibited great potential for group analysis of magnitude-only fMRI data, has rarely been applied to complex-valued fMRI data. The main challenges in this application include the extremely noisy nature and large variability of the source component vector (SCV) distribution. New method To address these challenges, we propose an adaptive fixed-point IVA algorithm for analyzing multiple-subject complex-valued fMRI data. We exploited a multivariate generalized Gaussian distribution (MGGD)- based nonlinear function to match varying SCV dis…

Predictive error detection in pianists: A combined ERP and motion capture study

2013

Performing a piece of music involves the interplay of several cognitive and motor processes and requires extensive training to achieve a high skill level. However, even professional musicians commit errors occasionally. Previous event-related potential (ERP) studies have investigated the neurophysiological correlates of pitch errors during piano performance, and reported pre-error negativity already occurring approximately 70–100 ms before the error had been committed and audible. It was assumed that this pre-error negativity reflects predictive control processes that compare predicted consequences with actual consequences of one's own actions. However, in previous investigations, correct a…

The Pursuit of Happiness in Music: Retrieving Valence with Contextual Music Descriptors

2009

In the study of music emotions, Valence is usually referred to as one of the dimensions of the circumplex model of emotions that describes music appraisal of happiness, whose scale goes from sad to happy. Nevertheless, related literature shows that Valence is known as being particularly difficult to be predicted by a computational model. As Valence is a contextual music feature, it is assumed here that its prediction should also require contextual music descriptors in its predicting model. This work describes the usage of eight contextual (also known as higher-level) descriptors, previously developed by us, to calculate happiness in music. Each of these descriptors was independently tested …

The effectiveness of cochlear implantation on performance-based and patient-reported outcome measures in Finnish recipients

2021

Understanding speech is essential for adequate social interaction, and its functioning affects health, wellbeing, and quality of life (QoL). Untreated hearing loss (HL) is associated with reduced social activity, depression and cognitive decline. Severe and profound HL is routinely rehabilitated with cochlear implantation. The success of treatment is mostly assessed by performance-based outcome measures such as speech perception. The ultimate goal of cochlear implantation, however, is to improve the patient’s QoL. Therefore, patient-reported outcomes measures (PROMs) would be clinically valuable as they assess subjective benefits and overall effectiveness of treatment. The aim of this study…

Part of speech tagging with Naïve Bayes methods

2014

Complexity of operations on cofinite languages

2010

International audience; We study the worst case complexity of regular operation on cofinite languages (i.e., languages whose complement is finite) and provide algorithms to compute efficiently the resulting minimal automata.

Supramodal neural processing of abstract information conveyed by speech and gesture

2013

Abstractness and modality of interpersonal communication have a considerable impact on comprehension. They are relevant for determining thoughts and constituting internal models of the environment. Whereas concrete object-related information can be represented in mind irrespective of language, abstract concepts require a representation in speech. Consequently, modality-independent processing of abstract information can be expected. Here we investigated the neural correlates of abstractness (abstract vs. concrete) and modality (speech vs. gestures), to identify an abstractness-specific supramodal neural network. During fMRI data acquisition 20 participants were presented with videos of an ac…

2014

Due to its millisecond-scale temporal resolution, EEG allows to assess neural correlates with precisely defined temporal relationship relative to a given event. This knowledge is generally lacking in data from functional magnetic resonance imaging (fMRI) which has a temporal resolution on the scale of seconds so that possibilities to combine the two modalities are sought. Previous applications combining event-related potentials (ERPs) with simultaneous fMRI BOLD generally aimed at measuring known ERP components in single trials and correlate the resulting time series with the fMRI BOLD signal. While it is a valuable first step, this procedure cannot guarantee that variability of the chosen …

Genome-wide analyses of individual differences in quantitatively assessed reading- and language-related skills in up to 34,000 people

2022

Published August 23, 2022 The use of spoken and written language is a fundamental human capacity. Individual differences in reading- and language-related skills are influenced by genetic variation, with twin-based heritability estimates of 30 to 80% depending on the trait. The genetic architecture is complex, heterogeneous, and multifactorial, but investigations of contributions of single-nucleotide polymorphisms (SNPs) were thus far underpowered. We present a multicohort genome-wide association study (GWAS) of five traits assessed individually using psychometric measures (word reading, nonword reading, spelling, phoneme awareness, and nonword repetition) in samples of 13,633 to 33,959 part…