6533b7ddfe1ef96bd12747db

RESEARCH PRODUCT

Timbre Similarity: Convergence of Neural, Behavioral, and Computational Approaches

Risto NäätänenMinna HuotilainenPetri ToiviainenMari TervaniemiMarieke SaherJukka Louhivuori

subject

Self-organizing mapArtificial neural networkBrain activity and meditationSpeech recognitionSimilarity (psychology)Convergence (routing)Mismatch negativityPsychologyScale (map)TimbreMusic

description

The present study compared the degree of similarity of timbre representations as observed with brain recordings, behavioral studies, and computer simulations. To this end, the electrical brain activity of subjects was recorded while they were repetitively presented with five sounds differing in timbre. Subjects read simultaneously so that their attention was not focused on the sounds. The brain activity was quantified in terms of a change-specific mismatch negativity component. Thereafter, the subjects were asked to judge the similarity of all pairs along a five-step scale. A computer simulation was made by first training a Kohonen self-organizing map with a large set of instrumental sounds. The map was then tested with the experimental stimuli, and the distance between the most active artificial neurons was measured. The results of these methods were highly similar, suggesting that timbre representations reflected in behavioral measures correspond to neural activity, both as measured directly and as simulated in self-organizing neural network models.

https://doi.org/10.2307/40285788