A Human-Humanoid Interaction Through the Use of BCI for Locked-In ALS Patients Using Neuro-Biological Feedback Fusion.

This paper illustrates a new architecture for a human–humanoid interaction based on EEG-brain computer interface (EEG-BCI) for patients affected by locked-in syndrome caused by Amyotrophic Lateral Sclerosis (ALS). The proposed architecture is able to recognise users’ mental state accordingly to the biofeedback factor $\text {B}_{\text f}$ , based on users’ attention, intention, and focus, that is used to elicit a robot to perform customised behaviours. Experiments have been conducted with a population of eight subjects: four ALS patients in a near locked-in status with normal ocular movement and four healthy control subjects enrolled for age, education, and computer expertise. The results s…

Brain Controlled Architecture for Human-Human Interaction Mediated by a Humanoid Robot

This paper presents an Assistive social robots architecture designed for social interaction with humans, mediated by a humanoid robot. The architecture has been designed for being used by people with severe paralysis and the architecture has been tested by a user affected by amyotrophic lateral sclerosis (ALS) in a locked-in state. The system allows the patient to communicate with the stakeholders using a Brain Controlled Interface, based on Evoked Response Potentials (ERP), to express needing, feelings or writing phases. Stakeholders visualize messages sent by the patient on a GUI and use a tele operated humanoid robot as an avatar of them to extend their physical presence to interact with…

Embodied responses to musical experience detected by human bio-feedback brain features in a geminoid augmented architecture

Abstract This paper presents the conceptual framework for a study of musical experience and the associated architecture centred on Human-Humanoid Interaction (HHI). On the grounds of the theoretical and experimental literature on the biological foundation of music, the grammar of music perception and the perception and feeling of emotions in music hearing, we argue that music cognition is specific and that it is realized by a cognitive capacity for music that consists of conceptual and affective constituents. We discuss the relationship between such constituents that enables understanding, that is extracting meaning from music at the different levels of the organization of sounds that are f…

UnipaBCI a novel general software framework for brain computer interface

The increasing interest in Brain Computer Interface (BCI) requires new fast, reliable and scalable frameworks that can be used by researchers to develop BCI based high performance applications in efficient and fast ways. In this paper is presented "UnipaBCI", a general software framework for BCI applications based on electroencephalogra-phy (EEG) that can fulfill these new needs. A visual evoked potentials (VEP) application has also been developed using the proposed framework in order to test the modular architecture and the overall performance. Different types of users (beginners and experts in BCI) have been involved during the "UnipaBCI" experimental test and they have exhibited good and…

Conveying Audience Emotions Through Humanoid Robot Gestures to an Orchestra During a Live Musical Exhibition

In the last twenty years, robotics have been applied in many heterogeneous contexts. Among them, the use of humanoid robots during musical concerts have been proposed and investigated by many authors. In this paper, we propose a contribution in the area of robotics application in music, consisting of a system for conveying audience emotions during a live musical exhibition, by means of a humanoid robot. In particular, we provide all spectators with a mobile app, by means of which they can select a specific color while listening to a piece of music (act). Each color is mapped to an emotion, and the audience preferences are then processed in order to select the next act to be played. This dec…

Reaching and Grasping a Glass of Water by Locked-In ALS Patients through a BCI-Controlled Humanoid Robot

Locked-in Amyotrophic Lateral Sclerosis (ALS) patients are fully dependent on caregivers for any daily need. At this stage, basic communication and environmental control may not be possible even with commonly used augmentative and alternative communication devices. Brain Computer Interface (BCI) technology allows users to modulate brain activity for communication and control of machines and devices, without requiring a motor control. In the last several years, numerous articles have described how persons with ALS could effectively use BCIs for different goals, usually spelling. In the present study, locked-in ALS patients used a BCI system to directly control the humanoid robot NAO (Aldebar…

An android architecture for bio-inspired honest signalling in Human-Humanoid Interaction

Abstract This paper outlines an augmented robotic architecture to study the conditions of successful Human-Humanoid Interaction (HHI). The architecture is designed as a testable model generator for interaction centred on the ability to emit, display and detect honest signals. First we overview the biological theory in which the concept of honest signals has been put forward in order to assess its explanatory power. We reconstruct the application of the concept of honest signalling in accounting for interaction in strategic contexts and in laying bare the foundation for an automated social metrics. We describe the modules of the architecture, which is intended to implement the concept of hon…

A Cognitive Model of Trust for Biological and Artificial Humanoid Robots

This paper presents a model of trust for biological and artificial humanoid robots and agents as antecedent condition of interaction. We discuss the cognitive engines of social perception that accounts for the units on which agents operate and the rules they follow when they bestow trust and assess trustworthiness. We propose that this structural information is the domain of the model. The model represents it in terms of modular cognitive structures connected by a parallel architecture. Finally we give a preliminary formalization of the model in the mathematical framework of the I/O automata for future computational and human-humanoid application.

Acceptability Study of A3-K3 Robotic Architecture for a Neurorobotics Painting

In this paper, authors present a novel architecture for controlling an industrial robot via Brain Computer Interface. The robot used is a Series 2000 KR 210-2. The robotic arm was fitted with DI drawing devices that clamp, hold and manipulate various artistic media like brushes, pencils, pens. User selected a high-level task, for instance a shape or movement, using a human machine interface and the translation in robot movement was entirely demanded to the Robot Control Architecture defining a plan to accomplish user's task. The architecture was composed by a Human Machine Interface based on P300 Brain Computer Interface and a robotic architecture composed by a deliberative layer and a reac…

Reaching and grasping a glass of water by locked-in ALS patients through a BCI-controlled humanoid robot

A Cognitive Model of Trust for Biological and Artificial Humanoid Robots

Abstract This paper presents a model of trust for biological and artificial humanoid robots and agents as antecedent condition of interaction. We discuss the cognitive engines of social perception that accounts for the units on which agents operate and the rules they follow when they bestow trust and assess trustworthiness. We propose that this structural information is the domain of the model. The model represents it in terms of modular cognitive structures connected by a parallel architecture. Finally we give a preliminary formalization of the model in the mathematical framework of the I/O automata for future computational and human-humanoid application.