6533b850fe1ef96bd12a8625

RESEARCH PRODUCT

Discriminating and simulating actions with the associative self-organising map

Magnus JohnssonHaris DindoMiriam Buonamente

subject

action recognitionArtificial neural networkneural networkbusiness.industryComputer scienceinternal simulationassociative self-organising map; neural network; action recognition; internal simulation; intention understandingassociative self-organising mapSelf organising mapsMachine learningcomputer.software_genreHuman-Computer InteractionContinuationintention understandingArtificial IntelligenceAction recognitionArtificial intelligencebusinesscomputerSoftwareAssociative property

description

We propose a system able to represent others’ actions as well as to internally simulate their likely continuation from a partial observation. The approach presented here is the first step towards a more ambitious goal of endowing an artificial agent with the ability to recognise and predict others’ intentions. Our approach is based on the associative self-organising map, a variant of the self-organising map capable of learning to associate its activity with different inputs over time, where inputs are processed observations of others’ actions. We have evaluated our system in two different experimental scenarios obtaining promising results: the system demonstrated an ability to learn discriminable representations of actions, to recognise novel input, and to simulate the likely continuation of partially seen actions.

https://doi.org/10.1080/09540091.2015.1025571