0000000000054058
AUTHOR
Paolo Arena
A spiking network for body size learning inspired by the fruit fly
The concept of peripersonal space is an interesting research topics for psychologists, neurobiologists and for robotic applications. A living being can learn the representation of its own body to take the correct behavioral decision when interacting with the world. To transfer these important learning mechanisms on bio-robots, simple and efficient solutions can be found in the insect world. In this paper a neural-based model for body-size learning is proposed taking into account the results obtained in experiments with fruit flies. Simulations and experimental results on a roving platform are reported and compared with the biological counterpart.
Modelling Spatial Memory
Among the different capabilities of animals, the formation of spatial memories is crucial for their life. Living beings able to move, constantly need to orient themselves in the environment to reach a target that might be not always visible. This chapter investigates the process of spatial memory formation as an essential ingredient for orientation in open and unstructured environments. Neural centres devoted to spatial memory and path integration were deeply investigated both in rats and different insect species like ants, bees and fruit flies. In this chapter a neural-inspired model for the formation of a spatial working memory is discussed considering some key elements of the insect neur…
Motor-skill learning in an insect inspired neuro-computational control system
In nature, insects show impressive adaptation and learning capabilities. The proposed computational model takes inspiration from specific structures of the insect brain: after proposing key hypotheses on the direct involvement of the mushroom bodies (MBs) and on their neural organization, we developed a new architecture for motor learning to be applied in insect-like walking robots. The proposed model is a nonlinear control system based on spiking neurons. MBs are modeled as a nonlinear recurrent spiking neural network (SNN) with novel characteristics, able to memorize time evolutions of key parameters of the neural motor controller, so that existing motor primitives can be improved. The ad…
A Fly-Inspired Mushroom Bodies Model for Sensory-Motor Control Through Sequence and Subsequence Learning
Classification and sequence learning are relevant capabilities used by living beings to extract complex information from the environment for behavioral control. The insect world is full of examples where the presentation time of specific stimuli shapes the behavioral response. On the basis of previously developed neural models, inspired by Drosophila melanogaster, a new architecture for classification and sequence learning is here presented under the perspective of the Neural Reuse theory. Classification of relevant input stimuli is performed through resonant neurons, activated by the complex dynamics generated in a lattice of recurrent spiking neurons modeling the insect Mushroom Bodies n…
Modeling the insect mushroom bodies: application to a delayed match-to-sample task.
Despite their small brains, insects show advanced capabilities in learning and task solving. Flies, honeybees and ants are becoming a reference point in neuroscience and a main source of inspiration for autonomous robot design issues and control algorithms. In particular, honeybees demonstrate to be able to autonomously abstract complex associations and apply them in tasks involving different sensory modalities within the insect brain. Mushroom Bodies (MBs) are worthy of primary attention for understanding memory and learning functions in insects. In fact, even if their main role regards olfactory conditioning, they are involved in many behavioral achievements and learning capabilities, as …
Modelling the insect Mushroom Bodies: Application to sequence learning
Learning and reproducing temporal sequences is a fundamental ability used by living beings to adapt behaviour repertoire to environmental constraints. This paper is focused on the description of a model based on spiking neurons, able to learn and autonomously generate a sequence of events. The neural architecture is inspired by the insect Mushroom Bodies (MBs) that are a crucial centre for multimodal sensory integration and behaviour modulation. The sequence learning capability coexists, within the insect brain computational model, with all the other features already addressed like attention, expectation, learning classification and others. This is a clear example that a unique neural struc…
Roving Robots Gain from an Orientation Algorithm of Fruit Flies and Predict a Fly Decision-Making Algorithm
Simple organisms like bacteria are directly influenced by momentary changes in concentration or strength of sensory signals. In noisy sensory gradients frequent zigzagging reduces the performance of the cell or organism. Drosophila melanogaster flies significantly deviate from a direct response to sensory input when orienting in gradients. A dynamical model has been derived which reproduces fly behaviour. Here we report on an emergent property of the model. Implemented in a robot, the algorithm is sustaining decisions between visual targets. The behaviour was consequently found in wild-type flies, which stay with a once-chosen visual target for considerable longer times than mutant flies wi…
An insect brain computational model inspired by Drosophila melanogaster: architecture description
The fruit fly Drosophila melanogaster is an extremely interesting insect because it shows a wealth of complex behaviors, despite its small brain. Nowadays genetic techniques allow to knock out the function of defined parts or genes in the Drosophila brain. Together with specific mutants which show similar defects in those parts or genes, hypothesis about the functions of every single brain part can be drawn. Following these experiments, a computational model of the fly Drosophila has been designed with a view to its robotic implementation.
Software/Hardware Issues in Modelling Insect Brain Architecture
The concept of cognitive abilities is commonly associated to humans and animals like mammals, birds and others. Nevertheless, in the last years several research groups have intensified the studies on insects that posses a much simpler brain structure even if they are able to show interesting memory and learning capabilities. In this paper a survey on some key results obtained in a joint research activity among Engineers and Neurogeneticians is reported. They were focussed toward the design and implementation of a model of the insect brain inspired by the Drosophila melanogaster. Particular attention was paid to the main neural centers the Mushroom Bodies and the Central Complex. Moreover a …
Learning spatio-temporal behavioural sequences
Living beings are able to adapt their behaviour repertoire to environmental constraints. Among the capabilities needed for such improvement, the ability to store and retrieve temporal sequences is of particular importance. This chapter focuses on the description of an architecture based on spiking neurons, able to learn and autonomously generate a sequence of generic objects or events. The neural architecture is inspired by the insect mushroom bodies already taken into account in the previous chapters as a crucial centre for multimodal sensory integration and behaviour modulation in insects. Sequence learning is only one among a variety of functionalities that coexist within the insect brai…
Implementation of a Drosophila-inspired orientation model on the Eye-Ris platform
A behavioral model, recently derived from experiments on fruit-flies, was implemented, with successful comparative experiments on orientation control in real robots. This model has been firstly implemented in a standard CNN structure, using an algorithm based on classical, space-invariant templates. Subsequently, the Eye-Ris platform was utilised for the implementation of the whole strategy, at the aim to constitute a stand alone smart sensor for orientation control in bio-inspired robotic platforms. The Eye-Ris vl.2 is a visual system, made by Anafocus, that employs a fully-parallel mixed-signal array sensor-processor chip. Some experiments are reported using a commercial roving platform, …
A computational model for motor learning in insects
The aim of this paper is to propose a computational model, inspired by Drosophila melanogaster, able to handle problems related to motor learning. The role of the Mushroom Bodies and the Central Complex in solving this problem is analyzed and plausible biologically inspired models are proposed. The designed computational models have been evaluated in simulation using a dynamic structure inspired by the fruit fly. The obtained results open the way to new neurobiological experiments focused to better understand the underlined mechanisms involved, to verify the feasibility of the hypotheses formulated and the significance of the obtained results.
Controlling and learning motor functions
Effective and adaptive motor functions are important for living beings and developing computational and learning mechanisms for roving robots is a crucial aspect in biorobotics. In this chapter we report a new architecture for motor learning to be applied in insect-like walking robots. The proposed model is based on the MB structure previously introduced able to memorize time evolutions of key parameters of the neural motor controller to improve existing motor primitives. The adopted control scheme enables the structure to efficiently cope with goal-oriented behavioural motor tasks. The problem of body-size evaluation is also considered and a model for the parallax-based estimation is provi…
Non-linear neuro-inspired circuits and systems: Processing and learning issues
In this chapter the main elements useful for the design and realization of the neural architectures reported in the following chapters will be presented. Considering spiking and non-spiking neurons, the models used for implementing each of them, the synaptic models, the basic learning and plasticity algorithms and the network architectures will be introduced and analysed. The key elements that led to their selection and application in the developed neuro-inspired systems will be discussed briefly.
Visual learning in Drosophila: Application on a roving robot and comparisons
Visual learning is an important aspect of fly life. Flies are able to extract visual cues from objects, like colors, vertical and horizontal distributedness, and others, that can be used for learning to associate a meaning to specific features (i.e. a reward or a punishment). Interesting biological experiments show trained stationary flying flies avoiding flying towards specific visual objects, appearing on the surrounding environment. Wild-type flies effectively learn to avoid those objects but this is not the case for the learning mutant rutabaga defective in the cyclic AMP dependent pathway for plasticity. A bio-inspired architecture has been proposed to model the fly behavior and experi…
The Insect Mushroom Bodies: a Paradigm of Neural Reuse
This paper is devoted to discuss the implementation of models,which are inspired by the fly Drosophila melanogaster and able to handle open problems in the field of robotics such as attention, expectation and sequence learning. The role of the Mushroom Bodies (MBs) in solving these tasks is analyzed in detail and a unifying plausible biologically inspired model is proposed. The developed neural structure is able to show different capabilities in line with the paradigm of neural reuse. The same neural circuit can be exploited to accomplish multiple tasks showing interesting capabilities such as attention, expectation and delayed match-to-sample. The simulation results here reported suggest a…
Drosophila-inspired visual orientation model on the Eye-Ris platform: Experiments on a roving robot
Behavioral experiments on fruit flies had shown that they are attracted by near objects and they prefer front-to-back motion. In this paper a visual orientation model is implemented on the Eye-Ris vision system and tested using a roving platform. Robotic experiments are used to collect statistical data regarding the system behaviour: followed trajectories, dwelling time, distribution of gaze direction and others strictly resembling the biological experimental setup on the flies. The statistical analysis has been performed in different scenarios where the robot faces with different object distribution in the arena. The acquired data has been used to validate the proposed model making a compa…
Overview of the JET results in support to ITER
The 2014–2016 JET results are reviewed in the light of their significance for optimising the ITER research plan for the active and non-active operation. More than 60 h of plasma operation with ITER first wall materials successfully took place since its installation in 2011. New multi-machine scaling of the type I-ELM divertor energy flux density to ITER is supported by first principle modelling. ITER relevant disruption experiments and first principle modelling are reported with a set of three disruption mitigation valves mimicking the ITER setup. Insights of the L–H power threshold in Deuterium and Hydrogen are given, stressing the importance of the magnetic configurations and the recent m…
Exploiting Imperfections in Perception-Action Learning
In this paper a some examples of simulations and experiments performed in the last few years in the field of bio-inspired robotics are reviewed and revisited, deepening their characteristics and emphasising the role of imperfections that could be the main actors guiding their success in real environment. Our cases of study rely on both geetic and behavioral experiments on the fruit fly, from which models, simulations and robotic experiments were performed.
Biological investigation of neural circuits in the insect brain
Watching insects thoughtfully one cannot but adore their behavioural capabilities. They have developed amazing reproductive, foraging and orientation strategies and at the same time they followed the evolutionary path of miniaturization and sparseness. Both features together turn them into a role model for autonomous robots. Despite their tiny brains, fruit flies (Drosophila) can orient, walk on uneven terrain, in any orientation to gravity, can fly in adverse winds, find partners, places for egg laying, food and shelter. Drosophila melanogaster is the model animal for geneticists and cutting-edge tools are being continuously developed to study the underpinnings of their behavioural capabil…
A spiking network for spatial memory formation: Towards a fly-inspired ellipsoid body model
Neural centers devoted to spatial memory and path integration were largely studied in rats and in different insect species like ants and bees. In this paper a neural-based model for the formation of a spatial working memory is proposed mirroring some peculiarities of the Drosophila central brain and in particular the ellipsoid body. Simulation results are reported opening the way to applications on roving platforms.
A Mushroom Bodies inspired spiking network for classification and sequence learning
Sequence learning is a complex capability shown by living beings, able to extract information from the environment. Looking into the insect world, there are several examples where the presentation time of specific stimuli is considered to select the proper behavioural response. On the basis of previously developed neural models for sequence learning, inspired by the Drosophila melanogaster, a new formalization of key brain structures involved in the process is here provided. The input classification is performed through resonant neurons, stimulated by the complex dynamics generated in a lattice of recurrent spiking neurons modelling the Mushroom Bodies neuropile in the insect brain. The net…
Towards Neural Reusable Neuro-inspired Systems
This chapter presents an overview of some key aspects of the neuro-inspired modelling previously discussed, under the new perspective of the neural reuse theory. Here it is envisaged that the excellent capabilities shown by insects with their small neuron number and relatively low brain complexity, as compared to vertebrates, could be justified if some key neural structures are re-used for different behavioural needs. The chapter recalls some examples, found in the literature for addressing specific topics and reformulates them in relation to the neural reuse theory.
Motor learning and body size within an insect brain computational model
Nowadays modeling insect brains is also an important source of inspiration to develop learning architectures and control algorithms for applications on autonomous walking robots. Within the insect brain two important neuropiles received a lot of attention: the mushroom bodies (MBs) and the central complex (CX). Recent research activities considered the MBs as a unique architecture where different behavioural functions can be found. MBs are well known in bees and flies for their role in performing associative learning and memory in odor conditioning experiments [4]. They are also involved in the processing of multiple sensory modalities including visual tasks [3], different forms of learning…