Augmented Mirror: Interactive Augmented Reality System Based on Kinect

Part 1: Long and Short Papers; International audience; In this paper we present a virtual character controlled by an actor in real time, who talks with an audience through an augmented mirror. The application, which integrates video images, the avatar and other virtual objects within an Augmented Reality system, has been implemented using a mixture of technologies: two kinect systems for motion capture, depth map and real images, a gyroscope to detect head movements, and control algorithms to manage avatar emotions.

Multisensory Experiences in Virtual Reality and Augmented Reality Interaction Paradigms

Multisensory stimuli can be integrated in systems that make use of different paradigms, such as Virtual Reality (VR), Augmented Reality (AR) or, in a wider sense, Mixed Reality (MR), enhancing user experiences within the virtual content. However, despite the many technological solutions that exist (both hardware and software), only visual and sonic stimuli can be considered as highly integrated in consumer-grade applications. This chapter addresses the current state of the art in multisensory experiences, taking also in consideration the aforementioned interaction paradigms, and brings the benefits and challenges. As an example, authors introduce ROMOT, a RObotic 3D-MOvie Theatre, that supp…

Agency and Presence: A Common Dependence on Subjectivity?

This paper argues that presence, as shown in virtual environments, can usefully be seen as comprising various subtypes and that these in turn may have common conceptual and ontological features with a sense of agency as defined by Russell (1996, Agency: Its Role in Mental Development, Erlbaum.). Furthermore, an analysis of Russell's characterization of the concept of agency may be useful for acquiring insight into the sense of presence itself and the variables affecting it. Empirical evidence from cognitive developmental research and the positive results of attempts to develop symbolic understanding in people with autism spectrum disorders (ASD) in virtual environments suggest that presenc…

Current Trends on the Acquisition, Virtual Representation, and Interaction of Cultural Heritage

Cultural heritage (CH) tells us about our roots, and therefore, constitutes a rich value for the society. Its conservation, dissemination, and understanding are of utmost importance. In order to preserve CH for the upcoming generations, it needs to be documented, a process that nowadays is done digitally. Current trends involve a set of technologies (cameras, scanners, etc.) for the shape and radiometric acquisition of assets. Also, intangible CH can be digitally documented in a variety of forms. Having such assets virtualized, a proper dissemination channel is of relevance, and recently, new technologies that make use of interaction paradigms have emerged. Among them, in this chapter, the …

Towards a Guidance System to Aid in the Dosimetry Calculation of Intraoperative Electron Radiation Therapy

In Intraoperative Electron Radiation Therapy (IOERT), the lack of specific planning tools limits its applicability, the need for accurate dosimetry estimation and application during the therapy being the most critical. Recently, some works have been presented that try to overcome some of the limitations for establishing planning tools, though still an accurate guidance system that tracks, in real-time, the applicator and the patient is needed. In these surgical environments, the acquisition of an accurate 3D shape of the patient’s tumor bed in real-time is of high interest, as current systems make use of a 3D model acquired before the treatment. In this paper, an optical-based system is pre…

A Hybrid Virtual-Augmented Serious Game to Improve Driving Safety Awareness

The use of 3D virtual content and Augmented Reality (AR) in certain applications allows designing tools and serious games that are more attractive to the potential users. Focusing on the area of learning and education, these technologies can be adapted to the requirements of the application that needs to be developed, to the available devices on which they are expected to run and also to the learning content. However, in most applications only a single interaction paradigm and a single visualization mode is used, restricting the potential benefits of the system. In this paper, we propose a software application designed to improve driving safety awareness and learning for both adults and chi…

Virtual reality school for children with learning difficulties

This paper describes the process starting from the identification of educational needs of children with learning difficulties to the design of a fully interactive virtual school, where it is possible to learn about the physical and social world. The fundamentals of this design are the exclusive advantages that Real Time Graphics offer for developing tools in which children can learn while playing. This development has been done in the framework of a strongly-funded project by the Spanish Government. This ongoing project is in its final stage of development and will produce tools which are valid both for special and mainstream education, ready to be used and tested over final users.

Virtual and Augmented Reality Mirrors for Mental Health Treatment

Virtual and Augmented Reality are technologies widely used in a variety of areas, including the medical sector. On the other hand, regular mirrors have been traditionally used as tools to aid in mental health treatment for a variety of diseases and disorders. Although it is possible to build Virtual and Augmented Reality experiences based on mirror metaphors, there are very few contributions of this kind in the medical sector. In this chapter, the great benefits that regular mirrors have brought for mental health treatment are addressed. In addition, a review on the state of the art in mirror-based Virtual and Augmented Reality applications is given, highlighting the potential benefits that…

Abstract concept and imagination teaching through Virtual Reality in people with Autism Spectrum Disorders

Computer graphics applications in the education process of people with learning difficulties

This paper describes the use of Real Time graphic applications as educational tools, specifically oriented to working with people who have certain learning difficulties. We first focus on identifying the most relevant traits (from a psychological point of view) of those disorders, then we continue by analysing the advantages of graphics in Real Time in this context, and how they can be used to complement the conventional teaching methods. Finally, we review the main characteristics of two applications belonging to this category, which serve as a practical example of this encounter between education and technology.

On the Development of VR and AR Learning Contents for Children on the Autism Spectrum

Autism spectrum disorder (ASD) is an umbrella term used to group a range of brain development disorders. The learning profile of most people with ASD is mainly visual, and VR and AR technologies offer important advantages to provide a visually based mean for gaining access to educational contents. The prices of VR and AR glasses and helmets have fallen. Also, a number of tools that facilitate the development and publication of AR and VR contents have recently appeared. Therefore, a scenario of opportunity for new developments has appeared in this field. This chapter offers guidelines for developing AR and VR learning contents for people on the autism spectrum and analyses those guidelines f…