Search results for "modality."

Sensory modalities and mental content in product experience

2015

Contemporary research in human-technology interaction emphasises the need to focus on what people experience when they interact with technological artefacts. Understanding how people experience products requires detailed investigation of how physical design properties are mentally represented, and the theorisation of how people represent information obtained through different modalities still needs work. The objective of this study is to investigate how people experience modality-related affective aspects of products, using the psychological concept of mental content. For this purpose, we adopt the framework of user psychology, which is the sub-area of psychology involved with investigating…

Apperception as a Multisensory Process in Material Experience

2015

Visual perspective has dominated experience research in humantechnology interaction for decades now. The neglect of other sensory modalities is gradually being addressed by scholars and designers, who investigate user experience based on touch, smell, taste, sound and even expressive bodily interactions. In cognitive and affective processes, user experience is always multi-modal, not just regarding perceived multi-sensory information, but also while perceiving through one modality we mentally construct information relevant to the other senses. This article reports the results of an experiment, where participants (N = 52) appraised materials either only by touching them or only by seeing. Th…

The Use of Multimodal Resources by Technical Managers and Their Peers in Meetings Using English as the Business Lingua Franca

2020

Background: Engineers increasingly work and advance their careers in international business settings. As technical managers, they need management and technical skills when working with different stakeholders with whom they may not share a common first language. Studies have revealed that informal oral communication skills are of prime importance for global engineers who face challenges in building shared meaning and formulating clear messages in meetings with non-native speakers of English. This article proposes that studying the use of multimodal resources (spoken language, gaze, gestures, and objects) in meetings can unpack how work tasks are accomplished in business through different com…

Connecting the Language Classroom and the Wild : Re-enactments of Language Use Experiences

2018

AbstractUsing multimodal conversation analysis, this article analyses language learning as an in situ process during a teacher-assigned, experientially based pedagogical activity. The activity involved a three-part pedagogical structure, where learners first prepared for and then participated in real-life service encounters, and later reflected on their experiences back in the classroom. The analysis details how the co-constructed telling sequences through which novice second language users re-enact their experiences create an occasion for language-focused activity. We argue that the actions through which the participants display and sustain an orientation to an interactional practice as an…

Learning Grammar for Social Action : Implications for Research and Language Teaching

2022

Multimodal mediational means in assessment of processes : an argument for a hard-CLIL approach

2022

In Japan, CLIL instruction falls under a soft-CLIL approach, content serving as secondary to language instruction. Furthermore, assessment in classrooms in Japan is oftentimes limited to assessing the product summatively. In the paper, we argue for the value of focusing on content in CLIL activities and assessing the process with the goal to promote learning. The present small-scale study at a Japanese university explored how learners (n = 6) used multimodal mediational means to build their conceptual understanding of ‘Earth breathing’ in order to create a presentation on it for a general English course. The further goal was to explore how inferences made from assessing this process of lear…

Gestural expressions in use for unveiling dynamic experience attributed to verbs

2013

The focus of this paper is on justifying the presented experimental design that aims at examining the enactive linkages between a verb’s content and a sensorimotor experience of movement. The experiment utilised spontaneous production of hand and vocal gestures for expressing the energetic feel attributed to a word. Preliminary qualitative analysis of the expressions shows degrees of similarity in terms of experiential movement qualities. These results imply that conceiving a verb’s meaning is not necessarily far removed from bodily action. peerReviewed

Linguistic representation of ethnicities in Assassin's Creed: Black Flag

2018

Tässä tutkimuksessa analysoidaan Assassin’s Creed: Black Flagia, suosittua historiallista seikkailuvideopelia (Ubisoft, 2013). Peli kertoo monisyisen tarinan, joka antaa pelaajille mahdollisuuden olla vuorovaikutuksessa hyvin kirjoitettujen, kolmiuloitteisten hahmojen kanssa. Pelihahmot edustavat lukuisia eri etnisiä ryhmiä ja heidät on sijoitettu huolellisesti rakennettuun historialliseen kontekstiin. Pelin monipuolinen ja monikielinen tapahtumapaikka on myös tärkeässä asemassa ja kieli on siinä erittäin tärkeä immersion, maailmanrakennuksen ja tarinankerronnan väline. Pelidiskursia analysoitiin sosiolingvistikan, proseduraalisen retoriikan, narratologian ja aiemman historiallisia seikkail…

English in interpretation to Finnish Sign Language : the forms and functions of chaining sequences in educational interpreting

2017

Tässä tutkimuksessa selvitettiin ketjutusta (chaining) kieleilyn (languaging) käytänteenä viittomakielen tulkkauksessa. Tutkimuskysymyksinä esitettiin, mitä semioottisia resursseja viittomakielen tulkit käyttivät englantia sisältävissä ketjutussekvensseissä sekä mitä funktioita em. sekvensseillä oli. Tutkimuksessa tuotettiin yksityiskohtaista kuvausta autenttisesta aineistosta. Tutkimuskohteena oli kolme englannin kielestä suomalaiselle viittomakielelle tulkattua korkeakoululuentoa. Luennot videoitiin ja niistä paikannettiin ne kohdat, joissa tulkkeessa esiintyi englantia. Nämä kohdat annotoitiin käyttäen ELAN-annotointiohjelmaa. Englantia sisältävät ketjutussekvenssit jaoteltiin muodon ja …

Building a political image on Instagram: A study of the personal profile of Santiago Abascal (Vox) in 2018

2020

Due to Instagram’s growing popularity in Spain, politicians have also begun to turn to this social network increasingly more. Accordingly, this paper analyses the visual and textual discourse of 259 posts published throughout 2018 on the personal Instagram profile of Santiago Abascal, the leader of the party Vox. Insofar as he is the Spanish politician with the highest number of followers on Instagram, the aim here is to analyse how he uses this social network in order to identify possible strategies that justify his growing number of followers. In the analysis, special attention was paid to aspects that might have contributed to the (self)presentation of Abascal and the promotion of his pa…