Search results for "Multimodality"
showing 10 items of 100 documents
The Multimodality of Digital Longform Journalism
2016
Digital longform journalism has recently attracted increased attention among both academics and professionals. This study contributes to the growing body of research by dissecting the multimodal structure of digital longform journalism, that is, how the emerging genre combines written language, photography, short videos, maps and other graphical elements, and joins them together into a seamless narrative using subtle transitions. The data consist of 12 longform articles published in 2012–2013, which have been annotated for their visual and verbal content, their underlying principle of organization and the transitions that hold between them. The annotation is stored into a digital corpus, wh…
Co-participatory multimodal intergenerational storytelling : preschool children’s relationship with modality creating elder inclusion
2021
The COVID-19 crisis has highlighted elderly people as a vulnerable and excluded community, and connecting to the younger social media generation requires a shift in intergenerational storytelling performance. Recent research on multimodality has emphasized its benefits for the interactional process in storytelling. This study examines three aspects of storytelling – participation, multimodality, and emotional interaction – and uses co-creation and multimodal discourse analysis to investigate two questions: (1) To what extent can intergenerational storytelling benefit older people’s community engagement? (2) In a globalized world, how do children’s relationships with modalities create new l…
Studying social media as semiotic technology: a social semiotic multimodal framework
2018
How do we study social media technology? While social semiotics provides an extensive toolkit for analysing multimodal texts and semiotic practices, the study of social media as semiotic technology poses a significant challenge to existing research methodologies. In this article, we present a social semiotic framework that allows us to describe in analytical details the multimodal meaning potentials offered by digital social media technology and connect these to multimodal text-making and semiotic practices while underscoring the role of technology. Our framework is organized around seven interrelated and inherently informed dimensions: (1) multimodality, (2) practice, (3) the social, (4) m…
Multimodal approach to foster the Multiliteracies pedagogy in the teaching of EFL through picturebooks: The Snow Lion
2020
espanolEnsenar lenguas en el siglo veintiuno implica prestar atencion a las demandas pedagogicas multimodales de un mundo digital global. Para alcanzar este objetivo, la ensenanza efectiva del ingles requiere una preparacion de los instructores para guiar de manera consciente el desarrollo de la literacidad de los alumnos e integrar las distintas maneras de construir significado que van mucho mas alla del mero uso de la lengua. Este articulo suscribe la nocion de literacidad como un concepto multidimensional y propone un conjunto de herramientas multimodales como medio para que los maestros de ingles como lengua extranjera (ILE) trabajen con elementos literarios y visuales clave. Centrandon…
Multimodal accomplishment of alignment and affiliation in the local space of distant meetings
2017
Technology-mediated (i.e. distant) meetings are complex settings that involve distributed participation frameworks and the coordination of actions in multiple interactional spaces. This paper examines how problems with hearing, speaking, or understanding in the overall meeting space enable the negotiation of alignment and affiliation by co-present participants in the same local meeting space. Conversation analysis is used to investigate the local accomplishment of alignment and affiliation achieved through the sequential and temporal organization of verbal, embodied, and material resources of interaction in three types of situations: during technological trouble, silences, and disagreements…
Analyzing American Public Diplomacy: The case of Brand USA. When Tourism becomes an Ideological Tool
2016
This paper aims to study the communicative strategies used in the American campaign of public diplomacy.Our objective in this work is twofold: first, to verify whether behind the action of rebranding the image of the U.S.A. there is an ideological agenda; second, to identify the communication dynamics - both textual and semiotic - which have contributed to make the campaign successful and whether they are in line with the communicative profile of the U.S.A., adopting a handful of current models in intercultural studies.
The Go2School project for promoting cycling to school: A case study in Palermo
2021
Abstract The identification of transport policy measures able to reduce the use of private cars for home-to-school travel is very relevant to reduce congestion during peak hours and to ensure that the areas around schools have livable environments. An action that policymakers could apply is promoting cycling to school through the introduction of bikesharing programs and creating safe routes to school through the construction of new cycle infrastructure. The aim of the paper has been, therefore, to assess if these policies could lead the high-school students to cycle to school, considering the city of Palermo as a case study. The goal is reached through the calibration of a modal choice mode…
A Multimodal Guide for Virtual 3D Models of Cultural Heritage Artifacts
2008
The area of cultural heritage preservation and fruition has drawn an ever growing attention of artificial intelligence and human-computer interaction research in the last decades. The common aim is to develop systems that can interact with the user in a variety of modes and in the most natural way. In this paper, a multimodal guide for virtual 3D environment navigation is presented. The proposed system integrates X3D environment with a multimodal interface. The application scenario is to provide a visitor assistance and guidance during the visit of one of the halls in the historical Palazzo Steri, the headquarters of the University of Palermo.
Transmediating argumentation : Students composing across written essays and digital videos in higher education
2016
This comparative study examined how university students built an argument in written essays and multimodal digital videos, and how their argumentation transmediated across these two mediums. Data analysis involved 1) analysis of content in both written essays and digital videos; 2) the development of transmediation visualizations to elucidate how ideas were transformed from essays into videos; and 3) multimodal analysis to understand the communicative affordances and constrains for argumentation with each medium. The findings revealed that the most common type of content in both essays and videos was supportive argumentation; however, the videos did not include any counter-argumentation. St…