0000000000975318

AUTHOR

Tuija Wainio

Head movements in Finnish Sign Language on the basis of Motion Capture data

This paper reports a study of the forms and functions of head movements produced in the dimension of depth in Finnish Sign Language (FinSL). Specifically, the paper describes and analyzes the phonetic forms and prosodic, grammatical, communicative, and textual functions of nods, head thrusts, nodding, and head pulls occurring in FinSL data consisting of a continuous dialogue recorded with motion capture technology. The analysis yields a novel classification of the kinematic characteristics and functional properties of the four types of head movement. However, it also reveals that there is no perfect correspondence between form and function in the head movements investigated.

research product

Annotated Video Corpus of FinSL with Kinect and Computer-Vision Data

This paper presents an annotated video corpus of Finnish Sign Language (FinSL) to which has been appended Kinect and computer-vision data. The video material consists of signed retellings of the stories Snowman and Frog, where are you?, elicited from 12 native FinSL signers in a dialogue setting. The recordings were carried out with 6 cameras directed toward the signers from different angles, and 6 signers were also recorded with one Kinect motion and depth sensing input device. All the material has been annotated in ELAN for signs, translations, grammar and prosody. To further facilitate research into FinSL prosody, computer-vision data describing the head movements and the aperture change…

research product

Taking non-manuality into account in collecting and analyzing Finnish Sign Language video data

This paper describes our attention to research into non-manuals when collecting a large body of video data in Finnish Sign Language (FinSL). We will first of all give an overview of the data-collecting process and of the choices that we made in order for the data to be usable in research into non-manual activity (e.g. camera arrangement, video compression, and Kinect technology). Secondly, the paper will outline our plans for the analysis of the non-manual features of this data. We discuss the technological methods we plan to use in our investigation of non-manual features (i.e. computer-vision based methods) and give examples of the type of results that this kind of approach can provide us…

research product

Variation in the use of constructed action according to discourse type and age in Finnish Sign Language

This paper presents a study of the use of constructed action (CA) in the stories and conversations of adult Finnish Sign Language (FinSL) signers of different ages. CA is defined here as a type of depiction in which a signer enacts the actions, feelings, thoughts and utterances of discourse referents with different parts of their body. Most studies on CA in sign languages have been done on the basis of signed storytelling, and little is known about how the use of CA varies in different discourse types. The use of CA has also been noted to vary between individual signers, but we do not yet know much about the socio-individual phenomena that may be linked to this variation. In the present stu…

research product