Puheen ymmärtämisen tehtävien taitotasoille asettaminen Yleisissä kielitutkinnoissa

The aim of this study is to explore rater effects, such as consistency and severity of the judgements of 12 expert judges, and to report the extent of assessment criteria used by them. The data of the study are based on the three different phases of the standardization procedure which were analyzed using the MFRM model. In addition, feedback gathered from the expert judges was used to find out their opinions about the procedure and to validate the results of the standardization. The results of this study indicate that general discussion on and statistical information about the items influenced judges’ consistency and severity and their adaptation of the assessment criteria. The judges thems…

A Register Study Suggesting Homotypic and Heterotypic Comorbidity Among Individuals With Learning Disabilities

The present study examined whether learning disabilities (LD) in reading and/or math (i.e., reading disability [RD], math disability [MD], and RD+MD) co-occur with other diagnoses. The data comprised a clinical sample (n= 430) with LD identified in childhood and a sample of matched controls (n= 2,140). Their medical diagnoses (according to the International Classification of Diseases nosology) until adulthood (20–39 years) were analyzed. The co-occurrence of LD with neurodevelopmental disorders was considered a homotypic comorbidity, and co-occurrence with disorders or diseases from the other diagnostic categories (i.e., mental and behavioral disorders, diseases of the nervous system, injur…

Ensikielen tunnistamisen merkityksestä suullisen kielitaidon arvioinnissa Yleisissä kielitutkinnoissa

In this paper, we present a multidisciplinary study addressing fairness in the speaking test in a high-stakes language proficiency test in Finnish, National Certificates of Language Proficiency. The background of the research lies in studies on language assessment and (reversal) linguistic stereotyping and language attitudes. The focus L1 groups were Thai, Estonian, Finland Swedish, Arabic and Russian. Altogether 49 speech samples of test takers of these L1s were rated on a digital platform by 44 raters of the test system. The current paper reports on the sub-study that investigated whether the raters’ recognition of the test takers’ L1 affected their ratings and whether the effect differed…

sj-docx-1-ldx-10.1177_00222194221150230 – Supplemental material for A Register Study Suggesting Homotypic and Heterotypic Comorbidity Among Individuals With Learning Disabilities

Supplemental material, sj-docx-1-ldx-10.1177_00222194221150230 for A Register Study Suggesting Homotypic and Heterotypic Comorbidity Among Individuals With Learning Disabilities by Tuija Aro, Reeta Neittaanmäki, Elisa Korhonen, Heli Riihimäki and Minna Torppa in Journal of Learning Disabilities

Comparing speaking situations in three different language tests

The purpose of this study was to compare learner outcome when five similar speaking situations were offered in the speaking subtest in Finnish, Swedish and English intermediate level tests in the Finnish National Certificates language testing system. The overall aim was to investigate the tasks by comparing learner outcomes across the three tests and to seek explanations for the outcome in the learners’ selfreported demographic, language, educational and professional background.The speaking situations were selected from the NC item bank meaning that they have undergone the Item Response Theory based analyses which indicate that the tasks function well in all tests. More information was need…

Predicting Placement Accuracy and Language Outcomes in Immigrants’ L2 Finnish Education

Yliopistojen tutkintokoulutuksen ja tutkimuksen rahoitus ja tulokset vuosina 2000-2004

Diagnostinen arviointi suomen kielen ja kirjallisuuden pedagogiikan opintojakson opiskelua ja opetusta ohjaamassa

The article deals with diagnostic assessment conducted in the Finnish language and literature course for classroom teacher students. The research context was a hybrid learning environment, where the students evaluated both their linguistic and pedagogical competence using a self-assessment tool. The research questions were 1) what kind of linguistic competence the students showed in the beginning of the course, 2) how the results of linguistic competence and self-assessment were related, and 3) how the final grade of Finnish language and literature and the matriculation examination test of Finnish predicted the results of a diagnostic test. The data of the pilot research consisted of the re…

Allmänna språkexamina – språkfärdighetstest för vuxna i Finland

Allmänna språkexamina (ASE) är nationella språkfärdighetstest för vuxna i Finland. I ASE testas den kommunikativa och funktionella språkfärdigheten i praktiska vardagssituationer. Vem som helst kan delta, oberoende av hur man har lärt sig språket. Deltagarna kan delta i examen av olika orsaker och de använder examensintyget för olika ändamål, men examina i finska och svenska på mellannivå (CEFR B1–B2) är av särskilt stor betydelse, eftersom intyget kan användas för att påvisa tillräckliga språkkunskaper när man ansöker om finskt medborgarskap. I denna artikel identifieras deltagarna i examen i svenska på mellannivå och vilka resultat deltagarna har fått i examen. Vi visar också hur deltagar…

Ensikielen tunnistamisen merkityksestä suullisen kielitaidon arvioinnissa Yleisissä kielitutkinnoissa

In this paper, we present a multidisciplinary study addressing fairness in the speaking test in a high-stakes language proficiency test in Finnish, National Certificates of Language Proficiency. The background of the research lies in studies on language assessment and (reversal) linguistic stereotyping and language attitudes. The focus L1 groups were Thai, Estonian, Finland Swedish, Arabic and Russian. Altogether 49 speech samples of test takers of these L1s were rated on a digital platform by 44 raters of the test system. The current paper reports on the sub-study that investigated whether the raters’ recognition of the test takers’ L1 affected their ratings and whether the effect differed…

Aikuisten maahanmuuttajien kotoutumiskoulutuksen tulosten ennustaminen lähtötason arviointien perusteella

Artikkelissa selvitetään aikuisten maahanmuuttajien kotoutumiskoulutuksessa saavuttamaa suomen kielen taitoa ja sitä, ennustaako koulutuksen alussa tehtävä lähtötason arviointi saavutettua kielitaitoa. Tutkimukseen osallistuneet maahanmuuttajat (N = 286) osallistuivat lähtötason arviointiin Testipisteessä. Sen jälkeen he suorittivat kotoutumiskoulutuksen opinnot peruspolun tai hitaan opintopolun mukaisesti muutamassa pääkaupunkiseudun oppilaitoksessa. Testipisteen mallin mukaisessa lähtötason arvioinnissa selvitetään maahanmuuttajan suomen kielen taitoa ja opiskeluvalmiuksia testeillä ja taustatietoja keräämällä. Niiden pohjalta maahanmuuttaja ohjataan sopivimmalle opintopolulle ja kielitai…

Minustako maisteri? : maisteriklinikka tietotekniikan opiskelijoiden ohjauksen tehostamisessa

Suomalaisen viittomakielen taitotasokuvainten ja arviointikriteereiden kehittäminen Yleisissä kielitutkinnoissa

Artikkelissa kuvaamme lyhyesti suomalaisen viittomakielen taitotasokuvainten ja arviointikriteereiden kehittämistä ja siihen liittyvää validointiprosessia Soveltavan kielentutkimuksen keskuksessa. Suomalaisessa viittomakielessä ei aiemmin ole ollut yhtenäisiä, teoreettisesti määriteltyjä kuvauksia viittomakielen taidon kehittymisestä. Nyt kehitetyissä taitotasokuvaimissa ja arviointikriteereissä viittomakielen taito on kuvattu kuusiportaisella asteikolla kolmessa eri osataidossa: viittomakielen ymmärtämisessä, viittomakielen itsenäisessä tuottamisessa ja viittomakielisessä keskustelussa. Kuvaimia ja kriteereitä voidaan soveltaa eri käyttötarkoituksiin, kuten kielen opetukseen, kielitaidon a…

Yliopistojen tutkintokoulutuksen ja tutkimuksen rahoitus ja tulokset vuosina 2000-2004 ja 2005-2009

sj-docx-1-ldx-10.1177_00222194221150230 – Supplemental material for A Register Study Suggesting Homotypic and Heterotypic Comorbidity Among Individuals With Learning Disabilities

Supplemental material, sj-docx-1-ldx-10.1177_00222194221150230 for A Register Study Suggesting Homotypic and Heterotypic Comorbidity Among Individuals With Learning Disabilities by Tuija Aro, Reeta Neittaanmäki, Elisa Korhonen, Heli Riihimäki and Minna Torppa in Journal of Learning Disabilities

Instrument to study rater behaviour: Rater uncertainty and its impact on the quality of assessment in the official language examination, the National Certificates of Language Proficiency (YKI) project

This research instrument was developed for a study on the uncertainty experienced by language raters and the impact of uncertainty on the quality of assessment in the official language examination, the National Certificates of Language Proficiency. The instrument consists of three online questionnaires using Webropol software and a note-taking sheet using Excel spreadsheet software. The survey focused on the assessment of speaking and writing in the intermediate-level Finnish language examination. The questions in the survey include both closed and open questions. Two almost identical versions of all the questionnaires and the Excel sheet were created for the collection of data for the diff…