Search results for "evaluators"

Instrument to study rater behaviour: Rater uncertainty and its impact on the quality of assessment in the official language examination, the National…

2023

This research instrument was developed for a study on the uncertainty experienced by language raters and the impact of uncertainty on the quality of assessment in the official language examination, the National Certificates of Language Proficiency. The instrument consists of three online questionnaires using Webropol software and a note-taking sheet using Excel spreadsheet software. The survey focused on the assessment of speaking and writing in the intermediate-level Finnish language examination. The questions in the survey include both closed and open questions. Two almost identical versions of all the questionnaires and the Excel sheet were created for the collection of data for the diff…