Search results for "assessment"
showing 10 items of 5125 documents
Using a hazard-independent approach to understand road-network robustness to multiple disruption scenarios
2021
Abstract A range of predictable and unpredictable events can cause road perturbations, disrupting traffic flows and more generally the functioning of society. To manage this threat, stakeholders need to understand the potential impact of a multitude of predictable and unpredictable events. The present paper adopts a hazard-independent approach to assess the robustness (ability to maintain functionality despite disturbances) of the Sioux Falls network to all possible disruptions. This approach allows understanding the impact of a wide range of disruptive events, including random, localised, and targeted link failures. The paper also investigates the predictability of the link combinations wh…
Assessment Capacity, Cultural Validity and Consequential Validity in PISA
2016
La evaluaciones internacionales de estudiantes han desempeñado un papel cada vez más importante en la política educativa. Estas comparaciones internacionales basadas en pruebas generan información valiosa sobre el rendimiento del estudiantado de cada país participante y los factores sociales y contextuales asociados. Una imagen compleja de los factores culturales, económicos y sociales que dan forma a la participación de PISA empieza a emerger. Nuestro objetivo es entender la relación entre la capacidad evaluative nacional y la forma en que los países participan en estas comparaciones internacionales. Proponemos un marco conceptual para examinar la capacidad evaluativa como clave para abord…
The development of a suite of computer-based diagnostic tests based on the Common European Framework
2005
DIALANG is an on-line language assessment system, which contains tests in 14 European languages and is based on the Common European Framework of Reference (CEFR). It is the first major testing system that is oriented towards diagnosing language skills and providing feedback to users rather than certifying their proficiency. This article describes the contents of Version 1 of DIALANG and the way in which the system works. This is followed by an account of the development of DIALANG tests and of the pilot testing and standard setting procedures. The results of the first analyses of items and self-assessment statements, and of the standard setting procedures, are reported. The article focuses…
Discursive construction of a high-stakes test: the many faces of a test-taker
2006
As part of a larger project, we studied how a foreign language test got discursively constructed in the talk of upper-secondary-school leavers. A group of students were asked to keep an oral diary to record their ideas, feelings and experiences of preparing for and taking the test over the last spring term of school, as part of a high-stakes national examination. In addition, they took part in discussions either in pairs or groups of three after having learned about the final test results. After transcribing the data, drawing on a form of discourse analysis originally launched by a group of social psychologists, we identified (at least) four interpretative repertoires in the students’ acco…
Acquisition of Generic Competencies Through Project Simulation in Translation Studies
2017
Motivated by the research in several international and interdisciplinary initiatives, for example, P21 Partnership for 21st Century Learning or the Collegiate Learning Assessment instruments, we seek for a scalable and measureable set of generic competencies for translation studies. Up to now, the acquisition of competencies in translation studies has primarily been operationalized by implementing authentic projects in higher education classes using socio-constructivist approaches. This results in a hybridization of subject-specific competencies and generic competencies in translator education. Because of the necessity to focus on the acquisition of generic competencies as a primary learnin…
Feedback practices in language classes in Finnish general upper secondary schools
2020
As feedback and formative assessment have a substantial effect on learning, the aim with this paper is to report on a study of the perceptions of Finnish general upper secondary school students of feedback in Swedish and English classes, and to compare how the perceptions differ at language proficiency (CEFR) levels. The data were collected by using a survey and were analysed quantitatively. The results show that several differences occur in Swedish: students with higher proficiency levels find feedback more useful, feel that they receive feedback from teachers, and are more willing to correct their own mistakes. There were no differences in perceptions according to language proficiency lev…
Perceived similarity between written Estonian and Finnish : Strings of letters or morphological units?
2017
The distance or similarity between two languages can be objective or actual, i.e. discoverable by the tools and methods of linguists, or perceived by users of the languages. In this article two methods, the Levenshtein Distance (LD), which purports to measure the objective distance, and the Index of Perceived Similarity (IPS), which quantifies language users’ perceptions, are compared. The data are the quantitative results of a test measuring conscious perceptions of similarity between Estonian and Finnish inflectional morphology by Finnish and Estonian native speakers (‘Finns’ and ‘Estonians’) with no knowledge of and exposure to the other (‘target’) language. The results show that Finns s…
Strategic Processing of Chinese Young English Language Learners in an International Standardized English Language Test
2018
Strategic competence is acknowledged to be able to explain variations in language test performance. Research with adult language test-takers has shown that strategic competence has dual components: strategic knowledge and strategic processing. Of the two components, strategic processing, which is state-like, unstable, and tends to fluctuate from contexts to contexts, is more closely related to language test performance. To date, none of the existing studies investigates strategic processing with children English language learners (ELLs) and explores the relationship between strategic processing in all the four skills of language learning and the test performance. Addressing these gaps, the …
Using evaluation criteria and rubrics as learning tools in subtitling for the D/deaf and the hard of hearing
2018
This paper focuses on the use of evaluation criteria and rubrics as tools for training in an audiovisual translation mode: subtitling for the D/deaf and the hard of hearing (SDH). Following an introduction to the current conception of and research carried out on quality assurance and assessment both in the translation industry and academia, a brief overview of the assessment processes and instruments used in SDH university training and in the professional sector is provided. This is followed by a case study of SDH assessment practices in Spain. Two questionnaires were filled in by five service providers and 12 university trainers, and the data gathered has enabled a better understanding of …
A Tool to Assess Architectural Education from the Sustainable Development Perspective and the Students' Viewpoint
2021
[EN] Architectural education plays a fundamental role in achieving sustainable development by training future professionals who can contribute to sustainability through their practice. Nevertheless, to ensure the introduction of sustainable development in the education of future architects, it is fundamental to understand what is being done and what could be improved. Despite this, a big gap has been detected in the assessment of architectural education in Spain and worldwide. Thus, a close-ended questionnaire for students has been designed based on the outcomes from a literature review, exploratory interviews with specialists, and the qualitative analysis of two schools of architecture. Ad…