Search results for "Rasch model"
showing 10 items of 39 documents
Advantages of the Rasch measurement model in analysing educational tests:an applicator's reflection
2011
Educational achievement is a very important issue for parents, teachers, and the government. An accurate measurement plays a very important role in evaluating achievement fairly, and, therefore, analysis methods have been developed considerably in recent years. Education based on long-time learning processes forms a fruitful base for item tests, as it opens up possibilities to design a nearly unlimited number of items. There are several methods available to analyse such tests, but which method is the most useful and in which situation? The Rasch measurement from the Institute for Object Measurement (IOM) has pointed out to be the most useful in evaluating individual items and their function…
Evidencias de validez interna de un instrumento para evaluar la colegialidad docente
2019
Este estudio es parte de una investigación más amplia que busca diseñar un modelo de evaluación de los sistemas educativos basado en la mejora de la cohesión social. Se trata de un estudio de validación métrica de un instrumento de evaluación de la colegialidad docente. El instrumento se aplicó a partir de las conclusiones del estudio de validación por comités de expertos. La muestra estuvo formada por 147 profesores voluntarios de primaria y secundaria de España. La metodología utilizada se basó en la recogida de evidencias métricas de validez interna del instrumento; se estudió la dimensionalidad mediante el análisis factorial exploratorio y la capacidad de discriminación mediante el anál…
Reliability and Validity of Family Affluence Scale (FAS II) among Adolescents in Beijing, China
2011
This study comprises two sub-studies. Study I assessed the test-retest reliability of Family Affluence Scale (FAS II) items among 95 students aged 11 and 15 years old in Beijing. Study II investigated the completion rate of traditional indicators (parents’ educational level, perceived family wealth, resident area, and school location) measuring socioeconomic status (SES) compared with FAS II, and examined the internal reliability, external and construct validity of the FAS II items in a population of 5876 schoolchildren aged 11, 13 and 15 years old in Beijing. Our study found that the FAS II items have high completion rates (> 99%) which are better than other SES indicators. Analyses of rel…
Hierarchy of Eustress and Distress: Rasch Calibration of the Valencia Eustress-Distress Appraisal Scale
2016
The purpose of the study was to uncover the hierarchy of eustress and distress appraisal and calibrate the Valencia Eustress Distress Appraisal Scale (VEDAS, Rodríguez, Kozusznik, & Peiró, 2013) using the Rasch Analysis (RA). A cross-sectional study was conducted on sample of 603 Spanish social service professionals. The VEDAS included four subscales addressing work demands that can be appraised as sources of eustress and distress. RA was carried out for eustress and distress appraisal scales. A graduation of stressful situations appraised as distress and/or as eustress was revealed. One of the greatest sources of distress and one of the lesser sources of eustress was “switching off at …
Comparing the outcomes of two different approaches to CEFR-based rating of students’ writing performances across two European countries
2018
This study investigated to what extent two teams of experienced raters from different European countries (Finland and Austria), using their own CEFR-based rating scale (one holistic and one analytic), agreed on the CEFR level of students’ writing performances. Both teams rated one hundred performances written by Austrian secondary school students based on two tasks. The Finnish raters (N = 3) applied a holistic CEFR-linked rating scale consisting of verbatim CEFR descriptors developed in Finland, while the Austrian team (N = 6) used an analytic CEFR-linked rating scale consisting of four criteria developed in Austria. The ratings were analysed using the Rasch model. Although there were indi…
Assessing learners’ writing skills in a SLA study: Validating the rating process across tasks, scales and languages
2014
There is still relatively little research on how well the CEFR and similar holistic scales work when they are used to rate L2 texts. Using both multifaceted Rasch analyses and qualitative data from rater comments and interviews, the ratings obtained by using a CEFR-based writing scale and the Finnish National Core Curriculum scale for L2 writing were examined to validate the rating process used in the study of the linguistic basis of the CEFR in L2 Finnish and English. More specifically, we explored the quality of the ratings and the rating scales across different tasks and across the two languages. As the task is an integral part of the data-gathering procedure, the relationship of task p…
Rasch analysis of the Lower Extremity Functional Scale for foot and ankle patients.
2018
Purpose: The Lower Extremity Functional Scale (LEFS) is a widely used 20-item patient-reported outcome instrument with five response categories. We investigated the measurement properties of the Finnish version of the LEFS among foot and ankle patients to refine the scale to measure more accurately what is relevant for patients.Materials and methods: Data were obtained from 182 patients who had undergone foot and ankle surgery for various reasons. The Rasch Measurement Theory and Cronbach's alpha were employed for analyses of model and item fit, response category thresholds, targeting, person separation index, and internal consistency.Results: Threshold misfit was noted in 13 of the 20 item…
Play assessment for group settings: A pilot study to construct an assessment tool
2006
The Play Assessment for Group Setting (PAGS) was constructed to measure children's play performance. The study was undertaken with 93 children aged from 2 to 8 years to examine whether the items of the PAGS construct a unidimensional scale that can be used to measure children's play ability. The internal scale validity and the person response validity of the PAGS were investigated by examining the goodness-of-fit of the play items and children's play performance to the many-faceted Rasch model for the PAGS. In total, 46 of the 51 play items demonstrated acceptable goodness-of-fit. Of the 93 children, 90.3% demonstrated acceptable goodness-of-fit on the scale of play items. Overall, the resu…
Structural validity of the Finnish Manchester-Oxford Foot Questionnaire (MOXFQ) using the Rasch model.
2019
Background: The 16-item patient-reported Manchester-Oxford Foot Questionnaire (MOXFQ) with subscales of pain, social interactions, and walking/standing has been claimed for strongest scientific evidence in measuring foot and ankle complaints. This study tests the validity of the Finnish MOXFQ for orthopaedic foot and ankle population using the Rasch analysis. Methods: We translated the MOXFQ into Finnish and used that translation in our study. MOXFQ scores were obtained from 183 patients. Response category distribution, item fit, coverage, targeting, item dependency, ability to measure latent trait (unidimensionality), internal consistency (Cronbach's alpha), and person separation index (PS…
Assessing Online Collaborative Problem Solving Among School Children in Finland : A Case Study Using ATC21S TM in a National Context
2018
Online collaborative problem-solving tasks were piloted in five Finnish schools participating in the Assessment and Teaching of Twenty-first Century Skills (ATC21STM) project. Process stream data from online tasks were captured from 480 Finnish students who explored dyad problem spaces. The log file data were explored to identify indicative behaviours of collaborative problem solving (CPS), which were coded into a series of dichotomous indicators. The Rasch simple logistic model was used to analyse student performance across the social and cognitive dimensions of CPS. Analysis of the Finnish data indicated that the construct can be interpreted using a two-dimensional model, matching the fin…