Search results for "inter-rater reliability"

Intra- and Interrater Reliability of Sagittal Spinopelvic Parameters on Full-Spine Radiographs in Adults With Symptomatic Spinal Disorders

2018

Background/Aims To evaluate the intra- and interrater reliability (I-IR) of sagittal spinopelvic parameters from digital full-spine plain radiographs with basic software tools in an unselected adult population with degenerative spinal complaints who were evaluated for surgery. Methods Forty-nine adult full-spine digital radiographs were measured twice by 3 independent observers, including an experienced spine surgeon, an experienced radiologist, and a resident orthopedic surgeon. Clinical picture archiving and communication system workstations and software tools were used and landmarks were set manually. The I-IR of the sagittal vertical axis (SVA), pelvic tilt (PT), pelvic incidence (PI), …

Comparative evaluation of three semi-quantitative radiographic grading techniques for knee osteoarthritis in terms of validity and reproducibility in…

2008

OBJECTIVE: The objective of this work was to compare the measurement properties of three categorical X-ray scoring methods of knee osteoarthritis (OA), both on semiflexed and extended views. METHODS: In data obtained from trials and cohorts, X-rays were graded using Kellgren and Lawrence (KL), the OA Research Society International (OARSI) joint space narrowing score, and measurement of joint space width (JSW). JSW was analyzed as a categorical variable. Construct validity was assessed through logistic regression between X-ray stages and Western Ontario and McMaster Universities OA Index. Inter-observer reliability was assessed in 50 subjects for extended views by weighted kappa. Intra-obser…

Pre-training inter-rater reliability of clinical instruments in an international psychosis research project.

2021

International audience

A Validation Study of Classroom Assessment Scoring System–Secondary in the Finnish School Context

2017

This study examined the reliability and validity of the Classroom Assessment Scoring System–Secondary (CLASS-S) in Finnish classrooms. Trained observers coded classroom interactions based on video recordings of 46 Grade 6 classrooms (450 cycles). Concurrent associations were investigated with respect to teacher self-ratings (e.g., efficacy beliefs and teaching-related stress). Confirmatory factor analysis showed that the hypothesized three-factor structure of the original CLASS-S (Emotional Support, Organizational Support, and Instructional Support), with some modifications, provided a better fit for the data compared with one- and two-factor structures. Structural validity was demonstrate…

Fiabilidad y evidencias de validez de un instrumento para la evaluación de la calidad de los mapas conceptuales

2017

Diversos autores han señalado el interés y la pertinencia de los mapas conceptuales como herramientas para el aprendizaje significativo. Sin embargo, la revisión de la literatura pone de manifiesto la escasez de propuestas dirigidas a la evaluación de los mapas con criterios objetivables y la complejidad de las existentes. El objetivo del presente estudio fue desarrollar un instrumento para la evaluación de los mapas conceptuales en formato rúbrica. De esta manera, se consigue que los alumnos posean una herramienta que permita, mediante indicadores precisos, la evaluación de la calidad tanto de sus ejecuciones como de las ejecuciones realizadas por otros. Se construyó una rúbrica que incluy…

Investigating applicability of ratings of indicators of the CLASS Pre-K instrument

2022

When classroom observations are increasingly used for accountability and evaluation purposes, a deeper understanding of the psychometric properties of such measurement tools is needed. The present study took a unique approach to examine the psychometric properties of a commonly used classroom observation measure by testing the reliability of indicators for higher-order constructs (i.e. dimensions). We investigated the reliability of indicator ratings of the Classroom Assessment Scoring System (CLASS) Pre-K instrument in Finnish kindergarten and first grade classrooms. Twenty-one observer pairs rated 838 segments identified from the 413 lessons of 48 teachers. Variance components models were…

Play assessment for group settings : validating a measurement tool for assessment of children's play performance in the day-care context

2012

Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders

2004

Interrater variability of sleep stage scorings is a well-known phenomenon. The SIESTA project offered the opportunity to analyse interrater reliability (IRR) between experienced scorers from eight European sleep laboratories within a large sample of patients with different (sleep) disorders: depression, general anxiety disorder with and without non-organic insomnia, Parkinson's disease, period limb movements in sleep and sleep apnoea. The results were based on 196 recordings from 98 patients (73 males: 52.3 +/- 12.1 years and 25 females: 49.5 +/- 11.9 years) for which two independent expert scorings from two different laboratories were available. Cohen's kappa was used to evaluate the IRR o…

Reliability Assessment of Scores from Video-Recorded TGMD-3 Performances

2017

This study examined the intrarater and interrater reliability of the Test of Gross Motor Development—3rd Edition (TGMD-3). Participants were 60 Finnish children aged between 3 and 9 years, divided into three separate samples of 20. Two samples of 20 were used to examine the intrarater reliability of two different assessors, and the third sample of 20 was used to establish interrater reliability. Children’s TGMD-3 performances were video-recorded and later assessed using an intraclass correlation coefficient, a kappa statistic, and a percent agreement calculation. The intrarater reliability of the locomotor subtest, ball skills subtest, and gross motor total score ranged from 0.69 to 0.77, a…

THERapy–Related InterACTion (THER-I-ACT) in Rehabilitation—Instrument Development and Inter-Rater Reliability

2021

Objective: To develop an instrument for the observation of therapeutic communication interactions during rehabilitation sessions and test its inter-rater reliability.Methods: The new instrument THER-I-ACT (THERapy–related Inter-ACTion) has been designed to assess both the frequency and timing of therapeutic interactions in the thematic fields information provision, feedback, other motivational interaction, and bonding. For this inter-rater reliability study, a sample of stroke survivors received arm rehabilitation as either arm ability training, arm basis training, or mirror therapy, or neglect training as individually indicated. Therapy sessions were video-recorded (one for each participan…