Search results for "M response"
showing 10 items of 78 documents
La soddisfazione degli utenti interni delle aziende ospedaliere: considerazioni su uno strumento di misura
2003
The paper proposes the application of two different methodologies, based on the Traditional Test Theory (TTT) and on the Modern Test Theory (IRT), to select the items of a questionnaire administered in the year 2000 to the personnel of the Hospital Firm “Careggi” in Florence, in order to analyse the satisfaction of “internal consumers”. Such methodologies provide very different results, depending on the assumptions of the different models used.
Estimating person parameters via item response model and simple sum score in small samples with few polytomous items: A simulation study
2018
Background The Item Response Theory (IRT) is becoming increasingly popular for item analysis. Theoretical considerations and simulation studies suggest that parameter estimates will become precise only by utilizing many items in large samples. Method A simulation study focusing on a single scale was performed on data with (a) n = 40, 60, 80, 120, 200, 300, 500, and 900 cases utilizing (b) 4, 8, 16, or 32 items. The items were (c) symmetrically distributed vs. skew (skewness 0, 1, and 2). Item loadings were (d) homogeneous vs. heterogeneous. Item loadings were (e) low vs. high. Half of the items had (f) a correlated error or not. The number of answering categories (g) was four vs. five. A to…
Ranking Scientific Journals Via Latent Class Models for Polytomous Item Response Data
2015
Summary We propose a model-based strategy for ranking scientific journals starting from a set of observed bibliometric indicators that represent imperfect measures of the unobserved ‘value’ of a journal. After discretizing the available indicators, we estimate an extended latent class model for polytomous item response data and use the estimated model to cluster journals. We illustrate our approach by using the data from the Italian research evaluation exercise that was carried out for the period 2004–2010, focusing on the set of journals that are considered relevant for the subarea statistics and financial mathematics. Using four bibliometric indicators (IF, IF5, AIS and the h-index), some…
Power and Type I Error of the Mean and Covariance Structure Analysis Model for Detecting Differential Item Functioning in Graded Response Items.
2016
In this simulation study, we investigate the power and Type I error rate of a procedure based on the mean and covariance structure analysis (MACS) model in detecting differential item functioning (DIF) of graded response items with five response categories. The following factors were manipulated: type of DIF (uniform and non-uniform), DIF magnitude (low, medium and large), equality/inequality of latent trait distributions, sample size (100, 200, 400, and 800) and equality or inequality of the sample sizes across groups. The simulated test was made up of 10 items, of which only 1 contained DIF. One hundred replications were generated for each simulated condition. Results indicate that the MA…
Building up adjusted indicators of students' evaluation of university courses using generalized item response models
2012
This article advances a proposal for building up adjusted composite indicators of the quality of university courses from students’ assessments. The flexible framework of Generalized Item Response Models is adopted here for controlling the sources of heterogeneity in the data structure that make evaluations across courses not directly comparable. Specifically, it allows us to: jointly model students’ ratings to the set of items which define the quality of university courses; explicitly consider the dimensionality of the items composing the evaluation form; evaluate and remove the effect of potential confounding factors which may affect students’ evaluation; model the intra-cluster variabilit…
A Dominance Variant Under the Multi-Unidimensional Pairwise-Preference Framework: Model Formulation and Markov Chain Monte Carlo Estimation.
2018
Forced-choice questionnaires have been proposed as a way to control some response biases associated with traditional questionnaire formats (e.g., Likert-type scales). Whereas classical scoring methods have issues of ipsativity, item response theory (IRT) methods have been claimed to accurately account for the latent trait structure of these instruments. In this article, the authors propose the multi-unidimensional pairwise preference two-parameter logistic (MUPP-2PL) model, a variant within Stark, Chernyshenko, and Drasgow’s MUPP framework for items that are assumed to fit a dominance model. They also introduce a Markov Chain Monte Carlo (MCMC) procedure for estimating the model’s paramete…
A Management Model of ICT Adoption in Latvia
2012
AbstractThis paper describes and analyzes the validity of a managerial model for ICT adoption. The proposed model of ICT adoption decision has two components: an objective component (largely from an economic understanding) and a managerial component (from firm level factors). The factors in both components were considered at firm level. The analysis and confirmation come from a survey of 500 businesses in Latvia in 2008. Confirmation of the theoretical model was accomplished using Ordered Logistical Regression analysis. Analyses results revealed that the dimensions of perceived benefits (top line growth and efficiency gains), technology absorption capacity (employees openness to change, com…
Design of Scales to Assess the subjective social value of education for students in primary and secondary school.
2017
Abstract The devaluation of education, related with multiple socio-economic and psycho-school factors may be influencing decisively on academic results. A target level is observed that the socio-economic and cultural level of families can decide the student performance, however, this international trend shows inconsistent results. In addition, in different studies, we can observe that students from disadvantaged backgrounds statistics exceed expectations in performance, surpassing the expected results depending on their socioeconomic and cultural level; and students should achieve optimal results for their family situation do not get the expected performance. An interpretative hypothesis ma…
Comparing Traditional and IRT Scoring of Forced-Choice Tests.
2018
This article explores how traditional scores obtained from different forced-choice (FC) formats relate to their true scores and item response theory (IRT) estimates. Three FC formats are considered from a block of items, and respondents are asked to (a) pick the item that describes them most (PICK), (b) choose the two items that describe them the most and the least (MOLE), or (c) rank all the items in the order of their descriptiveness of the respondents (RANK). The multi-unidimensional pairwise-preference (MUPP) model, which is extended to more than two items per block and different FC formats, is applied to obtain the responses to each item block. Traditional and IRT (i.e., expected a po…
Test fairness: a DIF analysis of an L2 vocabulary test
2000
The purpose of this study is to analyse gender-uniform differential item functioning (DIF) in a second language (L2) vocabulary test with the tools of item response theory (the separate calibration t-method) and to study potential gender impact on the test performance measured by different item composites. The results of the study show that despite the fact that there are test items with indications of DIF in favour of either females or males, the test as a whole is not gender-biased. In spite of this, it was demonstrated that some item composites are gender-biased. In view of item bank building and use, it means that some of the tests constructed on the basis of an item bank might be bias…