Search results for "test validity"

Unreliability of the dot probe task

2005

The dot probe task is a widely used measure of attention allocation to threatening stimuli. The present two studies examine the reliability of different versions of this task using words as well as pictures as stimulus material. Estimates of both internal consistency and retest reliability over one week lead to the conclusion that the dot probe task is a completely unreliable measure of attentional allocation in non‐clinical samples. This unreliability may explain the inconsistent findings for the dot probe task as reported in the literature. Copyright © 2005 John Wiley & Sons, Ltd.

Does the Implicit Association Test for assessing anxiety measure trait and state variance?

2004

The stability of the Implicit Association Test for assessing anxiety (IAT‐Anxiety) is lower than its internal consistency, indicating that the IAT‐Anxiety measures both stable and occasion‐specific variance. This suggests that the IAT‐Anxiety may be not only a valid measure of trait anxiety but also one of state anxiety. To test this assumption, two studies were conducted in which state anxiety was experimentally induced by a public speaking task. However, both studies showed that the IAT‐Anxiety score did not change when a state of anxiety was induced. Thus, it seems that occasion‐specific factors other than variations in state anxiety lead to occasion‐specific variance in the IAT‐Anxiety…

The assessment of susceptibility to emotional contagion: A contribution to the Italian adaptation of the “Emotional Contagion Scale”

2013

The Emotional Contagion Scale (ECS; Doherty, 1997) is a self-report instrument assessing susceptibility to emotional contagion. The study was aimed at examining its dimensionality, reliability, and validity in the Italian context. It was completed by 541 young adults (45% men) in Study 1 and 649 young adults (40% men) in Study 2. The results of a series of confirmatory factor analyses showed that a bi-factor model, with one general factor and four specific factors was supported. The general and specific factors resulted differently related to self-other differentiation, empathy, emotional fragility, masculinity, and femininity. Notwithstanding, the results posited some questions about the E…

Reliability of Implicit Self–Esteem Measures Revisited

2011

This study investigated the internal consistencies and temporal stabilities of different implicit self–esteem measures. Participants ( N = 101) responded twice—with a time lag of 4 weeks—to five different tasks: the Implicit Association Test (IAT), the Brief Implicit Association Test (BIAT), the Affective Priming Task (APT), the Identification–Extrinsic Affective Simon Task (ID–EAST) and the Name–Letter Task (NLT). As expected, the highest reliability coefficients were obtained for the self–esteem IAT. Importantly, the internal consistencies and the temporal stabilities of the APT, the ID–EAST, and the NLT were substantially improved by using material, structural, and analytic innovations.…

School Burnout Inventory (SBI)

2009

This study introduces a measure for school burnout and examines its validity and reliability among students in upper secondary high schools and vocational schools by using confirmatory factor analysis. School-related burnout comprises three dimensions: (a) exhaustion at school, (b) cynicism toward the meaning of school, and (c) sense of inadequacy at school. A total of 1418 (709 girls, 709 boys) adolescents from 13 postcomprehensive schools (6 upper secondary high schools, 7 vocational schools) filled in a questionnaire concerning their school burnout and background variables. The results showed that the three-factor solution, compared to one- or two-factor solutions, fit the data best and…

Assessment of Modelling in Mathematics Examination Papers: Ready-Made Models and Reproductive Mathematising

2013

In the Netherlands modelling is integrated into the mathematics curriculum. This chapter describes a study of modelling characteristics in recent mathematics examination papers. Results show that the tasks convey the message that mathematics can be found in unexpected situations. In many tasks a situation and a ready-made model are given and students are asked to work with the model. For mathematising, two design principles were: to finalise the parameters of a given model, and to reconstruct a given mathematical model from verbal descriptions and diagrams of a situation. These formats were coined as mechanistic and reproductive mathematising respectively. These formats have been introduced…

A Novel Instrument to Measure the Multidimensional Structure of Professional Agency

2018

This study aimed to construct and validate a quantitative measurement instrument to determine the structure of professional agency in working life. Empirical data (N = 589) were collected via a web-based, theoretically informed questionnaire, within the professional domains of education, healthcare, rescue services, and information technology. The questionnaire items incorporated theoretically based dimensions of professional agency. The structure of professional agency was initially analysed via exploratory factor analysis. Thereafter, using exploratory structural equation modelling, the structure of professional agency was investigated with a view to confirmation and validation. The resul…

Psychometric Properties of the “Alcohol Consumption Consequences Evaluation” (ACCE) Scale for Young Spanish University Students

2020

Instruments that evaluate alcohol use consequences among young people do not consider the intensive alcohol consumption pattern that is so characteristic during these ages. Some of these instruments are even ineffective in the Spanish population. Hence the interest in developing an instrument more adapted to the reality of our young people. A total of 601 university students (35.9% male and 64.1% female) from 18 to 20 years old were recruited. All of them answered a total of 77 items obtained from the review of both the scientific literature and the different scales used to measure consequences derived from alcohol consumption. In addition, they completed the AUDIT and the Timeline Followba…

2018

Smith and colleagues developed the Brief Resilience Scale (BRS) to assess the individual ability to recover from stress despite significant adversity. This study aimed to validate the German version of the BRS. We used data from a population-based (sample 1: n = 1.481) and a representative (sample 2: n = 1.128) sample of participants from the German general population (age ≥ 18) to assess reliability and validity. Confirmatory factor analyses (CFA) were conducted to compare one- and two-factorial models from previous studies with a method-factor model which especially accounts for the wording of the items. Reliability was analyzed. Convergent validity was measured by correlating BRS scores …

The Emotion Regulation Cecklist Italian Translation Validation for parents and teacher versions.

2014

Our research explored the factor structure and the reliability of the Italian version of the Emotion Regulation Checklist [ERC; Shields, A.,& Cicchetti, D. (1997). Emotion regulation among school-age children: The development and validation of a new criterion Q-sort scale. Developmental Psychology, 33, 906-916], an instrument that has been widely adopted in studies using parents and/or teachers as informants. We carried out two studies evaluating the properties of the Italian ERC (ERC-I) when completed by parents and teachers, respectively. Study 1 participants were kindergarten and elementary school children for whom the ERC was completed by their mothers. Study 2 involved kindergarten and…