6533b857fe1ef96bd12b39d9

RESEARCH PRODUCT

Validity and fairness of a new entry diagnostics test in higher education economics

Olga Zlatkin-troitschanskaiaSebastian BrücknerJasmin SchlaxJudith JitomirskiManuel FörsterCarla Kühling-theesRoland HappHans Anand Pant

subject

050101 languages & linguisticsHigher educationbusiness.industryFirst language05 social sciences050301 educationlanguage.human_languageEducationTest (assessment)DisadvantagedGermanGroup differencesMathematics educationlanguage0501 psychology and cognitive sciencesKnowledge testbusinessPsychology0503 educationCoding (social sciences)

description

Abstract Research has been focusing increasingly on measuring students’ prior economic knowledge in higher education. However, in German-speaking countries, valid instruments are rare. A diagnostic study investigated the validity and fairness of an internationally established economic knowledge test (adapted German version of TUCE IV and TEL IV) with a representative sample of 7664 students from 46 universities across Germany. Previous findings with the dataset ( Zlatkin-Troitschanskaia et al., 2019a ) suggest that native language significantly predicts missing answers in the knowledge test. Similar effects can be found for gender. After coding missing answers as incorrect, students with a native language other than German and females are disadvantaged. Using multiple imputation, group differences are still significant but to a lesser extent. This approach is critically discussed in terms of valid diagnostics and assessment in higher education.

https://doi.org/10.1016/j.stueduc.2020.100900