How authenticity impacts validity: Developing a model of teacher education assessment and exploring the effects of the digitisation of assessment methods

Zeitschrift für Erziehungswissenschaft, vol. 26, pp. 601–625

Abstract

Based on a literature review of studies on teachers' professional competence and related assessment tools, this paper introduces a model of teacher education assessment. It is influenced by Miller's (1990) framework of assessment in medical education and includes, among other aspects, performance assessments. This model is used to understand the potential effects of transferring assessment tools into a digital format with assessment feedback. Five examples for such a transfer will be discussed: three methods for various aspects of communication, a test for pedagogical content knowledge, and a test for content knowledge. All five are established instruments well-described in terms of validity. All five have recently been transferred into a digital format. The analysis of this transfer also reveals a potentially harmful effect of digital assessment. The closer an assessment instrument is to assessing action-related parts of professional competence, the more authenticity is required; however, digitisation tends to decrease this authenticity. This suggests that an increasing number of digital assessment tools in teacher education might result in an even more dominant focus on knowledge tests, ignoring other parts of professional competence. This article highlights the role of authenticity in validity and discusses the most suitable assessment format to address various parts of professional competence. It ends by highlighting the lessons learned from the transfer of assessment instruments into a digital format that other academic disciplines might find interesting.

Authors 9

1. Christoph Kulgemeyer corresponding

   University of Bremen

   Affiliation as printed

   Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334 Bremen, Germany

   Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334, Bremen, Germany

2. Josef Riese

   Paderborn University

   Affiliation as printed

   Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098 Paderborn, Germany

   Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098, Paderborn, Germany

3. Christoph Vogelsang

   Paderborn University

   Affiliation as printed

   Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098 Paderborn, Germany

   Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098, Paderborn, Germany

4. David Buschhüter

   University of Potsdam

   Affiliation as printed

   Institut für Physik und Astronomie, Lehrstuhl Didaktik der Physik, Universität Potsdam, Karl-Liebknecht-Str. 24/25, 14476 Potsdam-Golm, Germany

   Institut für Physik und Astronomie, Lehrstuhl Didaktik der Physik, Universität Potsdam, Karl-Liebknecht-Str. 24/25, 14476, Potsdam-Golm, Germany

5. Andreas Borowski

   University of Potsdam

   Affiliation as printed

   Institut für Physik und Astronomie, Lehrstuhl Didaktik der Physik, Universität Potsdam, Karl-Liebknecht-Str. 24/25, 14476 Potsdam-Golm, Germany

   Institut für Physik und Astronomie, Lehrstuhl Didaktik der Physik, Universität Potsdam, Karl-Liebknecht-Str. 24/25, 14476, Potsdam-Golm, Germany

6. Anna Weißbach

   University of Bremen

   Affiliation as printed

   Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334 Bremen, Germany

   Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334, Bremen, Germany

7. Melanie Jordans Aachen I. Phys. Institut IA

   RWTH Aachen University

   Affiliation as printed

   I. Phys. Institut IA, RWTH Aachen University, Sommerfeldstr. 14, 52074 Aachen, Germany

   I. Phys. Institut IA, RWTH Aachen University, Sommerfeldstr. 14, 52074, Aachen, Germany

8. Peter Reinhold

   Paderborn University

   Affiliation as printed

   Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098 Paderborn, Germany

   Fakultät für Naturwissenschaften, Department Physik, Universität Paderborn, Warburger Str. 100, 33098, Paderborn, Germany

9. Horst P. Schecker

   University of Bremen

   Affiliation as printed

   Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334 Bremen, Germany

   Institut für Didaktik der Naturwissenschaften, Abt. Physikdidaktik, Universität Bremen, Otto-Hahn-Allee 1, 28334, Bremen, Germany