- Published:
Measurement of vocational competencies — a contribution to an international large-scale assessment on vocational education and training
Empirical Research in Vocational Education and Training volume 1, pages 85–102 (2009)
Abstract
Measurement of vocational competencies which includes not only the knowledge but also the action domain is one of the central targets of VET research — under scientific as well political perspectives. It also is a decisive prerequisite for running an international large-scale assessment on VET. The article describes how such measurement is operationalized by defining dimensions of VET competencies and developing adequate items which mirror authenticly tasks to be fulfilled at the workplace. Tasks and items are presented in the context of a technology-based virtual enterprise focusing on the fields of business and administration. Their format allows Item Response Theory (IRT) scaling.
References
Achtenhagen, F. (2004). Prüfung von Leistungsindikatoren für die Berufsbildung sowie zur Ausdifferenzierung beruflicher Kompetenzprofile nach Wissensarten. In M. Baethge, K.-P. Buss, & C. Lanfer (Eds.) Expertisen zu den konzeptionellen Grundlagen für einen Nationalen Bildungsbericht — Berufliche Bildung und Weiterbildung/Lebenslanges Lernen. Bonn, Berlin: BMBF.
Achtenhagen, F., Nijhof, J. W. & Raffe, D. (1995). Feasibility study: research scope for vocational education in the framework of COST social sciences. European commission: Directorate-general science, research and development, COST technical committee social sciences, 3. Brussels, Luxembourg: ECSC-EC-EAEC.
Achtenhagen, F. & Grubb, W.N. (2001). Vocational and occupational education: pedagogical complexity, institutional diversity. In V. Richardson (Ed.) Handbook of research on teaching, fourth edition. Washington, DC: American Educational Research Association.
Anderson, L. W. & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing. A revision of Bloom’s taxonomy of educational objectives. New York: Longman.
Baethge, M., Achtenhagen, F., Arends, L., Babic, E., Baethge-Kinsky, V. & Weber, S. (2006). PISA-VET — A feasibility-study. Stuttgart: Steiner.
Black, P., Harrison, C., Lee, C., Marshall, B. & William, D. (2003). Assessment for learning. London: Open University Press.
Buttler, F. (1992). Bildungslandschaft bis 2010. In F. Achtenhagen & E.G. John (Eds.) Mehrdimensionale Lehr-Lern-Arrangements. Wiesbaden: Gabler.
Europäische Kommission (2002). Beschäftigung in Europa 2002 — Jüngste Tendenzen und Ausblick in die Zukunft. Brussels: http://europa.eu.int/comm/employment_social/news/2002/sep/employment_in_europe2002_de.pdf.
Gelman, R. & Greeno, J. G. (1989). On the nature of competence: principles for understanding in a domain. In L. B. Resnick (Ed.) Knowing, learning and instruction. Essays in honor of Robert Glaser. Hillsdale, N. J.: Lawrence Erlbaum.
Glaser, R. (1976). Cognitive psychology and instructional design. In D. Klahr (Ed.) Cognition and instruction. Hillsdale, NJ: Lawrence Erlbaum.
Greeno, J. G., Riley, M. S. & Gelman, R. (1984). Conceptual competence and children’s counting. Cognitive Psychology, 16, 94–143.
Lang-von Wins, T. (2003). Die Kompetenzhaltigkeit von Methoden moderner psychologischer Diagnostik-, Personalauswahl- und Arbeitsanalyseverfahren sowie aktueller Management-Diagnostik-Ansatze. In J. Erpenbeck, & L. von Rosenstiel (Eds.) Handbuch Kompetenzmessung. Stuttgart: Schäffer-Poeschel.
Oates, T. (2004). The Role of outcome-based national qualifications in the development of an effective vocational education and training system: The case of England and Wales. Policy Futures in Education, 2(1), 53–71.
OECD (1995). Literacy, economy and society. Results of the first international adult literacy Survey. Paris: OECD.
OECD (2003). The PISA 2003 assessment framework — mathematics, reading, science and problem solving knowledge and skills. Paris: OECD.
Rychen, D.S. & Salganik, L.H. (2003). A holistic model of competence. In D.S. Rychen, & L.H. Salganik (Eds.) Key competencies for a successful life and a well-functioning society. Cambride, Göttingen: Hogrefe & Huber.
Shavelson, R. J., Baxter, G. P. & Pine, J. (1992). Performance assessments: Political rhetoric and measurement reality. Educational Researcher, 21(4), 22–27.
Wilson, M. (2005). Constructing measures: An item-response modeling approach. Mahwah, NJ: Erlbaum.
Wilson, M. (2008). Cognitive diagnosis using item response models. Journal of Psychology, 216(2), 74–88.
Winther, E. (2006). Motivation in Lernprozessen. Konzepte in der Unterrichtspraxis von Wirtschaftsgymnasien. Wiesbaden: DUV.
Winther, E. & Achtenhagen, F. (2008). Kompetenzstrukturmodell für die kaufmännische Bildung. Adaptierbare Forschungslinien und theoretische Ausgestaltung. Zeitschrift für Berufs- und Wirtschaftspädagogik, 104, 511–538.
Yuan, K., Steedle, J., Shavelson, R., Alonzo, A. & Oppezzo, M. (2006). Working memory, fluid intelligence, and science learning. Educational Research Review, 1, 83–98.
Author information
Authors and Affiliations
Corresponding author
Additional information
The idea of a VET-PISA was initiated by a call of tender of the German Federal Ministry of Economy and Labour. The feasibility study was finished in 2006 (Baethge et al.). The following activities are supported by the German Federal Ministry of Education and Research.
Rights and permissions
About this article
Cite this article
Winther, E., Achtenhagen, F. Measurement of vocational competencies — a contribution to an international large-scale assessment on vocational education and training. Empirical Res Voc Ed Train 1, 85–102 (2009). https://doi.org/10.1007/BF03546481
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03546481