Being an economic-civic competent citizen: A technology-based assessment of commercial apprentices in Germany and Switzerland
- Stephan Schumann†1Email authorView ORCID ID profile,
- Esther Kaufmann†2View ORCID ID profile,
- Franz Eberle3,
- Andreas Jüttler1 and
- Nicole Ackermann3
© The Author(s) 2017
Received: 5 September 2016
Accepted: 16 May 2017
Published: 21 June 2017
Citizens in modern democratic societies are confronted with complex demands, challenges, and economic problems, and they typically act as consumers, savers, voters, and employees. It is highly desirable for citizens to be able to competently manage these various demands. This ability we call economic-civic competence. Given the lack of empirical findings and adequate instruments on this issue, we analyze the economic-civic competence of commercial apprentices in Germany and Switzerland. In Swiss commercial apprenticeships, the fostering of this competence is explicitly anchored in the curricula of vocational schools. In Germany, the curricula coverage is not as broad as in Switzerland, which leads to an assumption of country differences in civic-economic competence.
A total of 1255 apprentices in the commercial occupations/branches of industrial clerk and logistic clerk were assessed at the end of their second or third training year. Our newly developed, reliable and valid technology-based assessment on economic-civic competence includes issues such as the Euro crisis and public debt.
Results and conclusions
An advantage among the male trainees, which was expected from previous research, was confirmed only among the German logistic clerks. The expected gender effect was not observed among the German industrial clerks or the Swiss clerks. Furthermore, the results confirm the hypothesized higher scores among German trainees with a university entrance degree. In both countries, the industrial clerks scored significantly higher than the logistic clerks did, and the Swiss trainees scored higher than did their German counterparts in a comparable occupation. This difference becomes markedly stronger if only learners without a university entrance degree are considered. One possible explanation for the country difference may be that the promotion of economic-civic competence has a more prominent role in Swiss vocational schools during commercial apprenticeship. Considering the methodological restrictions, the findings should be interpreted primarily as explorative depictions of the characteristics and group differences of economic-civic competence. However, our study can also be seen in the broader context of contemporary interest and challenges in developing technology-based assessment within the field of education. Thus, our study contributes to further research on the characteristics and genesis of economic-civic competences as well as on technology-based assessments.
Citizens in modern democratic societies are confronted with complex economic demands, challenges, and problems. They typically act as consumers, savers, voters, and employees. The growing complexity of economic processes in private life, the workplace, and the modern internationalized world requires knowledge to understand basic economic principles, concepts and mechanisms. For instance, in direct democracies and in representative democracies, people have the right to vote on voting proposals or partisan programs that are closely related to economic objectives. To justify their voting decisions, people should understand the causes and effects of suggested solutions and the conflicting interests of the stakeholders involved. Thus, it is highly desirable that citizens have the ability to handle economic-related demands in various contexts. We call this economic-civic competence.1
Fostering economic-civic competence has long been an explicit goal of the Swiss commercial apprenticeship program. In addition to professional competence, Swiss commercial trainees are required to achieve economic-civic competence, which is largely acquired in the subject “Economics and Society” (E&S) in vocational schools. In German commercial apprenticeships, the promotion of these types of competencies also plays a significant role (Winther 2010). To date, however, no studies have investigated economic-civic competence in an adequate empirical manner.
Considering the substantial lack of empirical findings, the aim of this study was to analyze in detail the economic-civic competence of Swiss and German commercial apprentices in the occupations and branches of “Industrial clerk” and “Logistic clerk”, respectively. In particular, we examine the effects of gender, prior education, occupation, and national affiliation. We introduce our concept of economic-civic competence and outline the related state of the research. Subsequently, we highlight the country-specific systems, the commercial apprenticeship and the curricular support for economic-civic competence in detail.
Concept of economic-civic competence
The concept of economic-civic competence combines the concepts of economic competence and civic competence (see Eberle 2015). There are research traditions in both economic competence/education (e.g., Wuttke et al. 2016) and civic competence/education (e.g., Print and Lange 2013). Given that civic demands (e.g., referenda) are often related to economic problems on the individual or social level, the weak connection between these two research areas is surprising. Our definition of economic-civic competence is outlined in the next section and considers both research approaches. A more detailed description of our model of economic-civic competence is outlined in Eberle et al. (2016).
Economic-civic competence is defined as the ability to understand private-economic, politico-economic and business issues in state and non-state social systems, to evaluate proposed solutions, and to develop solutions to simple problems (Eberle et al. 2016). According to existing definitions of competencies (e.g., Beck 1989; Weinert 2001), economic-civic competence is based on knowledge, skills and non-cognitive factors (e.g., an interest in economic problems, a motivation to solve economic problems, and attitudes and values that allow economic problems to be discussed and responsibly resolved). In the present study, we focus on the cognitive domain, although we emphasize the need to include non-cognitive facets in future research, as mentioned in our research outline.
Economic-civic competence is significant for all citizens of a society and not solely for specific occupations. Two examples are provided. (1) All western countries must address demographic changes and their effects on the retirement provision system. Considering the recurrent suggestions of politicians, parties, think tanks and experts regarding the “appropriate” solutions to this challenge, it is necessary to have a solid understanding of the basic economic principles of the existing system, the economic and social effects of the suggested transformations and the intentions of the involved stakeholders. (2) The European (Monetary) Union constitutes an important pillar of the economic integration of the member states of the European Union (EU). Near or executed shocks, such as Greece’s struggle (including the massive Greek public debt) since 2010 or BREXIT in 2016, clarify the importance of a basic understanding of the economic and societal causes and consequences of such incidents. Broader comprehension within society may have resulted in a different voting decision in the UK, for example. Of course, economic-civic competence is no panacea. However, with a higher competence, we argue that citizens may be less prone to populism and “simple” suggested solutions.
State of research
Explicit empirical research on economic-civic competence is lacking. Thus, the research on civic and economic education and competence exist relatively independently. At most, there is a connection with the related concept of financial literacy in democratic contexts (Davies 2015). In the following paragraphs, we focus on selected empirical findings on economic competence and their correlations because, along with our understanding of economic-civic competence, we assume a stronger interrelation with economic than with civic competence. For civic competence, we refer to recent studies (e.g., Print and Lange 2013; Schulz et al. 2016).
Historically, the origin of modeling and measuring economic competencies can be observed in the US in the report “Economic Education in School” (Committee for Economic Development [CED] 1961). Numerous definitions and test instruments to explain and measure economic competences were subsequently developed (see Kotte and Witt 1995). The test of economic literacy (TEL; Soper 1979; Walstad et al. 2013) is the most frequently applied instrument to assess economic competencies in upper secondary education. Many studies have used the TEL or a translation of it (e.g., the German translation “Wirtschaftskundlicher Bildungstest” by Beck and Krumm 1998). An overview of the results shows considerable differences among countries (Walstad 1994). Students in Australia, the UK and South Korea performed well, whereas the mean scores of students in the US, Germany, Austria, Switzerland and Greece were lower. Based on these findings, significant international differences can be assumed. However, comparative international studies of economic competencies are still lacking. Despite the widespread application of the TEL, three related drawbacks must be mentioned. First, the TEL focuses on only economics, whereas topics of business administration and individual budgeting are ignored (Tramm and Seeber 2006). Second, the data of several empirical studies cannot validate the hypothesized complexity of the items with Bloom`s taxonomy of knowledge. Third, due to the TEL’s use of forced-choice items only, an assessment of higher-order abilities is not possible. To reveal higher-order abilities, open-question formats should supplement the forced-choice items.
Several studies have examined learners` economic competencies in the vocational track in upper secondary education in German-speaking countries. Some of these studies used the German version of the TEL or parts of it (e.g., Beck and Krumm 1998; Lehmann and Seeber 2007). Furthermore, several studies investigated economic competencies in commercial apprenticeship programs (Klotz and Winther 2015; Seeber 2008; Winther 2010; Winther and Achtenhagen 2008) and revealed substantial differences among different programs. However, because of the use of cross-sectional designs, possible causes could not be identified. The main question is whether the program differences are affected mainly by program influences or by learners’ prerequisites. In general, one finding seems to be evident in most studies: when students complete more economic coursework, they score higher on related tests (for an overview, see Seeber et al. 2015).
Another question in the present study focuses on gender differences. The gender gap in terms of economic competence is well documented. Male students score significantly higher than their female peers do at several educational levels (e.g., Brückner et al. 2015; National Center for Education Statistics 2013; Schumann and Eberle 2014; Walstad 1994). However, the reason for this gap has not been explained (Schmidt et al. 2015). Furthermore, it is unclear whether this gap can be replicated for economic-civic competence.
There are robust findings regarding the correlations and predictors of economic competencies. Prior education (including course participation in economics), basic competencies in a native language and mathematics, and general cognitive abilities in terms of intelligence are some of the main factors that have been shown to correlate with students’ economic knowledge (Brückner et al. 2015; Schumann and Eberle 2014; Seeber et al. 2015). In addition, learners with higher prior knowledge, basic competencies and general cognitive abilities typically score better (Lehmann and Seeber 2007; Schumann and Eberle 2014; Seeber et al. 2015; Spoden et al. 2015; Winther 2010). Finally, the effects of socio-cultural background are unclear and have been reported inconsistently in the literature (Jüttler and Schumann 2016; Kotte and Lietz 1998).
The research overview reveals that although different educational levels have been considered, no study has focused on economic-civic competence at the commercial trainee level. This gap also leads to missing studies on trainee characteristics such as gender, prior education, and branch/affiliation as well as country comparisons at this educational level. These gaps are addressed by the present empirical study.
International studies tend to change their measurement procedures to use new technologies to measure students’ competences. The main goal of this shift in measurement procedure is a more precise measurement (e.g., improved accuracy in data collection, saving time, permitting more interactive question types, adaptive testing and multimedia support). Due to the technology evolution leading to an easy application of an automatic coding approach to open question formats in the future, the today dominant forced-choice items then will be rarely used and open questions will be preferred. Open question formats represent a more valid testing situation. Moreover, students’ writing in an open question format may represent a deeper knowledge structure than forced-choice items (see also our critics of the TEL, introduced before). Technology-based assessments also provide new opportunities for data collection and data saving by using data more efficiently for future analysis, such as meta-analysis that includes replication checks (see Kaufmann et al. 2016). Finally, technology-based assessments may increase students’ motivation for testing.
However, technology-based assessments for economic competencies have not previously been used. Hence, we see a need to use the advantages of technology-based assessment for future applications to measure civic-economic competence. For the first time in German-speaking countries, this study uses a technology-based approach to assess economic-civic competence.
Educational system and vocational education in Germany and Switzerland
At first glance, the German and Swiss educational systems appear to be similar. Historically, both systems have been characterized by a highly stratified educational system in lower secondary education and a somewhat impermeable divide between an academic track and a vocational track following compulsory school (Deißinger 2010). The smaller academic track usually leads to universities and typically requires a university entrance degree (UED) that is received from a general baccalaureate school (BS). In contrast, the larger vocational track is geared toward professions within employment systems and is characterized mainly by so-called dual apprenticeships. Dual apprenticeships are distinguished by a combination of company- and school-based training (Maurer and Gonon 2013; SERI 2016). Apprenticeships last from three to four years and qualify trainees for numerous specific occupations. There is no formal allocation process for the selection of trainees (e.g., through a general school certificate). Companies are free to choose their trainees (Deißinger 2010).
In a general comparison with the contemporary German system, the Swiss system can be described as more “traditional”. Approximately 20% of young adults pursue a “pure” academic track. This rate has been somewhat stable over the past 20 years (Eberle and Brüggenbock 2013). More than 90% of Swiss baccalaureate holders enter a university or a university of applied sciences (UAS) after leaving a BS. In contrast, approximately 70% of young adults in Switzerland pursue vocational education and training (VET) after their compulsory schooling (SERI 2016; Wettstein et al. 2014).
In contrast with Switzerland, a much stronger shift toward longer school attendance, higher general school certificates, and, especially, higher education can be observed in Germany, triggered by comprehensive school reform debates in the 1960s and 1970s (Deißinger and Gonon 2016). In most German federal states, the BS system currently has the largest enrollment in the general educational system. Because of the creation of an opportunity to acquire general school certificates within the VET system, more than 40% of youths earn a university entrance degree (UED), and an additional 15% earn a degree for entrance to a UAS (Authoring Group Educational Reporting 2016). In 2011, for the first time, there were as many people entering higher education as people enrolling in dual VET programs (Authoring Group Educational Reporting 2014). In contrast to Switzerland and its relatively low permeability between the academic and vocational tracks, much higher permeability can be currently observed in Germany. Many young adults enter the higher educational system through programs in the VET system. In contrast, a substantial proportion of learners with a UED subsequently start an apprenticeship. The most favored commercial training programs are attended by trainees with a UED (approximately 70% in the industrial clerk occupation and almost 60% of logistic clerks; see DESTATIS 2015).
In both countries, commercial apprenticeships play an important role within the VET system. In Switzerland, with approximately 30,000 trainees, commercial apprenticeships are by far the most popular of the VET programs among male and female youths (Swiss Conference of Commercial Training and Examination Branches 2011a). Commercial training is allocated to the three following learning locations (SERI 2011): (1) training at the host company; (2) classroom instruction at vocational schools; and (3) training in branch training centers. In the branch courses, trainees spend 8–16 days for 3 years at branch training centers, where they are provided with essential practical skills for one of the 21 branches. There is only one commercial apprenticeship that leads to the same VET certificate for all learners. However, the program is differentiated with respect to the 21 commercial branches (e.g., banking, industry, and logistics). The school-based general education is identical and standardized across all branches, whereas the company-based and industry-based vocational training is more flexible and varies among the branches because of their specific business structures and processes (Swiss Conference of Commercial Training and Examination Branches 2011b).
Despite their many similarities, there are significant differences between German and Swiss commercial apprenticeships. First, in Germany, there are more than 50 types of commercial apprenticeships. The most prominent are the commercial apprenticeships to become office clerks (approximately 70,000), retail clerks (approximately 60,000), industrial clerks (approximately 50,000), and sales clerks (approximately 40,000) (Federal Institute for Vocational Education and Training 2016). Thus, the occupations and curricula are more varied in Germany than in Switzerland. Second, the occupational associations do not provide specific courses in Germany, as they do in Switzerland. The conceptual professional competencies and more general competencies must be learned in vocational schools. Third, unlike Switzerland and its subject-driven curricula, the German vocational school curricula are organized mainly into so-called learning fields. In general, learning fields are oriented toward typical demands within a particular occupation. Fourth, the vocational school curricula in Switzerland are standardized nationwide, whereas the school curricula in Germany vary slightly among the federal states. However, the curriculum should be closely oriented to the framework curriculum of the Standing Conference of the Ministers of Education and Cultural Affairs.
Fostering economic-civic competence in vocational schools
In both Switzerland and Germany, the systematic fostering of economic-civic competence is performed particularly in the vocational schools during commercial apprenticeships.
In Switzerland, the teaching of this competence largely occurs in the subject “Economics and Society” (E&S). The educational goals and learning content in E&S are formulated in the federal curriculum (Swiss Conference of Commercial Training and Examination Branches 2011b). The overarching educational goals in E&S are the following: commercial learners should understand the relations, challenges and problems in companies, the economy and society; commercial learners should be able to suggest, implement and evaluate solutions within their area of influence; and commercial learners should be aware of their responsibility and opportunities as economic and social citizens (Swiss Conference of Commercial Training and Examination Branches 2011b). E&S is divided into the four subfields of finance, management and business, economics, and civics and law. The learning material in the subfield of economics addresses a wide range of economic topics and policy issues (e.g., economic growth, unemployment, inflation, fiscal and monetary policy, and social security). Trainees must complete 520 h in E&S during their apprenticeship: 5 h/week in their first and second training years and 3 h/week in their final year.
As described above, the vocational school curricula of occupations in Germany are oriented to the framework curricula of the Standing Conference of the Ministers of Education and Cultural Affairs. Regardless of the differences among the several federal states, the curricula-driven promotion of economic-civic competence is not as broad and deep in Germany as in Switzerland. In the following, we discuss the trainees as “Industrial clerk” and “Logistic clerk”, which are the scope of our study.
“Industrial clerk” trainees must be taught in 12 learning fields for a total of 880 h during the apprenticeship (KMK 2002). Because of the system of the learning field, an accurate identification of subject-specific content is not possible. However, the business and entrepreneurial aspects of specific commercial occupations have received considerable attention. In Germany, general education in economics and politico-economics is not covered in depth, unlike in Switzerland. German industrial clerk trainees receive approximately 150–200 h of this type of instruction during their three-year apprenticeship (see also Ministry of School, Youth and Sport Baden-Wurttemberg 2016a, b, “Logistic clerk” trainees receive vocational school instruction in 15 learning fields for 880 h (KMK 2004). Most of the learning fields are oriented toward logistic material. More general economic content is covered by a total of 60–80 h during the entire apprenticeship, which is more than half of Germany’s industrial clerk trainee requirements.
Gender differences According to the largely robust finding of males` higher scores in terms of economic competences, we expect to see an advantage for male trainees. Do male trainees actually score higher on economic-civic competence than female trainees across countries and in the different occupations?
Prior education Particularly among German commercial apprentices, a substantial proportion of the trainees hold a UED. Typically, these trainees are educated longer and better than trainees without a UED and show higher levels of academic achievement. Moreover, these trainees show higher general cognitive abilities on average. Because of the differences due to a UED, we expect that there are substantial advantages for trainees with a UED.
Occupation/branch affiliation Are there actual differences in the scoring of economic-civic competence between the two commercial branches/occupations in Germany and Switzerland?
Countries Considering the stronger curricular consideration of economic-civic competence that is promoted in Switzerland, higher scores for Swiss commercial trainees are plausible. However, until recently, there were no empirical findings on this matter. Therefore, we examine the differences between German and Swiss trainees within equivalent branches/occupations.
Development of the technology-based assessment
The development of the required economic-civic test is implemented in a technology-based assessment because our goal is to validly measure economic-civic competence and to increase students’ motivation. New technology provides new opportunities for the development of tests for international comparison. In addition to technology-based test development, consistent with Hambleton (2001) and Hambleton et al. (2005), we considered subject-, language- and culture-specific characteristics and adequately adapted them.
Because we used a technology-based approach, we had the opportunity to easily implement a complex booklet design (see Frey et al. 2009) that was used with the German sample. Six different booklets that each included a combination of two of the six topics were used. Each participant was randomly assigned a booklet. Because of the small sample size in Switzerland, the use of the booklet design was not possible. Therefore, two topics—national debt and energy policy—were selected for use with the Swiss sample.
In addition to the advantages of a technology-based assessment compared to a traditional paper-and-pencil assessment approach, in the development of an instrument that includes open-response items, a technology-based approach is preferred because it improves the precision of data analysis and interpretation. In classical paper-and-pencil assessments, the reading of handwritten student data is much more time consuming and interpretations are more error prone compared to machine-aided student answers. This improvement clearly enhances the objectivity of the data analysis and interpretation.
In addition to the technology-based check, the psychometric quality of the assessment was proofed by pilot studies and within the current study.
These psychometric evaluations included different psychometric indices. We checked the psychometric assessment properties of each country. For the assessment evaluation based on the Swiss sample, the weighted mean squares and t-values were mostly acceptable. However, for the assessment evaluation based on the German sample, the weighted mean squares and t-values fit less well. A careful check revealed that two item types were critical. An in-depth item-based analysis revealed a satisfying distractor analysis. Therefore, despite the heterogeneity of the different psychometric assessment properties, the quality of our assessment instrument was acceptable (for details see Eberle et al. 2016).
For the analyses of the current study, the one-dimensional model solution of economic-civic competence was used. The reliability score was sufficient (weighted likelihood estimators (WLE) reliability 0.83).
Differential item functioning (DIF) analyses were conducted for occupations/branches within the countries and then for the countries within the occupations/branches (for detailed information, see "Appendix"). Moreover, there was gender DIF within the countries and within each respondent occupation branch within the countries.
DIF can suggest that the measured latent variable is not the same for different groups and that the answers cannot be scaled together and used for valid group comparison. However, the question concerning how to handle and interpret statistical DIF is not trivial. No common agreement exists regarding acceptable tolerance limits for the strength of DIF (Liedtke and Seeber 2015; Osterlind and Everson 2009). Furthermore, it is necessary to distinguish between construct-relevant and construct-irrelevant DIF (see Zumbo 1999). Thus, although statistical DIF is a necessary condition for item bias, it is not a sufficient one. To determine whether DIF is construct (ir-)relevant would require deeper content-related analyses (e.g., Liedtke and Seeber 2015; Spoden et al. 2015) that do not reflect the subject matter of this article. Therefore, it is not sensible to eliminate items for further analyses only because statistical DIF exists (Spoden et al. 2015; Zumbo 1999). In our paper, DIF can also be seen as a diagnostic instrument for the specific strengths and weaknesses of different groups regarding the same underlying construct that result from different learning opportunities (for details, see Scheuneman and Gerritz 1990). Although statistical DIF among the branch and country affiliations was evident, we assume curricula-driven differences rather than construct-related DIF (i.e., no item bias). Additionally, the DIF items were equally distributed among the groups. Therefore, DIF was not considered, and all items were used to calculate the WLE.
The test scores for economic-civic competence were developed and analyzed based on item response theory (IRT, see Masters 1982; Rasch 1960) using the software program “ConQuest” version 2.0 (Wu et al. 2007). For the current analyses, the WLE (see Warm 1989) of the specific personal abilities was used. Furthermore, the test scores were standardized to yield a mean value of 500 and a standard deviation of 100.
Design and procedure
The analyses are based on the data from the cross-sectional Study Modellierung und Messung wirtschaftsbürgerlicher Kompetenz (for more information, see Eberle et al. 2016).3 Data were gathered from the German samples between March and October 2014 and from the Swiss samples in the spring of 2015. The technology-based assessment consisted of a 45-min online speed test. Additionally, the trainees completed an online questionnaire that contained biographical, educational and social items (35 min). The test was administered by test administrators to groups of approximately 20 trainees in branch courses in Switzerland4 and in vocational schools in Germany.
In Switzerland, the research team together with the two commercial branch associations5 organized communications with the training firms and trainees, the arrangement of the test locations and the testing logistics. The assessments in Germany were managed by the members of the project teams of the German research cooperation partners in Network CoBALIT.
The sampling procedures differed depending on the country. The Swiss sample was representative of trainees in both surveyed occupational branches in the German-speaking part of Switzerland. In contrast, the German sample was a convenience sample of trainees in the two commercial occupations of industrial and logistic clerk.
Characteristics of the Swiss sample
Characteristics of the German sample
Training year (N)
Country-specific competence scores by commercial occupation and gender
The male trainees scored significantly higher than their female peers did only in the German sample. No significant gender effect was evident among the Swiss trainees. In addition, the effect in Germany was small (Cohen’s d = 0.19). By specifically examining the differences within both occupations, a stronger effect can be identified among the German logistic clerks (Cohen’s d = 0.38). In contrast, no significant difference is observed among the industrial clerks.
Competence scores of German trainees with and without a UED by occupation
Differences by occupation and country affiliation
Country-specific competence scores by commercial occupation/branch
Occupation/branch-specific competence scores by country affiliation
Second, we compared the country-specific competence scores within the corresponding occupations/branches. A slight advantage of the Swiss trainees was revealed, although these differences were not statistically significant (see Table 6, upper section). As reported above, apprentices with a UED score substantially higher. Given the high proportion of UED-holding trainees in the German sample and their small proportion in the Swiss sample, we analyzed the country differences using only the data from trainees without a UED (see Table 6, lower section). Among this subgroup, the Swiss trainees clearly scored significantly higher. The expected effect was slightly stronger among industrial clerks (Cohen’s d = 0.38 compared with 0.28).
Citizens in modern democratic societies are confronted with complex challenges. Many of these demands are related to economic issues, which can occur on an individual level and on a societal level. Citizens typically act as consumers, savers, credit users, voters, and employees. From our perspective, it is highly desirable for citizens to be able to competently manage these demands in various contexts. We call this ability economic-civic competence.
Given the substantial lack of research, our study sheds new light on economic-civic competencies. This study used a new technology-based assessment to analyze in detail the economic-civic competence of commercial apprentices in Germany and Switzerland. Until now, there have been almost no empirical findings regarding this topic. In both Swiss and German commercial apprenticeship programs, the fostering of this competence is promoted by vocational schools. However, the extent of the curricula and lecture hours are more intense in Switzerland.
Summary and conclusions
Gender differences The advantage among male trainees, which was expected based on previous studies concerning economic competence (e.g., Brückner et al. 2015; National Center for Education Statistics 2013; Schmidt et al. 2015; Schumann and Eberle 2014; Walstad 1994), was confirmed only among German logistic clerks. The expected gender effect was not found among German industrial clerks or Swiss trainees.
Prior education In contrast to the Swiss trainees, a considerable number of German apprentices had acquired a UED before attending commercial training. Typically, these trainees display higher academic achievement than do trainees without a UED (Lehmann and Seeber 2007; Schumann and Eberle 2014; Seeber et al. 2015; Spoden et al. 2015; Winther 2010). Our results confirm the assumed higher scores among the German trainees with a UED. The effects are small among logistic clerks and moderate among industrial clerks.
Occupation/branch affiliation In both countries, industrial clerks scored significantly higher than logistic clerks did. This effect was slightly stronger in Switzerland. As stated in the theoretical background, the main question is whether the differences between the two commercial occupations/branches are affected mainly by program influences or by learners’ prerequisites. Considering the robust findings from several studies that students who experience more economic learning opportunities score higher on related tests, the advantage for industrial clerks in Germany can be explained by the approximately double number of curriculum-based hours on related content. However, the greater difference between Swiss industrial and logistic clerks cannot be explained by different learning opportunities because they are taught in vocational schools with the same curriculum in the subject of E&S. Therefore, learners’ preconditions must be scrutinized. One explanation may be the greater popularity of industrial clerk apprenticeships than of logistic clerk apprenticeships. Trainees with better cognitive and motivational preparedness are deciding to apprentice as industrial clerks, and the training companies of the industrial branch have the opportunity to choose among a larger group of better educated and motivated apprentices (the cascade effect). This assumption can be confirmed by the significantly higher math and language scores of industrial clerks than of logistic clerks in Switzerland. However, these findings are not reported here in detail because the data on these abilities are available only for a small subsample.
Countries In general, the Swiss trainees scored higher than their German counterparts did within a comparable occupation/branch. This expected advantage was significant and notably stronger among the trainees without a UED. A plausible explanation is the broader and more explicit promotion of economic-civic competence in Swiss vocational schools in commercial apprenticeships. Commercial trainees in Switzerland receive significantly more instruction in related content than their German colleagues do.
Limitations and outlook
Due to several methodological restrictions, the findings should be viewed with caution. Significant limitations regarding the design, sample selection (in Germany) and few control variables must be noted. First, our study design does not allow us to identify causal relations among the score differences. We do not know enough regarding the interplay of individual, institutional and contextual variables and their effects on economic-civic competence within the observed population. In times of increasing interest in large-scale international comparisons of educational outputs, international differences should be viewed with caution. This is particularly true with regard to the use of the convenience sample in Germany. In contrast, the Swiss sample was selected more systematically. Moreover, additional control variables were not used to check the robustness of the findings. Again, we emphasize that only the cognitive aspect is considered in this study. Future research should also include a non-cognitive component, which is implied in the competence concept (see also Klieme et al. 2007; Weinert 2001), especially economic-civic competence (see Eberle 2015).
Given that our study introduces a technology-based assessment comparison of civic-economic competence as well as the study’s results and methodological restrictions, several conclusions can be drawn. The findings should be interpreted primarily as explorative depictions of the characteristics and group differences that control economic-civic competence. Thus, the study can be used as a basis for further research on this topic. Open questions, such as the unexpected weakness of the gender effect or the identified branch and country differences, should be studied with more precise study designs and sampling. Sampling should be performed with a more systematic description of the basic population. In future efforts that aim to identify causal effects (i.e., selection and socialization effects), multi-perspective and multilevel longitudinal studies could be appropriate ways to obtain more knowledge about the genesis of economic-civic competence. This knowledge is clearly needed to understand the complexity of economic-civic competence in an effort to measure it with assessments other than technology-based assessments.
Our study can be seen in the broader context of the contemporary interest and challenges in developing technology-based assessment within the educational field. The focus of technology-based assessment reveals many open questions that require additional research, such as comparisons of the data quality of technology-based assessment and traditional assessment approaches. Our contribution highlights the advantages of a technology-based approach with regard to design development and data analysis. In our technology-based assessment, open questions were coded by experts. However, future applications should consider the automatic coding approach as an alternative. Coding open questions using an automatic coding approach would support the application of our technology-based instrument and increase knowledge of the complexity of economic-civic competence.
German translation: Wirtschaftsbürgerliche Kompetenz.
The study CoBALIT was part of the project Network CoBALIT. The project Network CoBALIT was embedded in the German ASCOT research initiative.
Because the Swiss students had to appear only for the assessment test in their branch courses, each received 50 Swiss francs as compensation for their travel costs.
Commercial branch associations: Maschinen-, Elektro- und Metallindustrie (MEM) = Engineering, Electrical and Metal Industry; Internationale Speditionslogistik = International Forwarding and Logistics.
All authors contributed substantially to this work. SS and FE raised funding for the project and designed the study. EK collected the data. Data analysis for this paper was conducted by AJ in consultation with all other authors. All authors were involved in the interpretation and discussion of the results. All authors agree to be accountable for all aspects of the work. All authors read and approved the final manuscript.
Stephan Schumann holds the chair of business and economics education at the University of Konstanz, Germany. His research focuses on the assessment and fostering of economic competencies, learning and instruction in vocational schools and transitions from school to work.
Esther Kaufmann is a senior lecturer and researcher at the University of Zurich, Switzerland.
Her research focuses on competence modeling and measurement, meta-analysis (information aggregation), online research and judgment and decision-making within education.
Franz Eberle holds the chair of upper-secondary education at the University of Zurich, Switzerland. He has directed numerous national and international externally funded research projects. His research focuses on learning and teaching within upper-secondary education as well as within vocational education and training, didactics and the methodology of lessons in economics and law, general didactics and methodology at the upper-secondary level and the exploration of the macro level regarding the academic track of the Swiss educational system, especially transitions from the upper-secondary to the tertiary level.
Andreas Jüttler is a research associate and Ph.D. student in the Department of Economics at the University of Konstanz, Germany. His research focuses on the measurement of economic competencies, vocational interests and socio-economic effects.
Nicole Ackermann is a research associate and Ph.D. student at the University of Zurich (chair of upper-secondary education). Her research focuses on measuring and modeling economic-civic competence and financial literacy.
The author(s) wish(es) to thank the SERI for funding the project “Economic-civic competence: Modeling and measuring”. Furthermore, we would like to thank the research teams of Prof. Susan Seeber (Georg-August University of Göttingen, Germany), Prof. Esther Winther (The German Institute for Adult Education—Leibniz Centre for Lifelong Learning, Bonn, Germany), and Prof. Dr. Susanne Weber (LMU Munich, Germany) for collecting the data for our German database.
The authors declare that they have no competing interests.
Availability of data and materials
We cannot share our data at present due to ongoing analyses. However, we plan to deposit the data at a later date at forsbase (https://forsbase.unil.ch).
This study was substantially financed by the State Secretariat for Education, Research and Innovation (SERI). The interpretations and conclusions are those of the authors and do not necessarily represent the views of the SERI.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Authoring Group Educational Reporting (2014) Education in Germany 2014. An indicator-based report including an analysis of the situation of people with special educational needs and disabilities (summary). Commissioned by the Standing Conference of the Ministers of Education and Cultural Affairs of the states in the Federal Republic of Germany and the Federal Ministry of Education and Research. W. Bertelsmann, BielefeldGoogle Scholar
- Authoring Group Educational Reporting (2016) Education in Germany 2016. Ein indikatorengestützter Bericht mit einer analyse zu Bildung und migration [An indicator-based report including an analysis of the situation of people with migration background]. KMK/BMBF, Berlin and W. Bertelsmann, BielefeldGoogle Scholar
- Beck K (1989) Ökonomische Bildung—Zur Anatomie eines wirtschaftspädagogischen Begriffs [Economic education—On the anatomy of a term of business and economic education]. Zeitschrift Berufs-und Wirtschaftspädagogik 85:579–596Google Scholar
- Beck K, Krumm V (1998) Wirtschaftskundlicher Bildungstest (WBT) [Test of economic literacy]. Hogrefe, GöttingenGoogle Scholar
- Brückner S, Förster M, Zlatkin-Troitschanskaia O, Walstad WB (2015) Effects of prior economic education, native language, and gender on economic knowledge of first-year students in higher education. A comparative study between Germany and the USA. Stud High Educ 40:437–453View ArticleGoogle Scholar
- Committee for Economic Development (CED) (1961) Economic education in the schools: a report of the national task force on economic education. Committee for Economic Development, New YorkGoogle Scholar
- Davies P (2015) Towards a framework for financial literacy in the context of democracy. J Curric Stud 47:300–316View ArticleGoogle Scholar
- Deißinger T (2010) Dual system. In: Peterson P, Baker E, McGaw B (eds) International encyclopedia of education. Elsevier, Oxford, pp 448–454View ArticleGoogle Scholar
- Deißinger T, Gonon P (2016) Stakeholders in the German and Swiss vocational educational and training system. Educ Train 58:568–577View ArticleGoogle Scholar
- DESTATIS (2015) Bildung und Kultur [Education and culture]. Berufliche Bildung 11(3). Statistisches Bundesamt, WiesbadenGoogle Scholar
- Eberle F (2015) Die Förderung ökonomischer Kompetenzen zwischen normativem Anspruch und empirischer Rationalität—am Beispiel der Schweizer Sekundarstufe II [The promotion of economic competencies between a normative claim and empirical rationality]. Empirische Pädagogik 29:10–34Google Scholar
- Eberle F, Brüggenbrock Ch (2013) Bildung am gymnasium [Education at grammar school]. EDK-Schriftenreihe “Studien+Berichte”. Schweizerische Konferenz der kantonalen Erziehungsdirektoren. BernGoogle Scholar
- Eberle F, Schumann S, Kaufmann E, Jüttler A, Ackermann N (2016) Modellierung und Messung wirtschaftsbürgerlicher Kompetenz von kaufmännischen Auszubildenden in der Schweiz und in Deutschland [Modelling and measuring civic-economical competence in commercial apprenticeship in Switzerland and Germany]. In: Beck K, Landenberger M, Oser F (eds) Technologiebasierte Kompetenzmessung in der beruflichen Bildung – Ergebnisse aus der BMBF-Förderinitiative ASCOT. Reihe Wirtschaft – Beruf – Ethik, Bd. 32 (S. 93–117). W. Bertelsmann, BielefeldGoogle Scholar
- Federal Institute for Vocational Education and Training (2016) Datenreport zum Berufsbildungsbericht 2016 [Data report on the German VET-report 2016]. Federal Institute for Vocational Education and Training, BonnGoogle Scholar
- Frey A, Hartig J, Rupp AA (2009) An NCME instructional module on booklet designs in large-scale assessments of student achievement: theory and practice. Educ Meas Issues Pract 28:39–53View ArticleGoogle Scholar
- Hambleton RK (2001) The next generation of the ITC test translation and adaptation guidelines. Eur J Psychol Assess 17:164–172View ArticleGoogle Scholar
- Hambleton RK, Merenda P, Spielberger C (2005) Adapting educational and psychological tests for cross cultural assessment. Lawrence Erlbaum, MahwahGoogle Scholar
- Jüttler A, Schumann S (2016) Effects of students socio-cultural background on economic competencies at the end of upper secondary education. In: Wuttke E, Seifried J, Schumann S (eds) Economic competence and financial literacy of young adults: status and challenges. Barbara Budrich, OpladenGoogle Scholar
- Kaufmann E, Reips U-D, Maag Merki K (2016) Avoiding methodological biases in meta-analysis. Z Psychol 224:157–167Google Scholar
- Klieme E, Maag Merki K, Hartig J (2007) Kompetenzbegriff und Bedeutung von Kompetenzen im Bildungswesen [Competence concept and importance of competencies in education]. In: Hartig J (ed) Möglichkeiten und Voraussetzungen technologiebasierter Kompetenzdiagnostik. BMBF, Berlin, pp 5–15Google Scholar
- Klotz VK, Winther E (2015) Kaufmaennische Kompetenz im Ausbildungsverlauf—Befunde einer pseudolaengsschnittlichen Studie. Empirische Pädagogik 29(1):61–83Google Scholar
- KMK (2002) Rahmenlehrplan für den Ausbildungsberuf Industriekaufmann/Industriekauffrau [Curriculum-framework for the apprenticeship-program “industrial clerk”]. Beschluss der Kultusministerkonferenz Vom 14(06):2002Google Scholar
- KMK (2004) Rahmenlehrplan für den Ausbildungsberuf Kaufmann für Spedition und Logistikdienstleistung/Kauffrau für Spedition und Logistikdienstleistung [Curriculum-framework for the apprenticeship-program “logistic clerk”]. Beschluss der Kultusministerkonferenz Vom 30(04):2004Google Scholar
- Kotte D, Lietz P (1998) Welche Faktoren beeinflussen die Leistung in Wirtschaftskunde? [What factors are affecting the performance in economics?] Zeitschrift Berufs- und Wirtschaftspädagogik 94:421–434Google Scholar
- Kotte D, Witt R (1995) Chance and challange: assessing economic literacy. In: Bos W, Lehmann R (eds) Reflections on educational achievement. Papers in Honor of T Neville Postlethwait. Waxmann, Münster, pp 159–168Google Scholar
- Lehmann R, Seeber S (2007) ULME III. Untersuchung von Leistungen, motivation und Einstellungen der Schülerinnen und Schüler in den Abschlussklassen der Berufsschulen [ULME III. Study of the achievement, motivation and attitudes of learners in the final year at vocational schools]. Behörde für Bildung und Sport, HamburgGoogle Scholar
- Liedtke M, Seeber S (2015) Modellgeltungstests und Einflussfaktoren auf Differentielle Item Funktionen in einem computergestützten Assessment für kaufmännische Berufe [Model validity tests and factors affecting differential item functions in a computer-based assessment for commercial professions]. Zeitschrift Berufs- und Wirtschaftspädagogik 111:242–267Google Scholar
- Masters GN (1982) A Rasch model for partial credit scoring. Psychometrika 47:149–174View ArticleGoogle Scholar
- Maurer M, Gonon P (2013) Herausforderungen für die Berufsbildung in der Schweiz: Bestandsaufnahme und Perspektiven Challenges for vocational training in Switzerland: stocktaking and perspectives. Hep, BernGoogle Scholar
- Ministry of School, Youth and Sport Baden-Wurttemberg (2016a) Bildungsplan für die Berufsschule. Industriekaufmann/Industriekauffrau. 1., 2. und 3. Ausbildungsjahr [Curriculum of the vocational school. Industrial clerk. First, second and third training year]. Ministry of School, Youth and Sport Baden-Wurttemberg, StuttgartGoogle Scholar
- Ministry of School, Youth and Sport Baden-Wurttemberg (2016b) Bildungsplan für die Berufsschule. Kaufmann für Spedition und Logistikdienstleistung/Kauffrau für Spedition und Logistikdienstleistung. 1., 2. und 3. Ausbildungsjahr [Curriculum of the vocational school. Logistics clerk. First, second and third training year]. Ministry of School, Youth and Sport Baden-Wurttemberg, StuttgartGoogle Scholar
- National Center for Education Statistics (2013) The nation’s report card: economics 2012. National Assessment of Educational Progress at Grade 12. National Center for Education Statistics, Washington, D.CGoogle Scholar
- Osterlind SJ, Everson HT (2009) Differential item functioning. Sage, Thousand OaksView ArticleGoogle Scholar
- Print M, Lange D (2013) Civic education and competences for engaging citizens in democracies. Sense, RotterdamView ArticleGoogle Scholar
- Rasch G (1960) Probabilistic models for some intelligence and attainment tests. Nissen and Lydecke, KopenhagenGoogle Scholar
- Scheuneman JD, Gerritz K (1990) Using differential item functioning procedures to explore sources of item difficulty and group performance characteristics. J Educ Meas 27:109–131View ArticleGoogle Scholar
- Schmidt S, Brückner S, Zlatkin-Troitschanskaia O, Förster M (2015) Das wirtschaftswissenschaftliche Wissen in der Hochschulbildung—eine Analyse der messinvarianten Erfassung finanzwirtschaftlichen Fachwissens bei Studierenden [Students’ knowledge of business and economics in higher education]. Empirische Pädagogik 29:106–124Google Scholar
- Schulz W, Ainley J, Fraillon J, Losito B, Agrusti G (2016) IEA international civic and citizenship education study 2016: assessment framework. Springer International, BerlinView ArticleGoogle Scholar
- Schumann S, Eberle F (2014) Ökonomische Kompetenzen von Lernenden am Ende der Sekundarstufe II [Economic Competencies at the end of upper secondary education]. Z Erziehungswissenschaft 17:103–126View ArticleGoogle Scholar
- Seeber S (2008) Ansätze zur Modellierung berulicher Fachkompetenz in kaufmännischen Ausbildungsberufen [Towards the modeling of occupational competencies in commercial apprenticeship programs]. Zeitschrift Berufs- und Wirtschaftspädagogik 104:74–97Google Scholar
- Seeber S, Schumann S, Nickolaus R (2015) Ökonomische Kompetenzen: Konzeptuelle grundlagen und Empirische Befunde [Economic competencies: concepts and empirical findings]. In: Weißeno G, Schelle C (eds) Empirische Forschung in gesellschaftswissenschaftlichen Fachdidaktiken—Ergebnisse und Perspektiven. Springer, Heidelberg/Berlin, pp 169–184Google Scholar
- Soper JC (1979) The test of economic literacy: discussion guide and rationale. Joint Council of Economic Education, New YorkGoogle Scholar
- Spoden C, Frey A, Bernhardt R, Seeber S, Balkenhol A, Ziegler B (2015) Differenzielle Domänen- und Itemeffekte zwischen Ausbildungsberufen bei der Erfassung allgemeiner schulischer Kompetenzen von Berufsschülerinnen und Berufsschülern [Differential domain and item effects between professions in measuring basic knowledge competence of vocational education trainees]. Zeitschrift Berufs- und Wirtschaftspädagogik 111:168–188Google Scholar
- State Secretariat for Education, Research und Innovation (SERI) (2011) Bildungsverordnung für Kauffrau/Kaufmann EFZ [Education regulations for clerks]. State Secretariat for Education, Research und Innovation, BernGoogle Scholar
- State Secretariat for Education, Research and Innovation (SERI) (2016) Vocational and professional education and training in Switzerland 2016—facts and Figures. State Secretariat for Education, Research and Innovation, BernGoogle Scholar
- Swiss Conference of Commercial Training and Examination Branches (2011a) Bildungsplan Kauffrau/Kaufmann EFZ vom 26. September 2011 für die für die betrieblich organisierte GrundbildungGoogle Scholar
- Swiss Conference of Commercial Training and Examination Branches (2011b) Bildungsplan Kauffrau/Kaufmann EFZ vom 26. September 2011. Teil A: Handlungskompetenzen. Leistungszielkatalog Unterrichtsbereich “Wirtschaft und Gesellschaft W&G—E-Profil”Google Scholar
- Tramm T, Seeber S (2006) Überlegungen und Analysen zur Berufsspezifität kaufmännischer kompetenz. In: Minnameier G, Wutttke E (eds) Berufs- und wirtschaftspädagogische Grundlagenforschung. Lehr-Lern-Prozesse und Kompetenzdiagnostik. Peter Lang Publishing, Frankfurt, pp S273–S288Google Scholar
- Walstad WB (1994) An international perspective on economic education. Kluwer Academic Publishers, BostonView ArticleGoogle Scholar
- Walstad WB, Rebeck K, Butters RB (2013) Test of economic literacy, 4th edn. National Council on Economic Education, New YorkGoogle Scholar
- Warm TA (1989) Weighted likelihood estimation of ability in item response theory. Psychometrika 54:427–450View ArticleGoogle Scholar
- Weinert FE (2001) Concept of competence: a conceptual clarification. In: Rychen DS (ed) Defining and selecting key competencies. Hogrefe & Huber Publishers, Kirkland, pp 45–65Google Scholar
- Wettstein E, Schmid E, Gonon P (2014) Berufsbildung in der Schweiz [Vocational education and training in Switzerland], 2nd edn. Hep, BernGoogle Scholar
- Winther E (2010) Kompetenzmessung in der beruflichen Bildung [Measuring competence in VET]. wbv, BielefeldGoogle Scholar
- Winther E, Achtenhagen F (2008) Kompetenzstrukturmodell für die kaufmännische Bildung. Adaptierbare Forschungslinien und Theoretische Ausgestaltung [Competence model for commercial training: adaptable research approaches and theoretical foundations]. Zeitschrift Berufs- und Wirtschaftspädagogik 104:511–538Google Scholar
- Wu ML, Adams RJ, Wilson MR (2007) ACER ConQuest Version 2.0. Generalised item response modelling software. Acer Press, VictoriaGoogle Scholar
- Wuttke E, Seifried J, Schumann S (2016) Economic competence and financial literacy of young adults: status and challenges. Barbara Budrich, OpladenView ArticleGoogle Scholar
- Zumbo BD (1999) A handbook on the theory and methods of differential item functioning (DIF). Logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Directorate of Human Resources Research and Evaluation. Department of National Defense, Ottawa, ONGoogle Scholar