Table 3 Authenticity of the ECON 2022 assessment: expert ratings and self-ratings
Item | Expert rating (ER) | Self rating (ExpR) | Difference ER–ExpR Total | Difference | |||||
|---|---|---|---|---|---|---|---|---|---|
| Â | N | Min | Max | 1 (high) to 3 (low) M | 1 (high) to 3 (low) M | Economic expertise | School and teaching | Test developement | |
1_1 | 24 | 1 | 3 | 1.21 | 1.00 | − 0.08 | 0.90 | 0.82 | 0.70 |
1_2 | 25 | 1 | 3 | 1.48 | 2.00 | − 1.46 | − 0.45 | − 0.42 | − 0.40 |
1_3 | 24 | 1 | 3 | 1.50 | 2.00 | − 0.08 | 0.40 | 0.55 | 0.60 |
1_4 | 23 | 1 | 3 | 1.87 | 2.00 | 0.35 | 1.11 | 1.10 | 1.10 |
2_1 | 23 | 1 | 1 | 1.00 | 2.00 | − 0.13 | 1.00 | 1.00 | 1.00 |
2_2 | 25 | 1 | 2 | 1.44 | 1.04 | − 0.36 | 0.55 | 0.67 | 0.40 |
2_3 | 25 | 1 | 3 | 1.60 | 3.00 | − 0.96 | − 0.27 | − 0.33 | − 0.90 |
3_1 | 25 | 1 | 3 | 1.76 | 1.00 | − 0.40 | − 0.55 | − 0.42 | − 1.20 |
3_2 | 24 | 1 | 3 | 2.13 | 2.00 | − 1.09 | − 0.30 | 0.09 | − 0.20 |
3_3 | 25 | 1 | 2 | 1.36 | 2.00 | − 0.24 | − 0.36 | − 0.25 | − 0.50 |
3_4 | 25 | 1 | 3 | 2.08 | 3.00 | − 0.52 | 0.00 | 0.25 | − 0.50 |
3_5 | 25 | 1 | 3 | 1.88 | 2.00 | − 0.16 | − 0.82 | − 0.75 | − 1.00 |
4_1 | 25 | 1 | 3 | 2.16 | 2.00 | − 0.04 | 0.00 | − 0.08 | − 0.30 |
4_2 | 25 | 1 | 3 | 2.16 | 2.00 | − 0.48 | − 0.09 | − 0.08 | − 0.20 |
4_3 | 25 | 1 | 3 | 2.12 | 2.00 | − 0.12 | − 0.09 | − 0.25 | − 0.10 |
4_4 | 23 | 1 | 3 | 2.30 | 3.00 | 0.46 | 0.70 | 0.70 | 0.60 |
4_5 | 25 | 1 | 3 | 2.04 | 2.00 | − 0.42 | − 1.18 | − 1.00 | − 0.90 |
4_6 | 25 | 1 | 3 | 2.12 | 3.00 | − 0.71 | − 0.18 | − 0.08 | 0.00 |
5_1 | 24 | 1 | 3 | 1.29 | 2.00 | − 0.88 | − 0.20 | − 0.17 | − 0.33 |
5_2 | 25 | 1 | 3 | 1.16 | 3.00 | 0.08 | 0.91 | 1.00 | 0.70 |
5_3 | 25 | 1 | 3 | 1.24 | 3.00 | 0.08 | 0.82 | 1.00 | 0.80 |
5_4 | 25 | 1 | 2 | 1.16 | 1.00 | − 0.32 | 0.82 | 0.83 | 0.80 |
6_1 | 25 | 1 | 1 | 1.00 | 1.00 | 0.04 | 1.00 | 1.00 | 1.00 |
6_2 | 24 | 1 | 2 | 1.25 | 3.00 | 0.08 | 0.82 | 0.83 | 0.70 |
6_3 | 25 | 1 | 3 | 1.64 | 2.00 | − 1.20 | 0.55 | 0.58 | 0.10 |
6_4 | 24 | 1 | 2 | 1.13 | 1.00 | 0.08 | 1.00 | 0.82 | 0.90 |
6_5 | 25 | 1 | 3 | 1.68 | 1.00 | − 0.17 | 0.45 | 0.17 | 0.50 |
6_6 | 25 | 1 | 3 | 1.52 | 2.00 | − 0.21 | − 0.64 | − 0.67 | − 0.40 |
7_1 | 25 | 1 | 3 | 1.36 | 3.00 | 0.48 | 0.36 | 0.67 | 0.40 |
7_2 | 24 | 1 | 3 | 1.71 | 3.00 | − 0.64 | − 0.70 | − 0.64 | − 0.90 |
7_3 | 24 | 1 | 3 | 1.38 | 2.00 | − 0.16 | 0.80 | 0.82 | 0.50 |
7_4 | 23 | 1 | 2 | 1.04 | 1.00 | − 0.40 | 0.00 | − 0.10 | 0.00 |
7_5 | 25 | 1 | 3 | 1.28 | 2.00 | − 0.16 | 0.73 | 0.92 | 0.40 |
8_1 | 25 | 1 | 3 | 2.48 | 3.00 | − 0.68 | − 0.64 | − 0.50 | − 0.30 |
8_2 | 25 | 2 | 3 | 2.56 | 3.00 | 0.36 | 0.36 | 0.33 | 0.60 |