.png)
.png)
Email this article 
Rank analysis in evaluating the validity of olympiad tasks
https://doi.org/10.20913/2618-7515-2020-4-14
Abstract
The rank analysis (cenological approach) based on a strict mathematical apparatus allows diagnosing the state of educational systems and processes on a scientific objective basis. The rank analysis base is applying the law of hyperbolic rank distribution of objects in systems-cenoses, which is a refined Pareto law 20/80 (Pareto-Kudrin law). Using of rank analysis to evaluate the validity of the olympiad tasks of the all-Russian Multidisciplinary Engineering Olympiad «Star», the authors demonstrate the necessity of implementing rank analysis in the practice of education quality management. They show that this law is important and appropriate to apply in the education quality management. Optimization of educational systems and processes using rank analysis consists in eliminating anomalous deviations from the hyperbolic law, which is possible only with graphical visualization of the rank distribution and its approximation. The rank distribution graph provides visibility and insight into the nature of the rank decrease. Shortcomings in the content of olympiad tasks (as well as tests), leading to a deterioration of their validity and reliability, are shown the form of distortions of the hyperbolic graph (humps, depressions, tails, degeneration of the hyperbola into other dependencies). The rank analysis allows identifying objectively several levels of validity of olympiad or test tasks carrying on a scientific basis. The paper demonstrates graphs of run distributions illustrating examples of high (natural science) and below the average (history) validity of olympiad tasks. Educational systems are cenoses, ranking objects in them are students, classes, schools, etc., and their ranked parameters are academic performance, rating in points, performance indicators, etc. Using simple mathematical tools of rank analysis and computer software bring the technologies to assess the education quality to a higher level meeting the challenges of the time.
About the Authors
R. V. GurinaRussian Federation
Rose V. Gurina – Doctor of Pedagogical Sciences, Associate Professor, Professor, Department of Physical Methods in Applied Research, Faculty of Engineering and Physics of High Technologies
42 L. Tolstoy Str., Ulyanovsk, 432000, Russian Federation
E. V. Morozova
Russian Federation
Ekaterina V. Morozova – Сandidate of Physical-Mathematical Science, Department of Physical Methods in Applied Research, Faculty of Engineering and Physics of High Technologies
42 L. Tolstoy Str., Ulyanovsk, 432000, Russian Federation
V. V. Kosheva
Russian Federation
Kosheva V. Vilena – postgraduate student, Department of Physical Materials Science, Faculty of Engineering and Physics of High Technologies
42 L. Tolstoy Str., Ulyanovsk, 432000, Russian Federation
References
1. Gurina R. V., Evseev D. A. Rank analysis, or cenological approach, in the methodology of applied research. Ulyanovsk. UlSU, 2018, 287 p. (In Russ.)
2. Gurina R. V. Rank analysis of educational systems (cenological approach): methodological recommendations for educators. Moscow, Technetika, 2006, 40 p. (In Russ.)
3. Gurina R. V. Cenological research of pedagogical educational systems. Polzunovsky Bulletin, 2004, no. 3, pp. 133–138. (In Russ.)
4. Gurina R. V. Rank analysis method and the law of diversity in pedagogy. Pedagogical Journal of Bashkortostan, 2013, no. 3/4, pp. 111–122. (In Russ.)
5. Gurina R. V., Bedash V. V. Rank analysis method in education quality management. International Journal of Experimental Education, 2014, no. 7, pp. 108–111. (In Russ.)
6. Gurina R. V., Bedash V. V. Laws of the social sphere. Eurasian Union of Scientists, 2014, no. 8, pp. 16–20. (In Russ.)
7. Gurina R. V., Morozova E. V. Cenology is the doctrine of cenoses of different nature. Educational Technologies, 2020, no. 1, pp. 40–49. (In Russ.)
8. Koch R. Pareto's law or 80/20 principle. General and Applied Cenology, 2007, no. 4, pp. 76–79. (In Russ.)
9. Lyubischev A. A. Rise and fall of civilizations: (a preliminary sketch). Ulyanovsk, Samara, 1993, 131 p. (In Russ.)
Supplementary files
For citation: Gurina R.V., Morozova E.V., Kosheva V.V. Rank analysis in evaluating the validity of olympiad tasks. Professional education in the modern world. 2020;10(4):4302-4309. https://doi.org/10.20913/2618-7515-2020-4-14
Refbacks
- There are currently no refbacks.
