Exploring shared control in upper primary school learners working with an adaptive learning technology
Main Article Content
Abstract
This study explored how learners engage in shared control in math in Adaptive Learning Technologies (ALT). In shared control, learners adjust task difficulty (easy, medium, or hard), while the ALT selects tasks based on performance. These adjustments to task difficulty influence the probability of solving the next task correctly. This study aimed to understand (1) differences in how learners use shared control and (2) how this relates to general math ability, regulation of practice behaviour (number of finished problems and accuracy), and learning outcomes. In this exploratory study, 98 grade 5 learners practiced three math topics using an ALT combined with an app, including personalised visualisations of learners’ real-time progress on the math topics and shared control selection options. Results showed four clusters reflecting differences in learners’ use of shared control in quantity and direction of task difficulty changes: learners making no changes (cluster 1), learners making some changes preferring hard difficulty (cluster 2) or easy difficulty (cluster 3), and learners who frequently changed across all task difficulties (cluster 4). Shared control was related to general math ability and influenced learners’ regulation of practice behaviour. Although a comparison with the ALT control was absent, learners seem to choose task difficulties in line with their needs and benefit from these choices, resulting in learning gain. From a self-regulated learning perspective, this indicated how learners engaged in regulation and were aware of their needs.
Article Details
FLR adopts the Attribution-NonCommercial-NoDerivs Creative Common License (BY-NC-ND). That is, Copyright for articles published in this journal is retained by the authors with, however, first publication rights granted to the journal. By virtue of their appearance in this open access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.
References
Alboukadel, K., & Mundt, F. (2020). factoextra: Extract and visualise the results of multivariate data analyses (1.0.7). https://cran.r-project.org/package=factoextra
Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2016). Instruction based on adaptive learning technologies. In R. E. Mayer & P. Alexander (Eds.), Handbook of Research on Learning and Instruction (pp. 522–560). Routledge.
Baars, M., Wijnia, L., de Bruin, A., & Paas, F. (2020). The relation between students’ effort and monitoring judgments during learning: A meta-analysis. Educational Psychology Review, 32, 979-1002. https://doi.org/10.1007/s10648-020-09569-3
Bannert, M., Reimann, P., & Sonnenberg, C. (2014). Process mining techniques for analysing patterns and strategies in students’ self-regulated learning. Metacognition and learning, 9, 161-185. https://doi.org/10.1007/s11409-013-9107-6
Bjork, E. L., & Bjork, R. A. (2014). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In M. A. Gernsbacher & J. Pomerantz (Eds.), Psychology and the Real World: Essays Illustrating Fundamental Contributions to Society (pp. 59–64). Worth Publishing.
Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe & A. Shimamura (Eds.), Metacognition: Knowing about Knowing (pp. 185–205). MIT Press. https://doi.org/10.7551/mitpress/4561.003.0011
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual Review of Psychology, 64, 417–444. https://doi.org/10.1146/annurev-psych-113011-143823
Brinkhuis, M., & Maris, G. (2019). Tracking ability: Defining trackers for measuring educational progress. In Theoretical and Practical Advances in computer-based Educational Measurement. Springer Open. https://doi.org/10.1007/978-3-030-18480-3_8
Brod, G., Kucirkova, N., Shepherd, J., Jolles, D., & Molenaar, I. (2023). Agency in educational technology: Interdisciplinary perspectives and implications for learning design. Educational Psychology Review, 1–23. https://doi.org/10.1007/s10648-023-09749-x
Carpenter, S. K., Endres, T., & Hui, L. (2020). Students’ use of retrieval in self-regulated learning : Implications for monitoring and regulating effortful learning experiences. Educational Psychology Review, 32, 1029–1054. https://doi.org/10.1007/s10648-020-09562-w
Danhof, W., Bandstra, P., & Hofstetter, W. (2015). Rekendrempels nemen. Volgens Bartjens, 34(3), 4-7.
Dignath, C., Buettner, G., & Langfeldt, H. P. (2008). How can primary school students learn self-regulated learning strategies most effectively? A meta-analysis on self-regulation training programmes. Educational Research Review, 3(2), 101–129. https://doi.org/10.1016/j.edurev.2008.02.003
Dijkstra, S. H. E., Hinne, M., Segers, E., & Molenaar, I. (2023). Clustering children’s learning behaviour to identify self-regulated learning support needs. Computers in Human Behavior, 145, 107754. https://doi.org/10.1016/j.chb.2023.107754
Faber, J. M., Luyten, H., & Visscher, A. J. (2017). The effects of a digital formative assessment tool on mathematics achievement and student motivation: Results of a randomised experiment. Computers and Education, 106, 83–96. https://doi.org/10.1016/j.compedu.2016.12.001
Félix, V. B., & Menezes, A. F. B. (2018). Comparisons of ten corrections methods for t-test in multiple comparisons via Monte Carlo study. Electronic Journal of Applied Statistical Analysis, 11(1), 74–91. https://doi.org/10.1285/I20705948V11N1P74
Foster, N. L., Was, C. A., Dunlosky, J., & Isaacson, R. M. (2017). Even after thirteen class exams, students are still overconfident: The role of memory for past exam performance in student predictions. Metacognition and Learning, 12, 1-19. https://doi.org/10.1007/s11409-016-9158-6
Greene, J. A., & Azevedo, R. (2007). Adolescents’ use of self-regulatory processes and their relation to qualitative mental model shifts while using hypermedia. Journal of Educational Computing Research, 36(2), 125–148. https://doi.org/10.2190/G7M1-2734-3JRR-8033
Greene, J. A., & Azevedo, R. (2010). The measurement of learners’ self-regulated cognitive and metacognitive processes while using computer-based learning environments. Educational Psychologist, 45, 203–209. https://doi.org/10.1080/00461520.2010.515935
Hu, J., & Gao, X. A. (2017). Using think-aloud protocol in self-regulated reading research. Educational Research Review, 22, 181-193. https://doi.org/10.1016/j.edurev.2017.09.004
Jansen, B. R. J., Hofman, A. D., Savi, A., Visser, I., & van der Maas, H. L. J. (2016). Self-adapting the success rate when practicing math. Learning and Individual Differences, 51, 1–10. https://doi.org/10.1016/j.lindif.2016.08.027
Jansen, B. R. J., Louwerse, J., Straatemeier, M., Van der Ven, S. H. G., Klinkenberg, S., & Van der Maas, H. L. J. (2013). The influence of experiencing success in math on math anxiety, perceived math competence, and math performance. Learning and Individual Differences, 24, 190–197. https://doi.org/10.1016/j.lindif.2012.12.014
Kaskens, J., Segers, E., Goei, S. L., van Luit, J. E., & Verhoeven, L. (2020). Impact of Children's math self-concept, math self-efficacy, math anxiety, and teacher competencies on math development. Teaching and teacher education, 94, 103096. https://doi.org/10.1016/j.tate.2020.103096
Kassambra, A. (2023). rstatix: Pipe-friendly framework for basic statistical tests (0.7.2). https://cran.r-project.org/package=rstatix
Karssen, M., Krepel, A., Stronkhorst, E., Lourens, J. M. P., Bruck, S., van Kessel, M., & Saab, N. (2023). Monitor digitalisering funderend onderwijs: Onderzoeksrapport primair onderwijs MYRA 2023. Kohnstamm Instituut.
Kinnebrew, J. S., Segedy, J. R., & Biswas, G. (2014). Analysing the temporal evolution of students’ behaviors in open-ended learning environments. Metacognition and learning, 9, 187-215. https://doi.org/10.1007/s11409-014-9112-4
Klinkenberg, S., Straatemeier, M., & Van Der Maas, H. L. J. (2011). Computer adaptive practice of maths ability using a new item response model for on the fly ability and difficulty estimation. Computers and Education, 57(2), 1813–1824. https://doi.org/10.1016/j.compedu.2011.02.003
Knoop‐van Campen, C. A. N., van der Graaf, J., Horvers, A., Kooi, R., Dijkstra, R., & Molenaar, I. (2024). Enacting control with student dashboards: The role of motivation. Journal of Computer Assisted Learning, 1-17. https://doi.org/10.1111/jcal.12936
Kodinariya, T. M., & Makwana, P. R. (2013). Review on determining of cluster in K-means clustering. International Journal of Advance Research in Computer Science and Management Studies, 1(6), 90–95. https://www.researchgate.net/publication/313554124
Kostons, D., van Gog, T., & Paas, F. (2010). Self-assessment and task selection in learner-controlled instruction: Differences between effective and ineffective learners. Computers and Education, 54(4), 932–940. https://doi.org/10.1016/j.compedu.2009.09.025
Kostons, D., Van Gog, T., & Paas, F. (2012). Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning. Learning and instruction, 22(2), 121-132. https://doi.org/10.1016/j.learninstruc.2011.08.004
Lawrence, M. A. (2016). ez: Easy analysis and visualisation of factorial experiments (4.4-0). https://cran.r-project.org/package=ez
Locke, E. A., & Latham, G. P. (1990). A theory of goal setting & task performance. Prentice-Hall, Inc.
Maechler, M., Rousseeuw, P., Struyf, A., Hubert, M., & Hornik, K. (2022). cluster: Cluster analysis basics and extensions (2.1.4). https://cran.r-project.org/package=cluster
McGarth, M. C. (2011). Grade equivalents. In S. Goldstein & J. A. Naglieri (Eds.), Encyclopedia of child behavior and development. Springer. https://doi.org/10.1007/978-0-387-79061-9_1271
Molenaar, I., Knoop-Van Campen, C. A. N., & Hasselman, F. (2017). The effects of a learning analytics empowered technology on students' arithmetic skill development. ACM International Conference Proceeding Series, 614–615. https://doi.org/10.1145/3027385.3029488
Molenaar, I., Horvers, A., and Dijkstra, R. (2019). Young learners’ regulation of practice behavior in adaptive learning technologies. Frontiers in Psychology, 10, 2792. doi: 10.3389/fpsyg.2019.02792
Molenaar, I., Horvers, A., Dijkstra, R., & Baker, R. S. (2020). Personalised visualisations to promote young learners' SRL: The Learning Path App. ACM International Conference Proceeding Series, 330–339. https://doi.org/10.1145/3375462.3375465
Molenaar, I. (2022). The concept of hybrid human-AI regulation: Exemplifying how to support young learners' self-regulated learning. Computers and Education: Artificial Intelligence, 3, 100070. https://doi.org/10.1016/j.caeai.2022.100070
Morgan, G. B. (2015). Mixed mode latent class analysis: An examination of fit index performance for classification. Structural Equation Modeling, 22(1), 76–86. https://doi.org/10.1080/10705511.2014.935751
Nelson, T. O. (1990). Metamemory: A theoretical framework and new findings. Psychology of Learning and Motivation - Advances in Research and Theory, 26, 125–173. https://doi.org/10.1016/S0079-7421(08)60053-5
Ogle, D. H., Doll, J. C., Powell Wheeler, A., & Dinno, A. (2023). FSA: Simple fisheries stock assessment methods (0.9.4). https://cran.r-project.org/package=FSA
Özdemir, D., & Isiksal Bostan, M. (2021). A Design Based Study: Characteristics of Differentiated Tasks for Mathematically Gifted Students. European Journal of Science and Mathematics Education, 9(3), 125-144. https://doi.org/10.30935/scimath/10995
Panadero, E. (2017). A Review of Self-regulated Learning: Six Models and Four Directions for Research. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00422
Papoušek, J., & Pelánek, R. (2017, July). Should we give learners control over item difficulty?. In Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization (pp. 299-303). https://doi.org/10.1145/3099023.3099080
Plass, J. L., & Pawar, S. (2020). Toward a taxonomy of adaptivity for learning. Journal of Research on Technology in Education, 52(3), 275–300. https://doi.org/10.1080/15391523.2020.1719943
Rusticus, S. A., & Lovato, C. Y. (2014). Impact of sample size and variability on the power and type I error rates of equivalence tests: A simulation study. Practical Assessment, Research and Evaluation, 19(11), 1–10. https://doi.org/10.7275/4s9m-4e81
Schunk, D. H. (1990). Goal Setting and Self-Efficacy During Self-Regulated Learning. Educational Psychologist, 25(1), 71–86. https://doi.org/10.1207/s15326985ep2501_6
Seufert, T. (2018). The interplay between self-regulation in learning and cognitive load. Educational Research Review, 24, 116-129. https://doi.org/10.1016/j.edurev.2018.03.004
Smith, C. E., & Cribbie, R. (2021). Factorial ANOVA with unbalanced data: A fresh look at the types of sums of squares. Journal of Data Science, 12(3), 385–404. https://doi.org/10.6339/jds.201407_12(3).0001
Team, R. C. (2023). R: A language and environment for statistical computing (4.2.3). R Foundation for Statistical Computing. https://www.r-project.org/
Teasley, S. D. (2017). Student facing dashboards: One size fits all? Technology, Knowledge and Learning, 22(3), 377–384. https://doi.org/10.1007/s10758-017-9314-3
Townsend, M., Shilts, M., Rios, K. D., Leavens, L., & Panarella, K. (2019). NP13 Designing Retrospective Evaluation Tools with Low-Literacy Adults: Development Process. Journal of Nutrition Education and Behavior, 51(7), S15-S16. https://doi.org/10.1016/j.jneb.2019.05.337
Usher, E. L., & Schunk, D. H. (2018). Social cognitive theoretical perspective of self-regulation. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (pp. 19–35). Routledge/Taylor & Francis Group.
van Buuren, S., & Groothuis-Oudshoorn, K. (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1–67. https://doi.org/10.18637/jss.v045.i03
Van Der Heyden, A. M., Broussard, C., & Burns, M. K. (2021). Classification agreement for gated screening in mathematics: Subskill mastery measurement and classwide intervention. Assessment for Effective Intervention, 46(4), 270-280. https://doi.org/10.1177/1534508419882484
Van Gog, T., & Paas, F. (2008). Instructional efficiency: Revisiting the original construct in educational research. Educational psychologist, 43(1), 16-26. https://doi.org/10.1080/00461520701756248
Verbert, K., Govaerts, S., Duval, E., Parra, G., & Klerkx, J. (2014). Learning dashboards : an overview and future research opportunities. Pers Ubiquit Comput, 18, 1499–1514. https://doi.org/10.1007/s00779-013-0751-2
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (Vol. 86). Harvard university press.
Wilcox, J. (2023). Human Judgment: How Accurate Is It, and How Can It Get Better? Springer Nature.
Winne, P. H. (2017). Learning analytics for self-regulated learning. In C. Lang, G. Siemens, A. Wise, & D. Gasevic (Eds.), Handbook of Learning Analytics (pp. 241–249). https://doi.org/10.18608/hla17.021
Winne, P. H. (2018). Theorising and researching levels of processing in self-regulated learning. British Journal of Educational Psychology, 88(1), 9–20. https://doi.org/10.1111/bjep.12173
Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. Graesser (Eds.), Metacognition in Educational Theory and Practice (pp. 277–304). Lawrence Erlbaum.
Ye, Z., Jiang, L., Li, Y., Wang, Z., Zhang, G., & Chen, H. (2022). Analysis of Differences in Self-Regulated Learning Behavior Patterns of Online Learners. Electronics, 11(23), 4013. https://doi.org/10.3390/electronics11234013