annotations; reflection amplifiers; students set the test; widgets; split screen teaching; Claxton; note-taking; reflective practioner; Boch & Piolat
Abstract :
[en] In a controlled experiment on the effects of frequent and local digital annotations, 137 volunteers covered an online course under three possible conditions: no/free/question-based digital annotations. Results show no difference in performance between groups when annotation behaviour is considered in isolation. However, analyses conducted within treatments provide indications of a positive impact on performance when annotation rates are taken into consideration, and coupled with other enactments tracked in the course. Combined in engagement profiles (Learning DNAs), these enactments suggest that what makes active learning efficient might be an ongoing crisscrossing between a firstorder learning activity (the study of the course) and a series of second order activities, such as making notes. Students who manage to coordinate these activities at a higher rate perform better. This observation opens a line of reasoning about what determines the quality of a mental engagement in a learning task, in terms of balance and rotation of cognitive and metacognitive operations.
Disciplines :
Education & instruction
Author, co-author :
Verpoorten, Dominique ; Université de Liège > IFRES : Pédagogie de l'Enseignement supérieur
Westera, Wim
Specht, Marcus
Language :
English
Title :
Effects of isolated versus combined learning enactments in an online course
Alternative titles :
[en] Etude comparative d'actions d'apprentissage pratiquées en isolation et en combinaison
Publication date :
15 May 2017
Journal title :
International Journal of Technology Enhanced Learning
ISSN :
1753-5255
eISSN :
1753-5263
Publisher :
Inderscience Publishers, Olney, United Kingdom
Special issue title :
Special Issue "Awareness and Reflection in Technology Enhanced Learning"
Reference in APA: Verpoorten, D., Westera, W., & Specht, M. (2017). Effects of isolated versus combined learning enactments in an online course. International Journal of Technology Enhanced Learning (IJTEL), 9(2), 169–185
Baird, J.R., Mitchell, I.J., (1986) Improving the Quality of Teaching and Learning: An Australian Case Study - The PEEL Project, , Report, Monash University, Melbourne
Bannert, M., Effects of reflection prompts when learning with hypermedia (2006) Journal of Educational Computing Research, 35 (4), pp. 359-375
Bannert, M., Hildebrand, M., Mengelkamp, C., Effects of a metacognitive support device in learning environments (2009) Computers in Human Behavior, 25 (4), pp. 829-835
Bijker, M., Van Der-Klink, M., Boshuizen, H., Modeling self-efficacy, self-regulation, self-directed learning and career processes of adult professionals and relations with learning outcomes and labour market success (2010) 5th EARLI-SIG14 Learning and Professional Development, , Munich, Germany
Bixler, B.A., (2008) The Effects of Scaffolding Student's Problem-Solving Process Via Question Prompts on Problem Solving and Intrinsic Motivation in An Online Learning Environment, , PhD dissertation, Pennsylvania State University
Boch, F., Piolat, A., Note taking and learning: A summary of research (2005) The WAC Journal, 16, pp. 101-113
Boud, D., Keogh, R., Walker, D., (1985) Reflection, Turning Experience into Learning, , Kogan Page, London
Butler, D., Winne, P., Feedback and self-regulated learning: A theoretical synthesis (1995) Review of Educational Research, 65 (3), pp. 245-281
Claxton, G., Expanding the capacity to learn: A new end for education? (2006) Opening Keynote Address Prasented at the British Educational Research Association Annual Conference, , University of Warwick, UK
(2005) Creating Learning Materials for Open and Distance Learning - A Handbook for Authors and Instructional Designers, , Commonwealth of Learning, Vancouver
Corliss, S.B., (2006) The Effects of Reflective Prompts and Collaborative Learning in Hypermedia Problem-Based Learning Environments on Problem Solving and Metacognitive Skills, , PhD dissertation, University of Texas at Austin
Crawford, C., Some experimental studies of the results of college note-taking (1925) Journal of Educational Research, 12, pp. 379-386
DeCoster, J., Iselin, A.-M.R., Gallucci, M., A conceptual and empirical examination of justifications for dichotomization (2009) Psychological Methods, 14 (4), pp. 349-366
Degani, A., Wiener, E.L., (1990) The Human Factors of Flight Deck Checklists: The Normal Checklist, , (NASA Contractor Report 177549), NASA Ames Research Center, Moffett Field, CA
Dillon, A., Reading from paper versus screens: A critical review of the empirical literature (1992) Ergonomics, 35 (10), pp. 1297-1326
Eshuis, J., Goltstein, G., (2007) Seks en de Evolutie, , http://www.ou.nl/eCache/DEF/2/22/850.html, Open Universiteit Nederland, Heerlen. Retrieved from
Fiorella, L., Vogel-Walcutt, J., Metacognitive prompting as a generalizable instructional tool in simulation-based training (2011) Proceedings of the 55th Human Factors and Ergonomics Society Annual Meeting, 55 (1), pp. 565-569
Gama, C., Metacognition in interactive learning environments: The reflection assistant model (2004) Proceedings of the 7th International Conference on Intelligent Tutoring Systems, pp. 668-677. , Lester, J.C., Vicario, R.M. and Paraguaçu, F. (Eds.)
Glahn, C., (2009) Contextual Support of Social Engagement and Reflection on the Web, , https://www.ou.nl/Docs/Onderzoek/Promoties/2009/Christian_Glahn_thesis.pdf, PhD dissertation, Open Universiteit, Heerlen, The Netherlands. Retrieved from
Glover, I., Xu, Z., Hardaker, G., Online annotation - research and practices (2007) Computers & Education, 49 (4), pp. 1308-1320
Hartley, J., Davies, I., Note-taking: A critical review (1978) Innovations in Education & Training International, 15 (3), pp. 207-224
Hattie, J., (2009) Visible Learning: A Synthesis of over 800 Meta-Analyses Relating to Achievement, , Routledge, London
Hinett, K., (2002) Improving Learning Through Reflection, , Higher Education Academy, York, UK
Hmelo-Silver, C., Duncan, R., Chinn, C., Scaffolding and achievement in problembased and inquiry learning: A response to kirschner, sweller, and clark (2006) (2007) Educational Psychologist, 42 (2), pp. 99-107
Hoffman, B., Spatariu, A., The influence of self-efficacy and metacognitive prompting on math problem-solving efficiency (2008) Contemporary Educational Psychology, 33 (4), pp. 875-893
Hwang, W.-Y., Chen, N.-S., Shadiev, R., Li, J.-S., Effects of reviewing annotations and homework solutions on math learning achievement (2011) British Journal of Educational Technology, 42 (6), pp. 1016-1028
Hwang, W.-Y., Hsu, G.-L., The effects of pre-reading and sharing mechanisms on learning with the use of annotations (2011) Turkish Online Journal of Educational Technology - TOJET, 10 (2), pp. 234-249. , http://files.eric.ed.gov/fulltext/EJ932242.pdf, Retrieved from
Hwang, W.-Y., Wang, C.-Y., Sharples, M., A study of multimedia annotation of webbased materials (2007) Computers and Education, 48 (4), pp. 680-699
Jackson, H., (2001) Marginalia: Readers Writing in Books, , Yale University Press, New Haven
Kam, M., Wang, J., Iles, A., Tse, E., Chiu, J., Glaser, D., Canny, J., Livenotes: A system for cooperative and augmented note-taking in lectures (2005) Conference on Human Factors in Computing Systems, , Portland, OR, USA
Kauffman, D.F., Ge, X., Xie, K., Chen, C.-H., Prompting in web-based environments: Supporting self-monitoring and problem solving skills in college students (2008) Journal of Educational Computing Research, 38 (2), pp. 115-137
Kawase, R., Papadakis, G., Herder, E., Nejdl, W., Creation and Use of Annotations in Different Usage Contexts, , (N.A.) L3S Research Center, Hannover
Kirschner, P., Sweller, J., Clark, R., Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching (2006) Educational Psychologist, 41 (2), pp. 75-86
Kramarski, B., Michalsky, T., Three metacognitive approaches to training pre-service teachers in different learning phases of technological pedagogical content knowledge (2009) Educational Research & Evaluation, 15 (5), pp. 465-485
Krause, U.-M., Stark, R., Reflection in example- and problem-based learning: Effects of reflection prompts, feedback and cooperative learning (2010) Evaluation & Research in Education, 23 (4), pp. 255-272
Logtenberg, A., Van Boxtel, C., Van Hout-Wolters, B., Stimulating situational interest and student questioning through three types of historical introductory texts (2011) European Journal of Psychology of Education, 26 (2), pp. 179-198
Makany, T., Kemp, J., Dror, I., Optimising the use of note-taking as an external cognitive aid for increasing learning (2009) British Journal of Educational Technology, 40 (4), pp. 619-635
Marbach-Ad, G., Sokolove, P.G., Can undergraduate biology students learn to ask higher level questions? (2000) Journal of Research in Science Teaching, 37 (8), pp. 854-870
Molenaar, I., (2011) It's All about Metacognitive Activities: Computerized Scaffolding of Self-Regulated Learning, , PhD dissertation, University of Amsterdam, The Netherlands
Nokelainen, P., Miettinen, M., Kurhila, J., Floréen, P., Tirri, H., A shared documentbased annotation tool to support learner-centred collaborative learning (2005) British Journal of Educational Technology, 36 (5), pp. 757-770
(1991) Guide for the Appointment of Tutorial and Counselling Staff, Open Teaching Toolkits, , Open University, Milton Keynes, UK
Papadopoulos, P., Demetriadis, S., Stamelos, I., Tsoukalas, I., The value of writing-tolearn when using question prompts to support web-based learning in ill-structured domains (2011) Educational Technology Research and Development, 59 (1), pp. 71-90
Pedrosa De-Jesus, H., Moreira, A.C., The role of students' questions in aligning teaching, learning and assessment: A case study from undergraduate sciences (2009) Assessment & Evaluation in Higher Education, 34 (2), pp. 193-208
Priolli, P., (2007) Information Foraging Theory: Adaptive Interaction with Information, , Oxford University Press, Oxford-New York
Schilit, B., Golovchinsky, G., Price, M., Beyond paper: Supporting active reading with free form digital ink annotations (1998) Conference on Human Factors in Computing Systems, , Los Angeles, CA, USA
Schön, D., (1983) The Reflective Practitioner: How Professionals Think in Action, , Temple Smith, London
Schraw, G., Dennison, R., Assessing metacognitive awareness (1994) Contemporary Educational Psychology, 19, pp. 460-475
Slotte, V., Lonka, K., Review and process effects of spontaneous note-taking on text comprehension (1999) Contemporary Educational Psychology, 24, pp. 1-20
Slotte, V., Lonka, K., Note-taking review - practical value for learners (2003) Arob@se, 1-2, pp. 79-86
Sweller, J., Kirschner, P., Clark, R., Why minimally guided teaching techniques do not work: A reply to commentaries (2007) Educational Psychologist, 42 (2), pp. 115-121
Tanner, D., Promoting student metacognition (2012) CBE Life Sci Educ, 11, pp. 113-120
Terhart, E., Constructivism and teaching: A new paradigm in general didactics? (2003) Journal of Curriculum Studies, 35 (1), pp. 25-44
Van Den-Boom, G., Paas, F., Van Merriënboer, J., Van Gog, T., Reflection prompts and tutor feedback in a web-based learning environment: Effects on students' self-regulated learning competence (2004) Computers in Human Behavior, 20, pp. 551-567
Van Der-Baaren, J., Schuwer, R., Kirschner, P., Hendriks, M., Finding your way into an open online learning community (2008) Journal of Interactive Media in Education, 1, p. 4. , http://doi.org/10.5334/2008-4
Verma, V., Gagliardi, F., Ferretti, C., On pooling of data and measures (2009) DMQ, 84 (9). , University of Siena
Verpoorten, D., Glahn, C., Chatti, A., Westera, W., Specht, M., Self-reported learning effects of a tagging activity carried out in a personal learning environment (PLE) by secondary-school pupils (2011) International Journal for Cross-Disciplinary Subjects in Education, 2 (1), pp. 276-284. , http://orbi.ulg.ac.be/handle/2268/151959, Retrieved from
Verpoorten, D., Westera, W., Specht, M., Infusing reflective practice in eLearning courses - can widgets help? (2011) International Journal of Technology Enhanced Learning, 3 (1), pp. 93-109. , http://orbi.ulg.ac.be/handle/2268/151348, Retrieved from
Verpoorten, D., Westera, W., Specht, M., Reflection amplifiers in online courses: A classification framework (2011) Journal of Interactive Learning Research, 22 (2), pp. 167-190. , http://orbi.ulg.ac.be/handle/2268/151374, Retrieved from
Verpoorten, D., Westera, W., Specht, M., A first approach to "Learning dashboards" in formal learning contexts (2011) ADVTEL Workshop (1st International Workshop on Enhancing Learning with Ambient Displays and Visualization Techniques) at EC-TEL, , http://orbi.ulg.ac.be/handle/2268/151988, Palermo, Italy. Retrieved from
Zhang, W., Hsu, Y., Wang, C., Ho, Y., Exploring the impacts of cognitive and metacognitive prompting on students' scientific inquiry practices within an e-learning environment (2015) International Journal of Science Education, 37 (3), pp. 529-553