Document Open Access Logo

A Systematic Review of Teacher-Facing Dashboards for Collaborative Learning Activities and Tools in Online Higher Education

Authors Tiago Romão , Pedro Pestana , Leonel Morgado

PDF
Thumbnail PDF

File

OASIcs.ICPEC.2023.13.pdf
  • Filesize: 0.89 MB
  • 12 pages

Document Identifiers

Author Details

Tiago Romão
  • University of Trás-os-Montes e Alto Douro, Vila Real, Portugal
  • Universidade Aberta, Lisbon, Portugal
  • INESC TEC, Porto, Portugal
Pedro Pestana
  • Universidade Aberta, Lisbon, Portugal
  • CITAR, UCP, Porto, Portugal
Leonel Morgado
  • LE@D, CIAC, & CEG, Universidade Aberta, Lisbon, Portugal
  • INESC TEC, Porto, Portugal

Funding

This work was supported by the TRIO project funded by the European Union’s Erasmus+ KA220-ADU – Cooperation partnerships in adult education programme under grant agreement no. KA220-ADU-1B9975F8.

Cite AsGet BibTex

Tiago Romão, Pedro Pestana, and Leonel Morgado. A Systematic Review of Teacher-Facing Dashboards for Collaborative Learning Activities and Tools in Online Higher Education. In 4th International Computer Programming Education Conference (ICPEC 2023). Open Access Series in Informatics (OASIcs), Volume 112, pp. 13:1-13:12, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2023)
https://doi.org/10.4230/OASIcs.ICPEC.2023.13

Abstract

Dashboard for online higher education support monitoring and evaluation of students’ interactions, but mostly limited to interaction occurring within learning management systems. In this study, we sought to find which collaborative learning activities and tools in online higher education are included in teaching dashboards. By following Kitchenham’s procedure for systematic reviews, 36 papers were identified according to this focus and analysed. The results identify dashboards supporting collaborative tools, both synchronous and asynchronous, along categories such as learning management systems, communication tools, social media, computer programming code management platforms, project management platforms, and collaborative writing tools. Dashboard support was also found for collaborative activities, grouped under four categories of forum discussion activities, three categories of communication activities and four categories of collaborative editing/sharing activities, though most of the analysed dashboards only provide support for no more than two or three collaborative tools. This represents a need for further research on how to develop dashboards that combine data from a more diverse set of collaborative activities and tools.

Subject Classification

ACM Subject Classification
  • Applied computing → Collaborative learning
  • Applied computing → Distance learning
  • Applied computing → E-learning
Keywords
  • Dashboards
  • collaborative tools
  • collaborative activities
  • online learning
  • e-learning
  • computer-supported collaborative learning

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
    0
    Metadata Views

References

  1. Abbas Abdoli-Sejzi, Baharuddin Aris, Maizah Hura Ahmad, and Mohd Shafie Rosli. The relationship between web 2.0 technologies and students achievement in virtual university. In International Education Studies, volume 8, pages 67-72, 2015. URL: https://doi.org/10.5539/ies.v8n13p67.
  2. Gokce Akcayir, Leticia Farias Wanderley, Carrie Demmans Epp, Jim Hewitt, and Athar Mahmoudi-Nejad. Learning Analytics Dashboard Use in Online Courses: Why and How Instructors Interpret Discussion Data. In Visualizations and Dashboards for Learning Analytics, pages 371-397. Springer, 2021. URL: https://doi.org/10.1007/978-3-030-81222-5_17.
  3. Hosam Al-Samarraie and Noria Saeed. A systematic review of cloud computing tools for collaborative learning: Opportunities and challenges to the blended-learning environment. Computers and Education, 124:77-91, 2018. URL: https://doi.org/10.1016/j.compedu.2018.05.016.
  4. Naif Radi Aljohani, Ali Daud, Rabeeh Ayaz Abbasi, Jalal S. Alowibdi, Mohammad Basheri, and Muhammad Ahtisham Aslam. An integrated framework for course adapted student learning analytics dashboard. Computers in Human Behavior, 92:679-690, 2019. URL: https://doi.org/10.1016/j.chb.2018.03.035.
  5. Elske Ammenwerth and Werner O. Hackl. Monitoring of students' interaction in online learning settings by structural network analysis and indicators. Studies in Health Technology and Informatics, 235:293-297, 2017. URL: https://doi.org/10.3233/978-1-61499-753-5-293.
  6. Haogang Bao, Yanyan Li, You Su, Shuang Xing, Nian Shing Chen, and Carolyn Penstein Rosé. The effects of a learning analytics dashboard on teachers' diagnosis and intervention in computer-supported collaborative learning. Technology, Pedagogy and Education, 30(2):287-303, 2021. URL: https://doi.org/10.1080/1475939X.2021.1902383.
  7. Francis Brouns, Marta Zorrilla, Elena Álvarez, and Pedro Solana-González. ECO D2.5 Learning analytics requirements and metrics report. Technical report, Open Universiteit, 2015. URL: https://www.ecolearning.eu.
  8. Susan Bull, Matthew D. Johnson, Mohammad Alotaibi, Will Byrne, and Gabi Cierniak. Visualising multiple data sources in an independent open learner model. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 7926 LNAI, pages 199-208. Springer, 2013. URL: https://doi.org/10.1007/978-3-642-39112-5_21.
  9. Susan Bull, Michael Kickmeier-Rust, Ravi K. Vatrapu, Matthew D. Johnson, Klaus Hammermueller, William Byrne, Luis Hernandez-Munoz, Fabrizio Giorgini, and Gerhilde Meissl-Egghart. Learning, learning analytics, activity visualisation and open learner model: Confusing? In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 8095 LNCS, pages 532-535. Springer, 2013. URL: https://doi.org/10.1007/978-3-642-40814-4_51.
  10. Youness Chaabi and Yahya Al-Ashmoery. Development of a learning analytics extension in Open edX. In International Conference of Modern Trends in ICT Industry: Towards the Excellence in the ICT Industries, MTICTI 2021, pages 1-6. IEEE, 2021. URL: https://doi.org/10.1109/MTICTI53925.2021.9664754.
  11. Li Chen, Min Lu, Yoshiko Goda, Atsushi Shimada, and Masanori Yamada. Learning Analytics Dashboard Supporting Metacognition. In Balancing the tension between digital technologies and learning sciences, pages 129-149. Springer, 2021. URL: https://doi.org/10.1007/978-3-030-65657-7_8.
  12. Miguel A. Conde, Francisco J. García-Peńalvo, Diego A. Gómez-Aguilar, and Roberto Theron. Visual learning analytics techniques applied in software engineering subjects. In Proceedings - Frontiers in Education Conference, FIE, volume 2015-February, pages 1-9. IEEE, 2015. URL: https://doi.org/10.1109/FIE.2014.7044486.
  13. Emilia Corina Corbu and Eduard Edelhauser. Responsive dashboard as a component of learning analytics system for evaluation in emergency remote teaching situations. Sensors, 21(23):7998, 2021. URL: https://doi.org/10.3390/s21237998.
  14. Rogério F. da Silva, Itana M. S. Gimenes, and José C. Maldonado. Analyzing learners' behavior and discourse within large online communities: a social learning analytics dashboard. In Anais do XXXII Simpósio Brasileiro de Informática na Educação, pages 576-585. SBC, 2021. URL: https://doi.org/10.5753/sbie.2021.217468.
  15. Jonce Dimov. Infrastructure of learning analytics dashboard. Technical report, Technische Universiteit Eindhoven, 2017. Google Scholar
  16. Anna Dipace, Bojan Fazlagic, and Tommaso Minerva. The design of a learning analytics dashboard: EduOpen MOOC platform redefinition procedures. Journal of E-Learning and Knowledge Society, 15(3):29-47, 2019. URL: https://doi.org/10.20368/1971-8829/1135044.
  17. Raphael A. Dourado, Rodrigo Lins Rodrigues, Nivan Ferreira, Rafael Ferreira Mello, Alex Sandro Gomes, and Katrien Verbert. A teacher-facing learning analytics dashboard for process-oriented feedback in online learning. In ACM International Conference Proceeding Series, pages 482-489, 2021. URL: https://doi.org/10.1145/3448139.3448187.
  18. Xiaojing Duan, Chaoli Wang, and Guieswende Rouamba. Designing a learning analytics dashboard to provide students with actionable feedback and evaluating its impacts. In International Conference on Computer Supported Education, CSEDU - Proceedings, volume 2, pages 117-127, 2022. URL: https://doi.org/10.5220/0011116400003182.
  19. Anabela Costa e Silva, Leonel Morgado, and António Coelho. Drill-down dashboard for chairing of online master programs in engineering. In Technology and Innovation in Learning, Teaching and Education - Second International Conference, TECH-EDU 2020, Vila Real, Portugal, December 2-4, 2020, Proceedings, 3, pages 203-209, 2020. URL: https://doi.org/10.1007/978-3-030-73988-1_15.
  20. Luan Einhardt, Tatiana Aires Tavares, and Cristian Cechinel. Moodle analytics dashboard: A learning analytics tool to visualize users interactions in Moodle. In Proceedings - 2016 11th Latin American Conference on Learning Objects and Technology, LACLO 2016, pages 1-6. IEEE, 2016. URL: https://doi.org/10.1109/LACLO.2016.7751805.
  21. Anatoliy Gruzd and Nadia Conroy. Designing a learning analytics dashboard for twitter-facilitated teaching. In Proceedings of the 5th Annual ACM Conference on Learning at Scale, L at S 2018, pages 1-4, 2018. URL: https://doi.org/10.1145/3231644.3231704.
  22. Anatoliy Gruzd and Nadia Conroy. Learning analytics dashboard for teaching with Twitter. In Proceedings of the Annual Hawaii International Conference on System Sciences, volume 2020-January, pages 2708-2717, 2020. URL: https://doi.org/10.24251/hicss.2020.330.
  23. Francisco Gutiérrez, Karsten Seipp, Xavier Ochoa, Katherine Chiluiza, Tinne De Laet, and Katrien Verbert. LADA: A learning analytics dashboard for academic advising. Computers in Human Behavior, 107:105826, 2020. URL: https://doi.org/10.1016/j.chb.2018.12.004.
  24. Anne-Wil Harzing. The publish or perish book. Tarma Software Research Pty Limited Melbourne, 2010. Google Scholar
  25. Caitlin Holman, Stephen Aguilar, and Barry Fishman. GradeCraft: What can we learn from a game-inspired learning management system? In ACM International Conference Proceeding Series, pages 260-264, 2013. URL: https://doi.org/10.1145/2460296.2460350.
  26. Ya Han Hu, Chia Lun Lo, and Sheng Pao Shih. Developing early warning systems to predict students' online learning performance. Computers in Human Behavior, 36:469-478, 2014. URL: https://doi.org/10.1016/j.chb.2014.04.002.
  27. Rangana Jayashanka, E. Hettiarachchi, and K. P. Hewagamage. Technology enhanced learning analytics dashboard in higher education. Electronic Journal of e-Learning, 20(2):151-170, 2022. URL: https://doi.org/10.34190/ejel.20.2.2189.
  28. Heisawn Jeong and Cindy E. Hmelo-Silver. Seven affordances of computer-supported collaborative learning: How to support collaborative learning? How can technologies help? Educational Psychologist, 51(2):247-265, 2016. URL: https://doi.org/10.1080/00461520.2016.1158654.
  29. Rogers Kaliisa and Jan Arild Dolonen. CADA: a teacher-facing learning analytics dashboard to foster teachers' awareness of students' participation and discourse patterns in online discussions. Technology, Knowledge and Learning, pages 1-22, 2022. URL: https://doi.org/10.1007/s10758-022-09598-7.
  30. Max Kesselbacher, Kevin Wiltschnig, and Andreas Bollin. Block-based learning analytics repository and dashboard: Towards an interface between researcher and educator. In ACM International Conference Proceeding Series, pages 1-2, 2020. URL: https://doi.org/10.1145/3421590.3421662.
  31. Hanan Khalil and Martin Ebner. Using electronic communication tools in online group activities to develop collaborative learning skills. Universal Journal of Educational Research, 5(4):529-536, 2017. URL: https://doi.org/10.13189/ujer.2017.050401.
  32. Barbara Kitchenham. Procedures for performing systematic reviews. Keele University, 33(2004):1-26, 2004. Google Scholar
  33. Joris Klerkx, Katrien Verbert, and Erik Duval. Learning analytics dashboards. In Charles Lang, George Siemens, Alyssa Friend Wise, and Dragan Gaševic, editors, Handbook of Learning Analytics, pages 143-150. Society for Learning Analytics Research, Alberta, Canada, 2017. URL: https://doi.org/10.18608/hla17.012.
  34. Koushal Kumar and Bhagwati Prasad Pande. Rise of online teaching and learning processes during COVID-19 pandemic. In Lalit Mohan Goyal Praveen Kumar Khosla, Mamta Mittal, Dolly Sharma, editor, Predictive and preventive measures for COVID-19 pandemic, pages 251-271. Springer, 2021. URL: https://doi.org/10.1007/978-981-33-4236-1_14.
  35. Marjan Laal and Mozhgan Laal. Collaborative learning: What is it? Procedia-Social and Behavioral Sciences, 31:491-495, 2012. Google Scholar
  36. Derick Leony, Abelardo Pardo, Luis de la Fuente Valentín, David Sánchez de Castro, and Carlos Delgado Kloos. GLASS: a learning analytics visualization tool. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge - LAK '12, page 162, 2012. URL: https://doi.org/10.1145/2330601.2330642.
  37. SungTae Lim and EunHee Kim. The design of dashboard for instructor feedback support based on learning analytics. The Journal of Korean Association of Computer Education, 20(6):1-15, 2017. Google Scholar
  38. Alberto Martín-Martín, Enrique Orduna-Malea, Mike Thelwall, and Emilio Delgado López-Cózar. Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories. Journal of Informetrics, 12(4):1160-1177, 2018. URL: https://doi.org/10.1016/j.joi.2018.09.002.
  39. Carlos Monroy, Virginia Snodgrass Rangel, and Reid Whitaker. STEMscopes: Contextualizing learning analytics in a K-12 science curriculum. In ACM International Conference Proceeding Series, pages 210-219, 2013. URL: https://doi.org/10.1145/2460296.2460339.
  40. Diana M. Naranjo, José R. Prieto, Germán Moltó, and Amanda Calatrava. A visual dashboard to track learning analytics for educational cloud computing. Sensors (Switzerland), 19(13):2952, 2019. URL: https://doi.org/10.3390/s19132952.
  41. Donatella Persico, Francesca Pozzi, and Luigi Sarti. Monitoring collaborative activities in computer supported collaborative learning. Distance Education, 31(1):5-22, 2010. URL: https://doi.org/10.1080/01587911003724603.
  42. Stanislav Pozdniakov, Roberto Martinez-Maldonado, Shaveen Singh, Peter Chen, Dan Richardson, Tom Bartindale, Patrick Olivier, and Dragan Gasevic. Question-driven learning analytics: Designing a teacher dashboard for online breakout rooms. In Proceedings - IEEE 21st International Conference on Advanced Learning Technologies, ICALT 2021, pages 176-178. IEEE, 2021. URL: https://doi.org/10.1109/ICALT52272.2021.00060.
  43. Faisal A.T. Putra, Harry B. Santoso, and Rizal F. Aji. Evaluation of learning analytics metrics and dashboard in a software engineering project course. Global Journal of Engineering Education, 20(3):171-180, 2018. Google Scholar
  44. A. Ramos-Soto, M. Lama, B. Vazquez-Barreiros, A. Bugarin, M. Mucientes, and S. Barro. Towards textual reporting in learning analytics dashboards. In Proceedings - IEEE 15th International Conference on Advanced Learning Technologies: Advanced Technologies for Supporting Open Access to Formal and Informal Learning, ICALT 2015, pages 260-264. IEEE, 2015. URL: https://doi.org/10.1109/ICALT.2015.96.
  45. Chrysi Rapanta, Luca Botturi, Peter Goodyear, Lourdes Guàrdia, and Marguerite Koole. Online university teaching during and after the COVID-19 crisis: Refocusing teacher presence and learning activity. Postdigital Science and Education, 2(3):923-945, 2020. URL: https://doi.org/10.1007/s42438-020-00155-y.
  46. Alex Rayón, Mariluz Guenaga, and Asier Núñez. Supporting competency-assessment through a learning analytics approach using enriched rubrics. In ACM International Conference Proceeding Series, pages 291-298, 2014. URL: https://doi.org/10.1145/2669711.2669913.
  47. Majid Rouhani. Utilizing Slack as a communication platform in a flexible learning trajectory course: Supporting the learning process. In ACM International Conference Proceeding Series, CSERC '20, New York, NY, USA, 2020. Association for Computing Machinery. URL: https://doi.org/10.1145/3442481.3442503.
  48. Jose Luis Santos, Katrien Verbert, Sten Govaerts, and Erik Duval. Addressing learner issues with StepUp!: An evaluation. In ACM International Conference Proceeding Series, pages 14-22, 2013. URL: https://doi.org/10.1145/2460296.2460301.
  49. Jose Luis Santos, Katrien Verbert, Joris Klerkx, Sven Charleer, Erik Duval, and Stefaan Ternier. Tracking data in open learning environments. Journal of Universal Computer Science, 21(7):976-996, 2015. Google Scholar
  50. Beat A. Schwendimann, Maria Jesus Rodriguez-Triana, Andrii Vozniuk, Luis P. Prieto, Mina Shirvani Boroujeni, Adrian Holzer, Denis Gillet, and Pierre Dillenbourg. Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1):30-41, 2017. URL: https://doi.org/10.1109/TLT.2016.2599522.
  51. Gabriel Lenon Barros Silva, Janaína Alexandre de Carvalho, and Alexandre Magno Andrade Maciel. Desenvolvimento de um learning analytics dashboard a partir de modelos de mineração de dados educacionais. Revista de Engenharia e Pesquisa Aplicada, 6(3):59-69, 2021. URL: https://doi.org/10.25286/repa.v6i3.1688.
  52. Keerthana Muthu Subash, Lakshmi Prasanna Kumar, Sri Lakshmi Vadlamani, Preetha Chatterjee, and Olga Baysal. DISCO: A dataset of Discord chat conversations for software engineering research. In Proceedings - 2022 Mining Software Repositories Conference, MSR 2022, pages 227-231, 2022. URL: https://doi.org/10.1145/3524842.3528018.
  53. Harmid Tarmazdi, Rebecca Vivian, Claudia Szabo, Katrina Falkner, and Nickolas Falkner. Using learning analytics to visualise computer science teamwork. In Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE, volume 2015-June, pages 165-170, 2015. URL: https://doi.org/10.1145/2729094.2742613.
  54. Stephanie D. Teasley. Student facing dashboards: One size fits all? Technology, Knowledge and Learning, 22(3):377-384, 2017. URL: https://doi.org/10.1007/s10758-017-9314-3.
  55. Saida Ulfa, Izzull Fattawi, Ence Surahman, and Hayashi Yusuke. Investigating learners' perception of learning analytics dashboard to improve learning interaction in online learning system. In 2019 5th International Conference on Education and Technology, ICET 2019, pages 49-54. IEEE, 2019. URL: https://doi.org/10.1109/ICET48172.2019.8987229.
  56. Mehmet Uysal and Mehmet Barış Horzum. Designing and developing a learning analytics dashboard to support self-regulated learning. In Visualizations and Dashboards for Learning Analytics, pages 477-496. Springer, 2021. URL: https://doi.org/10.1007/978-3-030-81222-5_22.
  57. Maria Viana, António Coelho, and Leonel Morgado. Drill-down and drill-through dashboard for master program chairing in e-learning. Revista de Ciências da Computação, 17:13-27, 2022. URL: https://doi.org/10.34627/rcc.v17i0.279.
  58. Juan Zheng, Lingyun Huang, Shan Li, Susanne P. Lajoie, Yuxin Chen, and Cindy E. Hmelo-Silver. Self-regulation and emotion matter: A case study of instructor interactions with a learning analytics dashboard. Computers and Education, 161:104061, 2021. URL: https://doi.org/10.1016/j.compedu.2020.104061.
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH Imprint Privacy Contact