簡易檢索 / 詳目顯示

研究生: 李加安
Lee, Chia-An
論文名稱: 基於MOOCs平台設計AIED系統以評估學生表現和回饋之研究
Designing an AIED system to assess learner performance and feedback based on MOOCs platform
指導教授: 黃能富
Huang, Nen-Fu
口試委員: 張耀中
Chang, Yao-Chung
韓永楷
Hon, Wing-Kai
張宏義
Chang, Hong-Yi
曾建維
Tzeng, Jian-Wei
學位類別: 博士
Doctor
系所名稱: 電機資訊學院 - 資訊工程學系
Computer Science
論文出版年: 2021
畢業學年度: 109
語文別: 英文
論文頁數: 114
中文關鍵詞: 磨課師深度學習知識地圖試題分析學習分析動態評量
外文關鍵詞: itemanalysis, Knowledgemap
相關次數: 點閱:2下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近年來MOOC課程提供了靈活的學習環境,然而也導致了以下問題:
    第一,MOOC學習者是多樣化的,並非所有人都有足夠的背景相關知識。第二,許多學生在學習中面臨認知負擔過重及容易迷失學習方向。 第三,課程設計的考試可能無法對學生的表現進行清晰客觀的評估。
    第四,MOOC課程缺乏有效的方式來獲得有效的學習反饋。

    本篇研究藉助於大數據和人工智慧技術在MOOCs中的應用,有助於洞察及理解教育數據,達到提高教學效果,並有助於學生和教師之間的互動
    透過收集學生在MOOCs平台的學習資料,搭配上試題分析,利用深度學習的方式,設計出四種應用模型。
    1.提供學生對個知識節點的熟悉程度並加以量化。生成每位學生專屬的學習知識地圖。
    2.預測學生是否會答對試題
    3.預測學生成績表現模組
    4.預測學生滿意度模組

    本篇提出的四個模組,使教師可以從各個向度評估學生以及對學習行為追蹤,得知每位學生的學習狀況,並給予適時的幫助。


    Online platform providing Massive Open Online Courses (MOOCs) are valuable because they offer efficient and flexible learning. However, MOOCs have fundamental problems.

    First, MOOC learners are diverse, and thus it is possible that not all of them have insufficient background knowledge when registering some courses.
    Second, a significant disorientation is observed when a person attempts to acquire knowledge because of the overwhelming massive amount of learning material presented to users
    Third, examinations designed by lecturers may not be reliable enough to give clear and objective evaluations of a students' performance. Lacking a efficient way to obtain effective learning feedback is another disadvantage of MOOCs.
    Course designers have attempted to evaluate the experiences of MOOC participants and found out that it is difficult to track and analyze the online actions and interactions of students due to the large class sizes.

    The application of big data and artificial intelligence (AI) in MOOCs help comprehend raw educational data and enrich the learning process for students and instructors. The student data generated on MOOCs can be used to substantially improve teaching and learning effectiveness.

    This study proposes the HSNL AI Tutor platform based on Deep Neural Networks(DNN) method.
    The HSNL AI tutor now provide four Predictive Learning Analytics modules to give more accurate output when facing different scenarios.
    First, the tutor has a concept assessment system integrated with knowledge maps to determine the students' familiarity and mastery of the content of a given course. The knowledge map approach is a suitable tool for evaluating and presenting students' learning performance at information education.
    Second, a Correct on Attempt(COA) prediction system is added to the AI tutor. The system uses a innovative exercise-based model that predicts the outcome of whether a student will correctly answer examination questions which are relevant to the presented course materials.
    Third, it features a Prediction of Learning Performance System, predicting learning outcomes on the basis of learning behaviors resulted from students watching class videos.
    Lastly, the Evaluation Courses System incorporated into the platform explores the use of deep learning techniques to assess MOOC student experiences.

    The data used by this thesis was collected from National Tsing Hua University’s MOOCs platform and ShareCourse.The results indicate that these approaches yield reliable predictions. Furthermore, teachers and teaching assistants can know students' performance and weaknesses in order to offer them more support promptly. By using data mining in education and learning analytics techniques, both teachers and online learners could benefited from the HSNL AI Tutor platform. The purpose of this study is to propose a system providing a more customized and intelligent online learning environment for students to learn in a more efficient and flexible way.

    Abstract i 中文摘要 iii Acknowledgement iv Contents v List of Figures viii List of Tables x Chapter 1 Introduction 1 1.1 The Development of MOOCs . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 The Current Trend of AI in Education . . . . . . . . . . . . . . . . . . 2 1.3 The Importance of Data Analysis . . . . . . . . . . . . . . . . . . . . 3 1.4 Insights Provided by Previous Studies . . . . . . . . . . . . . . . . . . 5 1.5 Proposing a Promising Evaluating Online Platform Based on AI . . . . 7 Chapter 2 Background and Related Works 9 2.1 Moocs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.1.1 ShareCourse . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.1.2 NTHU MOOCs . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2 Concept Mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.3 Deep Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.3.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.3.2 Activation Function . . . . . . . . . . . . . . . . . . . . . . . 17 2.3.3 Cross-validation . . . . . . . . . . . . . . . . . . . . . . . . . 18 2.3.4 Normalization . . . . . . . . . . . . . . . . . . . . . . . . . . 18 2.3.5 Confusion Matrix . . . . . . . . . . . . . . . . . . . . . . . . . 19 2.4 Data Analysis and Enhancement of Learning Effectiveness . . . . . . . 20 2.5 Evaluation of Learning Performance Based on Behavior . . . . . . . . 21 2.6 Measuring Learner Proficiency in a MOOCs Context . . . . . . . . . . 23 2.7 Prediction of Learning Performance Using Exercises . . . . . . . . . . 24 2.8 Lack of an Evaluation Mechanism in MOOCs . . . . . . . . . . . . . . 25 2.9 Student’s feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 2.10 Course evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Chapter 3 System Architecture 29 3.1 knowledge map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 3.2 Item discrimination system . . . . . . . . . . . . . . . . . . . . . . . . 33 3.3 Artificial Intelligence Modules . . . . . . . . . . . . . . . . . . . . . . 33 3.3.1 Concept Assessment System . . . . . . . . . . . . . . . . . . . 34 3.3.2 Correct on Attempt(COA) prediction . . . . . . . . . . . . . . 35 3.3.3 Prediction of Learning Performance System . . . . . . . . . . . 36 3.3.4 Evaluation Courses System . . . . . . . . . . . . . . . . . . . . 36 3.3.5 Data Collection APIs . . . . . . . . . . . . . . . . . . . . . . . 36 3.3.6 Data Analysis Result and Learning Tool API . . . . . . . . . . 37 Chapter 4 Predictive Learning Analytics Method 40 4.1 Item Analysis System . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 4.2 Collection of Data on Learning Behaviors . . . . . . . . . . . . . . . . 41 4.3 AI concept assessment system . . . . . . . . . . . . . . . . . . . . . . 43 4.3.1 The Feature Extraction . . . . . . . . . . . . . . . . . . . . . . 44 4.3.2 Knowledge Diagnosis . . . . . . . . . . . . . . . . . . . . . . 47 4.3.3 Present with Learning Knowledge Map . . . . . . . . . . . . . 50 4.4 Correct on Attempt(COA) prediction . . . . . . . . . . . . . . . . . . . 52 4.5 Prediction of Learning Performance System . . . . . . . . . . . . . . . 56 4.6 Evaluation Courses System . . . . . . . . . . . . . . . . . . . . . . . . 63 Chapter 5 Experiment and Result 68 5.1 Concept assessment system . . . . . . . . . . . . . . . . . . . . . . . . 68 5.2 Correct On Attempt(COA) prediction . . . . . . . . . . . . . . . . . . 75 5.3 Prediction of Learning Performance System . . . . . . . . . . . . . . . 79 5.4 Evaluation Courses System . . . . . . . . . . . . . . . . . . . . . . . . 82 5.5 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94 5.5.1 Prediction of Learning Performance System . . . . . . . . . . . 94 5.5.2 Evaluation Courses System . . . . . . . . . . . . . . . . . . . . 94 Chapter 6 Conclusion and Future Work 95 Bibliography 98

    Bibliography
    [1] R. Kop, “The challenges of connectivist learning on open online networks: Learning experiences during a massive open online course,” International Review of
    Research in Open and Distance Learning, vol. 12, 03 2011.
    [2] A. McAuley, B. Stewart, G. Siemens, and D. Cormier, “The mooc model for
    digital practice,” 2010.
    [3] C. Vieira, P. Parsons, and V. Byrd, “Visual learning analytics of educational data:
    A systematic literature review and research agenda,” Computers & Education,
    vol. 122, pp. 119–135, 2018.
    [4] P. Adamopoulos, “What makes a great mooc? an interdisciplinary analysis of student retention in online courses,” in 34th International Conference on Information
    Systems, (United States), Association for Information Systems, 2013. The most
    heavily-cited paper from the ICIS 2013 proceedings (as of August 15th, 2016).
    [5] Z. Ghahramani, “Probabilistic machine learning and artificial intelligence,” Nature, vol. 521, pp. 452–9, 05 2015.
    [6] Z. Papamitsiou and A. Economides, “Learning analytics and educational data
    mining in practice: A systematic literature review of empirical evidence,” Educational Technology & Society, vol. 17, pp. 49–64, 10 2014.
    [7] D. Gasevic, S. Dawson, and G. Siemens, “Let’s not forget: Learning analytics
    are about learning,” TechTrends, vol. 59, 01 2015.
    [8] P. Leitner, M. Khalil, and M. Ebner, Learning Analytics in Higher Education ȋA
    Literature Review, vol. 94 of Studies in Systems, Decision and Control, pp. 1–23.
    Switzerland: Springer International Publishing AG, Feb. 2017.
    [9] G.-J. Hwang, H.-C. Chu, and C. Yin, “Objectives, methodologies and research
    issues of learning analytics,” Interactive Learning Environments, vol. 25, pp. 143
    – 146, 2017.
    [10] O. Lu, A. Huang, J. Huang, A. Lin, H. Ogata, and S. Yang, “Applying learning
    analytics for the early prediction of students’ academic performance in blended
    learning,” Educational Technology and Society, vol. 21, pp. 220–232, 01 2018.
    [11] J. Kay, “Ai and education: Grand challenges,” IEEE Intelligent Systems, vol. 27,
    pp. 66–69, Sep. 2012.
    [12] B. du Boulay, “Artificial intelligence as an effective classroom assistant,” IEEE
    Intelligent Systems, vol. 31, pp. 76–81, Nov 2016.
    [13] Z. Kastrati, A. Imran, and A. Kurti, “Integrating word embeddings and document
    topics with deep learning in a video classification framework,” Pattern Recognition Letters, vol. 128, 08 2019.
    [14] C. Li and H. Zhou, “Enhancing the efficiency of massive online learning by integrating intelligent analysis into moocs with an application to education of sustainability,” Sustainability, vol. 10, no. 2, 2018.
    [15] T.-Y. Yang, C. Brinton, C. Joe-Wong, and M. Chiang, “Behavior-based grade
    prediction for moocs via time series neural networks,” IEEE Journal of Selected
    Topics in Signal Processing, vol. PP, pp. 1–1, 05 2017.
    [16] G.-J. Hwang, H.-Y. Sung, S.-C. Chang, and X.-C. Huang, “A fuzzy expert systembased adaptive learning approach to improving students’learning performances by
    considering affective and cognitive factors,” Computers and Education: Artificial
    Intelligence, vol. 1, p. 100003, 01 2020.
    [17] S. A. Becker, M. Cummins, A. Davis, A. Freeman, C. G. Hall, and V. Ananthanarayanan, “Nmc horizon report: 2017 higher education edition,” tech. rep., The
    New Media Consortium, Austin, Texas, 2017.
    [18] S. Fauvel, H. Yu, C. Miao, L. Cui, H. Song, L. Zhang, X. Li, and C. Leung,
    “Artificial intelligence powered moocs: A brief survey,” pp. 56–61, 07 2018.
    [19] C. Tekin, J. Braun, and M. Schaar, “etutor: Online learning for personalized education,” pp. 5545–5549, 04 2015.
    [20] I. Ndukwe and B. Daniel, “Teaching analytics, value and tools for teacher data literacy: a systematic and tripartite approach,” International Journal of Educational
    Technology in Higher Education, vol. 17, 12 2020.
    [21] E. Er, E. Gómez-Sánchez, Y. Dimitriadis, M. Bote-Lorenzo, J. Asensio-Pérez,
    and S. Alvarez Alvarez, “Aligning learning design and learning analytics through
    instructor involvement: a mooc case study,” Interactive Learning Environments,05 2019.
    [22] Y. Lee, “Effect of uninterrupted time-on-task on students’success in massive open
    online courses (moocs),” Computers in Human Behavior, vol. 86, 04 2018.
    [23] O. Lu, J. Huang, A. Huang, and S. Yang, “Applying learning analytics for improving students engagement and learning outcomes in an moocs enabled collaborative programming course,” Interactive Learning Environments, vol. 25, pp. 1–15,
    01 2017.
    [24] P. Merino, J. A. Ruipérez-Valiente, C. Alario-Hoyos, M. Pérez-Sanagustín, and
    C. Delgado-Kloos, “Precise effectiveness strategy for analyzing the effectiveness
    of students with educational resources and activities in moocs,” Computers in
    Human Behavior, 11 2014.
    [25] J. Donath, “Identity and deception in the virtual community,” 08 1996.
    [26] M. Crosslin, “Exploring self-regulated learning choices in a customisable learning pathway mooc,” Australasian Journal of Educational Technology, vol. 34, 03
    2018.
    [27] R. Azevedo and J. Cromley, “Does training on self-regulated learning facilitate students’ learning with hypermedia?,” Journal of Educational Psychology,
    vol. 96, pp. 523–535, Sept. 2004. Copyright: Copyright 2012 Elsevier B.V., All
    rights reserved.
    [28] L. Bol and J. Garner, “Challenges in supporting self-regulation in distance education environments,” J. Computing in Higher Education, vol. 23, pp. 104–123,
    12 2011.
    [29] S. Peverly, K. Brobst, M. Graham, and R. Shaw, “College adults are not good at
    self-regulation: A study on the relationship of self-regulation, note taking, and
    test taking,” Journal of Educational Psychology, vol. 95, pp. 335–346, 06 2003.
    [30] M. Magolda and A. Astin, “What matters in college: Four critical years revisited,”
    Educational Researcher, vol. 22, 01 1993.
    [31] D. Onah, J. Sinclair, and R. Boyatt, “Dropout rates of massive open online
    courses: Behavioural patterns,” 07 2014.
    [32] K. Li, “Mooc learners’demographics, self-regulated learning strategy, perceived
    learning and satisfaction: A structural equation modeling approach,” Computers
    & Education, vol. 132, 04 2019.
    [33] M. Lan, X. Hou, X. Qi, and N. Mattheos, “Selfregulated learning strategies in
    world’s first mooc in implant dentistry,” European Journal of Dental Education,
    vol. 23, 02 2019.
    [34] S. Crossley, D. McNamara, R. Baker, Y. Wang, L. Paquette, T. Barnes, and
    Y. Bergner, Language to Completion: Success in an Educational Data Mining
    Massive Open Online Class. 2015.
    [35] M. Wen, D. Yang, and C. Rosé, “Sentiment analysis in mooc discussion forums:
    What does it tell us?,” Proceedings of Educational Data Mining, pp. 130–137, 01 2014.
    [36] P. Moreno-Marcos, C. Alario-Hoyos, P. Munoz-Merino, I. Estévez-Ayres, and
    C. Delgado-Kloos, “Sentiment analysis in moocs: A case study,” pp. 1489–1496,04 2018.
    [37] R. Cobos, F. Jurado, and A. Villen, “Moods in moocs: Analyzing emotions in the
    content of online courses with edx-cas,” pp. 1467–1474, 04 2019.
    [38] T. L. Donohue and E. H. Wong, “Achievement motivation and college satisfaction
    in traditional and nontraditional students,” Education 3-13, vol. 118, p. 237, 1997.
    [39] J. P. Bean and R. K. Bradley, “Untangling the satisfaction-performance relationship for college students,” The Journal of Higher Education, vol. 57, no. 4,
    pp. 393–412, 1986.
    [40] J. Klobas, The anatomy of MOOCs, pp. 1–22. 01 2015.
    [41] R. Kim, L. Olfman, T. Ryan, and E. Eryilmaz, “Leveraging a personalized system
    to improve self-directed learning in online educational environments,” Computers
    & Education, vol. 70, pp. 150–160, 2014.
    [42] M. Liu, J. Kang, M. Cao, M. Lim, Y. Ko, R. Myers, and A. Schmitz Weiss,
    “Understanding moocs as an emerging online learning tool: Perspectives from
    the students,” American Journal of Distance Education, vol. 28, pp. 147–159, 08 2014.
    [43] R. Kop and H. Fournier, “A pedagogy of abundance or a pedagogy to support
    human beings? participant support on massive open online courses,” International
    Review of Research in Open and Distance Learning, vol. 12, pp. 74–93, 11 2011.
    [44] B. Swinnerton, N. Morris, S. Hotchkiss, and J. Pickering, “The integration of an
    anatomy massive open online course (mooc) into a medical anatomy curriculum:
    Anatomy mooc,” Anatomical Sciences Education, vol. 80, 06 2016.
    [45] M. Wang, J. Peng, B. Cheng, H. Zhou, and J. Liu, “Knowledge visualization
    for self-regulated learning.,” Educational Technology & Society, vol. 14, no. 3,
    pp. 28–42, 2011.
    [46] J. A. Ruipérez-Valiente, P. J. Muñoz-Merino, C. D. Kloos, K. Niemann, M. Scheffel, and M. Wolpers, “Analyzing the impact of using optional activities in selfregulated learning,” IEEE Transactions on Learning Technologies, vol. 9, no. 3,
    pp. 231–243, 2016.
    [47] A. Sunar, S. White, N. Abdullah, and H. Davis, “How learners’interactions sustain
    engagement: a mooc case study,” IEEE Transactions on Learning Technologies,
    2016.
    [48] C. Alario-Hoyos, M. Pérez-Sanagustín, C. Delgado-Kloos, M. Munoz-Organero,
    et al., “Delving into participants’profiles and use of social tools in moocs,” IEEE
    Transactions on Learning Technologies, vol. 7, no. 3, pp. 260–266, 2014.
    [49] C. D. Holley and D. F. Dansereau, Spatial learning strategies: Techniques, applications, and related issues. Academic Press, 2014.
    [50] P. W. Foos, “The effect of variations in text summarization opportunities on test
    performance.,” The Journal of experimental education, vol. 63, no. 2, pp. 89–95,
    1995.
    [51] J. C. Nesbit and O. O. Adesope, “Learning with concept and knowledge maps:
    A meta-analysis,” Review of educational research, vol. 76, no. 3, pp. 413–448,
    2006.
    [52] R. Castles, “Knowledge maps and their applications to students and faculty assessment,” Proc. Frontiers Edu. Conf., pp. S4A–9–S4A–14, 2008.
    [53] G. P. Jain, V. P. Gurupur, J. L. Schroeder, and E. D. Faulkenberry, “Artificial
    intelligence-based student learning evaluation: a concept map-based approach for
    analyzing a student’s understanding of a topic,” IEEE Transactions on Learning
    Technologies, vol. 7, no. 3, pp. 267–279, 2014.
    [54] C. G. Brinton, S. Buccapatnam, M. Chiang, and H. V. Poor, “Mining mooc clickstreams: Video-watching behavior vs. in-video quiz performance,” IEEE Transactions on Signal Processing, vol. 64, no. 14, pp. 3677–3692, 2016.
    [55] C. G. Brinton and M. Chiang, “Mooc performance prediction via clickstream data
    and social learning networks,” in 2015 IEEE Conference on Computer Communications (INFOCOM), pp. 2299–2307, 2015.
    [56] J. Qiu, J. Tang, T. Liu, J. Gong, C. Zhang, Q. Zhang, and Y. Xue, “Modeling and
    predicting learning behavior in moocs,” pp. 93–102, 02 2016.
    [57] C. Tekin, J. Braun, and M. van der Schaar, “etutor: Online learning for personalized education,” in 2015 IEEE International Conference on Acoustics, Speech
    and Signal Processing (ICASSP), pp. 5545–5549, 2015.
    [58] A. Ng and D. Koller, “Coursera.” Retrieved April 16, 2017, from the World Wide
    Web: https://zh-tw.coursera.org/, 2012.
    [59] M. I. of Technology and H. University, “edx.” Retrieved April 16, 2017, from the
    World Wide Web: https://www.edx.org/, 2012.
    [60] N. T. University, “Sharecourse.” Retrieved May 20, 2018, from the World Wide
    Web: http://www.sharecourse.net/sharecourse/, 2012.
    [61] N. T. University, “Nthucloud.” Retrieved May 20, 2018, from the World Wide
    Web: https://mooc.nthu.edu.tw/, 2020.
    [62] M. Davies, “Concept mapping, mind mapping and argument mapping: what are
    the differences and do they matter?,” Higher Education, vol. 62, pp. 279–301,
    2011.
    [63] W. Trochim, “The reliability of concept mapping,” in annual conference of the
    American Evaluation Association, vol. 6, 1993.
    [64] N.-F. Huang, C.-A. Lee, Y.-W. Huang, P.-W. Ou, H.-H. Hsu, S.-C. Chen, and J.-
    W. Tzeng, “On the automatic construction of knowledge-map from handouts for
    mooc courses,” pp. 107–114, 08 2018.
    [65] G. Salton and C. Buckley, “Term-weighting approaches in automatic text retrieval,” Information processing & management, vol. 24, no. 5, pp. 513–523,
    1988.
    [66] “Cosine similarity.” Retrieved June 21, 2017, from the World Wide Web: https:
    //en.wikipedia.org/wiki/Cosine\_similarity.
    [67] Z. Yihua, Z. Chaoqun, Z. Tong, W. Longfeng, X. Mali, W. Dongbo, and L. Xiaohui, “The research of recognizing the reviews in webpages based on calculating
    the similarity of dom-subtrees,” New Technology of Library and Information Service, vol. 11, p. 012, 2013.
    [68] Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” nature, vol. 521, no. 7553,
    p. 436, 2015.
    [69] M. Leshno, V. Y. Lin, A. Pinkus, and S. Schocken, “Multilayer feedforward networks with a non-polynomial activation function can approximate any function,”
    1992.
    [70] J. Han and C. Moraga, “The influence of the sigmoid function parameters on the
    speed of backpropagation learning,” in Proceedings of the International Workshop
    on Artificial Neural Networks: From Natural to Artificial Neural Computation,
    IWANN ’96, (Berlin, Heidelberg), p. 195–201, Springer-Verlag, 1995.
    [71] J. Rafferty, P. Shellito, N. H. Hyman, W. D. Buie, et al., “Practice parameters for
    sigmoid diverticulitis,” Diseases of the colon & rectum, vol. 49, no. 7, pp. 939–
    944, 2006.
    [72] K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpassing
    human-level performance on imagenet classification,” in Proceedings of the IEEE
    international conference on computer vision, pp. 1026–1034, 2015.
    [73] V. Chiley, I. Sharapov, A. Kosson, U. Koster, R. Reece, S. Fuente, V. Subbiah,
    and M. James, “Online normalization for training neural networks,” 05 2019.
    [74] A. L. Maas, “Rectifier nonlinearities improve neural network acoustic models,”
    2013.
    [75] J. Kay and B. Kummerfeld, “From data to personal user models for lifelong,
    lifewide learners,” British Journal of Educational Technology, vol. 50, 09 2019.
    [76] B. Schwendimann, M. Rodríguez-Triana, A. Vozniuk, L. Prieto, M. Shirvani Boroujeni, A. Holzer, D. Gillet, and P. Dillenbourg, “Perceiving learning
    at a glance: A systematic literature review of learning dashboard research,” IEEE
    Transactions on Learning Technologies, vol. 10, pp. 1–1, 10 2016.
    [77] L. Daghestani, L. Fattouh, R. Al-Towirgi, and H. Salman, “Adapting gamified
    learning systems using educational data mining techniques,” Computer Applications in Engineering Education, vol. 28, 03 2020.
    [78] G. Alexandron, J. A. Ruipérez-Valiente, Z. Chen, P. Merino, and D. Pritchard,
    “Copying@scale: Using harvesting accounts for collecting correct answers in a
    mooc,” Computers & Education, vol. 108, 02 2017.
    [79] C. Romero and S. Ventura, “Educational data science in massive open online
    courses,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. WIREs Data Mining Knowl Discov, 01 2017.
    [80] J. Maldonado, C. Alario-Hoyos, M. Pérez-Sanagustín, C. Delgado-Kloos,
    M. Alonso-Mencía, and I. Estévez-Ayres, “Self-regulated learning in moocs:
    Lessons learned from a literature review,” Educational Review, vol. 71, pp. 1–
    27, 03 2019.
    [81] M. Kavitha and L. Raj, “Educational data mining and learning analytics - educational assistance for teaching and learning,” International Journal of Computer &
    organization Trends, vol. 41, 06 2017.
    [82] G.-J. Hwang, H.-Y. Sung, S.-C. Chang, and X.-C. Huang, “A fuzzy expert systembased adaptive learning approach to improving students’learning performances by
    considering affective and cognitive factors,” Computers and Education: Artificial
    Intelligence, vol. 1, p. 100003, 01 2020.
    [83] Y. Meier, J. Xu, O. Atan, and M. van der Schaar, “Predicting grades,” IEEE Transactions on Signal Processing, vol. 64, no. 4, pp. 959–972, 2016.
    [84] T.-C. Hsu, H. Abelson, N. Lao, Y.-H. Tseng, and Y.-T. Lin, “Behavioral-pattern
    exploration and development of an instructional tool for young children to learn
    ai,” Computers and Education: Artificial Intelligence, vol. 2, p. 100012, 2021.
    [85] Y. Sun, L. Ni, Y. Zhao, X.-L. Shen, and N. Wang, “Understanding students’engagement in moocs: An integration of selfdetermination theory and theory of
    relationship quality,” British Journal of Educational Technology, 12 2018.
    [86] Y. Lee, “Effect of uninterrupted time-on-task on students’success in massive open
    online courses (moocs),” Computers in Human Behavior, vol. 86, 04 2018.
    [87] P. Guo, J. Kim, and R. Rubin, “How video production affects student engagement:
    An empirical study of mooc videos,” pp. 41–50, 03 2014.
    [88] J. Kim, P. Guo, D. Seaton, P. Mitros, K. Gajos, and R. Miller, “Understanding
    in-video dropouts and interaction peaks inonline lecture videos,” pp. 31–40, 03
    2014.
    [89] D. Sun, Y. Mao, J. Du, P. Xu, Q. Zheng, and H. Sun, “Deep learning for dropout
    prediction in moocs,” in 2019 Eighth International Conference on Educational
    Innovation through Technology (EITT), pp. 87–90, 2019.
    [90] T.-C. Liu, Y.-C. Lin, and C.-C. Tsai, “Identifying senior high school students’
    misconceptions about statistical correlation, and their possible causes: An ex10
    ploratory study using concept mapping with interviews,” International Journal of
    Science and Mathematics Education, vol. 7, pp. 791–820, 08 2008.
    [91] L. Chu, P.-H. Li, and M.-N. Yu, “The longitudinal effect of children’s selfregulated learning on reading habits and well-being,” International Journal of Educational Research, vol. 104, p. 101673, 01 2020.
    [92] J. DeBoer, A. Ho, G. Stump, and L. Breslow, “Changing “course”: Reconceptualizing educational variables for massive open online courses,” Educational
    Researcher, vol. 43, pp. 74–84, 02 2014.
    [93] W. Admiraal, B. Huisman, and M. Ven, “Self- and peer assessment in massive
    open online courses,” International Journal of Higher Education, vol. 3, pp. 119–
    128, 07 2014.
    [94] L. Shepard, “The role of classroom assessment in teaching and learning,” 01 2001.
    [95] P. Moreno-Marcos, T.-C. Pong, P. Merino, and C. Delgado-Kloos, “Analysis of
    the factors influencing learners’performance prediction with learning analytics,”
    IEEE Access, vol. PP, pp. 1–1, 01 2020.
    [96] M. M. Ashenafi, G. Riccardi, and M. Ronchetti, “Predicting students’ final exam
    scores from their course activities,” in 2015 IEEE Frontiers in Education Conference (FIE), pp. 1–9, 2015.
    [97] N.-F. Huang, C.-C. Chen, T. Fang, and C.-A. Lee, “Concept assessment system
    integrated with a knowledge map using deep learning,” pp. 113–116, 09 2018.
    [98] X. Li, L. Xie, and H. Wang, “Grade prediction in moocs,” in 2016 IEEE Intl
    Conference on Computational Science and Engineering (CSE) and IEEE Intl
    Conference on Embedded and Ubiquitous Computing (EUC) and 15th Intl Symposium on Distributed Computing and Applications for Business Engineering
    (DCABES), pp. 386–392, 2016.
    [99] B. Gameel, “Learner satisfaction with massive open online courses,” American
    Journal of Distance Education, vol. 31, pp. 1–14, 03 2017.
    [100] S. Shatnawi, M. Gaber, and E. Haig, “Automatic content related feedback for
    moocs based on course domain ontology,” vol. 8669, pp. 27–35, 09 2014.
    [101] V. J. Marin, T. Pereira, S. Sridharan, and C. R. Rivero, “Automated personalized
    feedback in introductory java programming moocs,” in 2017 IEEE 33rd International Conference on Data Engineering (ICDE), pp. 1259–1270, 2017.
    [102] H. Dohaiha, P. Prasad, A. Maag, and A. Alsadoon, “Deep learning for aspectbased sentiment analysis: A comparative review,” Expert Systems with Applications, vol. 118, 10 2018.
    [103] Z. Kastrati, A. S. Imran, and A. Kurti, “Weakly supervised framework for aspectbased sentiment analysis on students’reviews of moocs,” IEEE Access, vol. 8,
    pp. 106799–106810, 2020.
    [104] I. Sindhu, S. Muhammad Daudpota, K. Badar, M. Bakhtyar, J. Baber, and M. Nurunnabi, “Aspect-based opinion mining on student’s feedback for faculty teaching
    performance evaluation,” IEEE Access, vol. 7, pp. 108729–108741, 2019.
    [105] K. Lundqvist, T. Liyanagunawardena, and L. Starkey, “Evaluation of student
    feedback within a mooc using sentiment analysis and target groups,” The International Review of Research in Open and Distributed Learning, vol. 21, 09 2020.
    [106] T. Durksen, M.-W. Chu, Z. F. Ahmad, A. Radil, and L. Daniels, “Motivation in
    a mooc: a probabilistic analysis of online learners’basic psychological needs,”
    Social Psychology of Education, vol. 19, 06 2016.
    [107] G. Gonçalves, “Studying public health. results from a questionnaire to estimate
    medical students’workload,” Procedia - Social and Behavioral Sciences, vol. 116,
    02 2014.
    [108] M. Cakmak, “Changing roles of teachers: Prospective teachers’ thoughts,” Egitim
    ve Bilim, vol. 36, pp. 14–24, 01 2011.
    [109] R. Marciniak, “Quality assurance for online higher education programmes: Design and validation of an integrative assessment model applicable to spanish universities,” The International Review of Research in Open and Distributed Learning, vol. 19, 04 2018.
    [110] I. Kang, Y. Park, and Y. Kim, “A framework for designing a workflowbased
    knowledge map,” Business Process Management Journal, vol. 9, no. 3, pp. 281–
    294, 2003.
    [111] T. H. Davenport and L. Prusak, “Working knowledge: how organizations manage
    what they know [book review],” IEEE Engineering Management Review, vol. 31,
    pp. 137–137, 2000.
    [112] S. Wang, “Knowledge maps for managing webbased business,” Industrial Management & Data Systems, vol. 102, no. 7, pp. 357–364, 2002.
    [113] E. C. McCagg and D. F. Dansereau, “A convergent paradigm for examining
    knowledge mapping as a learning strategy,” The Journal of Educational Research,
    vol. 84, no. 6, pp. 317–324, 1991.
    [114] J. Kean and J. Reilly, Item response theory. NY: Demos Medical Publishing,
    2014.
    [115] P. Fotaris, T. Mastoras, I. Mavridis, and A. Manitsaris, “Extending lms to support
    irt-based assessment test calibration,” in Technology Enhanced Learning. Quality
    of Teaching and Educational Reform, pp. 534–543, 2010.
    [116] T. W. Kiat, “Test-item analysis,” Singapore Journal of Education, vol. 4, no. 1,
    pp. 39–43, 1981.
    [117] W. Wiersma and S. Jurs, Educational measurement and testing. Allyn and Bacon,1985.
    [118] S. E. Embretson and S. P. Reise, Item response theory. Psychology Press, 2013.
    [119] U. Kubat, “Identifying the individual differences among students during learning
    and teaching process by science teachers,” International Journal of Research in
    Education and Science, pp. 30–68, 01 2018.
    [120] M. G. Hewson and P. W. Hewson, “Effect of instruction using students’ prior
    knowledge and conceptual change strategies on science learning,” Journal of Research in Science Teaching, vol. 20, no. 8, pp. 731–743, 1983.
    [121] L.-Y. Li, “Effect of prior knowledge on attitudes, behavior, and learning performance in video lecture viewing,” International Journal of Human–Computer Interaction, vol. 35, no. 4-5, pp. 415–426, 2019.
    [122] T.-Y. Yang, C. G. Brinton, C. Joe-Wong, and M. Chiang, “Behavior-based grade
    prediction for moocs via time series neural networks,” IEEE Journal of Selected
    Topics in Signal Processing, vol. 11, no. 5, pp. 716–728, 2017.
    [123] K. Jordan, “Mooc completion rates: The data,” e-Learning and Innovative Pedagogies, 07 2013

    QR CODE