研究生: |
陳儀庭 Chen, Yi-Ting. |
---|---|
論文名稱: |
即時臉部表情回饋嵌入遠距同步教學平台之開發與教學應用探究 Development of Embedding Instant Facial Expression Feedback into Synchronous Online Learning Platform and Exploration of Its Educational Applications |
指導教授: |
王淳民
Wang, Chun-Min |
口試委員: |
陳揚學
Chen, Yang-Hsueh 林倍伊 Lin, Pei-Yi |
學位類別: |
碩士 Master |
系所名稱: |
竹師教育學院 - 教育與學習科技學系 Education and Learning Technology |
論文出版年: | 2022 |
畢業學年度: | 110 |
語文別: | 中文 |
論文頁數: | 77 |
中文關鍵詞: | 遠距教學 、系統設計 、臉部表情辨識 |
外文關鍵詞: | Distance Learning, system design, facial expression detection |
相關次數: | 點閱:1 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
隨著2020年初新型冠狀病毒(COVID-19)的爆發,遠距教學已從過去傳統課室面對面教學的替代選項,成為世界各國相繼採用的教育方式。然而相較於傳統教學,遠距的環境在教學上少了許多教師可觀察的社會線索,教學互動的方式也與實體教學截然不同,從這當中要如何突破遠距教學的限制,提升教學的可視性,成了當前極具意義的挑戰。本研究在此背景之下,將臉部表情即時回饋系統嵌入到同步遠距教學平台中,使得教師可即時掌握學生的學習情緒,並採取對應的教學策略來調整教學法。同時,系統回饋介面中也會即時回饋教師的情緒變化,使教師可以覺察自身情緒與學習者情緒之間的關係,並適時調整自身的情緒。
本研究主要是設計臉部表情回饋系統,並將其應用於同步遠距教學活動當中,本研究屬於實驗性質,共進行兩次實驗,先進行系統優化實驗,優化結束後進行教學應用實驗,以非正式的教學情境來進行研究,教學活動中的教學者將由研究者擔任。而每次實驗邀請10名大學學生擔任受試者,前者發現的問題進行調整與修正,後者則進行三次的同步遠距教學,藉由實驗過程來蒐集研究資料。在教學活動過程中除了蒐集教師與學生的表情資料之外,也記錄學生之間的互動,於三次教學活動之後,對所有的學生進行個別訪談,同時研究者也藉由反思與觀察的方式,提供教師端的觀點。其中訪談內容針對臉部表情回饋系統設計、遠距教學接受度及教學互動等三個主要向度進行,此外,研究者也透過觀察與反思,同時搭配學生訪談的結果,來蒐集更深入的想法與建議。
本研究的結果發現,在系統設計面,需考量使用者所需要的訊息及呈現方式,以及設備與網路資源的支援度來進行調整,對於臉部表情即時回饋系統嵌入同步遠距教學,使用者的接受度高,對於嵌入此系統在同步遠距教學活動中,是能降低學生學習壓力及提升教學互動。而在這當中,資訊能力落差、資訊設備與網路支援不足,是造成學習者負面回饋的主要原因。
With the outbreak of the novel coronavirus (COVID-19) in early 2020, distance learning has become an alternative to face-to-face learning in traditional classrooms, and has become an education method adopted by countries all over the world. However, compared with traditional learning, the remote environment lacks many social cues that can be observed in teaching, and the way of teaching interaction is completely different from that of physical teaching. In this case, how to break through the limitations of online teaching and improve teaching visibility has become the most meaningful topic. In this study the facial expression instant detection system was embedded into a synchronous online learning platform, so that teachers were able to grasp the learning emotions of students in real-time and adopt corresponding teaching strategies to adjust teaching methods. At the same time, the interface of feedback steam would return the teacher's emotional changes in real-time, so that teachers can perceive the relationship between their own emotions and the learner's emotions, and adjusted their own emotions promptly.
The main purpose of this study is to design a facial expression detection system and apply it to synchronous online learning activities. Two experiments were conducted. The system optimization experiment was carried out first, followed by the learning application experiment. The study was carried out in an informal teaching situation, and the teacher in the teaching activity was the researcher. Each experiment invited 10 university students to serve as the subjects. The former experiment adjusted and corrected the problems identified, while the latter one conducted three simultaneous online learning sessions to collect research data through the experimental process. In addition to collecting the facial expression data of teachers and students, the interactions among students were recorded during the teaching activities. After three teaching activities, all students were interviewed individually. At the same time, the researchers also provided a teacher's viewpoint through reflection and observation. The interview content was conducted on three main dimensions: facial expression detection system design, online learning acceptance, and learning interaction. In addition, researchers also collected more in-depth ideas and suggestions through observation and reflection, as well as the results of student interviews.
The research found that it is necessary to consider the information and presentation methods required by the users, as well as the support of equipment and network resources to adjust the system design. For students, the acceptance of the embedded system in synchronous online learning activities is high. The system successfully reduces students’ learning pressure and enhance teaching interaction. However, the lack of information capabilities, insufficient information equipment and, network support are the main reasons for negative feedback from learners.
壹、中文部分
Google Meet (2021)。運作方式。2021年11月14日,取自:https://apps.google.com/intl/zh-TW/meet/how-it-works/
LINE (2018)。LINE服務條款。2021年11月14日,取自:https://terms.line.me/line_terms?lang=zh-Hant
Skype (2021)。了解Skype的功能。2021年11月14日,取自:https://www.skype.com/zh-Hant/features/
岳修平(2000)。即時群播遠距教學之班級經營。課程與教學季刊,3(2),63-74頁。
綜合規劃司 (2021)。全國各級學校因應疫情停課居家線上學習。2021年11月14日,取自:https://www.edu.tw/News_Content.aspx?n=9E7AC85F1954DDA8&sms=169B8E91BB75571F&s=8BF1696CC31F4FE9
楊致慧、黎瓊麗 (2013)。科技大學英文課堂師生互動量表之編制。南台人文社會學報,10,1-28。
陳建中、卓淑玲、曾榮瑜 (2013)。台灣地區華人情緒與相關心理生理資料庫─專業表演者臉部表情常模資料。中華心理學刊,55(4)。
襲充文、黃世琤、葉娟妤 (2013)。台灣地區華人情緒與相關心理生理資料庫─大學生基本情緒臉部表情資料庫。中華心理學刊,55(4)。
貳、英文部分
Aleman, A., and Sommer, I. (2020). The silent danger of social distancing. Psychological Medicine, 1–2. https://doi.org/10.1017/S00332917200025
Basharina, O. K.(2007) An activity theory perspective on student-reported contradictions in international telecollaboration. Language Learning and Technology 11, 2 , 82–103. http://dx.doi.org/10125/44105
BigBlueButton Inc. (2019). BigBlueButton. Retrieved November 16, 2021 from http://docs.bigbluebutton.org/
Chiero, R., and Beare, P. (2010). An evaluation of online versus campus-based teacher preparation programs. Journal of Online Learning and Teaching, 6(4), 780-790.
Cisco Webex (2020) Feature summary for the Cisco Webex meetings suite (WBS39). Retrieved August 11, 2021 from https://help.webex.com/en-us/nj6yyt6/Feature-Summary-for-the-Cisco-Webex-Meetings-Suite-WBS39
Costa, K. (2020). Cameras be damned. Retrieved November 16, 2021 from https://www.linkedin.com/pulse/cameras-damned-karen-costa/
Castelli, Frank R, and Sarvary, Mark A. (2021). Why students do not turn on their video cameras during online classes and an equitable and inclusive plan to encourage them to do so. Ecology and Evolution, 11(8), 3565-3576. https://doi.org/10.1002/ece3.7123
Dixon, F. and Federico, J. (2018). RecordingsBN. Retrieved November 16, 2021 from https://moodle.org/plugins/mod_recordingsbn
Dixon, F. and Federico, J. (2020). BigBlueButtonBN. Retrieved November 16, 2021 from https://moodle.org/plugins/mod_bigbluebuttonbn
Ekman, P., Sorenson, E. R., and Friesen, W. V. (1969). Pan-cultural elements in facial displays of emotion. Science, 164(3875), 86-88. https://doi.org/10.1126/science.164.3875.86
Ekman, P. (1973). Cross-cultural studies of facial expression. Darwin and facial expression: A century of research in review, 169-222.
Ekman, P. and Friesen, W. V. (1978). The facial action coding system: A technique for the measurement of facial movement, Palo Alto, CA: Consulting Psychologists Press.
Ekman, P. (2004). Emotional and conversational nonverbal signals. Language, Knowledge, and Representation (Philosophical Studies Series, vol 99, pp. 39-50).Springer. https://doi.org/10.1007/978-1-4020-2783-3_3
Ekman, P. (2018). Facial action coding system. Retrieved November 16, 2021 form https://www.paulekman.com/facial-action-coding-system/
Sánchez Godínez, E. and Stradi Granados, M. S. (2020). Learning Innovation through BigBlueButton technological tool implementation in statistics courses at UNED, Costa Rica. Innovaciones Educativas, 22(33), 106-123. http://dx.doi.org/10.22458/ie.v22i33.2875
Falloon, G. (2011). Making the connection. Journal of Research on Technology in Education, 43(3), 187–209. https://doi.org/10.1080/15391523.2011.1
Fischer, G. (2018). Design trade-offs for quality of life. ACM Interactions, XXV(1), 26–33. https://doi-org.nthulib-oc.nthu.edu.tw/10.1145/3170706
Francescucci, A., and Rohani, L. (2019). Exclusively synchronous online (VIRI) learning: The impact on student performance and engagement outcomes. Journal of Marketing Education, 41(1), 60–69. https://doi.org/10.1177/0273475318818864
Flynn, W., Kumar, N., Donovan, R., Jones, M., and Vickerton, P. (2021). Delivering online alternatives to the anatomy laboratory: Early experience during the COVID ‐19 pandemic. Clinical Anatomy (New York, N.Y.), 34(5), 757-765.
Guth, S., and Helm, F. (2012). Developing multiliteracies in ELT through telecollaboration. ELT Journal, 66(1), 42-51. doi:10.1093/elt/ccr027
Gregory Steel, and Scott L. Jones. (2013). Using virtual environments for synchronous online courses. Journal of Teaching and Learning with Technology, 2(1), 56-61.
Government, UK. (2020). PM address to the nation on coronavirus。Retrieved November 16, 2021 from https://www.gov.uk/government/speeches/pm-address-to-the-nation-on-coronavirus-23-march-2020
Google(2021). AI. Retrieved November 16, 2021 form https://ai.google/
Hassenzahl, Platz, A., Burmester, M., & Lehner, K. (2000). Hedonic and ergonomic quality aspects determine a software’s appeal. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 201–208. https://doi.org/10.1145/332040.332432
Hattie, J., and Gan, M. (2011). Instruction based on feedback. In Handbook of research on learning and instruction (pp. 249-271).Routledge.
HomeMeeting, Inc. (2013). JoinNet user’s guide. Retrieved November 16, 2021 from http://download.homemeeting.com/joinnet/doc/JoinNet_User_Guide.pdf
Hennessy, C., Kirkpatrick, E., Smith, C., and Border, S. (2016). Social media and anatomy education: Using twitter to enhance the student learning experience in anatomy. Anatomical Sciences Education, 9(6), 505-515. https://doi.org/10.1002/ase.1610
Hu, Qiaoping, Mei, Chuanneng, Jiang, Fei, Shen, Ruimin, Zhang, Yitian, Wang, Ce, and Zhang, Junpeng. (2020). RFAU: A database for facial action unit analysis in real classrooms. IEEE Transactions on Affective Computing, 14(8), 1-15. https://doi.org/10.1109/TAFFC.2020.3006392
Huckins, J. F., DaSilva, A. W., Wang, W., Hedlund, E., Rogers, C., Nepal, S. K., Wu, J., Obuchi, M., Murphy, E. I., Meyer, M. L., Wagner, D. D., Holtzheimer, P. E., and Campbell, A. T. (2020). Mental health and behavior of college students during the early phases of the COVID-19 pandemic: Longitudinal smartphone and ecological momentary assessment study. Journal of Medical Internet Research, 22(6), e20185:1-13. https://doi.org/10.2196/20185
Hammedi, S., Essalmi, F., Jemni, M., and Qaffas, A. A. (2020). An investigation of AI in games: educational intelligent games vs non-educational games, 2020 International Multi-Conference on Organization of Knowledge and Advanced Technologies (OCTA) (pp. 1-4).IEEE.
Kreijns, K., Kirschner, P., Jochems, W., and Buuren, H. (2011). Measuring perceived social presence in distributed learning groups. The Official Journal of the IFIP Technical Committee on Education, 16(4), 365-381. https://doi.org/10.1007/s10639-010-9135-7
Kasl, E., and Yorks, L. (2016). Do I really know you? Do you really know me? Empathy amid diversity in differing learning contexts. Adult Education Quarterly, 66(1), 3-20. https://doi.org/10.1177/0741713615606965
Kelsey, A., Mcculloch, V., Gillingwater, T., Findlater, G., and Paxton, J. (2020). Anatomical sciences at the University of Edinburgh: Initial experiences of teaching anatomy online. Translational Research in Anatomy, 19. https://doi.org/10.1016/j.tria.2020.100065
Kratov, S., and Podsadnikov, A. (2021). The overview of software and information support services for distance learning. 2021 15th International Conference on Ubiquitous Information Management and Communication (IMCOM), 1-6. https://doi.org/10.1109/IMCOM51814.2021.9377375
Lin, X., and Gao, L. (2020). Students' sense of community and perspective of taking synchronous and asynchronous online courses. Asian Journal of Distance Education, 15(1), 169–179. https://doi.org/10.5281/zenodo.3881614
Li, F.-F. (2018). How to make A.I. that’s good for people. The New York Times. Retrieved November 16, 2021 from https://www.nytimes.com/2018/03/07/opinion/artificial-intelligence-human.html
Longhurst, G., Stone, D., Dulohery, K., Scully, D., Campbell, T., and Smith, C. (2020). Strength, weakness, opportunity, threat (SWOT) analysis of the adaptations to anatomical education in the United Kingdom and Republic of Ireland in response to the Covid‐19 pandemic. Anatomical Sciences Education, 13(3), 301-311. https://doi.org/10.1002/ase.1967
Miller, P. W. (1988). Nonverbal communication. Third Edition. What research says to the teacher. Retrieved November 16, 2021 from https://eric.ed.gov/?id=ED293190
Mottet, T. P. (2000). Interactive television instructors' perceptions of students' nonverbal responsiveness and their influence on distance teaching. Communication Education, 49(2), 146–164. https://doi.org/10.1080/03634520009379
Mottet, T. P., and Richmond, V. P. (2002). Student nonverbal communication and its influence on teachers and teaching. In J. L. Chesebro & J. C. McCroskey (Eds.), Communication for Teachers (pp. 47–61).Boston: Allyn & Bacon.
Magalhaes Vasconcelos, P., De Araujo Freitas, G., and Marques, T. (2016). Virtualization technologies in web conferencing systems: A performance overview. 2016 11th International Conference for Internet Technology and Secured Transactions (ICITST), 376-383. https://doi.org/10.1109/ICITST.2016.7856734
Microsoft. (2017). Microsoft Teams getting started guide for educators. Retrieved November 16, 2021 from https://onedrive.live.com/view.aspx?resid=91F4E618548FC604!2263&ithint=file%2cdocx&authkey=!AMAtJ_tqrNP2lyg
McKenna, K. (2018). The online classroom: A thorough depiction of distance learning spaces. The Journal of Continuing Higher Education, 66(1), 13-21. https://doi.org/10.1080/07377363.2018.1415633
Martin, F. U., and Bolliger, D. (2018). Engagement matters: Student perceptions on the importance of engagement strategies in the online learning environment. Online Learning Journal, 22(1), 205-222. https://doi.org/10.24059/olj.v22i1.1092
Martin, A. (2020). How to optimize online learning in the age of Coronavirus. UNSW Sydney Newsroom.
Muramatsu, K., and Wangmo, S. (2020). Comparison of traditional and online education in bhutan. Kidmore End: Academic Conferences International Limited. doi:http://dx.doi.org.nthulib-oc.nthu.edu.tw/10.34190/EEL.20.085
Muramatsu, K., & Wangmo, S. (2020). Comparison of traditional and online education in bhutan. Kidmore End: Academic Conferences International Limited. doi:http://dx.doi.org.nthulib-oc.nthu.edu.tw/10.34190/EEL.20.085
Microsoft. (2021). Guidelines for Human-AI Interaction. Retrieved November 16, 2021 form https://www.microsoft.com/en-us/research/project/guidelines-for-human-ai-interaction/
Nichol, J., & Watson, K. (2000). Videotutoring, non‐verbal communication and initial teacher training. British Journal of Educational Technology, 31(2), 135-144. https://doi.org/10.1111/1467-8535.00144
Olszanowski, Pochwatko, Kuklinski, Scibor-Rylski, Lewinski, Ohme, and Olszanowski, Michal. (2015). Warsaw set of emotional facial expression pictures: A validation study of facial display photographs. Frontiers in Psychology, 5, 1516:1-8. https://doi.org/10.3389/fpsyg.2014.01516
Paul Ekman Group. (2018). Facial Action Coding System. Retrieved November 16, 2021 form https://www.paulekman.com/facial-action-coding-system/
Pokhrel, S., & Chhetri, R. (2021). A literature review on impact of COVID-19 pandemic on teaching and learning. Higher Education for the Future, 8(1), 133-141. https://doi.org/10.1177/2347631120983481
Racheva, V. (2018). Social aspects of synchronous virtual learning environments. AIP Conference Proceedings, 2048, 020032:1-9. https://doi.org/10.1063/1.5082050
Sheridan, T. B., and Verplank, W. L. (1978). Human and computer control of undersea teleoperators.Massachusetts Institute of Technology Cambridge Man-Machine Systems Lab.
Swinnerton, B., Morris, N., Hotchkiss, S., & Pickering, J. (2017). The integration of an anatomy massive open online course (MOOC) into a medical anatomy curriculum. Anatomical Sciences Education, 10(1), 53-67. https://doi.org/10.1002/ase.1625
Tang, Chuangao, Xu, Pengfei, Luo, Zuying, Zhao, Guoxing, and Zou, Tian. (2015). Automatic facial expression analysis of students in teaching environments. Biometric Recognition, 9428, 439-447. https://doi.org/10.1007/978-3-319-25417-3_52
UNESCO(2020). COVID19 educational disruption and response. Retrieved November 16, 2021 from https://en.unesco.org/themes/education-emergencies/coronavirus-school-closures
Wallace, F. L., and Wallace, S. R. (2001). Electronic office hours: A component distance learning. Computers & Education, 37(3-4), 195-209. https://doi.org/10.1016/S0360-1315(01)00046-X
Wheeler, Steve. (2002). Student perceptions of learning support in distance education. Quarterly Review of Distance Education, 3(4), 419.
Wang, Y.-M., & Chen, D. V. (2011). Instructors as architects—Designing learning spaces for discussion-based online courses. Journal of Educational Technology Systems, 39(3), 281-294. https://doi.org/10.2190/ET.39.3.e
Wang, J., Xie, H., Wang, F. L., Lee, L. K., & Au, O. T. S. (2021). Top-n personalized recommendation with graph neural networks in MOOCs. Computers and Education: Artificial Intelligence, 2, 100010:1-10. https://doi.org/10.1016/j.caeai.2021.100010
William P Lord. (2021). Designing for social connectivity (Not Everyone Likes Webcams). eLearn. doi:https://doi.org/10.1145/3462445.3457174
Xie, H., Zou, D., Wang, F. L., Wong, T.-L., Rao, Y., and Wang, S. H. (2017). Discover learning path for group users: A profile-based approach. Neurocomputing (Amsterdam), 254, 59–70. https://doi.org/10.1016/j.neucom.2016.08.133
Xie, H., Hwang, G.-J., and Wong, T.-L. (2021). Editorial Note: From conventional AI to modern AI in education: Re-examining AI and analytic techniques for teaching and learning. Educational Technology & Society, 24(3), 85–88.
Yang, S.J.H., Ogata, H., Matsui, T., and Chen, N.S. (2021). Human-centered artificial intelligence in education: seeing the invisible through the visible. Computers and Education: Artificial Intelligence, 2, 100008:1-5. https://doi.org/10.1016/j.caeai.2021.100008
ZoomTW. (2020). Function description. Retrieved November 16, 2021 from https://zoomnow.net/zntw_zoom_compare.php