研究生: |
游雅婷 Ya-ting Yu |
---|---|
論文名稱: |
自動評分系統與雙語索引系統對台灣大學生寫作之影響 Effects of Automatic Essay Grading System and Bilingual Concordancer on EFL College Students’ Writing |
指導教授: |
葉由俐
Yuli Yeh |
口試委員: | |
學位類別: |
碩士 Master |
系所名稱: |
人文社會學院 - 外國語文學系 Foreign Languages and Literature |
論文出版年: | 2004 |
畢業學年度: | 94 |
語文別: | 英文 |
論文頁數: | 123 |
中文關鍵詞: | 自動評分系統 、雙語索引系統 、英文寫作 、台灣大學生 |
外文關鍵詞: | automatic grading system, bilingual concordancer, writing, college students |
相關次數: | 點閱:3 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
提供立即的電腦化回饋(computerized feedback)是目前英語學習的新趨勢;日前一種自動評分系統已推廣於市面上,此種系統能提供學生有關寫作上組織、文法等建議。根據我們的初步觀察發現,此種系統對於學生作文的文法和組織確有幫助,但對於學生最需要的用字遣詞,卻無法提供有效的建議。因此,本實驗除了繼續研究自動評分系統的效用之外,另外加入一個雙語索引工具(TOTALrecall)來提供學生在寫作上用字的幫助。因此,本研究旨在探討﹝一﹞自動評分系統與﹝二﹞雙語索引系統對於台灣大學生寫作上的影響與幫助,以及學習者對這兩種工具的態度與反應。
共有十九位英語系學生參與本研究。在為期一個學期的實驗中,受試者須完成三篇作文。每篇作文先送進MyAccess自動評分系統進行評分,學生再根據所得到的電腦化回饋進行修改。另外,我們會在每篇作文裡,挑出2-3個用字的錯誤,學生需利用TOTALrecall雙語索引工具進行修正。在實驗進行之前,學生需填寫一份背景問卷,以便我們了解學生利用網路學習英文之情形。在實驗結束之後,學生另需填寫有關MyAccess和TOTALrecall的評估問卷,來讓我們了解學生使用此兩種工具的看法。此外,針對學期中的學習情形,我們設計兩種紀錄表,其一為MyAccess紀錄表,學生可馬上記錄下他們使用MyAccess的情形,另一為TOTALrecall紀錄表,學生需記錄下他們針對寫作與用字錯誤所查之單字。
我們針對學生作文在MyAccess所得到之分數進行統計分析,結果顯示MyAccess的回饋報告(feedback report)確使學生的作文有顯著的進步。學生在評估問卷中也指出MyAccess在內容建構、表達意義與文體結構之建議對於寫作有幫助。另外我們發現,經過查詢TOTALrecall之後,超過一半的用字錯誤都得到修正;除了第一次寫作之外,因為當時系統仍不穩定且學生對於如何操作系統仍不熟悉。TOTALrecall對於修正名詞錯誤最為有效,對於形容詞錯誤修正之效果較不顯著。在期末的TOTALrecall評估問卷中,學生也肯定了TOTALrecall在他們寫作上用字遣詞的幫助。
本研究顯示了自動評分系統和雙語索引工具對於學生寫作上提供了有效的幫助。未來除了繼續改善工具效能之外,也可設計線上練習,針對學生常犯之用字錯誤提供更多的幫助。
Providing immediate computerized feedback to improve students’ writing skill at individualized pace has been a new technological approach developed for English learning. Recently, new automatic grading system which claims to provide diagnostic feedback on all aspects such as organization, word usage, and grammar of an essay is available now. A preliminary observation conducted in the Spring semester of 2003 found that students did benefit from computerized feedback on grammar and organization, but they could not obtain from such system suggestions for word usage, an area in which most EFL students are in great need for help. To meet students’ needs for word usage, the current study introduced to students, in addition to an automatic essay grading system, a bilingual concordancer which is advocated as beneficial for word usage in an EFL context (Lin, 2003). The purpose of this study was thus two-fold in investigating how effective (1) a computerized feedback system and (2) a bilingual concordancer were for college EFL students’ writing, revision, and self-correction of errors.
Nineteen freshmen enrolled in a writing class in a university in northern Taiwan participated in this study in Fall 2003 and were asked to compose three writings along the research process. Two online learning tools were applied to help enhance students’ writing skill--an automatic grading system, MyAccess (http://www.gomyaccess.com) for both grading student writing and providing feedback, and a web-based bilingual concodancer, TOTALrecall (http://candle.cs.nthu.edut.tw/candle) for helping students with word usage problems in their drafts or self-correcting errors highlighted by the teacher. Instruments used were two questionnaires (background and attitude); checklists on which students recorded feedback used from MyAccess and words looked up from TOTALrecall.
The analysis of students’ holistic scores indicated that students’ writing was significantly improved with the help of the feedback report from MyAccess. Also, , students considered MyAccess helpful in providing feedback for revision according to the responses from the evaluation questionnaire As for the effectiveness of TOTALrecall, over half of students’ errors were corrected with the tool, except for the first writing which might result from the instability of the tool and students’ unfamiliarity. In addition, TOTALrecall was found to be most helpful in providing information on word usages for nouns and less so in adjectives. Moreover, as shown in the evaluation questionnaire, students also regarded TOTALrecall useful for providing information on word usage and collocation. They also indicated that the parallel corpus made the learning of English words and meanings easier..
Three pedagogical implications are drown from the current study. First, there should be time allotted for learners’ computer literacy and familiarity with the target tools before using tools for computer assisted learning. Second, instructors should teach the students to make best use of the tools out of classroom so that the limited class hours could be effectively used. Third, bilingual concordancing exercises related to collocations and synonyms could be used to expend and deepen students’ vocabulary capacity.
Future research could continue exploring students’ errors on word usage and enlarging error data based on the findings of the current study. Online error exercises are in need to help students improve their word use in writing. To conclude, it is hoped that the encouraging results from the current study could inspire researchers to continue develop CALL software and at the same time, invite more efforts devoted to the field of CALL.
Ashwell, T. (2000). Patterns of teacher response to student writing in a multiple-draft
composition classroom: Is content feedback followed by form feedback the best
method? Journal of Second Language Writing, 9, 227-251.
Chen, H. C. (2001). Diagnosis of difficulties in English writing and suggested
remedial instructional strategies. Selected Papers from the Tenth Internaitonal
Symposium on English Teaching, 300-309.
Chen, H. J. (2000). Developing a web concordancer for English as foreign language learners. ICCE/ICCAI, 1, 340-347.
Chen, L. & Tokuda, N. (2003). A new template-template-enhanced ICALL system for a second language composition course. CALICO Journal, 20, 561-578.
Chung, Gregory K. W. K. & O’Neil, H. F. Jr. (1997). Methodological approaches to online scoring of essays (ERIC Document Reproduction Service No. ED 418101).
Cobb, T. (1997). Is there any measurable learning from hands-on concordancing? System, 25, 301-315.
Cook, V. (1997b). The consequences of bilingualism for cognitive processing. In A.
de Groot & J. F. Kroll (Eds.), Tutorials in bilingualism: Psycholinguisitc
perspectives, (pp. 279-299). Hillsdale, NJ: Lawrence Erlbaum.
Cook, V. (2001). Using the first language in the classroom. Canadian Modern
Language Review, 57, 402-423.
Education Testing Service. (1997). Criterion Student Manual. ETS Technologies.
Ferris, D. R. (1997). The influence of teacher commentary on student revision. TESOL Quarterly, 31, 315-319.
Farris, D. & Roberts, B. (2001). Error feedback in L2 writing classes: How explicit
does it need to be? Journal of Second Language Writing, 10, 161-184.
Flowerdrew, J. (1996). Concordancing in language learning. In Martha, C. P. (Ed.), The Power of CALL, (pp. 97-113). Houston, TX: Athelsten.
Foltz, P. W., Laham, D. & Landauer, T. K. (1999). Automated essay scoring:
Applications to educational technology. In proceedings of EdMedia ’99.
Available on-line: http://www-psych.nmsu.edu/~pfoltz/reprints/Edmedia99.html
Gavioli, L. (1997). Exploring texts through the concordancer: Guiding the learner. In A. Wichmann, S. Fligelston, T. McEnery and G.. Knowles (eds.), Teaching and Language Corpora (pp.83-99). NY: Addison Wesley Longman.
Grauberg, W. (1971). An error analysis in German of first-year university students’. In G.. Perren & J. L. M. Trim (eds.), Applications of Linguistics (pp. 257-263). Cambridge: Cambridge University Press.
Huang, Y. P. (2001). A review of composition teachers’ written feedback from learners’ perspectives. Selected Papers from the Tenth International Symposium on English Teaching.
Huffman, D. T. & Goldberg, J. R. (1987). System, 15, 169-175.
James, C. (1998). Errors in language learning and use. Harlow: Pearson Education.
Johns, T. (1991b). From printout to handout: Grammar and vocabulary teaching in the
context of data-driven learning. In T. Johns & P. King (Eds.), Classroom
concordancing, ELR Journal, 4, 27-45. Birmingham: University of Birmingham.
Lee, C. Y. (2002). A Study of Using Web Concordancing for English Vocabulary
Learning in a Taiwaness High School Context. Master Thesis. National Tsing Hua
University, June.
L’haire, S. & Faltin, A. V. (2003). Error diagnosis in the freetext project. CALICO, 20, 481-495.
Lin, C. C. (2003). Learning collocations in a bilingual corpus. The Proceedings of
2003 International Conference and Workshop on TEFL & Applied Linguistic,
250-256.
Liou, H. C. (1993). Investigation of using text-critiquing programs in a process-oriented writing class. CALICO Journal, 10, 17-38.
Liu, C. P. (1993). 我國大學生英文寫作上的錯誤與補救: 用字措辭之初探. Papers from the Tenth Conference on English Teaching and Learning in the Republic of China, 79-101.
Liu, C. P. (1999). An analysis of collocational errors in EFL writings. The proceedings of the Eighth International Symposium on English Teaching, 483-494. Taipei: Crane.
Meara, P. (1984). The study of lexis in Interlanguage. In A. Davies, C. Criper & A. P. R. Howatt (eds.). Interlanguage: Papers in Honour of S. Pit. Corder (pp.225-235). Edinburgh: Edinburgh University Press.
Vantage Learning Foundation. (2002/2003). MyAccess User’s Guide. Vantage Learning & Summit Intellimetric.
Nash, T., Hsieh, T. L & Chen, S. I. (1989). An evaluation of computer-aided composition. A Collection of Paper Presented in the Sixth Conference on English Teaching and Learning in the Republic of China, 313-323.
Nation, I. S. P. (2001). Learning Vocabulary in Another Language. Cambridge: Cambridge University Press.
Nelson, G. L. & Carson, J. G. (1998). ESL students’ perceptions of effectiveness in
peer response groups. Journal of Second Language Writing, 7, 113-131.
Paulus, T. M. (1999). The effect of peer and teacher feedback on student writing.
Journal of Second Language Writing, 8, 265-289.
Price, G. D. (1989). Grammatik IV: User’s Guide. San Francisco, CA: Reference Software International.
Rightsoft, Inc. (1988). Right Writer: User’s Guide. Sarasota, FL: Right Soft Incorporated.
Rolin-Ianziti, J. & Brownlie, S. (2002). Teacher use of learners’ native language in the
foreign language classroom. Canadian Modern Language Review, 58, 402-426.
Sims, B. R. & DiMaggio, D. (1990). Using computerized textual analysis with technical writing students: Is it effective? The Technical Writing Teacher, 17, 61-68.
Someya, Y. (2000). Online business letter corpus KWIC concordancer and an experiment in data-driven learning/ writing. A paper presented at the 3rd Association for Business Communication International Conference, Doshisha University, August 9, Kyoto, Japan. Down load, 8/6/2003 [on-line]. Available: http://www.kamakuranet.net.jp/~someya/DDW_Report.html
St. John, E. (2001). A case for using a parallel corpus and concordancer for beginners of a foreign language. Language Learning & Technology, 5, 185-203.
Sun, Y. C. (1999). Web-based concordancing: Challenges and opportunities for English language teaching. The Proceedings of the Eighth International Symposium on English Teaching.
Thurstun, J. & Candlin, C. N. (1998). Concordancing and the teaching of the
vocabulary of academic English. English for Specific Purposes, 17, 267-280.
Todd, R. W. (2001). Induction from self-selected concordances and self-correction.
System, 29, 91-102.
Tsui, B. M. (1999). Young ESL writers’ responses to peer and teacher comments in writing. The Proceedings of the Eighth International Symposium on English Teaching.
Wang, L. (2001). Exploring parallel concordancing in English and Chinese. Language
Learning & Technology, 5, 174-184.
Warden, C. A. & Chen, J. F. (1998). The application and impact of pc-based software
in evaluating Taiwan students’ writing error types. 朝陽學報, 3, 215-225.
Yang, N. D. (2004) Using MY ACCESS in EFL writing. 2004 International Conference on TEFL and Applied Linguistics, 550-560. March.
Yeh, Y. L. (2003). Vocabulary learning with concordancer for EFL college students. Proceedings of 2003 International Conference on English Teaching and Learning in the Republic of China, 467-476. 靜宜英文系, May.
Zhang, S. (1995). Re-examining the affective advantage of peer feedback in the ESL writing class. Journal of Second Language Writing, 4, 209-222.