簡易檢索 / 詳目顯示

研究生: 王珮珊
論文名稱: The Relationship between Fluency and Speaking Proficiency Levels in the Context of TOEFL iBT Speaking Tasks
流暢度與口說能力托福iBT口說測驗中之關係探討
指導教授: 張寶玉
口試委員: 黃虹慈
陳浩然
學位類別: 碩士
Master
系所名稱: 人文社會學院 - 外國語文學系
Foreign Languages and Literature
論文出版年: 2012
畢業學年度: 100
語文別: 英文
論文頁數: 163
中文關鍵詞: 流暢度托福口語測驗
相關次數: 點閱:4下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 能流暢的使用一個語言常被視為學習一個新語言的最終目標,因此「流暢度」常在語言測驗中是當作其中一個標準。然而,過去的實驗性研究中多說故事為取得口說的方式,受試者也多生活在目標語國家中、且人數不多。本研究受Iwashita, Brown, McNamara, & O’Hagan (2008)之啟發,欲探討以英語為外來言的受試者在托福iBT口說中的流暢度表現,並看是否Iwashita et al.(2008)之研究結果亦適用於台灣學生。主要研究問題如下:
    1. 在每種題型中,得分為高/中/低的受試者之時間性測量是否有所差異?
    2. 本研究中所使用之時間性測量彼此間之關連性為何?
    本研究共有一百位以英語為外來語的台灣學習者參與,他們不是已考過托福iBT就是正在準備。為確保他們身為以英語為外來語的學習者之代表性,他們皆未曾在國外連續待超過六個月。他們經歷一對一的托福iBT口說仿真測驗。兩位英語教師根據托福口說評分標準給予每位受試者每一題型的口說考試成績,並根據其得分將受試者在每個題型中分入三個不同的程度組別中。時間性測量之使用與Iwashita et al.(2008)之研究相同,並多增加一項在Kormos & Dénes (2004)及Towell, Hawkins, & Bazergui (1996)證實為有效之測量方式 – 回答問題時間比。
    結果顯示當分組分數依據為流暢及語言使用時,每一題型中,得分高/中/低的受試者在其停頓次數、總停頓時間、語速、平均用字長度及回答時間比的使用上有顯著差異。而當分組分數依據為內容時,在題型一、二、三、五中,得分高/中/低的受試者在同樣五個測量方式之使用上也有顯著差異;而題型四,則只有語速在這三個組別的使用上有差別;題型六,則是語速和平均用字長度有所區別。簡言之,得分較高的受試者停頓次數較少、總停頓時間較短、語速較快、平均用字長度較長、並花較多時間在回答上。而此五個在統計上有顯著差異的時間性測量彼此間也呈現相當程度的關聯性。其中,停頓次數、總停頓時間和回答時間比呈現高度相關,而語速和平均用字長度則呈現中至中高度相關。停頓次數和總停頓時間和得分為負相關,亦即停頓次數越多或總停頓時間越長,得分通常越低;而語速、平均用字長度、回答時間比和得分則為正相關,即說話速度越快、平均用字越多、花越多時間回答問題,得分通常越高。
    本研究結果證實以英語為外來語的台灣受試者在測驗的情況下仍在時間性測量方式上呈現出差異,此一結果進一步拓展了我們對「流暢」之了解。在實用性方面,本研究之結果指出部分時間性測量可能抑制考試表現、有些則可增加其口說流暢度,欲參與托福iBT口說之考生將可更明確的注意自己的口說呈現。


    Speaking a language fluently is commonly regarded as the ultimate goal of mastering a new language. As a result, test-takers’ fluency is frequently evaluated as part of speaking proficiency tests. Recently, Iwashita, Brown, McNamara, & O’Hagan (2008) reported the relationship between detailed features of speaking performance and holistic scores of around 200 subjects’ performance on the TOEFL iBT prototype speaking tasks. The results showed that vocabulary and fluency had the strongest impact on distinguishing overall speaking proficiency levels. Among the fluency measures, unfilled pauses, total pause time and speech rate showed a significant relationship with proficiency levels. Inspired by Iwashita et al. (2008), this study aims to investigate EFL test-takers’ fluency on simulated TOEFL iBT speaking tasks. To see whether Iwashita’s results would also apply to EFL learners who mainly receive formal on-campus instructions, we used English learners in Taiwan and propose the following questions:
    1. How do TOEFL iBT speaking test-takers who have different levels of Delivery, Language Use and Topic Development differ in terms of temporal measures of fluency?
    2. What are the relationships among the temporal measures of fluency used in this study?
    The participants were 100 Taiwanese EFL learners who either had already taken the TOEFL iBT or had planned to do so by the year 2010. To make sure that these participants were representative of TOEFL iBT test-takers from Taiwan, they had to spend most of their lives in Taiwan and did not spend more than six months abroad. The participants took one simulated TOEFL iBT speaking test in a one-on-one audio-recorded setting. Their performances were rated by two EFL teachers based on the TOEFL iBT rating scales and were grouped into three groups in each task following three speaking constructs – Delivery, Language Use, and Topic Development. The analyses of the speaking data followed Iwashita et al (2008), including the number of filled pauses, unfilled pauses and repair, total pausing time, speech rate, and mean length of run (MLR). One more variable was added – phonation-time ratio (PTR), which was found to be a useful indicator in identifying group differences in Kormos & Denes (2004) and Towell, Hawkins, & Bazergui (1996).
    The results indicated that the number of unfilled pauses, total pausing time, speech rate, MLR and PTR successfully differentiated test-takers from three groups based on Delivery and Language Use scores throughout all six task types, and in Task 1, 2, 3, 5 based on Topic Development score. Based on Topic Development score, speech rate was the only temporal measure which showed significant results in Task 4, and speech rate as well as MLR showed significant results in Task 6. On the other hand, the number of filled pauses and repair showed limited results in identifying group differences. Also, the five statistically significant temporal measures highly correlated with one another. The number of unfilled pauses, total pausing time and PTR have strong relationships with each other, with the total pausing time being the opposite of the other two. Speech rate and MLR have strong relationships with each other, while speech rate, unfilled pauses and total pausing time have moderately strong negative relationship with each other. Finally, filled pauses and repair seemed to have no obvious relationship with the rest of the temporal measures.
    Previous research on fluency has tended to focus on ESL context or use narrative tasks in non-testing contexts. Not much has been done with monologic tasks in a testing context. Thus, results from this study provided further information on EFL learners’ fluency in a testing context. Additionally, the results from this study could assist test-takers to pay more attention to the significant features attributing to language flow and do better in their actual TOEFL iBT performance.

    ABSTRACT (Chinese)………………………………………………………………...i ABSTRACT (English)……………………………………………………………….iii ACKNOWLEDGEMENTS…………………………………………………………..vi TABLE OF CONTENTS..………………………………………………………..…viii LIST OF TABLES……………………………………………………………………xi LIST OF FIGURES……………………………………………………………….. ...xv Chapter 1 INTRODUCTION…………………………………………………………1 1.1 Research background………………………………….………………………1 1.2 Purpose of the study…………………………………………………………...3 1.3 Definition of terms………………………………….………………………….4 Chapter 2 LITERATURE REVIEW………………………………….………………..5 2.1 Overview of this chapter………………….…………………………………….5 2.2 The nature of speaking ability…………………………………………………..5 2.2.1 The speaking construct……………………………………………………..5 2.2.2 Psychological mechanisms underlying speaking…………………………..8 2.2.3 Summary of section 2.2…………………………………………………...12 2.3 The construct of fluency…………………………………………………….....12 2.3.1 Construct definition…………………………………………………….…12 2.3.1.1 Fluency as proficiency or as a component of proficiency……………13 2.3.1.2 Fluency as opposed to accuracy……………………………………...14 2.3.1.3 Fluency as automaticity of psychological processes…………………15 2.3.2 Measures of fluency………………………………………………………15 2.3.3 Summary of section 2.3……………………………………………….…..20 2.4 The influence of fluency on oral proficiency levels – non-testing condition……………………………………………………………………...21 2.4.1 Studies comparing oral performance between fluent and less fluent L2 learners……………………………………………………………………21 2.4.2 Studies comparing oral performance in different tasks…………………...27 2.4.3 Studies comparing oral performance with and without planning time available before response…………………………………………………29 2.4.4 Summary of section 2.4…………………………………………………...31 2.5 The influence of fluency on oral proficiency levels – testing condition………32 2.6 Speaking tasks………………………………………………………………....35 2.7 Summary of the chapter…..…………………………………………………...39 Chapter 3 METHODOLOGY………………………………………………………..40 3.1 Research questions…………………………………………………………….40 3.2 Design of the study……………………………………………………………41 3.3 Participants…………………………………………………..………………...42 3.4 Instruments……………………………………………..……………………...42 3.5 Data collection procedure………………………………………………….…..51 3.6 Data analysis…………………………………………………………………..52 3.6.1 Transcription………………………………………………………………52 3.6.2 Data rating………………………………………………………………...53 3.6.3 Fluency analysis using seven temporal measures…………………...……55 3.6.4 Statistical analysis….……………………………………………………..58 3.7 Summary of the chapter.………………………………………………………58 Chapter 4 RESULTS…………………………………………………………………60 4.1 Overview………………………………………………………………………60 4.2 Results of research question 1…………………………………………………60 4.2.1 Grouping based on Delivery scores……………………………………….63 4.2.1.1 Task 1…………………………………………………………………64 4.2.1.2 Task 2…………………………………………………………………68 4.2.1.3 Task 3…………………………………………………………………72 4.2.1.4 Task 4…………………………………………………………………76 4.2.1.5 Task 5…………………………………………………………………80 4.2.1.6 Task 6…………………………………………………………………84 4.2.2 Grouping based on Language Use scores…………………………………88 4.2.2.1 Task 1…………………………………………………………………89 4.2.2.2 Task 2…………………………………………………………………94 4.2.2.3 Task 3…………………………………………………………………98 4.2.2.4 Task 4………………………………………………………………..102 4.2.2.5 Task 5………………………………………………………………..106 4.2.2.6 Task 6………………………………………………………………..110 4.2.3 Grouping based on Topic Development scores………………………….114 4.2.3.1 Task 1……………………………………………………………….115 4.2.3.2 Task 2………………………………………………………………..119 4.2.3.3 Task 3………………………………………………………………..123 4.2.3.4 Task 4………………………………………………………………..127 4.2.3.5 Task 5………………………………………………………………..128 4.2.3.6 Task 6………………………………………………………………..133 4.2.4 Summary of research question 1………………………………………...135 4.3 Results of research question 2………………………………………………..135 4.4 Summary of the chapter……………………………………………………...139 Chapter 5 DISCUSSION AND CONCLUSION…………………………………...140 5.1 Overview……………………………………………………………………..140 5.2 Discussion of research question 1……………………………………………140 5.3 Discussion of research question 2……………………………………………144 5.4 Contribution and implications………………………………………………..147 5.5 Limitation and future research…………………………………………….....149 References…………………………………………………………………………..151 Appendices………………………………………………………………………….155 Appendix A………………………………………………………………………155 Appendix B………………………………………………………………………159 Appendix C………………………………………………………………………161

    Anderson, J. R. (1983). The Architecture of Cognition. Cambridge, MA: Harvard
    University Press.
    Brumfit, C. (1984). Communicative Methodology in Language Teaching: The Roles of
    Fluency and Accuracy. Cambridge: Cambridge University Press.
    Chambers, F. (1997). What do we mean by oral fluency? System, 25, 535-544.
    Derwing, T. M., Rossiter, M. J., Munro, M. J., & Thomson, R. I. (2004). Second
    language fluency: Judgments on different tasks. Language Learning, 54 (4),
    655-679.
    Educational Testing Service (2005). Helping your students communicate with
    confidence. Princeton, NJ: Educational Testing Service.
    Educational Testing Service (2007). TOEFL iBT Performance Feedback for Test
    Takers. Princeton, NJ: Educational Testing Service.
    Educational Testing Service (2008). Test and Data Summary for TOEFL iBT Tests
    and TOEFL PBT Tests: January 2007 – December 2007 Test Data. Princeton,
    NJ: Educational Testing Service.
    Educational Testing Service (2009). Test and Data Summary for TOEFL iBT Tests
    and TOEFL PBT Tests: January 2008 – December 2008 Test Data. Princeton,
    NJ: Educational Testing Service.
    Educational Testing Service (2010). Test and Data Summary for TOEFL iBT Tests
    and TOEFL PBT Tests: January 2009 – December 2009 Test Data. Princeton,
    NJ: Educational Testing Service.
    Educational Testing Service (2011). Test and Data Summary for TOEFL iBT Tests
    and TOEFL PBT Tests: January 2010 – December 2010 Test Data. Princeton,
    NJ: Educational Testing Service.
    Educational Testing Service (2012). Test and Data Summary for TOEFL iBT Tests
    and TOEFL PBT Tests: January 2011 – December 2011 Test Data. Princeton,
    NJ: Educational Testing Service.
    Ejzenberg, R. (2000). The juggling act of oral fluency: A psycho-sociolinguistic
    metaphor. In H. Riggenbach (ed.), Perspectives on Fluency (pp. 287-313). Ann
    Arbor: The University of Michigan Press.
    Fillmore, C. J. (1979). On fluency. In C. J. Fillmore, D. Kempler, & W. S-Y. Wang
    (eds.), Individual Differences in Language Ability and Language Behavior (pp.
    85-101). New York: Academic Press.
    Freed. B. F. (1995). What makes us think that students who study abroad become
    fluent? In B. F. Freed (ed.), Second Language Acquisition in a Study Abroad
    Context. Philadelphia, PA: John Benjamins.
    Freed, B. F. (2000). Is fluency, like beauty, in the eyes (and ears) of the beholder? In
    H. Riggenbach (ed.), Perspectives on Fluency (pp. 243-65). Ann Arbor: The
    University of Michigan Press.
    Foster, P. & Skehan, P. (1996). The influence on planning and task type on second
    language performance. SSLA, 18, 299-323.
    Fulcher, G. (2003). Testing Second Language Speaking. London: Pearson Education
    Limited.
    Ginther, A., Dimova, S., & Yang R. (2010). Conceptual and empirical relationships
    between temporal measures of fluency and oral English proficiency with
    implications for automated scoring. Language Testing, 27 (3), 379-399.
    Hatch, E., & Lazaraton, A. (1991). The research manual: Design and statistics for
    applied linguistics. New York: Newbury House Publishers.
    Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second
    language acquisition. Applied Linguistics, 30 (4), 461-473.
    Iwashita, N., McNamara, T., & Elder, C. (2001). Can we predict task difficulty in an
    oral proficiency test? Exploring the potential of an information-processing
    approach to task design. Language Learning, 51 (3), 401-436.
    Iwashita, N., Brown, A., McNamara, T., & O’Hagan, S. (2008). Assessed levels of
    second language speaking proficiency: How distinct? Applied Linguistics, 29
    (1), 24-49.
    Khojastehrad, S. (2012). Hesitation Strategies in an Oral L2 Test among Iranian
    Students Shifted from EFL Context to EIL. International Journal of English
    Linguistics, 2 (3), 10-21.
    Koponen, & Riggenbach, H. (2000). In H. Riggenbach (ed.), Perspectives on Fluency
    (pp. 5-24). Ann Arbor: The University of Michigan Press.
    Kormos, J., & Denes, M. (2004). Exploring measures and perceptions of fluency in
    the speech of second language learners. System, 32, 145-164.
    Kormos, J. (2006). Speech Production and Second Language Acquisition. New
    Jersey: Lawrence Erlbaum Associates.
    Lennon, P. (1990). Investigating Fluency in EFL: A quantitative approach. Language Learning, 40(3), 387-417.
    Lennon, P. (2000). The lexical element in spoken second language fluency. In H.
    Riggenbach (ed.), Perspectives on Fluency (pp. 25-42). Ann Arbor: The
    University of Michigan Press.
    Levelt, W. (1989). Speaking: From intention to articulation. Cambridge, MA: MIT
    Press.
    Luoma, S. (2004). Assessing Speaking. Cambridge: Cambridge University Press.
    Mehnert, U. (1998). The Effects of different Lengths of Time for Planning on Second Language Performance. SSLA, 20, 83-108.

    Ortega, L. (1999). Planning and Focus on Form in L2 Oral Performance. Studies in Second Language Acquisition, 21, 109-148.
    Pawley, A., & Syder, F. H. (1983). Two puzzles for linguistic theory: Nativelike selection and nativelike fluency. In J. C. Richards, & R. W. Schmidt (eds.), Language and Communication (pp. 191-225). London: Longman.
    Riggenbach, H. (1991). Toward an understanding of fluency: A microanalysis of nonnative speaker conversations. Discourse Processes, 14, 423-441.
    Riggenbach, H. (2000). Perspectives on Fluency. Ann Arbor: University of Michigan Press.
    Rossiter, M. J. (2009). Perceptions of L2 fluency by native and non-native speakers of English. The Canadian Modern Language Review, 65(3), 395-412.
    Sawaki, Y., Stricker, L. J., & Oranje, A. H. (2009). Factor structure of the TOEFL Internet-based test. Language Testing, 26 (1), 5-30.
    Schmid, M., & Fagersten, K. (2010). Disfluency Markers in L1 Attrition. Language Learning, 60 (4), 753-791.
    Schmidt, R. (1992). Psychological mechanisms underlying second language fluency. SSLA, 14, 357-385.
    Skehan, P. (1998). A Cognitive Approach to Language Learning. Oxford: Oxford University Press.
    Towell, R., Hawkins, R., & Bazergui, N. (1996). The Development of Fluency in Advanced Learners of French. Applied Linguistics, 17 (1), 84-119.
    Wood, D. (2001). In search of fluency: What is it and how can we teach it? The
    Canadian Modern Language Review, 57 (4), 573-589.

    無法下載圖示 全文公開日期 本全文未授權公開 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)

    QR CODE