在跨語言溝通的情境之中，人們通常使用共同語言來溝通，非該共同語言母語人士（non-native speaker, NNS）相較於母語人士（native speaker, NS），時常遇到諸如無法正確理解母語人士的涵義以及無法跟上進行中對話等問題。過往研究中雖已證實自動語音辨識字幕（automated speech recognition transcript）能有效增進非母語人士對會話內容的理解，然而自動語音辨識字幕的錯誤與延遲，以及同時聽、說、讀非母語的語言，都在在增加了非母語人士在對話中的負荷。為了減輕非母語人士的負荷，本篇論文提出在自動語音辨識字幕上增加新的訊息通道，即是讓母語人士替非母語人士在自動語音辨識字幕上標註出重點，使得非母語人士能更輕易得到自動語音辨識字幕所帶來的好處。我們進行了組內設計實驗來驗證此一新的訊息通道（標註重點）對於跨語言溝通之影響，14個包含兩個母語人士及一個非母語人士的三人小組在有／無在自動語音辨識字幕上標註重點功能的兩個不同的條件下，分別進行合作性的討論。實驗結果發現，母語人士不但自發性地去標註重點，標註重點也使得他們更專注在實驗任務中並增進了他們在實驗任務中的表現，除此之外，非母語人士在跨語言溝通所認知到的訊息清晰度以及自在程度也有顯著提升。我們發現，母語人士在自動語音辨識上標註重點，可以幫助到跨語言溝通中的雙方，並進一步探討此一研究發現對於跨語言溝通系統設計之影響。

In multilingual communication through a common language among both native speakers (NS) and non-native speakers (NNS), NNS may encounter problems in comprehending the messages of NS or following conversations. Even though automated speech recognition (ASR) transcripts provide support to NNS, such transcripts may contain errors and impose the need to simultaneously listen and read. To reduce this burden, we propose adding another channel (i.e., highlighting) through which NS can help NNS by highlighting the critical parts of transcripts, thus making them more useful to NNS. In a laboratory study involving 14 triads (two NS and one NNS in each triad), participants engaged in collaborative discussions under two conditions: audio conferencing plus ASR transcripts with and without the highlighting function. NS showed various motivations to perform the extra task of highlighting. The highlighting efforts helped NS themselves focus on the discussion and enhanced their task performance while increasing the clarity and comfort perceived by NNS during communication. Having NS generating highlights can benefit both NS and NNS, but in different ways. We discuss the implications for research and design of multilingual collaborative work.

1. Herbert H. Clark and Susan E. Brennan. 1991. Grounding in communication. In L. B. Resnick, J. M. Levine, & S. D. Teasley, (Eds.). Perspectives on Socially Shared Cognition (pp. 127-149). APA Press.
2. Alan J. Feely and Anne-Wil Harzing. 2003. Language management in multinational companies. Cross-Cultural Management: An Int’l Journal, 10: 37–52.
3. Ge Gao, Hao-Chuan Wang, Dan Cosley, and Susan R. Fussell. 2013. Same translation but different experience: the effects of highlighting on machine-translated conversations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 449-458.
4. Ge Gao, Naomi Yamashita, Ari M.J. Hautasaari, Andy Echenique, and Susan R. Fussell. 2014. Effects of public vs. private automated transcripts on multiparty communication between native and non-native English speakers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 843-852.
5. Ge Gao, Naomi Yamashita, Ari M.J. Hautasaari, and Susan R. Fussell. 2015. Improving Multilingual Collaboration by Displaying How Non-native Speakers Use Automated Transcripts and Bilingual Dictionaries. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 3463-3472.
6. Christine C.M. Goh. 2000. A cognitive perspective on language learner’s listening comprehension problems. System 28, 1: 55-75.
7. Cheng-Hsien Han, Chi-Lan Yang, and Hao-Chuan Wang. 2014. Supporting second language reading with picture note-taking. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14), 2245-2250.
8. Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In P. A. Hancock and N. Meshkati (Eds.) Human Mental Workload. Amsterdam: North Holland Press.
9. Ari Hautasaari and Naomi Yamashita. 2014. Catching up in audio conferences: highlighting keywords in ASR transcripts for non-native speakers. In Proc. of the 5th ACM International Conference On Collaboration Across Boundaries: Culture, Distance & Technology, 107-110.
10. Rieko Inaba, Yohei Murakami, Akiyo Nadamoto, Toru Ishida. Multilingual Communication Support Using the Language Grid. In Intercultural Collaboration. Springer, Berlin, 118-132.
11. Vaiva Kalnikaitė, Patrick Ehlen, and Steve Whittaker. 2012. Markup as you talk: establishing effective memory cues while still contributing to a meeting. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (CSCW '12), 349-358.8
12. Mardi Kidwell. 2000. Common ground in cross-cultural communication: Sequential and institutional contexts in front desk service encounters. Issues of Applied Linguistics 11, 1: 17-37.
13. Edith Law and Luis von Ahn. 2011. Human Computation (1st ed.). Morgan & Claypool Publishers.
14. Han Z. Li. 1999. Grounding and information communication in intercultural and intracultural dyadic discourse. Discourse Processes 28, 3: 195-215.
15. Han Z. Li, Young-ok Yum, Robin Yates, Laura Aguilera, Ying Mao, & Yue Zheng. 2005. Interruption and Involvement in Discourse: Can Intercultural Interlocutors be Trained? Journal of Intercultural Communication Research 34, 4: 233-254.
16. Leigh Anne Liu, Chei Hwee Chua and Günter Stahl. 2010. Quality of communication experience: definition, measurement, and implications for intercultural negotiations. Journal of Applied Psychology 95, 3: 469-487.
17. Catherine C. Marshall. 1997. Annotation: from paper books to the digital library. In Proceedings of the second ACM international conference on Digital libraries (DL '97), 131-140.
18. Yingxin Pan, Danning Jiang, Michael Picheny, and Yong Qin. 2009. Effects of real-time transcription on non-native speaker's comprehension in computer-mediated communications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 2353-2356.
19. Pamela Rogerson-Revell. 2008. Participation and performance in international business meetings. English for Special Purposes 27, 3: 338-360.
20. Yohtaro Takano and Akiko Noda. 1995. Interlanguage dissimilarity enhances the decline of thinking ability during foreign language processing. Language Learning 45, 4: 657-681.
21. Craig S. Tashman and W. Keith Edwards. 2011. Active reading and its discontents: the situations, problems and ideas of readers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 2927-2936.
22. Michael D. Tyler. 2001. Resource consumption as a function of topic knowledge in nonnative and native comprehension. Language Learning 51, 2: 257-280.
23. Eric Wallen, Jan L. Plass, and Roland Brünken. 2005. The function of annotations in the comprehension of scientific texts: Cognitive load effects and the impact of verbal ability. Educational Technology Research and Development 53, 3: 59-71.
24. Hao-Chuan Wang, Susan Fussell, and Dan Cosley. 2013. Machine translation vs. common language: effects on idea exchange in cross-lingual groups. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW '13), 935-944.
25. Joanna L. Wolfe. 2000. Effects of annotations on student readers and writers. In Proceedings of the fifth ACM conference on Digital libraries (DL '00), 19-26.
26. Jen-Her Wu, Yufei Yuan. 2003. Improving searching and reading performance: the effect of highlighting and text color coding. Information & Management 40, 7: 617-637.
27. Naomi Yamashita, Andy Echenique, Toru Ishida, and Ari Hautasaari. 2013. Lost in transmittance: how transmission lag enhances and deteriorates multilingual collaboration. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW '13), 923-934.
28. Lin Yao, Yingxin Pan, and Danning Jiang. 2011. Effects of automated transcription delay on non-native speakers' comprehension in real-time computer-mediated communication. In Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I (INTERACT'11), 207-214.
29. Chien Wen Yuan, Leslie D. Setlock, Dan Cosley, and Susan R. Fussell. 2013. Understanding informal communication in multilingual contexts. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW '13), 909-93.