簡易檢索 / 詳目顯示

研究生: 黃博信
Huang, Po Hsin
論文名稱: 應用使用性測試方法於新產品雛型開發之研究
Applying Usability Testing Methods for New Product Prototypes Development
指導教授: 黃雪玲
Hwang, Sheue Ling
邱銘傳
Chiu, Ming Chuan
口試委員: 王茂駿
Wang, Mao Jiun
王明揚
Wang, Min Yang
林久翔
Lin, Chiu Hsiang
趙金榮
Chao, Chin Jung
學位類別: 博士
Doctor
系所名稱: 工學院 - 工業工程與工程管理學系
Department of Industrial Engineering and Engineering Management
論文出版年: 2015
畢業學年度: 103
語文別: 英文
論文頁數: 95
中文關鍵詞: 使用性測試主觀和客觀指標DAISY 播放機DAISY 電子教科書健康管理系統
外文關鍵詞: Usability Testing, Objective and Subjective Metrics, DAISY Player, DAISY E-Textbooks, Health Management System
相關次數: 點閱:1下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 使用性測試在產品開發階段時就應扮演重要的角色,因其能找出不良與不便的設計問題,進而檢討並改善。然而,很少有針對產品在雛型時期即導入使用性測試的研究。因此,根據產品的特性,本研究將客觀和主觀指標整合成使用性測試方法,針對產品雛型進行評估,以更深入更全面的了解使用者對產品使用性的接受程度,期能讓產品在進入市場時就具有最佳的使用性。而本研究為了探究使用性測試方法在產品雛型期所能發揮之成效,故將整合的使用性測試方法針對三個產品雛型執行檢測。首先,本研究重新設計一款能提供給台灣人甚至於所有人使用的DAISY雛型機,並設計一使用性測試實驗進行測試。實驗結果證實,DAISY雛型機具有最快的操作時間,最少操作錯誤,以及最低的心智負荷。研究結果提供給下一代DAISY播放機的開發商,供其開發出讓使用者能輕易上手之DAISY播放機。另外,對於視障生而言,常常在數學課程和數學考試中感到挫折,最後就會放棄數學這門課程。因此,本研究提出一個基於DAISY標準製做的電子教科書,所設計的新數學教學及學習方式,同時建立使用性測試實驗進行評估,研究結果顯示使用DAISY電子教科書之數位學習方式對視障生的數學學習確有明顯助益。同時,隨著國內健康管理系統的市場越來越受到歡迎,本研究根據文獻整合及應用使用性問卷,並藉由使用性測試的實驗,評估一套健康管理雛型系統。根據實驗結果,提供改善實際的健康管理產品的使用性的建議,讓產品在進入市場之前就有較佳的使用性。在學術貢獻上,本研究整合的使用性測試方法,可以應用在未來產品設計及開發的相關學術研究中;在實務貢獻上,本研究致力於將使用性測試方法加入於產品雛型開發過程。研究結果顯示,整合的使用性測試方法確實能幫助產品雛型改設計及改善,有助於讓新產品更加的舒適及易用,更能貼近使用者的需求。


    Usability testing can evaluate product performance and improve the usability of new product prototype. However, various types of products need different usability testing methods during development process. According to the product attribute, this dissertation integrates usability testing methods that incorporate the objective and subjective metrics to evaluate new product prototypes comprehensively before launching to the market. Three new product prototypes are utilized to verify these usability testing methods at product design stage. Firstly, usability testing experiment is conducted to improve the performance of new DAISY plyer prototype. Results and findings have allowed us to generate suggestions for developing the next generation DAISY players for impaired people, especially for Chinese audience. In addition, this dissertation presents a new learning approach based on the DAISY e-textbooks, and conducts usability testing to evaluate the learning effects. Results show that the new approach effectively improved visually impaired students’ mathematics proficiency. Finally, this dissertation integrates and applies usability metrics to evaluate a health management product prototype. Based the results, usability of a new product prototypes are improved before it entered the market. Academically, this dissertation integrates the objective and subjective metrics as usability testing methods. Practically, this dissertation is actually benefiting a new product prototype to be more comfortable and suitable for use.

    摘要 II Abstract III 誌謝 IV Contents V List of Figures VIII List of Tables IX Chapter 1. Introduction 1 1.1 Background and Motivation 1 1.2 Objective 2 1.3 Research Framework 3 Chapter 2. Literature Review 5 2.1 Usability 5 2.1.1 Usability Testing 5 2.1.2 National Aeronautics and Space Administration-Task Load Index 6 2.1.3 Physiological indicator 6 2.2 Digital Accessible Information SYstem 7 2.3 Electronic Learning 9 2.4 User Centered Design 9 2.5 Universal Design 10 2.6 Specifications for the Digital Talking Books 11 2.7 The Goals, Operators, Methods and Selection Model 12 2.8 Summary 13 Chapter 3. Methodology 17 3.1 Methods 17 3.2 Variables 17 3.3 Process 18 Chapter 4. Usability Testing on New DAISY Player Prototype 19 4.1 Design Process and Experiment 21 4.1.1 Understand and Specify the Context of Use 23 4.1.2 Specify the User Requirements 23 4.1.3 Product Design Solutions 26 4.1.4 Usability Testing 30 4.2 Results of the New DAISY Player Prototype Experiment 37 4.2.1 Subjective Mental Workload 37 4.2.2 User Performance and Open Ended Questionnaire 38 4.2.3 New DAISY Player Prototype Interface 41 4.3 Discussion 45 4.4 Summary of the New DAISY Player Prototype Development 47 Chapter 5. Usability Testing on New E-learning Accessibility System 49 5.1 Curriculum Development and Experiment 50 5.1.1 Curriculum and E-Textbooks Development 51 5.1.2 Experimental Design 53 5.1.3 Experimental Participants 53 5.1.4 Experimental Equipment 53 5.1.5 Experiment Process 54 5.2 Results of the New E-learning Accessibility System Experiment 55 5.2.1 Questionnaire Responses 55 5.2.2 Interview Results 56 5.2.3 Experimental Results 57 5.3 Finding and Implication 58 5.3.1 Finding 58 5.3.2 Implication 60 5.4 Summary of the New E-learning Accessibility System Development 61 Chapter 6. Usability Testing on New Health Management System 63 6.1 Design of Experiments 64 6.1.1 Participants 64 6.1.2 Apparatus 64 6.1.3 Task and Process 65 6.1.4 Data Collection 66 6.2 Results of the New Health Management System Experiment 68 6.2.1 NASA-TLX Result 68 6.2.2 Usability Questionnaire Results 69 6.2.3 Average Increase Heart Rate 69 6.3 Discussion and Suggestion 70 6.4 Summary of the New Health Management System Development 73 Chapter 7. Conclusion 75 7.1 Conclusion 75 7.2 Contribution 76 7.2.1 Academic Contribution 76 7.2.2 Practical Contribution 76 References 77 Appendix A: Relevant DTBs Playback Device Guidelines 84 Appendix B: Visually Impaired Student Survey Questionnaire 86 Appendix C: Questionnaire 90 I. NASA-TLX Questionnaires 90 II.Usability Questionnaire 90 Appendix D: Human Research Ethics Committee Approval 95

    Abras, C., Maloney-Krichmar, D., & Preece, J. (2004). User-centered design.Bainbridge, W. Encyclopedia of Human-Computer Interaction. Thousand Oaks: Sage Publications, 37(4), 445-456.
    Afacan, Y., & Erbug, C. (2009). An interdisciplinary heuristic evaluation method for universal building design. Applied Ergonomics, 40(4), 731-744.
    Alelaiwi, A., & Hossain, M. S. (2014). Evaluating and Testing User Interfaces for Engineering Education Tools: Usability Testing. INTERNATIONAL JOURNAL OF ENGINEERING EDUCATION, 30(3), 603-609.
    Amant, R. S., Freed, A. R., & Ritter, F. E. (2005). Specifying ACT-R models of user interaction with a GOMS language. Cognitive Systems Research, 6(1), 71-88.
    American National Standard Developed by the National Information Standards Organization [ANSI/NISO] Z39.86-2005, (2012). Specifications for the Digital Talking Book. Retrieved May 1, 2014 from World Wide Web: http://www.niso.org/apps/group_public/project/details.php?project_id=88.
    Beecher, V., & Paquet, V. (2005). Survey instrument for the universal design of consumer products. Applied Ergonomics, 36(3), 363-372.
    Bentley, T. A., Catley, B., Forsyth, D., & Tappin, D. (2014). Understanding workplace violence: The value of a systems perspective. Applied ergonomics, 45(4), 839-848.
    Buurman, R. D. (1997). User-centred design of smart products. Ergonomics, 40(10), 1159-1169.
    Card, S. K., Newell, A., & Moran, T. P. (1983). The psychology of human-computer interaction. NJ: Lawrence Erlbaum Associates.
    Card, S. K., Moran, T. P., & Newell, A. (1980). Computer text-editing: An information-processing analysis of a routine cognitive skill. Cognitive psychology, 12(1), 32-74.
    Card, S. K., Moran, T. P., & Newell, A. (1980). The keystroke-level model for user performance time with interactive systems. Communications of the ACM, 23(7), 396-410.
    Campbell, B. A., Tossell, C. C., Byrne, M. D., & Kortum, P. (2014). Toward More Usable Electronic Voting Testing the Usability of a Smartphone Voting System. Human Factors: The Journal of the Human Factors and Ergonomics Society, 0018720813519266.
    Center for Universal Design, (1997). The principles of universal design. Raleigh: North Carolina State University.
    Clarkson, J. (Ed.). (2003). Inclusive design: Design for the whole population. Springer.
    Crombie, D., Lenoir, R., McKenzie, N., Nicotra, G., & Nesi, P. (2004). The Interactive-Music Network.
    Davids, M. R., Chikte, U., Grimmer‐Somers, K., & Halperin, M. L. (2014). Usability testing of a multimedia e‐learning resource for electrolyte and acid‐base disorders. British Journal of Educational Technology, 45(2), 367-381.
    Diaper, D., & Stanton, N. (Eds.). (2003). The handbook of task analysis for human-computer interaction. CRC Press.
    Digital Accessible Information SYstem (DAISY) Consortium, (2014). The current DAISY Standard (DAISY 3) is officially the ANSI/NISO Z39.86-2005 (R2012) Specifications for the Digital Talking Book. Retrieved on January 1, 2014, from http://www.daisy.org/daisy-3.
    Di Stasi, L. L., Antolí, A., & Cañas, J. J. (2011). Main sequence: an index for detecting mental workload variation in complex tasks. Applied ergonomics, 42(6), 807-813.
    Dumas, J. S., & Redish, J. (1999). A practical guide to usability testing. Intellect Books.
    Ecalle, J., Kleinsz, N., & Magnan, A. (2013). Computer-assisted learning in young poor readers: The effect of grapho-syllabic training on the development of word reading and reading comprehension. Computers in Human Behavior, 29(4), 1368-1376.
    Fänge, A., & Iwarsson, S. (2003). Accessibility and usability in housing: Construct validity and implications for research and practice. Disability & Rehabilitation, 25(23), 1316-1325.
    Federici, S., & Borsci, S. (2010). Usability evaluation: models, methods, and applications. International Encyclopedia of Rehabilitation, 1-17.
    Fisk, A. D., & Rogers, W. A. (1997). Handbook of human factors and the older adult. Academic Press.
    Fruchterman, J. (2008). Accessing Books and Documents. In Assistive Technology for Visually Impaired and Blind People (pp. 555-580). Springer London.
    Gardner, J., Bulatov, V., & Kelly, R. (2009). Making journals accessible to the visually impaired: the future is near. Learned publishing: journal of the Association of Learned and Professional Society Publishers, 22(4), 314.
    German Central Library for The Blind, Who we are and what we do (2011). Retrieve July 15, 2014 from World Wide Web: http://www.dzb.de/en/about-us.html.
    Gray, W. D., John, B. E., & Atwood, M. E. (1993). Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human-computer interaction, 8(3), 237-309.
    Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52, 139-183.
    Henry, S. L., Law, C., & Barnicle, K. (2001). Adapting the design process to address more customers in more situations. In UPA (Usability Professionals’ Association) 2001 Conference.
    Hertzum, M., Hansen, K., & Andersen, H. (2009). Scrutinising Usability Evaluation: Does Thinking Aloud Affect Behaviour and Mental Workload? Behaviour & Information Technology, 28(2), 165-181
    Hornbæk, K. (2006). Current practice in measuring usability: Challenges to usability studies and research. International journal of human-computer studies, 64(2), 79-102.
    Hong, Y., Goldberg, D., Dahlke, D. V., Ory, M. G., Cargill, J. S., Coughlin, R., ... & Peres, S. C. (2014). Testing usability and acceptability of a web application to promote physical activity (iCanFit) among older adults. JMIR Human Factors, 1(1), e2.
    International Organization for Standardization [ISO]. (1998). Ergonomic requirements for office work with visual display terminals (VDT) s-Part II Guidance on Usability (ISO/IEC 9241-11). International Organization for Standardization.
    International Standardization Organization [ISO] 9241-210. (2010). Ergonomics of human system interaction - Part 210: Human-centred design for interactive systems (formerly known as 13407). Switzerland: International Standardization Organization.
    International Diabetes Federation [IDF]. (2013). DIABETES IN TAIWAN – 2013, Retrieved May 1, 2014, from World Wide Web: http://www.idf.org/membership/wp/taiwan.
    International Organization for Standardization [ISO] 13407. (2010). Human - Centred Design Processes for Interactive Systems. Retrieved May 1, 2014, from World Wide Web: http://www.iso.org/iso/home/store/catalogue_ics/catalogue_detail_ics.htm?csnumber=52075.
    Institute of Labor, Occupational Safety and Health, Ministry of Labor, Taiwan [ILOSH]. (2014). Taiwanese anthropometric database, Retrieve May 1, 2014, from World Wide Web: http://www.iosh.gov.tw/wSite/ct?xItem=7295&ctNode=665&mp=11.
    Jastrzembski, T. S. (2006). The model human processor and the older adult: Validation and error extension to GOMS in a mobile phone task.
    John, B. E., & Kieras, D. E. (1996). The GOMS family of user interface analysis techniques: Comparison and contrast. ACM Transactions on Computer-Human Interaction (TOCHI), 3(4), 320-351.
    Jung, K., & Jang, J. (2015). Development of a two-step touch method for website navigation on smartphones. Applied Ergonomics, 48, 148-153.
    Karaksha, A., Grant, G., Davey, A. K., & Anoopkumar-Dukie, S. (2011). Development and evaluation of computer-assisted learning (CAL) teaching tools compared to the conventional didactic lecture in pharmacology education.EDULEARN11 Proceedings, 3580-3589.
    Kieras, D. E. (1988). Towards a practical GOMS model methodology for user interface design. Handbook of human-computer interaction, (7), 135-157.
    Kieras, D. E. (1999). A guide to GOMS model usability evaluation using GOMSL and GLEAN3. University of Michigan, 1-12.
    Kjeldskov, J., & Stage, J. (2004). New Techniques for Usability Evaluation of Mobile Systems. International Journal of Human-Computer Studies, 60(5-6), 599-620.
    Kieras, D. (2003). GOMS models for task analysis. The handbook of task analysis for human-computer interaction, 83-116.
    Kontogiannis, T., & Embrey, D. (1997). A user-centred design approach for introducing computer-based process information systems. Applied Ergonomics, 28(2), 109-119.
    Krajnc, M. (2009). E-learning environment integration in the chemical engineering educational process. International Journal of Engineering Education, 25(2), 349-357.
    Leas, D., Persoon, E., Soiffer, N., & Zacherle, M. (2008). Daisy 3: A Standard for Accessible Multimedia.
    Leahy, D., & Lawler, S. (2012). NCBI and digital literacy: a case study (pp. 243-250). Springer Berlin Heidelberg.
    Lee, S. H. (1999). Usability testing for developing effective interactive multimedia software: concepts, dimensions, and procedures. Educational Technology & Society, 2(2), 1-13.
    Lewis, J.R. (2006). Usability testing. John Wiley, New York.
    Lenker, J., Nasarwanji M., Paquet V., and Feathers, D. (2011). A Tool for Rapid Assessment of Product Usability and Universal Design: Development and Preliminary Psychometric Testing. Journal of Work, 39:141–150.
    Likert, R. (1932). A technique for the measurement of attitudes. Archives of psychology, 140, 1-55.
    Lin, H., Choong, Y., & Salvendy, G. (1997). A Proposed Index of Usability: A Method for Comparing the Relative Usability of Different Software Systems. Journal of Behaviour & Information Technology, 16(4-5), 267-277.
    Lin, K. C., & Wu, C. F. (2015). Practicing universal design to actual hand tool design process. Applied Ergonomics, 50, 8-18.
    Lin, C.S. (2009). The basic philosophy of mathematics education, Retrieved July 1, 2014, from World Wide Web: http://www.math.ntu.edu.tw/community/viewtopic.php?CID=7&Topic_ID=48
    Ma, X., Yan, B., Chen, G., Zhang, C., Huang, K., Drury, J., & Wang, L. (2013). Design and Implementation of a Toolkit for Usability Testing of Mobile Apps. Mobile Networks and Applications, 18(1), 81-97.
    Mandryk, R., Inkpen, K. & Calvert, T. (2006). Using Psycho-Physiological Techniques to Measure User Experience with Entertainment Technologies. Journal of Behaviour & Information Technology, 25(2), 141-158.
    McGookin, D., Brewster, S., & Jiang, W. (2008). Investigating touchscreen accessibility for people with visual impairments. In Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges (pp. 298-307). ACM.
    McNabb, K., & Tamaira, M. (2010). Once upon a library: NVDA and the Aotearoa People’s Network Kaharoa. In Round Table On Information Access for People With Print Disabilities Conference, Auckland, New Zealand. Retrieved from from World Wide Web: http://printdisability.files.wordpress. com/2010/11/8a-once-upon-alibrary1.doc.
    Morgan, G. (2003). A word in your ear: library services for print disabled readers in the digital age. Electronic Library, 21(3), 234-239.
    Mouzé-Amady, M., Raufaste, E., Prade, H., & Meyer, J. P. (2013). Fuzzy-TLX: using fuzzy integrals for evaluating human mental workload with NASA-Task Load indeX in laboratory and field studies. Ergonomics, 56(5), 752-763.
    National Information Standards Organization [NISO], (2005). Specifications for the Digital Talking Book, Retrieved July 1, 2014 from World Wide Web: http://www.niso.org/workrooms/daisy/Z39-86-2002.html.
    Nakagawa, S. (2006). Textbook for universal design. Longsea press, Taipei, Taiwan.
    Ng, A. W., Siu, K. W. M., & Chan, C. C. (2012). The effects of user factors and symbol referents on public symbol design using the stereotype production method. Applied Ergonomics, 43(1), 230-238.
    Nielson, J. (1993). Usability Engineering. San Francisco: Morgan Kaufmann.
    Nielsen, J. (1994). Usability Inspection Methods. New York NY: Wiley.
    Noyes, J. M., & Bruneau, D. P. (2007). A self-analysis of the NASA-TLX workload measure. Ergonomics, 50(4), 514-519.
    Nunnally, J. C., Bernstein, I. H., & Berge, J. M. T. (1994). Psychometric Theory (Vol. 226). New York: McGraw-Hill.
    Olson, J. R., & Olson, G. M. (1990). The growth of cognitive modeling in human-computer interaction since GOMS. Human–computer interaction, 5(2-3), 221-265.
    Oray, W.D., John, B., & Atwood, M. (1993). Project Ernestine: Validating GOMS for predicting and explaining real-world task performance. Human Computer Interaction, 8. pp. 112-120.
    Palo, A. (2010). Bookshare Celebrates Major Milestone: 100,000 Students: Exceeds target & serves more students. Retrieve July 15, 2014, from the World Wide Web: https://www.bookshare.org/_/aboutUs/2010/10/100kStudents.
    Paterson, S. (2011). CNIB library for the blind: Placing library service for the blind in the community. Retrieve July 15, 2014 from World Wide Web: http://www.collectionscanada.gc.ca/accessinfo/005003-3020-10-2001-e.html.
    Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., & Carey, T. (1994).Human-computer interaction. Addison-Wesley Longman Ltd.
    Preiser, W. F., & Ostroff, E. (Eds.). (2001). Universal design handbook. McGraw Hill Professional.
    Rogers, Y., Sharp, H., & Preece, J. (2011). Interaction design: beyond human-computer interaction. John Wiley & Sons.
    Rose, J. A., & Bearman, C. (2012). Making effective use of task analysis to identify human factors issues in new rail technology. Applied Ergonomics, 43(3), 614-624.
    Salvendy, G. (1997). Handbook of human factors and ergonomics. Hoboken, N.J.:John Wiley & Sons.
    Sauer, J., & Sonderegger, A. (2011). The influence of product aesthetics and user state in usability testing. Behaviour & Information Technology, 30(6), 787-796.
    Schrepp, M. (2006). On the efficiency of keyboard navigation in Web sites. Universal Access in the Information Society, 5(2), 180-188.
    Schittek, M., Mattheos, N., Lyon, H. C., & Attström, R. (2010). Computer assisted learning. A review. European Journal of Dental Education, 5(3), 93-100.
    Shneiderman, B. (1998). Designing the user interface: Strategies for effective human-computer interaction (3th Edition). Boston: Addison-Wesley.
    Shackel, B., & Richardson, S. (Eds.). (1991). Human Factors for Informatics Usability. Cambridge University Press
    Sonderegger, A., Sauer, J. (2010). The influence of design aesthetics in usability testing: Effects on user performance and perceived usability. Applied Ergonomics, 41(3), 403-410.
    Story, M. F. (1998). Maximizing usability: the principles of universal design. Assistive technology, 10(1), 4-12.
    Stickel, C., Ebner, M., Steinbach-Nordmann, S., Searle, G., & Holzinger, A. (2009). Emotion detection: application of the valence arousal space for rapid biological usability testing to enhance universal access. In Universal Access in Human-Computer Interaction. Addressing Diversity (pp. 615-624). Springer Berlin Heidelberg.
    Statistical Yearbook of Republic of China Interior. (2014). Retrieved May 1, 2014 from World Wide Web: http://sowf.moi.gov.tw/stat/year/elist.htm.
    Taiwan Special Education Transmit Net. (2013). Special Education Student Statistics. Retrieved July 15, 2014 from World Wide Web: http://www.set.edu.tw/sta2/default.asp.
    Tonn-Eichstädt, H. (2006). Measuring website usability for visually impaired people-a modified goms analysis. In Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility (pp. 55-62). ACM.
    Uğurlu, Y. (2013). Smart E-learning: Enhancement of Human-Computer Interactions Using Head Posture Images, International Journal of Engineering Education, 29(3), 568–577.
    Vitense, H. S., Jacko, J. A., & Emery, V. K. (2003). Multimodal Feedback: An Assessment of Performance and Mental Workload. Ergonomics, 46(1-3), 68-87.
    Virvou, M., & Katsionis, G. (2008). On the Usability and Likeability of Virtual Reality Games for Education: The Case of VR-ENGAGE. Journal of Computers & Education, 50(1), 154-178.
    Weisbrod, B. A., & Asch, E. D. (2010). The truth about the “crisis” in higher education finance. Change: The Magazine of Higher Learning, 42(1), 23-29.
    Whitehouse, B. G. (2011). Access to books for the visually impaired: moving from charity to choice (Doctoral dissertation, © Bradley Guy Whitehouse).
    Wu, F. G., Ma, M. Y., & Chang, R. H. (2009). A new user-centered design approach: A hair washing assistive device design for users with shoulder mobility restriction. Applied ergonomics, 40(5), 878-886.
    Yannakakis, G., & Hallam, J. (2008). Entertainment Modeling through Physiology in Physical Play. International Journal of Human-Computer Studies, 66(10), 741-755.
    Zhang C.M. (2002). Ordinary high school students with visual impairments to adapt to school life and school support systems research. Unpublished master's thesis, Changhua University of Education, Institute for Special Education, Taiwan.

    無法下載圖示 全文公開日期 本全文未授權公開 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)

    QR CODE