簡易檢索 / 詳目顯示

研究生: 吳翰昇
Wu, Han-Sheng
論文名稱: 改善擴增實境中虛擬穿戴之遮蔽品質
Improving Occlusion Quality for Virtual Try-On in Augmented Reality
指導教授: 瞿志行
Chu, Chih-Hsing
口試委員: 陸元平
Luh, Yuan-Ping
郭嘉真
Kuo, Chia-Chen
學位類別: 碩士
Master
系所名稱: 工學院 - 工業工程與工程管理學系
Department of Industrial Engineering and Engineering Management
論文出版年: 2018
畢業學年度: 106
語文別: 中文
論文頁數: 74
中文關鍵詞: 擴增實境虛擬穿戴遮蔽處理參數化模型客製化
外文關鍵詞: Augmented reality, Virtual Try-on, Occlusion process, Parametric modeling, Customized
相關次數: 點閱:1下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 擴增實境技術近年來快速發展,已應用至諸多產品的展示與銷售,透過虛擬穿戴技術可快速、大量試穿戴商品,整合線上與線下資源,降低實體店家庫存成本。以往基於擴增實境的虛擬試穿戴研究,較少探討人體造成的處理遮蔽問題,或是使用過於簡化的幾何模型,由於不同使用者的人體尺寸的變異,虛實遮蔽的處理效果不佳,影響虛擬試穿戴的體驗。有鑑於此,本研究針對鞋品與手提包試穿戴系統的遮蔽問題,進行較深入的探討。於現有的鞋品試穿系統中,嘗試兩種改善遮蔽效果的方法,分別基於足部深度資料點雲,以及資料迴歸近似之角錐組合,建立近似人體腳踝部位的三維幾何,並即時計算腳踝關節的旋轉軸向,調整三維幾何的空間方位,進行準確的遮蔽處理計算。另一方面,開發手提包虛擬試戴的雛形系統,採用參數化模型,透過輸入人體特徵尺寸,建立接近使用者人體幾何的遮蔽模型,即時取得手臂與上半身骨架位置,以準確定位遮蔽模型,判斷虛實物體的前後關係。於上述兩項試穿戴系統中,整合客製化設計功能,使用者可挑選不同款式的商品模型,改變其顏色、形狀與尺寸,產生對應結果進行試穿戴。最後透過不同使用情境的測試,驗證遮蔽改善方法的準確性,並討論存在的功能限制。本研究改善虛擬試穿戴技術的視覺化品質,整合即時性的客製化設計功能,將可提高擴增實境在產品開發上的實用性。


    Augmented reality technology has developed rapidly in recent years, and has been applied to the display and sales of many products. We can quickly and massively try-on products throug virtual try-on technology. By integrating online and offline resources, physical stores can reduce inventory costs. In past researches about virtual try-on in augmented reality, there is less researches about solving occlusion problems caused by human body. In the past, the use of oversimplified geometric models, due to the variation of human body size of different users, the quality of occlusion is not good, affecting the experience of virtual try-on. In the light of it, this study explores the occlusion problem of footwear and handbag try-on system. In footwear try-on, this study try two methods to improve occlusion quality. First method is based on cloud points of foot depth data. Second method use foot depth data calculate rotation matrix with regression approximation, create a three-dimensional geometry that approximates the ankle of human body, calculate the rotation axis of ankle joint in real time, adjust the spatial orientation of the three-dimentional geometry, and perform accurate occlusion calculation. On the other hand, using parametric models to develop the prototype of virtual handbag try-on system. By inputting the measurements of human body, a model close to the geometry of the user’s body is created, and the position of the arm and the upper body skeleton is obtained to accurately locate the masking model and determine the distance relationship between virtual and real objects. Integrate customized design function in the above two try-on system. Users can select different styles of product, change their color, shape, and size, and produce create the corresponding model for try-on system. At the end, verify the accuracy of the occlusion improving method through different scenario, and discuss the limitation of the system. This study improve the visual quality of virtual try-on technology and integrate the customized design function, which will improve the practically of augmented reality in product development.

    摘要 II Abstract III 目錄 V 圖目錄 VII 表目錄 XI 第一章、 緒論 1 1.1 研究背景 1 1.2 問題定義與描述 2 1.3 研究目的 3 第二章、 文獻回顧 5 2.1 擴增實境之試穿戴應用 5 2.2 小結 10 第三章、 研究方法 11 3.1 系統架構 11 3.2 鞋品試穿之遮蔽改善 12 3.2.1 基於足部深度資料點雲之遮蔽方法 13 3.2.2 基於足部深度資料迴歸軸向之遮蔽方法 17 3.3 基於參數化模型之手提包試戴系統 27 3.3.1 參數化模型 27 3.3.2 人體模型訓練資料收集 28 3.3.3 特徵點與特徵尺寸之定義 29 3.3.4 參數化模型建立 34 3.3.5 試戴系統初始化 35 3.3.6 參數化模型動態組合 38 3.3.7 手提包配戴與系統限制 42 3.4 客製化整合系統 44 3.4.1 資料庫建立 44 3.4.2 客製化設計介面 44 第四章、 系統實作 46 4.1 測試環境 46 4.2 鞋品試穿系統遮蔽改善 47 4.2.1 基於足部深度資料點雲之遮蔽改善結果 47 4.2.2 基於足部深度資料迴歸軸向之遮蔽改善結果 48 4.2.3 鞋品試穿遮蔽改善方法比較 49 4.3 基於參數化模型之手提包試戴系統 53 4.3.1 手提包試戴遮蔽改善結果 53 4.3.2 參數化模型誤差分析 54 4.3.3 人體計測系統誤差分析 59 4.3.4 深度攝影機追蹤骨架之誤差 61 4.4 客製化鞋品試穿系統 65 4.5 客製化手提包試戴系統 67 第五章、 結論與未來展望 70 參考文獻 73

    [1] 鄭智鴻,擴增實境中鞋品虛擬試穿之進階研究,清華大學工業工程與工程管理學系,碩士論文,2016。
    [2] Chu, C. H., Wang, I. J., Wang, J. B., & Luh, Y. P. (2017). 3D Parametric Human Face Modeling for Personalized Product Design: Eyeglasses Frame Design Case. Advanced Engineering Informatics, 32, 202-223.
    [3] 王怡然,三維人體計測資料參數化模型與個人化產品設計驗證,清華大學工業工程與工程管理學系所,博士論文,2017。
    [4] Chen, A., Kao, C. Y., Chen, Y. H., & Wang, W. C. (2011). Applying augmented reality to consumer garment try-on experience. In Transactions on computational science XIII, Springer, Berlin, Heidelberg, pp. 169-190.
    [5] Eisert, P., & Hilsmann, A. (2011). Realistic virtual try-on of clothes using real-time augmented reality methods. E-LETTER.
    [6] Saakes, D., Yeo, H. S., Noh, S. T., Han, G., & Woo, W. (2016). Mirror mirror: An on-body t-shirt design system. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems , ACM. pp. 6058-6063.
    [7] Giovanni, S., Choi, Y. C., Huang, J., Khoo, E. T., & Yin, K. (2012). Virtual try-on using kinect and HD camera. In International Conference on Motion in Games , Springer, Berlin, Heidelberg. pp. 55-65.
    [8] Kjærside, K., Kortbek, K. J., Hedegaard, H., & Grønbæk, K.(2005). ARDressCode: Augmented Dressing Room with Tag-based Motion Tracking and Real-time Clothes Simulation. In Proceedings of the central european multimedia and virtual reality conference.
    [9] Günes, S., Sanli, O., & Ergün, Ö. Ö.(2015). Augmented Reality Tool for Markerless Virtual Try-on around Human Arm. In Mixed and Augmented Reality-Media, Art, Social Science, Humanities and Design (ISMAR-MASH'D), 2015 IEEE International Symposium on. IEEE. pp. 59-60.
    [10] Mochimaru, M., & Kouchi, M. (2008). Technologies for the design and retail service of well-fitting eyeglass frames. Synthesiology, vol. 1, pp. 38-46.
    [11] Yuan, M., Khan, I. R., Farbiz, F., Niswar, A., & Huang, Z. (2011). A mixed reality system for virtual glasses try-on. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry. acm. pp. 363-366.

    [12] Huang, S. H., Yang, Y. I., & Chu, C. H. (2012). Human-centric design personalization of 3D glasses frame in markerless augmented reality. Advanced Engineering Informatics, vol. 26, pp. 35-45.
    [13] Yuan, M., Khan, I. R., Farbiz, F., Yao, S., Niswar, A., & Foo, M. H. (2013). A Mixed Reality Virtual Clothes Try-on System. IEEE Transactions on Multimedia, 15(8), pp. 1958-1968.
    [14] Li, R., Zou, K., Xu, X., Li, Y., & Li, Z. (2011). Research of Interactive 3D Virtual Fitting Room on Web Environment. In Computational Intelligence and Design (ISCID), 2011 Fourth International Symposium on. IEEE. vol. 1, pp. 32-35.
    [15] Wang, L., Villamil, R., Samarasekera, S., & Kumar, R. (2012). Magic Mirror: A Virtual Handbag Shopping System. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2012 IEEE Computer Society Conference on. IEEE. pp. 19-24.
    [16] Eisert, P., Fechteler, P., & Rurainsky, J. (2008). 3-D tracking of shoes for virtual mirror applications. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, IEEE. pp. 1-6.
    [17] 楊攸奕,基於擴增實境之產品客製化設計:虛擬試穿與網格變型,清華大學工業工程與工程管理學系,碩士論文,2010。
    [18] 楊智凱,於擴增實境中使用多深度感測器之虛擬鞋品試穿技術,清華大學工業工程與工程管理學系,碩士論文,2012。
    [19] 陳耀軒,改善整合深度感測技術之擴增實境應用,清華大學工業工程與工程管理學系,碩士論文,2014。
    [20] 陳瑋萱,改善擴增實境中虛實遮蔽之邊緣品質,清華大學工業工程與工程管理學系,碩士論文,2015。
    [21] Wang, C. C. (2005) Parameterization and parametric design of mannequins. Computer-Aided Design, 37(1), 83-98.
    [22] Drefuss, H., & Dreyfuss, H. (1967). The measure of man: human factors in design. New York: Whitney Library of Design.
    [23] Chu, C. H., Liao, Z. J., Chang W. C., & Lin, Y. I. (2018). Computer-Aided Affective Product Design: Using Handbags as an Example. Future Design in Digital Era. Symposium conducted at 2018 International conference on innovation digital design, Tainan, Taiwan.

    QR CODE