研究生: |
許家齊 Hsu, Chia-Chi |
---|---|
論文名稱: |
使用Kinect的手拿小型物件的3D重建系統 In-hand 3D reconstruction for small objects using Kinect |
指導教授: |
黃仲陵
Huang, Chung-Lin 林嘉文 Lin, Chia-Wen |
口試委員: |
黃仲陵
張春明 柳金章 林嘉文 |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 電機工程學系 Department of Electrical Engineering |
論文出版年: | 2014 |
畢業學年度: | 103 |
語文別: | 英文 |
論文頁數: | 42 |
中文關鍵詞: | 3D重建 、3D掃描 、Kinect 、KinectFusion |
相關次數: | 點閱:3 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本論文提出了一個低成本且易於使用的小物件3D掃描系統。因為價格及普及度,我們使用Kinect作為掃描器,它可以提供即時深度影像,作為系統的輸入使用。微軟曾提出名為KinectFusion的演算法,用以建構場景的3D模型,我們的系統為基於KinectFusion演算法的延伸應用,讓使用者可以以手拿物件的方式,在Kinect前面旋轉物件以完成掃描,且使用者不需戴手套或調整任何顏色參數。在掃描的過程中,系統將顯示目前已完成的模型,作為使用者的參考。KinectFusion演算法使用體素及truncated signed distance function (TSDF) 做為3D模型的平面表示方法,如此可有效利用GPU平行運算,以達到即時的效果。有別於以往系統需要戴手套,以顏色區分手部資訊的方法,我們改良TSDF的整合方式以達到自動去除手部干擾的效果。因於Kinect的雜訊特性,在深度影像的邊緣部分容易產生較大誤差,所以我們使用gradient thresholding的方法去除影像邊緣。因為我們對於整合方式的修改,降低了疊合時產生的誤差,以省去後處理的步驟。整個系統的流程為,Kinect擷取深度影像後傳送至個人電腦,經過個人電腦內的GPU進行平行運算,產生模型並即時顯現於螢幕上,使用者依據目前的模型逐漸掃描完成。
[1] F. Bernardini and H. Rushmeier, "The 3d model acquisition pipeline," Computer Graphics Forum, vol. 21, pp. 149-172, 2002.
[2] Y. Cui, S. Schuon, D. Chan, S. Thrun and C. Theobalt, "3d shape scanning with a time-of-flight camera," in Computer Vision and Pattern Recognition (CVPR), 2010.
[3] S. Rusinkiewicz and M. Levoy, "Efficient variants of the ICP algorithm," in 3-D Digital Imaging and Modeling (3DIM), 2001.
[4] H. Kawasaki, R. Furukawa, R. Sagawa and Y. Yagi, "Dynamic scene shape reconstruction using a single structured light pattern," in Computer Vision and Pattern Recognition (CVPR), 2008.
[5] P. J. Besl and N. D. McKay, "A method for registration of 3-D shapes," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, pp. 239-258, 1992.
[6] Y. Chen and G. Medioni, "Object modelling by registration of multiple range images," Image and Vision Computing (IVC), vol. 10, pp. 145-155, 1992.
[7] T. Jaeggli, T. Koninckx and L. Van Gool, "Online 3d acquisition and model integration," in IEEE International Workshop on Projector-Camera Systems, 2003.
[8] S. Rusinkiewicz, O. Hall-Holt and M. Levoy, "Real-time 3d model acquisition," ACM Transactions on Graphics, vol. 21, pp. 438-446, 2002.
[9] D. Tubic, P. Hebert, J.-D. Deschenes and D. Laurendeau, "A unified representation for interactive 3d modeling," in 3D Data Processing, Visualization and Transmission (3DPVT), 2004.
[10] J.-D. Deschênes, P. Lambert and P. Hébert, "Interactive modeling with automatic online compression," in 3D Data Processing, Visualization and Transmission (3DPVT), 2006.
[11] T. Weise, T. Wismer, B. Leibe and L. V. Gool, "Online loop closure for real-time interactive 3D scanning," Computer Vision and Image Understanding, vol. 115, pp. 635-648, 2011.
[12] K. Khoshelham and S. Oude Elberink, "Accuracy and resolution of Kinect depth data for indoor mapping applications," Sensors, vol. 12, pp. 1437-1454, 2012.
[13] C. V. Nguyen, S. Izadi and D. Lovell, "Modeling Kinect sensor noise for improved 3d reconstruction and tracking," in 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2012.
[14] R. A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. J. Davison, P. Kohli, J. Shotton, S. Hodges and A. Fitzgibbon, "KinectFusion: real-time dense surface mapping and tracking," in Symposium on Mixed and Augmented Reality, 2011.
[15] S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison and A. Fitzgibbon, "KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera," in Symposium on User Interface Software and Technology (UIST), 2011.
[16] T. Whelan, H. Johannsson, M. Kaess, J. J. Leonard and J. McDonald, "Robust real-time visual odometry for dense RGB-D mapping," in IEEE International Conference on Robotics and Automation (ICRA), 2013.
[17] R. B. Rusu and S. Cousins, "3D is here: Point cloud library (PCL)," in IEEE International Conference on Robotics and Automation (ICRA), 2011.
[18] W. E. Lorensen and H. E. Cline, "Marching cubes: a high resolution 3d surface construction algorithm," in SIGGRAPH, 1987.
[19] "ReconstructMe," [Online]. Available: http://reconstructme.net.
[20] L. Cruz, D. Lucio and L. Velho, "Kinect and RGBD images: challenges and applications," in Graphics, Patterns and Images Tutorials (SIBGRAPI-T), 2012.
[21] Y. Cui, S. Schuon, S. Thrun, D. Stricker and C. Theobalt, "Algorithms for 3d shape scanning with a depth camera," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, pp. 1039-1050, 2013.