在本篇論文中，我們發展了一個在多重視野下以模型為基礎的即時人體運動參數分析系統。這個系統分析真實場景中人體的運動，並利用三維電腦繪圖技術 ( OpenGL) 合成一個相對應的虛擬世界及虛擬人物，其中的虛擬人物與真實世界的人物動作一致。我們使用一個由十個圓柱體所組成的三維人體模型分別代表人體的軀幹、頭部、手、腳等部位；其連接處則代表人體的關節。首先，我們發展了一個簡單的攝影機校正方法。矯正之後的攝影機可以讓我們尋找人體在空間中的位置，並使用一個透視投影縮放參數將正交投影轉換成透視投影。之後，我們使用一個以三維人體模型為基礎的人體運動參數分析法以尋找最佳的人體關節角度。透過比較影像中前景物體與三維人體模型投影在二維平面上的二維人體模型的相似程度，調整出最佳的人體關節角度。在這裡，我們發展了一個新的「重疊三元樹尋找法」調整關節的角度，可以在更短的時間內搜尋更廣的關節角度範圍。透過這個方法，我們可以在較低的影像擷取速度下分析一些快速的人體動作（例如：揮手）。而在系統中，因為兩台攝影機的拍攝方向互相垂直，所以可以很容易的分析出人體在空間中的位置。在結合多視野的資訊方面，我們發展了一個新的結合與仲裁的方法將多視野的高階資訊加以整合。

In this thesis, we introduce a real time multiple-views human motion analysis system. This system analyzes the motion of the human object in a real scene and synthesize virtual actor in a corresponding virtual world by computer graphic OpenGL. To analyze the motion of the human object, we use the 3-D human model, which consists of 10 cylindrical primitives, representing torso, head, arms, and legs, and 10 joints connecting these cylinders. First, we introduce a simple camera calibration and 2-D human position finding method that enable us to find the 2-D human position and simulate the perspective projection by applying a perspective-scaling factor on the orthographic projection. Then, we use the 3-D human model-based method to find the BAPs based on the searching for the best matching between the 2-D projection model and the foreground object. Here, we also introduce a new overlapped tri-tree search algorithm with less running time and wider search range, which enables us to track some fast human motions, such as hands waving, in a lower frame rate. In our system, there are two cameras controlled by two viewers and the viewing direction of one camera is orthogonal to that of the other one. To integrate and arbitrate the information from multiple-views, we introduce a new integration and arbitration method, which integrates high-level information from multiple-views.

[1] G. Johansson, "Visual motion perception," Sci. Am. 232(6), 1975, 76-88.
[2] R. F. Rashid, "Toward a system for the interpretation of moving light display," IEEE Trans. PAMI, 2(6), 574-581, November 1980.
[3] J. A. Webb and J. K. Aggarwal, "Visually interpreting the motion of objects in space," IEEE Comput. August 1981, 40-46.
[4] J. A. Webb and J. K. Aggarwal, "Structure from motion of rigid and jointed objects," in Artif. Intell. 19, 1982, 107-130.
[5] A. Shio and J. Sklansky, "Segmentation of people in motion," in Proc. Of IEEE Workshop on Visual Motion, IEEE Computer Society, October 1991, pp. 325-332.
[6] S. Kurakake and R. Nevatia, "Description and tracking of moving articulated objects," in 11th Intl. Conf. on Pattern Recognition, Hague, Netherlands, 1992, Vol. 1, pp. 491-495.
[7] A. G. Bharatkumar, K. E. Daigle, M. G. Pandy, Q. Cai, and J. K. Aggarwal, "Lower limb kinematics of human walking with the medial axis transformation," in Proc. of IEEE Computer Society Workshop on Motion of Non-Rigid and Articulated Objects, Austin, TX, 1994, pp. 70-76.
[8] M. K. Leung and Y. H. Yang, "First sight: A human body outline labeling system," IEEE Trans. PAMI 17(4), 1995, 359-377.
[9] J. O'Rourke and N. I. Badler, Model-based image analysis of human motion using constraint propagation," IEEE Trans. PAMI, 2:522-536, 1980.
[10] D. Marr and H. K. Nishihara, "Representation and recognition of the spatial organization of three-dimensional shapes," in Proc. R. Soc. London, 1978, Vol. B, pp. 269-294.
[11] Q. Cai and J. K. Aggarwal, "Tracking human motion using multiple cameras," in Proc. of Intl. Conf. on Pattern Recogintion," Vienna, Austria, August 1996, pp. 68-72.
[12] Q. Cai and J. K. Aggarwal, "Automatic tracking of human motion in indoor scene across multiple synchronized video streams," in Intl. Conf. on Computer Vision, Bombay, India, January 1998.
[13] K. Sato, T. Maeda, H. Kato, and S. Inokuchi, "CAD-based object tracking with distributed monocular camera for security monitoring," in Proc. 2nd CAD-Based Vision Workshop, Champion, PA, February 1994, pp. 291-297.
[14] Thanart Horprasert, David Harwood, and Larry S. Davis, "A robust background subtraction and shadow detection," Proceedings of the Fourth Asian Conference on Computer Vision, pp. 983-988, 2000.
[15] J. C. Lin and C. L. Huang, "HIVE encoder/decoder for creating virtual actor by using video computing technology," Master thesis, Department of Electrical Engineering in NTHU, Taiwan, 2000.