研究生: |
葉隆斌 Lung-pin Yeh |
---|---|
論文名稱: |
基於 Windows 的平行檔案系統 A Windows Based Parallel File System |
指導教授: |
許雅三
Yar-sun Hsu |
口試委員: | |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 電機工程學系 Department of Electrical Engineering |
論文出版年: | 2006 |
畢業學年度: | 94 |
語文別: | 英文 |
論文頁數: | 68 |
中文關鍵詞: | 平行檔案系統 、高效能輸入輸出 、視窗作業系統 |
外文關鍵詞: | parallel file system, high performance I/O, Windows operating system |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
隨著科技的進步,當今電腦系統的性能也有顯著的提升。研究人員也可以以負擔的起的價錢,輕易獲得配備有高速網路的個人電腦。一群電腦緊密的協同工作,形成一個叢集電腦系統。叢集電腦系統已被廣泛的應用在解決需要大量運算的工作,但是硬碟增進的速度比不上系統中其它的部分,儲存子系統變成需要大量I/O的工作的效能瓶頸。因此,在叢集電腦系統中,平行檔案系統已被廣泛的運用來提供高效能I/O。
微軟視窗作業系統佔了個人電腦作業系統市場相當大的一部分。但是大部分現存的平行檔案系統,都是基於UNIX-like的作業系統。我們使用微軟 .NET framework實作了一個平行檔案系統,並且提供一個 .NET 的程式庫給使用者,以藉由我們的平行檔案系統來達到高效能I/O。除此之外,我們也實作了一個檔案系統驅動程式來捕捉Win32 I/O相關的API,因此現存的執行檔可以不用重新編譯而可以存取存在我們檔案系統的檔案。在這篇論文中,描述了我們系統的設計方法與實現,也量測了我們檔案系統的效能。結果顯示,寫的效能可以達到110MB/s,而讀的效能可以達到75MB/s。
Advances in technology lead to remarkable performance improvements in computer systems nowadays. Personal computers (PC) equipped with high speed network interfaces are affordable and easy to acquire for researchers. A group of loosely coupled computers that work together closely form a cluster. PC clusters have been commonly used these days to solve CPU-intensive tasks. But the speed improvement of hard disks can not catch up with other components in the system. The storage subsystem becomes a bottleneck for I/O-intensive tasks. Therefore, parallel file system is widely used in clusters to provide high performance I/O.
Microsoft Windows operating systems share an enormous portion of the PC operating system market. But most of the existing parallel file systems are based on UNIX-like operating systems. We implement a parallel file system for Windows using the Microsoft .NET framework. A .NET library is provided for users to achieve high performance I/O by using our parallel file system. In addition, a file system driver is implemented to trap Win32 API I/O function calls. Thus existing binaries can access files stored on our parallel file system without recompiling. In this thesis, the design and implementation of our system are described and the performance is also evaluated. The results show that the write performance reaches a peak of 110MB/s and the read performance reaches a peak of 75MB/s.
[1] Myricom, “Myrinet”, http://www.myri.com/.
[2] InfiniBand Trade Association, “Infiniband”, http://www.infinibandta.org/.
[3] Thomas Sterling, Ewing Lusk, and William Gropp, Beowulf Cluster Computing
with Linux, MIT Press, Cambridge, MA, USA, 2003.
[4] NERSC/LBNL Univ. of MANHEIM, Univ. of TENNESSEE, “TOP500 supercomputing
sites”, http://www.top500.org/.
[5] Gene M. Amdahl, Validity of the Single Processor Approach to Achieving Large
Scale Computing Capabilities, pp. 79—81, Morgan Kaufmann Publishers Inc.,
San Francisco, CA, USA, 2000.
[6] NR Adiga, M Blumrich, and et al T Liebsch, “An overview of the BlueGene/L
supercomputer”, in Proceedings of the 2002 ACM/IEEE Conference on Supercomputing,
Baltimore, Maryland, 2002, pp. 1 — 22.
[7] P. H. Carns, W. B. Ligon III, R. B. Ross, and R. Thakur, “PVFS: A parallel
file system for linux clusters”, in 4th Annual Linux Showcase and Conference,
Atlanta, GA, October 2000, pp. 317—327.
[8] W. B. Ligon III and R. B. Ross, “An Overview of the Parallel Virtual File
System”, in 1999 Extreme Linux Workshop, June 1999.
[9] Jos´e Mar´ıa P´erez, Jes´us Carretero, and Jos´e Daniel Garc´ıa, “A Parallel File System
for Networks of Windows Worstations”, in ACM International Conference
on Supercomputing, 2004.
[10] S. Kleiman D., Walsh R. Sandberg, D. Goldberg, and B. Lyon, “Design and
implementation of the sun network filesystem”, in Proc. Summer USENIX
Technical Conf., 1985, pp. 119—130.
[11] Christopher R. Hertel, Implementing CIFS: The Common Internet File System,
Prentice-Hall, 2003.
[12] David A. Patterson, Garth A. Gibson, and Randy H. Katz, “A case for redundant
arrays of inexpensive disks (RAID)”, in Proceedings of the 1988 ACM
SIGMOD International Conference on Management of Data, Chicago, Illinois,
June1—3, 1988, pp. 109—116.
[13] Mark E. Russinovich and David A. Solomon, Microsoft Windows Internals,
Fourth Edition: Microsoft Windows Server 2003, Windows XP, and Windows
2000, Microsoft Press, 2004.
[14] Walter Oney, Programming the Microsoft Windows Driver Model, Second Edition,
Microsoft Press, Redmond, WA, USA, 2003.
[15] Bo Brant´en, “Windows driver example”, http://www.acc.umu.se/˜bosse/.
[16] OSR Online, “The home page for windows driver developers”,
http://www.osronline.com/.
[17] Mark Russinovich and Bryce Cogswell, “Sysinternals freeware”,
http://www.sysinternals.com/.
[18] Inc. VMware, “VMware - virtualization software”, http://www.vmware.com/.
[19] Rajeev Nagar, Windows NT file system internals: a developer’s guide, O’Reilly
& Associates, Inc., Sebastopol, CA, USA, 1997.
[20] VA Software OSTG Open Source Technology Group, “SourceForge”,
https://sourceforge.net/.