研究生: |
黃中昱 Huang, Chung-Yu |
---|---|
論文名稱: |
鯤鵬存儲: 核心實現既可程序化存儲系統 KPS: Kernel-based Programmable Storage System |
指導教授: |
鍾葉青
Chung, Yeh-Ching |
口試委員: |
周志遠
Chou, Jerry 賴冠州 Lai, Kuan-Chou |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 資訊工程學系 Computer Science |
論文出版年: | 2012 |
畢業學年度: | 100 |
語文別: | 英文 |
論文頁數: | 42 |
中文關鍵詞: | 雲端運算 、儲存虛擬化 、Linux 核心 |
外文關鍵詞: | Cloud Computing, Storage Virtualization, Linux Kernel |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本論文提出一套核心實現可程序化的區塊層級存儲系統虛擬化框架,並稱之為「鯤鵬存儲系統」。此系統透過提供API允許管理者重新映射區塊層級存儲資源,並提供具通透性的底層管理機制,在系統內部的設計上則是著重在提供更具有彈性與延展性的資源池管理機制,以及無縫銜接網路傳輸和各種虛擬化功能,同時也提供線上資料遷移與資料備份之能力。
為此目的,本論文在考量相當的模組化因素後,於Linux系統核心中設計並實現了本系統雛型,而為了模組化的目的,本系統的核心模組部分被細分為許多相互獨立的實作群組,群組中各自實現其主要功能並且透過固定API之形式提供給其他群組使用,最後經由這些API的相互配合將個別實作完成的功能群組整合成本系統的最終雛型。為了衡量此系統的運作效率,本論文中經由直接對系統進行大規模資料讀寫,以及對不同資料大小進行線上遷移實驗,這兩種方法分別測試此系統在一般操作下與線上資料遷移時的延展性,實驗顯示這兩項指標都呈現線性延展的結果,這也證明本論文題出並實作的系統雛型在實務運作上是可以達到最佳效能表現的。
In this thesis we propose the KPS system, a kernel-based programmable storage system that provides a cross node block-level storage virtualization framework. KPS system allows (i) administrator to remap block level storage resource with simple interface and (ii) apply versatile manageablilty to underling storage without user interruption. The system internal design focus on supporting (i) flexible and scalable resource pooling and remapping mechanism, (ii) seamless combination of data network transmission and block level virtualize functions and (iii) online data migration and replication abilities. To this end, we design the KPS system with highly modularization consideration that divides kernel module into four major component group targets on (i) IO redirection decision, (ii) data synchronization, (iii) local disk IO operation and (iv) remote disk IO operation. Each group is further broken down into numbers of implementation modules, that concentrate on atomic and unique tasks while complying an asynchronous access model proposed and widely adapted by modern operation system, and finally collaborate with each other to achieve various storage system requirements. To demonstrate the effectiveness of our approach we evaluate the KPS system in two ways: (i) We examine the scalability of system throughput by the pure sequential raw disk IO and then run a popular file level benchmark Bonnie++ after building two filesystems on KPS system to make experiment scenario more realistic. (ii) We show the efficiency of online migration module by running all four migration location combinations with various chunks size spread widely. Finally, we find out KPS system performs linear speedup with respective to the amount of resources in used. And we make online migration to achieve constant performance behavior as well.
[1] Global network block device. http://sourceware.org/cluster/gnbd.
[2] I. Ahmad, J.M. Anderson, A.M. Holler, R. Kambo, and V. Makhija. An analysis of disk
performance in vmware esx server virtual machines. In Workload Characterization, 2003.
WWC-6. 2003 IEEE International Workshop on, pages 65–76. IEEE, 2003.
[3] P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt,
and A. Warfield. Xen and the art of virtualization. ACM SIGOPS Operating Systems
Review, 37(5):164–177, 2003.
[4] Peter T. Breuer. Enhanced network block device. http://enbd.sourceforge.net.
[5] E.L. Cashin. Kernel korner: Ata over ethernet: putting hard drives on the lan. Linux
Journal, 2005(134):10, 2005.
[6] T. Clark. Designing storage area networks: a practical reference for implementing Fibre
Channel SANs. Addison-Wesley Longman Publishing Co., Inc., 1999.
[7] Russell Coker. Bonnie++ benchmark. http://www.coker.com.au/bonnie++.
[8] Linux Kernel Community. Logical volume manager. http://sources.redhat.com/lvm2.
[9] R. Hernandez, C. Kion, and G. Cole. IP storage networking: IBM NAS and iSCSI solutions.
IBM Corporation, International Technical Support Organization, 2002.
[10] K. Kim, J.S. Kim, and S.I. Jung. Gnbd/via: a network block device over virtual interface
architecture on linux. In Parallel and Distributed Processing Symposium., Proceedings
International, IPDPS 2002, Abstracts and CD-ROM, pages 7–13. IEEE, 2002.
[11] A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. kvm: the linux virtual machine
monitor. In Proceedings of the Linux Symposium, volume 1, pages 225–230, 2007.
41
[12] Mark Lord. hdparm tool. http://sourceforge.net/projects/hdparm.
[13] Pavel Macheck. Network block device. http://nbd.sourceforge.net.
[14] W. Reese. Increase performance, reliability and capacity with software raid. Linux Journal,
2008(175):3, 2008.
[15] D. Reiner, G. Press, M. Lenaghan, D. Barta, and R. Urmston. Information lifecycle management:
the emc perspective. In Data Engineering, 2004. Proceedings. 20th International
Conference on, pages 804–807. IEEE, 2004.