簡易檢索 / 詳目顯示

研究生: 方宜群
Fang, Yi-Chiun
論文名稱: 物件儲存裝置的虛擬化模擬
Virtual Storage Emulation for Object-based Storage Devices
指導教授: 許雅三
Hsu, Yarsun
口試委員:
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電機工程學系
Department of Electrical Engineering
論文出版年: 2009
畢業學年度: 98
語文別: 英文
論文頁數: 77
中文關鍵詞: 物件儲存裝置虛擬機器模擬器
外文關鍵詞: Object-based storage device, OSD, Virtual machine, QEMU, Storage emulator
相關次數: 點閱:3下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本研究為物件儲存裝置設計了一個新穎的模擬架構。虛擬化模擬是將物件儲存裝置模擬器整合進虛擬機器內的模擬架構,不只在模擬速度與模擬精確度之間提供了一個理想的平衡,也同時解決了傳統儲存系統模擬架構所存在的兩種主要限制。一種限制是儲存系統模擬器本身會佔用模擬平台上處理器一部份之資源,另一種限制則是平台與模擬器間多餘花費在網路溝通上的時間。這兩種限制都會降低系統模擬的精確度。此模擬架構中的儲存系統模擬器不只使獨立於虛擬機器內的處理器,處理器與模擬器之間也不需要使用網路溝通。在此研究中,物件儲存裝置被實現為虛擬機器QEMU內的一個SCSI裝置。此裝置使用了非同步資料處理的設計,可以提高處理能力。此虛擬機器具備執行完整作業系統的能力,可以進行更貼近真實情境的測試及更深入的系統分析。
    效能測試以檔案系統作為物件儲存裝置的比較對象。檔案系統的下層採用以區塊為儲存單位的傳統儲存裝置。物件儲存裝置由於可以將儲存資料的一部份管理轉移到儲存裝置本身,因此可以減輕系統整體的負荷,進而大幅增加儲存系統的資料傳輸效能。在測試數據中,物件儲存裝置的資料傳輸能力在最佳情況下可以比傳統檔案系統多出約436% 的效能。而在資料庫負荷能力的測試中,物件儲存裝置的效能在最佳情況下可以超出傳統檔案系統約666%。研究結果顯示,使用物件儲存裝置的儲存架構是高資料傳輸需求下的理想選擇。


    This work presents a new emulation framework for object-based storage devices (OSDs). The virtual storage emulation framework integrates an object-based storage emulator with a virtual machine. The OSD model in this work not only provides a respectable balance between the emulation speed and accuracy, but also avoids the common problems with conventional storage emulation frameworks. It resolves the limitations of host CPU resource consumption and network communication overhead found in other frameworks. The storage emulator in the virtual machine runs independently of the emulated CPU, and no network messages are required for communication. The OSD model is implemented as a SCSI target in QEMU. It implements asynchronous I/O request processing to improve its throughput. Operating systems can be run inside QEMU to provide a realistic workload and a more in-depth analysis of the system.
    The OSD model is compared to a traditional file system on top of a block device. The offloading of storage management into the device dramatically increases the throughput of the storage system. The benchmark results demonstrate an I/O performance improvement of 436% in the best case. Synthetic database workload performance improves by 666% in the best case. The results suggest that the object-based storage architecture is an ideal choice for throughput machines, especially under heavy workloads.

    List of Figures iii List of Tables v 1 Introduction 1 2 Related Work 5 3 Background Information 7 3.1 SCSI-3 Standards 7 3.2 The Linux SCSI Subsystem 13 3.3 Object-based Storage Devices 17 3.4 QEMU 21 3.5 The LSI53C895A SCSI Controller 25 4 Design and Implementation 31 4.1 Virtual Storage Emulation 31 4.2 QEMU SCSI OSD Disk 42 4.3 QEMU OSD Generic Device 48 4.4 Other Minor Modifications 52 5 Performance Evaluation 54 5.1 Evaluation Environment 54 5.2 Single-file Performance 57 5.3 Multiple-file Performance 62 5.4 Synthetic Workload Performance 69 6 Conclusion and Future Work 73 6.1 Conclusion 73 6.2 Future Work 74 References 75

    [1] J. L. Griffin, J. Schindler, S. W. Schlosser, J. S. Bucy, G. R. Ganger, “Timing-Accurate Storage Emulation,” Proceedings of the Conference on File and Storage Technologies, Jan. 2002, pp. 75-88.
    [2] S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, C. Maltzahn, “Ceph: A Scalable, High-Performance Distributed File System,” Proceedings of the 7th symposium on Operating systems design and implementation, 2006, pp. 307-320.
    [3] A. Azagury et al, “Towards an Object Store,” Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003, pp. 165-176.
    [4] P. Schwan, “Lustre: Building a File System for 1,000-node Clusters,” Proceedings of the Linux Symposium, Jul. 2003, pp. 380-386.
    [5] IBM Object Storage Device Simulator for Linux [Online]. Available:
    http://www.alphaworks.ibm.com/tech/osdsim
    [6] IITK OSD Simulator [Online]. Available:
    http://sourceforge.net/projects/iitk-osd-sim/
    [7] DISC OSD T10 Implementation [Online]. Available:
    http://sourceforge.net/projects/disc-osd/
    [8] SCSI Object-Based Storage Device Commands (OSD) Revision 10, T10 Project 1355-D, Jul. 2004.
    [9] SCSI Object-Based Storage Device Commands -2 (OSD-2) Revision 2, T10 Project 1729-D, Jul. 2007.
    [10] A. Devulapalli, D. Dalessandro, P. Wyckoff, N. Ali, P. Sadayappan, “Integrating Parallel File Systems with Object-Based Storage Devices,” Proceedings of the 2007 ACM/IEEE conference on Supercomputing, Vol. 00, No. 27, 2007.
    [11] The DiskSim Simulation Environment [Online]. Available:
    http://www.pdl.cmu.edu/DiskSim/
    [12] P. DeRosa, K. Shen, C. Stewart, J. Pearson, “Realism and Simplicity: Disk Simulation for Instructional OS Performance Evaluation,” Proceedings of the 37th SIGCSE technical symposium on Computer science education, 2006, pp. 308-312.
    [13] Virtual 802.11 Fuzzing [Online]. Available:
    http://www.iseclab.org/projects/vifuzz/
    [14] T10 Technical Committee [Online]. Available: http://www.t10.org/
    [15] SCSI Architecture Model - 2 (SAM-2), T10 Project 1157-D, Sep. 2002.
    [16] SCSI Primary Commands - 2 (SPC-2), T10 Project 1236-D, Jul. 2001.
    [17] SCSI Parallel Interface - 2 (SPI-2), T10 Project 1142D, Jul. 1998.
    [18] M. Mesnier, G. R. Ganger, E. Riedel, “Object-Based Storage,” IEEE Communications Magazine, Aug. 2003, pp. 84-90.
    [19] QEMU, an open source processor emulator [Online]. Available:
    http://www.qemu.org/
    [20] Kernel Based Virtual Machine [Online]. Available: http://www.linux-kvm.org/
    [21] Android Emulator [Online]. Available:
    http://developer.android.com/guide/developing/tools/emulator.html
    [22] F. Bellard, “QEMU, a Fast and Portable Dynamic Translator,” USENIX Annual Technical Conference, 2005, pp. 41-46.
    [23] LSI53C895A PCI to Ultra2 SCSI Controller Technical Manual Version 2.2, LSI Logic, Apr. 2001.
    [24] SCSI SCRIPTS™ Processors Programming Guide Version 2.3, LSI Logic, Oct. 2000.

    [25] Debian - The Universal Operating System [Online]. Available:
    http://www.debian.org/
    [26] The Linux Kernel Archives [Online]. Available: http://www.kernel.org/
    [27] Ubuntu [Online]. Available: http://www.ubuntu.com/
    [28] Bonnie++ [Online]. Available: http://www.coker.com.au/bonnie++/
    [29] S. Kang, A. L. Reddy, “An Approach to Virtual Allocation in Storage Systems,” ACM Transactions on Storage, Vol. 2, No. 4, Nov. 2006, pp. 371-399.
    [30] GT.M High end TP database engine [Online]. Available:
    http://sourceforge.net/projects/fis-gtm/
    [31] FIS GT.M Database Engine [Online]. Available: http://fis-gtm.com/
    [32] The Linux sg3_utils package [Online]. Available:
    http://sg.danny.cz/sg/sg3_utils.html

    無法下載圖示 全文公開日期 本全文未授權公開 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)

    QR CODE