研究生: |
何宗軒 Tsung-Hsuan Ho |
---|---|
論文名稱: |
Malugo: A Peer-to-Peer Storage System Malugo: 同儕網路資料儲存系統 |
指導教授: |
鍾葉青
Yeh-Ching Chung |
口試委員: | |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 資訊系統與應用研究所 Institute of Information Systems and Applications |
論文出版年: | 2008 |
畢業學年度: | 96 |
語文別: | 英文 |
論文頁數: | 33 |
中文關鍵詞: | 同儕網路 、資料儲存系統 、格網系統 |
外文關鍵詞: | peer-to-peer, storage system, grid system |
相關次數: | 點閱:3 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近幾年來,因為Internet的日漸成長,越來越多跨組織、跨地域的計畫被提出執行。其中一項很重要的部份便是儲存或交換資料的儲存系統。這類的儲存系統必須要有很高的擴展性,能動態的整合儲存資源,使用者能快速的取回所需要的檔案。之前的研究考慮到資料的地域性,方便使用者取回資料,但忽略了路由的地域性,造成使用者需費時找到適合的檔案。此外,過去研究的複本機制使用到大量的維護不忽且消耗資源的全域資訊。在本篇論文,我們提出一個分散式資料儲存系統─Malugo。Malugo是一個兩階層式的peer-to-peer:底層網路負責將臨近的端點連接成群,負責提供附近的使用者存取資料;上層網路負責將不同的群連接成一個網路,負責不同群之間的溝通。儲存在Malugo中的檔案會動態的複制到不同的群來提供不同程度的可得性,而不需要的全域資訊輔助。動態的負載平均也被考慮到以針對熱門檔案的服務。實驗顯示我們的系統可以同時考慮到資料與路由的地域性,提供使用者快速的找到檔案,並有效率的下載檔案。同時也有較低的網路負載和較短的檔案上傳複制時間。
Due to the high availability of Internet, many large cross-organization collaboration projects have been presented in the last decade. One of the fundamental requirements of these collaborations is a storage system to store and exchange data. The storage system must be highly scalable, can aggregate storage resources dynamically, and deliver data to user effi-ciently. Previous works have taken care of data locality but without taking routing locality into consideration. Besides, replication strategies of related works are usually relied on global information. In this paper, we propose a distributed storage system, called Malugo, which is based on the distributed two-tier hierarchical peer-to-peer architecture. The bottom layer is constructed for clustering neighboring peers in local area to provide services in local region. The upper layer is constructed for connecting local groups together with locality consideration. File stored in Malugo will be adaptively replicated to different number of groups to provide different level of availability without the need of global information. Furthermore, the issue of load balance among storage peers is also considered to keep high downloading rate for popular files. The simulation results show that Malugo considers not only data locality for user to obtain data efficiently but also the routing locality to achieve efficiently and stablaly routing as well as lower traffic overhead on both file insertion and overlay maintenance.
[1] "BitTorrent." www.bittorrent.com
[2] "SourceForge.Net." www.sf.net
[3] "Taiwan Unigrid." www.unigrid.org.tw
[4] "The Gnutella Protocol Specification," 2000. http://www.gnu.org/philosophy/gnutella.html
[5] I. Clarke, O. Sandberg, B. Wiley, and T. W. Hong, "Freenet: A Distributed Anonym-ous Information Storage and Retrieval System," in ICSI Workshop on Design Issues in Anonymity and Unobservability, Berkeley, CA, 2000.
[6] F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica, "Wide-area Coopera-tive Storage with CFS," in 18th ACM Symposium on Operating Systems Principles, 2001.
[7] P. Druschel and A. Rowstron, "PAST: A large-scale, persistent peer-to-peer storage utility," in HotOS VIII Schoss Elmau, Germany, May 2001.
[8] I. Foster, Grid: A New Infrastructure For 21st Century Science, 2002.
[9] L. Garcés-Erice, E. W. Biersack, P. A. Felber, K. W. Ross, and G. Urvoy-Keller, "Hierarchical Peer-to-Peer Systems," in International Euro-Par Conference Klagenfurt, Austria, August 2003.
[10] I. Gupta, K. Birman, P. Linga, A. Demers, and R. v. Renesse, "Kelips: Building an Efficient and Stable P2P DHT Through Increased Memory and Background Over-head," in 2nd International Workshop on Peer-to-Peer Systems, 2003.
[11] H. Jin, C. Wang, and H. Chen, "Boundary Chord: A Novel Peer-to-Peer Algorithm for Replica Location Mechanism in Grid Environment," in 8th International Symposium on Parallel Architectures,Algorithms and Networks, 2005, pp. 262 - 267.
[12] D. Karger, E. Lehman, F. T. Leighton, M. Levine, D. Lewin, and R. Panigrahy, "Con-sistent hashing and random trees: Distributed caching protocols for relieving hot spots on the World Wide Web," in 9th Annual ACM Symposium on Theory of Computing, 1997.
[13] J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and a. B. Zhao, "OceanStore: An Architecture for Global-Scale Persistent Storage," in Ninth international Conference on Architectural Support for Programming Languages and Operating Systems, November 2000.
[14] N. Leibowitz, M. Ripeanu, and A. Wierzbicki, "Deconstructing the Kazaa network," in Internet Applications. WIAPP 2003. Proceedings. The Third IEEE Workshop on, 2003, pp. 112-120.
[15] M.-R. Lin, S.-H. Lu, T.-H. Ho, P. Lin, and Y.-C. Chung, "CFR: A Peer-to-Peer Colla-borative File Repository System," in Grid and Pervasive Computing 2007, Paris, France, May 2007.
[16] Y. Liu, L. Xiao, X. Liu, L. M. Ni, and X. Zhang, "Location awareness in unstructured peer-to-peer systems," Transactions on Parallel and Distributed Systems, vol. 16, pp. 163-174, 2005.
[17] V. Lo, D. Zhou, Y. Liu, C. GauthierDickey, and J. Li, "Scalable Supernode Selection in Peer-to-Peer Overlay Networks," in Second International Workshop on Hot Topics in Peer-to- Peer Systems, Oregon, USA, 2005.
[18] S.-H. Min, J. Holliday, and D.-S. Cho, "Optimal Super-peer Selection for Large-scale P2P System," in International Conference on Hybrid Information Technology (ICHIT'06), 2006.
[19] A. Muthitacharoen, R. Morris, T. M. Gil, and B. Chen, "Ivy: A Read/Write Peer-to-Peer File System," in 5th Symposium on Operating Systems Design and Implementation, 2002.
[20] A. Rowstron and P. Druschel, "Pastry: Scalable, decentralized object location and routing for large-scale peer-to-peer systems," in IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), Heidelberg, Germany, November 2001, pp. 329-350.
[21] I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan, "Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications," in ACM SIGCOMM 2001 San Deigo, CA, August 2001, pp. 146-160.
[22] I. Stoica, R. Morris, D. Liben-Nowell, D. R. A. K. D. R. Karger, M. F. A. K. M. F. Kaashoek, F. A. D. F. Dabek, and H. A. B. H. Balakrishnan, "Chord: a scalable peer-to-peer lookup protocol for Internet applications," Networking, IEEE/ACM Transac-tions on, vol. 11, pp. 17-32, 2003.
[23] Z. Xu, R. Min, and Y. Hu, "HIERAS: a DHT based hierarchical P2P routing algo-rithm," in International Conference on Parallel Processing, Octorber 2003, pp. 187-194.
[24] X. Y. Zhang, Q. Zhang, Z. Zhang, G. Song, and W. Zhu, "A construction of locality-aware overlay network: mOverlay and its performance," Selected Areas in Communi-cations, IEEE Journal on, vol. 22, pp. 18-28, 2004.