研究生: |
黃光立 Kuang-Li Huang |
---|---|
論文名稱: |
在分散式系統中以位元運算為基礎之負載平衡演算法 A Bitwise Load-Balanced Algorithm for High-Performance Distributed Systems |
指導教授: |
黃泰一
Tai-Yi Huang |
口試委員: | |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 資訊工程學系 Computer Science |
論文出版年: | 2004 |
畢業學年度: | 92 |
語文別: | 英文 |
論文頁數: | 35 |
中文關鍵詞: | 點對點 、分散式系統 、負載平衡 |
外文關鍵詞: | peer-to-peer, distributed system, load-balance, replication algorithm |
相關次數: | 點閱:3 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在高效能的分散式系統中, 經常藉由複製常被存取的檔案以減少擁有這些檔案的節點的工作量. 傳統複製檔案的演算法大多依靠分析 client 存取行為的記錄檔來決定要將檔案複製於那些節點內. 在這篇論文中, 我們提出了 LessLog, 一個不需要分析 client 記錄檔的演算法, 是為了結構式點對點分散式系統 (structured peer-to-peer system) 所設計的. 在這個演算法中, 我們利用 binomial tree, 首先建構出一顆唯一的 virtual replication tree.
再用此 virtual replication tree 經過一些運算後, 得到 N 顆不同的 physical replication trees. 並利用 physical replication tree, 來決定檔案要被複製於那個節點. LessLog 使用位元運算 (bitwise operations) 來決定複製的檔案要擺放到那一個節點, 同時這個過程並不需要分析任何 client 的記錄檔, 也因此, LessLog 的演算法非常簡單, 且有效率. 除此之外, 每一個複製的檔案都保證能減少原來擁有這個檔案的節點約 1/2 的工作量. 最後, 我們也提供了具有容錯性的 LessLog. 在這個模型中, 我們考慮了在點對點系統裡, 若有節點 i 意外的離開系統時, LessLog 仍然能保證當使用者想要存取原本存在於節點 i
的檔案, 仍然能在其他節點尋找到, 並被成功的存取. 同時, LessLog 也允許節點動態的加入或離開系統.
實驗結果顯示 LessLog 與最簡單的隨機複製檔案的方法,
或需要分析使用者存取記錄的方法比起來,
LessLog 只需使用很少的 replicas, 就能成功且有效的減少原本負擔過重的節點的工作量.
The technique of replicating frequently-accessed files to other nodes has been widely used in a high-performance distributed system to reduce the load of the nodes hosting these files. Traditional file replication algorithms rely on the analysis of client-access logs to determine the location of the replicated nodes. In this paper, we present LessLog, a logless file replication algorithm, developed for a peer-to-peer distributed system. We first construct a replication tree for each node. LessLog uses bitwise operations to determine the location of the replicated node without any client-access history. In addition, each replication is guaranteed to reduce the workload of the replicating node by half. A fault-tolerant LessLog model is also presented. The experimental results show that LessLog
successfully and e±ciently reduces the load of overloaded nodes.
[1] AllPeers. http://www.allpeers.com/.
[2] Gnutella. http://www.gnutella.com/.
[3] KaZaA. http://www.kazaa.com/us/index.htm.
[4] Napster. http://www.napster.com/.
[5] SETI@Home. http://setiathome.ssl.berkeley.edu/.
[6] Y. Chen, R. H. Katz, and J. D. Kubiatowicz. SCAN: A Dynamic, Scalable, and E±cient Content Distribution Network. In International Conference on Pervasive Computing (Pervasive 2002), pages 282-296, August 2002.
[7] Jerry C.Y. Chou, Tai Yi Huang, and Kuang Li Huang. SCALLOP: A Scalable and Load-balanced Peer-to-Peer Lookup Protocol for High-performance Distributed Systems. In Proceedings of the 4th IEEE/ACM International Symposium on Cluster Computing and the Grid, April 2004.
[8] I. Clarke, O. Sandberg, B. Wiley, and T. W. Hong. Freenet: A Distributed Anonymous Information Storage and Retrieval System. Lecture Notes in Computer Science, 2009:46+, 2001.
[9] P. Druschel and A. Rowstron. PAST: A Large-scale, Persistent Peer-to-Peer Storage Utility. The 8th Workshop on Hot Topics in Operating Systems, May 2001.
[10] A. Fiat and J. Saia. Censorship Resistant Peer-to-Peer Content Addressable Networks. In Proceedings of Symposium on Discrete Algorithms, 2002.
[11] C. Gkantsidis, M. Mihail, and A. Saberi. Random Walks in Peer-to-Peer Networks. In Infocom, March 2004.
[12] J. Kangasharju, J. Roberts, and K. W. Ross. Object Replication Strategies in Content Distribution Networks. In Proceedings of the 6th International Web Caching Workshop and Content Delivery Workshop, pages 376-383, June 2001.
[13] J. Kubiatowicz, D. Bindel, Y. Chen, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells, and B. Zhao. OceanStore: An Architecture for Global-scale Persistent Storage. In Proceedings of ACM Architectural Support for Programming Languages and Operating Systems, pages 190-201, November 2000.
[14] A. Kumar, S. Merugu, J. Xu, and X. Yu. Ulysses: A Robust, Low-Dimeter, Low-Latency Peer-to-Peer Network. In Proceedings of the 11th IEEE International Conference on Network Protocols, pages 258-267, November 2003.
[15] G. Kwon and K. D. Ryu. An E±cient Peer{to{Peer File Sharing Exploiting Hierarchy and Asymmetry. In Proceedings of the 2003 Symposium on Applications and the Internet, pages 226-233, January 2003.
[16] J. Li, J. Jannotti, D. De Couto, D. Karger, and R. Morris. A Scalable Location Service for Geographic Ad-hoc Routing. In Proceedings of the 6th ACM International Conference on Mobile Computing and Networking, pages 120u-130, August 2000.
[17] D. Loguinov, A. Kumar, V. Rai, and S. Ganesh. Graph-theoretic Analysis of Structured Peer-to-Peer Systems: Routing Distances and Fault Resilience. In Proceedings of ACM SIGCOMM, August 2003.
[18] Q. Lv, P. Cao, E. Cohen, K. Li, and S. Shenker. Search and Replication in Unstructured Peer-to-Peer Networks. In Proceedings of the 16th International Conference on Supercomputing, pages 84-95, June 2002.
[19] D. Malkhi, M. Naor, and D. Ratajczak. Viceroy: A Scalable and Dynamic Emulation of the Butterfly. In Proceedings of the 21nd Annual ACM Symposium on Principles of Distributed Computing, pages 183-192, July 2002.
[20] W. S. Ng, B. C. Ooi, K. L. Tan, and A. Zhou. PeerDB { a Peer-to-Peer Based System for Distributed Data Sharing. In Proceedings of the 19th International Conference on Data Engineering, pages 633-644, May 2003.
[21] G. On, J. Schmitt, and R. Steinmetz. The E®ectiveness of Realistic Replication Strategies on Quality of Availability for Peer-to-Peer Systems. In Proceedings of the Third International Conference on Peer-to-Peer Computing, pages 57-65, September 2003.
[22] C. Greg Plaxton, R. Rajaraman, and A. W. Richa. Accessing Nearby Copies of Replicated Objects in a Distributed Environment. In ACM Symposium on Parallel Algorithms and Architectures, pages 311-320, June 1997.
[23] K. Ranganathan, A. Iamnitchi, and I. Foster. Improving Data Availability through Dynamic Model-Driven Replication in Large Peer-to-Peer Communities. In Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, pages 376-381, May 2002.
[24] S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker. A Scalable Content Addressable Network. In Proceedings of ACM SIGCOMM, pages 161-172, August 2001.
[25] A. Rowstron and P. Druschel. Pastry: Scalable, Decentralized Object Location and Routing for Large-scale Peer-to-Peer Systems. Lecture Notes in Computer Science, pages 329-340, 2001.
[26] A. Rowstron and P. Druschel. Storage management and Caching in PAST, a Large-scale, Persistent Peer-to-Peer Storage Utility. In Proceedings of the 18th ACM Symposium on Operating Systems Principles, pages 188{201, October 2001.
[27] I. Stoica, R. Morris, D. Karger, F. Kaashoek, and H. Balakrishnan. Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications. In Proceedings of ACM SIGCOMM, pages 149-160, August 2001.
[28] M Theimer and M.B Jones. Overlook: Scalable Name Service on an Overlay Network. In Proceedings of the 22nd International Conference on Distributed Computing Systems, pages 52-61, July 2002.
[29] T. Wauters, J. Coppens, T. Lambrecht, B. Dhoedt, and P. Demeester. Distributed Replica Placement Algorithms for Peer-to-Peer Content Distribution Networks. In Proceedings of the 29th EUROMICRO Conference "New Waves in System Architecture", pages 181-188, September 2003.
[30] Z. Xu and Y. Hu. SBARC: A Supernode Based Peer-to-Peer File Sharing System. In Proceedings of the Eighth IEEE International Symposium on Computers and Communication, pages 1053-1058, June 2003.
[31] B. Y. Zhao, L. Huang, J. Stribling, S. C. Rhea, A. D. Joseph, and J. D. Kubiatowicz. Tapestry: A Global-scale Overlay for Rapid Service Deployment. In IEEE Journal on Selected Areas in Communications, pages 41-53, January 2004.
[32] S. Q. Zhuang, B. Y. Zhao, A. D. Joseph, R. H. Katz, and J. D. Kubiatowicz. Bayeux: An Architecture for Scalable and Fault-tolerant Wide-area Data Dissemination. In Proceedings of NOSSDAV, pages 11-20, June 2001.