簡易檢索 / 詳目顯示

研究生: 吳正鈺
Wu, Cheng-Yu
論文名稱: Design and Implementation of Client System for Large-scale Content Delivery
大規模內容派送系統之端架構設計與研製
指導教授: 黃能富
Huang, Nen-Fu
口試委員: 黃能富
石維寬
簡榮宏
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 資訊工程學系
Computer Science
論文出版年: 2011
畢業學年度: 99
語文別: 英文
論文頁數: 64
中文關鍵詞: 檔案派送同儕網路點對點檔案傳輸點對點
外文關鍵詞: content delivery, Peer-to-Peer network, Peer-to-Peer file transfer, Peer-to-Peer, P2P
相關次數: 點閱:1下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • With the rapid development of network technology, more and more all sorts of contents are exchanged and published over the network. End-users hope to obtain content from the remote node while the content providers seek a reliable way publishing their content. A traditional Content Delivery System (CDS) was proposed adopting Client-Server model to deliver content. However, this architecture challenged to an enormous increment number of users, since all upload cost is only placed on the hosting machine. The upstream of the server-side network traffic is often a transmission bottleneck.
    This thesis is based on general industrial standards to practically design and implement a complete client system of the overall content delivery system. End-users arrange the sequence of delivery job by their preference on a friendly Graphical User Interface (GUI). The client-side Engine under the table delivers contents. Not only is Client-Server model adopted, Peer-to-Peer (P2P) model is flavored into the progress of content transmission. This is known as Peer-to-Server-and-to-Peer (P2SP) model. The mixed architecture does not cause one user never complete download if a particular piece of file is no longer available from any current downloaders and it expects much traffic saved in the server-side than pure Client-Server model does.
    We also evaluate the proposed system and present some experimental scenarios. The results show that with a lower receiving rate from server specified to the process of content delivery for the client system, the server system save more bandwidth. The proposed system also applied in a commercial online system. The statistics gathered from that online system show that most of contents distributed by the proposed system hardly gain the help of P2P model, since there is only one client requesting this content.


    隨著網路技術的蓬勃發展,越來越多各式各樣的檔案資訊在網路世界中被交換與散佈。使用者希望取得網路遠端的資源,內容提供商也尋求一個可靠的方式散佈檔案。傳統的內容派送系統採用採用客戶端-伺服器端的模式派送網路世界中的檔案。然而,由於所有的上傳頻寬全部由中央的內容伺服器提供,這類架構在使用者人數大量增加時遭遇到了極大的挑戰。不斷增加的伺服器流量於是造成了整個系統的瓶頸。
    本論文依據一般業界標準設計並實作出一個完整的內容派送系統之客戶端系統。使用者根據喜好透過圖形化使用者介面操作及安排派送任務。客戶端的引擎執行派送任務。除了傳統的客戶端-伺服器端的模式外,檔案內容的傳輸過程也加入了點對點的基礎模式。這類混合式架構稱為點對伺服器與對點模式。這種架構不會發生使用者無法完成下載的工作;與傳統的客戶端-伺服器端的模式相比,在中央伺服器端也可以省去較多的頻寬。
    我們同時去評估此系統,以及提出一些實驗的情境。實驗的結果顯示當客戶端系統在下載檔案的過程中被指派較低的伺服器接收率,中央伺服器系統可節省較多的頻寬。此派送系統目前也被應用於商業產品並且正式上線運行。從該線上系統收集到數據顯示,由於大部分的檔案只有被唯一一個使用者要求下載,因此,此類案例的檔案在傳輸的過程中很難藉由點對點技術來降低伺服器的頻寬。

    Chapter 1 Introduction ................................................................................................... 7 Chapter 2 Related Works ............................................................................................. 12 2.1 Bandongo ............................................................................................. 12 2.2 BitTorrent ............................................................................................. 13 2.3 Foxy ..................................................................................................... 15 2.4 Xunlei ................................................................................................... 15 Chapter 3 System Design ............................................................................................. 17 3.1 System Overview ................................................................................. 17 3.1.1 System Components..................................................................... 19 3.1.1.1 Components of Server System .............................................. 19 3.1.1.2 Components of Client System .............................................. 26 3.1.2 Relationship between the Components ........................................ 27 3.2 Client Engine ....................................................................................... 28 3.2.1 File & Job ..................................................................................... 28 3.2.2 REST ............................................................................................ 31 3.3 Operation Schemes .............................................................................. 32 3.3.1 GUI .............................................................................................. 33 3.3.2 API ............................................................................................... 34 3.3.3 Upload .......................................................................................... 36 3.3.4 Download ..................................................................................... 37 3.3.5 Parallel Upload/Download ........................................................... 38 3.3.6 Peer-to-Peer File Transfer ............................................................ 40 3.3.7 Local File Management ............................................................... 49 Chapter 4 Experimental Result .................................................................................... 52 4.1 Different Receiving Rates from Server ................................................ 52 4.2 Impact of file popularities .................................................................... 57 4.3 Different Download Frequency of Content ......................................... 59 Chapter 5 Conclusions ................................................................................................. 61 References .................................................................................................................... 63

    [1] Stefan Saroiu, Krishna P. Gummadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy, “An Analysis of Internet Content Delivery Systems,” in Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI 2002), Boston, MA, USA, Dec 2002.
    [2] Content Delivery Network. http://en.wikipedia.org/wiki/Content_delivery_network
    [3] Jaison Paul Mulerikkal and Ibrahim Khalil, “An Architecture for Distributed Content Delivery Network,” IEEE International Conference on Networks, pp. 359-364, Nov 2007.
    [4] Internet Engineering Task Force. Hypertext transfer protocol - http 1.1. RFC 2068, March 1997.
    [5] Fred Douglis, Anja Feldmann, Balachander Krishnamurthy, and Jeffrey Mogul, “Rate of change and other metrics: a live study of the world wide web,” in Proceedings of the 1997 USENIX Symp. On Internet Technologies and Systems, Dec 1997.
    [6] Ms. MAY PAING PAING ZAW and Ms. SU MYAT MARLAR SOE, “Design and Implementation of Client Server Network Management System for Ethernet LAN,” World Academy of Science, Engineering and Technology 48 2008.
    [7] Bandongo. http://www.badongo.com/
    [8] Bram Cohen, “Incentives Build Robustness in BitTorrent,” in Proceedings of the 1st Workshop on Economics of Peer-to-Peer Systems, Berkeley, CA, USA, Jun 2003.
    [9] BitTorrent. Free, open source file-sharing application effective for distributing very large software and media files. http://www.bittorrent.com/
    [10] BitTorrent Protocol. http://www.bittorrent.org/beps/bep_0003.html
    [11] Secure Hash Algorithm 1. http://tools.ietf.org/html/rfc3174
    [12] Foxy. http://en.wikipedia.org/wiki/Foxy_(P2P)
    [13] Gnutella. http://en.wikipedia.org/wiki/Gnutella
    [14] Gnutella Web Cache. http://www.gnucleus.com/gwebcache/
    [15] Xunlei. http://www.xunlei.com/
    [16] EDonkey. http://www.emule-project.net/
    [17] F. Liu, P. Liu, J. Yang, and Z. Lei, “Contrastive Analysis of P2SP Network and P2P Network,” Wireless Communications, Networking and Mobile Computing, 1-5, 2009.
    [18] XML. http://www.w3schools.com/xml/default.asp
    [19] Massage Passing Interface. http://www.mpi-forum.org/
    [20] OpenMP. http://openmp.org/
    [21] R. Lo Cigno, A.Russo, and D.Carra, “On Some Fundamental Properties of P2PPush/Pull Protocols”, in Proceedings of HUT-ICCE 2008, HoiAn, Vietnam, Jun 2008.
    [22] Chao Xie, Guihai Chen, Art Vandenberg, and Yi Pan, “Analysis of hybrid P2P overlay network topology”, Computer Communications, Volume 31, Issue 2, pp.190-200, Feb 2008.
    [23] Xiangying Yang and Gustavo de Veciana, “Service capacity of peer to peer networks,” in Proceedings of IEEE INFOCOM, Mar 2004.
    [24] Ashwin R. Bharambe, Cormac Herley, and Venkata N. Padmanabhan, “Analyzing and Improving a BitTorrent Networks Performance Mechanisms,” in Proceedings of IEEE INFOCOM 2006, Barcelona, Catalunya, Spain, Apr 2006.
    [25] L. Guo, S. Chen, Z. Xiao, E. Tan, X. Ding, and X. Zhang, “Measurements, Analysis, and Modeling of BitTorrent-like Systems,” In Internet Measurement Conference, 2005.
    [26] D. Qiu and R. Srikant, “Modeling BitTorrent-like peer-to-peer systems,” IEEE Communications Letters, vol. 10, pp. 513-515, Jul 2006.
    [27] D. Y. Qiu and R. Srikant, “Modeling and performance analysis of bittorrent-like peer-to-peer networks,” in Proceedings of ACM SIGCOMM 2004, Portland, Oregon, USA, Aug 2004.
    [28] Mauro Andreolini, Riccardo Lancellotti, and Philip S. Yu, “Analysis of peer-to-peer systems: workload characterization and effects on traffic cacheability,” in Proceedings of the IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS’04), pp.95-104, Volendam, Netherlands, October 2004.
    [29] J. A. Pouwelse, P. Garbacki, D. H. J. Epema, and H. J. Sips, “The BitTorrent P2P file-sharing system: measurements and analysis,” in Proceedings of 4th International Workshop on Peer-to-Peer Systems, Feb 2005.
    [30] L. Guo, S. Chen, Z. Xiao, E. Tan, X. Ding, and X. Zhang, “A performance study of bittorrent-like peer-to-peer systems,” in IEEE Journal on Selected Areas in Communications (IEEE JSAC), first Quarter of 2007.
    [31] GoGoBox. http://www.gogobox.com.tw/
    [32] The Long Tail. http://www.wired.com/wired/archive/12.10/tail_pr.html

    無法下載圖示 全文公開日期 本全文未授權公開 (校內網路)
    全文公開日期 本全文未授權公開 (校外網路)

    QR CODE