研究生: |
陳寬達 Kuan-Ta Chen |
---|---|
論文名稱: |
動態平行存取映射站台的Web資源之技術研究 Dynamic Parallel Access to Mirrored Web Resources |
指導教授: |
黃能富
Nen-Fu Huang |
口試委員: | |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 資訊工程學系 Computer Science |
論文出版年: | 2000 |
畢業學年度: | 88 |
語文別: | 中文 |
論文頁數: | 66 |
中文關鍵詞: | 平行存取 、映射站台 |
外文關鍵詞: | Parallel Access, Web Resource, Mirror Sites |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
為了減少從網路下載檔案的等待時間,許許多多的檔案被置放於映射站台,讓使用者自由選擇站台來進行瀏覽、下載,不但節省下載時間,也分散伺服器的負載。不過,選擇傳輸速度最佳的站台並不是件簡單的事,若選擇錯誤,很可能得到的極低的傳輸效率。平行存取技術由此而生:同時與多個映射站台連線,分別從各站台下載檔案的不同部分,再組合為原來的檔案,不但可大幅加快下載速度,還可分散網路及伺服器的負載,以及避免困難的站台選擇工作。
平行存取技術的關鍵為,將檔案切分為許多區塊,分別從不同站台下載各個區塊的資料。不同的區塊尺寸可決定整體的下載效率,大致來說,區塊尺寸越大,下載效能越高。不過當區塊尺寸過大,由於各站台區塊傳輸結束時間的不一致,反而可能使下載時間增長。區塊尺寸過小或過大都可能降低效能,要如何選擇最佳的區塊尺寸是使平行存取技術達到高效能的重要研究。
在本篇論文中,我們研究檔案大小、區塊尺寸對於平行存取技術傳輸效能的影響,並建立區塊尺寸-下載時間模型,找出計算最佳的區塊尺寸的方法,並藉此發展出動態平行存取技術。
動態平行存取技術可動態地根據根據各站台的連線及下載情形以時間預估演算法來計算最佳的區塊尺寸,企圖在各種情況下皆能得到合理的下載效率。根據我們的評估,動態平行存取技術的表現雖然不若直接指定最佳區塊尺寸的平行存取技術,不過在各種情況下能夠獲得較穩定的表現。在我們的實驗中,動態平行存取技術通常能獲得理想下載速率 85% 以上的傳輸效能。
[Agui 84] L. Aguilar. "Datagram routing for Internet multicasting", SIGCOMM'84, pp 58 - 63. ACM, Jun. 1984.
[Amma 97] Russell Clark and Ammar, Mostafa. " Providing Scalable Web Service Using Multicast Delivery ", Computer Networks and ISDN Systems Journal, Vol. 29, pp841-858, 1997.
[Apac] "Apache Web Server", http://www.apache.org/.
[Arli 96] M. F. Arlitt, C. L. Williamson, "Web server workload characterization: The search for invariants", in Proc. ACM SIGMETRICS, May 1996, pp.126-137.
[Bern 95] J Bernabeu, M. Ammar, and M Ahamad, "Optimizing a generalized polling protocol for resource finding over a multiple access channel," Computer Networks and ISDN Systems, 1995.
[Bhat 97] Samrat Bhattacharjee, Mostafa H. Ammar, Ellen W.Zegura, Viren Shah, Zongming Fei, "Application-Layer Anycasting", INFOCOMM97, Japan, April, 1997.
[Brad 92] R. Braden, "Extending TCP for transactions - Concepts", RFC 1379, Nov. 1992.
[Brad 94] R. Braden, "T/TCP - TCP extensions for transactions functional specification", RFC 1644, Jul. 1994.
[Byer 99] John Byers, Michael Luby, and Michael Mitzenmacher, "Accessing multiple mirror sites in parallel: Using tornado codes to speed up downloads," in INFOCOM 99, Apr. 1999.
[Calf 94] K.C. Claffy and H. Braun. "Web traffic characerization: An assessment of the impact of caching documents from NCSA's Web server". In Second World Wide Web Conference'94. http://www.ncsa.uiuc.edu/SDG/IT94/Proceedings, Oct. 1994
[CNet] "CNET DOWNLOAD.COM", http://download.cnet.com/.
[Cens] Censorware Project, "Size of the web: A dynamic essay for a dynamic medium", http://censorware.org/web_size/
[Crov 97] Mark Crovella and Robert Carter, "Dynamic server selection using bandwidth probing in wide-area networks," in Proceedings of IEEE INFOCOMM, 1997.
[Cunh 95] C.Cunha, A.Bestavros, and M.Crovella, "Characteristics of WWW client-based traces", Tech. Rep. 95-010, Boston Univ., Apr.1995
[Fan 98] Li Fan, Pei Cao, Jussara Almeida, and Andrei Broder, "Summary cache: A scalable wide-area web cache sharing protocol," Feb 1998, SIG-COMM'98.
[Fiel 97] R. Fielding, J. Gettys, J. Mogul, H. Frystyk, T. Berners-Lee, et al., "RFC 2068: Hypertext transfer protocol - HTTP/1.1," Jan. 1997.
[Frys 96] H. Frystyk, R. Fielding, T. Berners-Lee, et al., "RFC 1945: Hypertext transfer protocol - HTTP/1.0," May. 1996.
[Gadd 97] Syam Gadde, Michael Rabinovich, and Jeff Chase, "Reduce, reuse, recycle: An approach to building large internet caches," in The Sixth Workshop on Hot Topics in Operating Systems (HotOS-VI), May 1997.
[Heid 97] John Heidemann, Katia Obraczka, Joe Touch, "Modeling the Performance of HTTP Over Several Transport Protocols", Jun. 1997.
[Jaco 88] Van Jacobson, "Congestion Avoidance and Control", SIGCOMM, 1988.
[Jaco 90] Van Jacobson, "Modified TCP Congestion Avoidance Algorithm", April 30, 1990, end2end interest mailing list
[Kang 99] J. Kangasharju, K. W. Ross, and J.W. Roberts, "Locating copies of objects using the domain name system," in Proceedings of the 4th International Caching Workshop, San Diego, March 1999.
[Lawr 00] Dr. Lawrence G. Roberts, "Internet Growth Trends", IEEE Computer, Internet Watch, Jan. 2000
[Luby 97] M. Luby et al., "Practical loss-resilient codes," in STOC, 1997.
[Luig 97] Luigi Rizzo, "Effective erasure codes for reliable computer communication protocols," Computer Communication Review, vol. 27, no. 2, pp.24-36, April 1997.
[Lyco] http://ftpsearch.lycos.com/.
[Mehm 98] Mehmet Sayal, Yuri Breibart, Peter Scheuermann, and Radek Vingralek, "Selection algorithm for replicated web servers," in Workshop on Internet Server Performance, SIGMETRICS, Madison, USA, June 1998.
[Mogu 95] Jeffrey C.Mogul, "The Case for Persistent-Connection HTTP", SIGCOMM 95 Cambridge, MA USA
[NTHU] "NTHU Computer Science Dept.", http://www.cs.nthu.edu.tw/.
[Neum 92] B. C. Neuman, "The virtual system model: A scalable approach to organizing large system", Ph.D. dissertation, Univ. Washington, Seattle, 1992.
[Pabl 00] Pablo Rodriguez, Andreas Kirpal, Ernst W.Biersack, "Parallel-Access for Mirror Sites in the Internet" in Proceedings of IEEE INFOCOM, March 2000.
[Padm 96] Venkata N.Padmanabhan, Jeffrey C.Mogul, "Improving HTTP Latency"
[Post 85] J. Postel, J. Reynolds, "RFC 959: File Transfer Protocol", Oct. 1985.
[Rich 94] W. Richard Stevens, "TCP/IP Illustrated, Volume 1", pp.289-291.
[Rous 98] Alex Rousskov and Duane Wessels, "Cache digest," in 3rd International WWW Caching Workshop, June 1998.
[Sesh 97] S. Sesham, M. Stemm, and R. Katz, "Spand: Shared passive network performance discovery," in Proceedings of the USENIX Symposium on Internet Technologies and Systems, December
[Sper 95] E. E. Spero, "Analysis of HTTP performance problems," http://sunsite.unc.edu/mdma-release/http-prob.html, 1995
[Touc 95] J. Touch, "Defining 'high speed' protocols: Five challenges and an example that survives the challenges", IEEE J. Select. Areas Commun.,vol.13, pp.828-835, Jun. 1995
[Vern 97] Vern Paxson, "Measurements and Analysis of End-to-End Internet Dynamics", Ph.D. Thesis, Apr. 1997.
[Zong 98] Zongming Fei, S. Bhattacharjee, Ellen W. Zegura, and Mostafa H. Ammar, "A novel server selection technique for improving the response time of a replicated service," in Proceedings of IEEE INFOCOM, San Francisco, CA, USA, March 1998
[wget] wget, ftp://gnjilux.cc.fer.hr/pub/unix/util/wget/.