研究生: |
林新宗 Lin, Hsin-Tsung |
---|---|
論文名稱: |
運用折扣強化學習策略尋找艾爾法酒吧賽局之奈許平衡 Learning to play an El Farol bar game using discounted reinforcement learning |
指導教授: |
李端興
Lee, Duan-Shin |
口試委員: |
張正尚
Chang, Cheng-Shang 林華君 Lin, Hwa-Chun |
學位類別: |
碩士 Master |
系所名稱: |
電機資訊學院 - 通訊工程研究所 Communications Engineering |
論文出版年: | 2018 |
畢業學年度: | 106 |
語文別: | 英文 |
論文頁數: | 29 |
中文關鍵詞: | 艾爾法酒吧 、賽局理論 、奈許平衡 、學習理論 |
外文關鍵詞: | El Farol bar, game theory, Nash equilibrium, learning theory |
相關次數: | 點閱:3 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在本篇的論文中,我們探究艾爾法酒吧賽局(El Farol bar game)的折扣強化學習過程(discounted reinforcement learning process) ,並分析它。我們對這樣的強化學習過程推導出一個非線性微分方程組的系統,並從非線性系統(nonlinear system)中找出一些對應於賽局的奈許平衡(Nash equilibria of the game) 的平衡點。在這些穩
定的平衡點中,只有對應於純奈許平衡(pure Nash equilibria) 的平衡點是穩定的。其它對應於混合奈許平衡(mixed Nash equilibria)的平衡點則都是不穩定的。
In this paper we consider the discounted reinforcement learning process
of an El Farol bar game. We analyze a discounted reinforcement learning process of the El Farol Bar game. We derive a system of nonlinear differential equations for this process. We show that some equilibrium
points of this nonlinear system correspond to the Nash equilibria of the game. Among these stable equilibrium points only the equilibrium point that corresponds to pure Nash equilibrium is stable. Other equilibrium points that correspond to mixed Nash equilibria are unstable.
[1] D. Fudenberg and D. K. Levine, The theory of learning in games. Massachusetts: The MIT Press, 1999.
[2] E. Hopkins, “Two competing models of how people learn in games,” Econometrica, vol. 70, no. 6, pp. 2141–2166, 2002.
[3] I. Erev and A. E. Roth, “Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria,” The American Economic Review, vol. 88, no. 4, pp.848–881, 1998.
[4] R. S. Sutton and A. G. Barto, Reinforcement learning: an introduction. Massachusetts: The MIT Press, 2012.
[5] W. B. Arthur, “Inductive reasoning and bounded rationality,” American Economic Review, vol. 84, pp. 406–411, 1994.
[6] D. Challet, M. Marsili, and G. Ottino, “Shedding light on El Farol,” Physica A: Statistical Mechanics and Its Applications, vol. 332, pp.469–482, 2004.
[7] R. Franke, “Reinforcement learning in the El Farol model,” Journal of Economic Behavior & Organization, vol. 51, p. 367–388, 2003.
[8] D. Whitehead, “The El Farol Bar problem revisited: Reinforcement
learning in a potential game,” Edinburgh School of Economics, Discussion Paper Series 186, 2008.
[9] E. L. Thorndike, “Animal intelligence: An experimental study of
the associative processes in animals,” Psychological monographs,
vol. 2, no. 8, 1989.
[10] J. Blackburn, “Acquisition of skills: An analysis of learning
curves,” IHRB Report, Tech. Rep. 73, 1936.
[11] W. K. Estes, “Toward a statistical theory of learning,” Psychological Review, vol. 57, no. 2, pp. 94–107, March 1950.
[12] D. R. Luce, Individual choice behavior. New York: Wiley, 1959.
[13] R. Bush and F. Mosteller, Stochastic models for learning. New
York: Wiley, 1955.
[14] P. Suppes and R. C. Atkinson, Markov learning models for multiperson interactions. Stanford, CA: Stanford University Press,
1960.