研究生: |
余琬瑜 YU,WAN-YU |
---|---|
論文名稱: |
基於共識的委員會來協調多代理人系統 - 智能電網和無人機群的兩個應用案例研究 Consensus Based Committee Coordination for Multi-agent Systems -- Two Case-studies of Application on Smart Grid and UAVs |
指導教授: |
蘇豐文
SOO, VON-WUN |
口試委員: |
朱宏國
CHU, HUNG-KUO 沈之涯 SHEN, CHIH-YA 蘇英俊 SU, ING-JIUNN 李永隆 LEE , YUNG-LUNG |
學位類別: |
博士 Doctor |
系所名稱: |
電機資訊學院 - 資訊系統與應用研究所 Institute of Information Systems and Applications |
論文出版年: | 2021 |
畢業學年度: | 109 |
語文別: | 英文 |
論文頁數: | 114 |
中文關鍵詞: | 多代理人系統 、分散式系統 、容錯機制 、協調及共識 、能源系統 、復電問題 、智慧型代理人 、機群 、自動路徑規劃 、任務分配 |
外文關鍵詞: | Multi-UAV |
相關次數: | 點閱:2 下載:0 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
多代理人系統透過擬人化的協調並達到共識是一個具有挑戰的研究方向。近年來在很多不同的領域都有不同的應用與發展。例如,智能機器人、智慧型電網架構、自動控制及軍事領域等,信息系統的複雜性和動態性不斷增加,需要設備自己做出決策以滿足其設計目標。我們整合了多代理人系統社會化的概念提出委員會的架構,並透過訊息的溝通及提案的分享,在考量多個限制條件下,加入了共識決策的方法,並將架構及決策方法以模擬的方式分別驗證在智慧型電網的復電模型及無人機群的自主動態任務分配及避障的路徑規劃,驗證結果顯示了所提出的方法比傳統方法更有效地達成共識。
在這項研究中,我們基於委員會的演算法中也導入了具有Redun-skip方式的容錯機制,以增強多代理人系統的強健性。如此可避免軟體代理人在執行過程中因某些原因造成的錯誤導致系統失效,我們提出的方法中已包含的容錯機制可以容許在有限數量的代理人失效時,系統仍然可以持續工作。我們將此方法驗證於電力恢復系統,以評估在電力恢復系統中代理人在不同程度的故障下系統性能下降的程度。模擬結果證明,Redun-Skip機制可以在不增加硬體成本的情況下,提高了基於代理人機制的電力服務恢復系統的穩定性及強健性。
在配電系統服務恢復問題中,電力系統拓撲中的開關被模擬為智能代理人並組織為配電系統中的電力委員會。這種方法的優點是:委員會本身具備解決問題的能力,可以透過與相鄰委員會的協調,以達成滿足配電系統服務恢復問題的全局目標的協議,而無需依賴須預先具備足夠訊息的傳統集中式優化演算法。本研究中所提出的協調演算法有助於分散式電力委員會中的開關代理人在檢測到錯誤時同時主動採取故障隔離後,並可以同時在許多提出的服務恢復解決方案中達成共識。我們也在尋找解決方案時也同時考慮了電壓偏差下降的問題。本研究中以兩個不同配電系統架構的案例,模擬了協調方法的演算法如何在許多提議的局部候選解決方案中識別最佳電力恢復問題的解決方案。
在另一個多無人機系統的應用中,無人機技術近年來得到迅速的發展,應用範圍廣泛。然而,協調一組自主無人機在未知和不斷變化的環境中完成任務一直是個具有挑戰性和復雜性的問題。我們修改了基於共識的拍賣算法,使其可以在無人機之間動態進行任務分配,從而可以靈活地找到到達目標的路徑,同時可以在避免碰撞的狀況下保持群飛的隊形。我們提出了核心演算法並根據經驗模擬了許多場景,以說明所提出的框架是如何工作的。具體而言,我們模擬了無人機如何在某些目標可能會在飛行任務期間出現和消失的動態情況下重新進行任務分配並可以尋找到到達目標的動態路徑。
應用於上述兩個不同領域的模擬結果都表明,我們所提出的基於委員會的多代理方法比以前的方法具有更好的效能及穩健性。最後我們還提出了一些具有挑戰性的問題作為未來的研究。
Consensus in Multi-Agent System (MAS) coordination is a challenge research topic. The consensus of MAS had been widely applied and developed in many fields such as intelligent robots, smart grid structures, autonomous control and military operations. In real word applications, agents need to make operation decision to fulfill their design functions in a complex and dynamic information environment. In this research, we proposed an idea of "committee-based structure" based on the imitating human socialization concept. Under the committee-based structure, members can exchange information and proposed solutions to reach a consensus under the constraints. We tested the proposed method to the cases of restoration of smart grid power system and the task allocation with obstacle-avoid path planning among UAVs.
In this research, the fault tolerance mechanism is embedded in our committee-base algorithm with Redun-skip scheme to enhance the robustness of the MAS. In which they can avoid the agents failure for some reasons during the executing processes. Even when a limited number of agents failure, the proposed fault tolerance mechanism can still make the system work persistently. This method is used for simulation evaluation of the power restoration system to reveal how the performance of the system degrades under different degrees of failure of the commission agent in the power restoration system. The simulation results show that the Redun-Skip mechanism improves the stability of the MAS committee-based power service restoration system without increasing any hardware costs.
In distribution system service restoration problems, switches in the power topology are modeled as intelligent agents and organized as local power committees in a distribution system. The advantage of this approach is to utilize the solving ability of a local committee of agents who could coordinate with neighboring committees to achieve an agreement that satisfies the global objective of the power distribution system service restoration problems without relying on a pre-determined centralized optimization algorithm as traditional approaches. The proposed coordination method helps switches in the distributed local power committees to reach a consensus among many proposed service restoration solutions after faults are detected and isolated. We also take the voltage deviation into consideration in the search of solutions. Two examples of different power distribution system are presented to demonstrate how the algorithms of the coordination method can identify the best restoration solution among many proposed local candidate solutions.
In the application of UAVs, the UAV technology has recently been developed rapidly in a wide variety of applications. However, coordinating a team of autonomous UAVs to complete missions in an unknown and changing environment has been a challenging and complicated task. We modify Consensus-Based Auction Algorithm (CBAA) so that it can dynamically reallocate tasks among UAVs that can flexibly find a path to reach multiple dynamic targets while avoiding unexpected obstacles and staying close as a group as possible simultaneously. We propose the core algorithms and simulate with many scenarios empirically to illustrate how the proposed framework works. Specifically, we show that how UAVs could reallocate the tasks among each other in finding dynamically changing paths while certain targets may appear and disappear during the flight mission.
The simulation results applied in the above two different fields both show that the proposed committee-based multi-agent approach yields better performance than the previous methods. We also discuss some challenging problems as future work.
[1] Mordor Intelligence. INTERNET OF THINGS (IOT) MARKET - GROWTH, TRENDS, COVID-19 IMPACT, AND FORECASTS (2021 - 2026). Mordor Intel- ligence Pvt Ltd, 2021.
[2] Gerhard Weiss. Multiagent systems: a modern approach to distributed artificial intelligence. MIT press, 1999.
[3] Michael J Wooldridge and Nicholas R Jennings. Intelligent agents: Theory and practice. The knowledge engineering review, 10(2):115–152, 1995.
[4] Hyacinth S Nwana et al. Software agents: An overview. Knowledge engineering review, 11(3):205–244, 1996.
[5] B. W. Schermer. Software agents, surveillance, and the right to privacy: a legislative framework for agent-enabled surveillance. Leiden University Press, 2007.
[6] Kim On Chin, Kim Soon Gan, Rayner Alfred, Patricia Anthony, and Dickson Lukose. Agent architecture: An overviews. Transactions on science and technology, 1(1):18–35, 2014.
[7] Adam Cheyer and David Martin. The open agent architecture. Autonomous Agents and Multi-Agent Systems, 4(1):143–148, 2001.
[8] Tapio Heikkila¨, Martin Kollingbaum, Paul Valckenaers, and Geert-Jan Bluemink. An agent architecture for manufacturing control: manage. Computers in Industry, 46(3):315–331, 2001.
[9] Chai K Toh, Julio A Sanguesa, Juan C Cano, and Francisco J Martinez. Advances in smart roads for future smart cities. Proceedings of the Royal Society A, 476(2233): 20190439, 2020.
[10] Anurag Sharma, Dipti Srinivasan, and Dhivya Sampath Kumar. A comparative anal- ysis of centralized and decentralized multi-agent architecture for service restoration. In 2016 IEEE congress on evolutionary computation (CEC), pages 311–318. IEEE, 2016.
[11] K Spiros and K Daniel. Reinforcement learning of coordination in cooperative mas. In The 18th National Conference on AI, Alberta, Canada: ACM Press, pages 326– 331, 2002.
[12] Wiebe Van der Hoek and Michael Wooldridge. Multi-agent systems. Foundations of Artificial Intelligence, 3:887–928, 2008.
[13] Martin Lauer and Martin Riedmiller. An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In In Proceedings of the Seventeenth International Conference on Machine Learning. Citeseer, 2000.
[14] Caroline Claus and Craig Boutilier. The dynamics of reinforcement learning in co- operative multiagent systems. AAAI/IAAI, 1998(746-752):2, 1998.
[15] Carlos Guestrin, Michail Lagoudakis, and Ronald Parr. Coordinated reinforcement learning. In ICML, volume 2, pages 227–234. Citeseer, 2002.
[16] Jelle R Kok and Nikos Vlassis. Sparse cooperative q-learning. In Proceedings of the twenty-first international conference on Machine learning, page 61, 2004.
[17] Spiros Kapetanakis, Daniel Kudenko, and Malcolm JA Strens. Reinforcement learn- ing approaches to coordination in cooperative multi-agent systems. In Adaptive agents and multi-agent systems, pages 18–32. Springer, 2002.
[18] Richard S Sutton and Andrew G Barto. Reinforcement learning: An introduction. MIT press, 2018.
[19] Minyi Huang, Peter E Caines, and Roland P Malhame´. Large-population cost- coupled lqg problems with nonuniform agents: individual-mass behavior and de- centralized "-nash equilibria. IEEE transactions on automatic control, 52(9):1560– 1571, 2007.
[20] Dario Bauso, Laura Giarre´, and Raffaele Pesenti. Consensus for networks with unknown but bounded disturbances. SIAM Journal on Control and Optimization, 48 (3):1756–1770, 2009.
[21] Alain Y Kibangou. Graph laplacian based matrix design for finite-time distributed average consensus. In 2012 American Control Conference (ACC), pages 1901–1906. IEEE, 2012.
[22] Young-Cheol Choi and Hyo-Sung Ahn. A survey on multi-agent reinforcement learning: Coordination problems. In Proceedings of 2010 IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, pages 81–86. IEEE, 2010.
[23] Yongcan Cao, Wenwu Yu, Wei Ren, and Guanrong Chen. An overview of recent progress in the study of distributed multi-agent coordination. IEEE Transactions on Industrial informatics, 9(1):427–438, 2012.
[24] A Rodriguez-Angeles and H Nijmeijer. Cooperative synchronization of robots via estimated state feedback. In 42nd IEEE International Conference on Decision and Control (IEEE Cat. No. 03CH37475), volume 2, pages 1514–1519. IEEE, 2003.
[25] Derek B Kingston, Wei Ren, and Randal W Beard. Consensus algorithms are input- to-state stable. In Proceedings of the 2005, American Control Conference, 2005., pages 1686–1690. IEEE, 2005.
[26] Be´la Bolloba´s. Modern graph theory, volume 184. Springer Science & Business Media, 2013.
[27] Kwang-Kyo Oh, Myoung-Chul Park, and Hyo-Sung Ahn. A survey of multi-agent formation control. Automatica, 53:424–440, 2015.
[28] Bin Lei and Wenfeng Li. Formation control for multi-robots based on flocking algo- rithm. In International Conference on Intelligent Robotics and Applications, pages 1238–1247. Springer, 2008.
[29] Michael Rabbat and Robert Nowak. Distributed optimization in sensor networks. In Proceedings of the 3rd international symposium on Information processing in sensor networks, pages 20–27, 2004.
[30] Fumin Zhang and Naomi Ehrich Leonard. Cooperative filters and control for coop- erative exploration. IEEE Transactions on Automatic Control, 55(3):650–663, 2010.
[31] Gonzalo Mateos, Ioannis D Schizas, and Georgios B Giannakis. Distributed recur- sive least-squares for consensus-based in-network adaptive estimation. IEEE Trans- actions on Signal Processing, 57(11):4583–4588, 2009.
[32] Reza Olfati-Saber and Richard M Murray. Consensus problems in networks of agents with switching topology and time-delays. IEEE Transactions on automatic control, 49(9):1520–1533, 2004.
[33] David Ben-Arieh and Todd Easton. Multi-criteria group consensus under linear cost opinion elasticity. Decision support systems, 43(3):713–721, 2007.
[34] Junyan Yu and Long Wang. Group consensus in multi-agent systems with switching topologies and communication delays. Systems & Control Letters, 59(6):340–348, 2010.
[35] Na Li and Jason R Marden. Designing games for distributed optimization. IEEE Journal of Selected Topics in Signal Processing, 7(2):230–242, 2013.
[36] Zhongjie Lin and Hugh HT Liu. Consensus based on learning game theory. In Proceedings of 2014 IEEE Chinese Guidance, Navigation and Control Conference, pages 1856–1861. IEEE, 2014.
[37] Jason R Marden and Jeff S Shamma. Game theory and distributed control. In Hand- book of game theory with economic applications, volume 4, pages 861–899. Else- vier, 2015.
[38] Bowen Zhang, Yucheng Dong, Hengjie Zhang, and Witold Pedrycz. Consensus mechanism with maximum-return modifications and minimum-cost feedback: A perspective of game theory. European Journal of Operational Research, 287(2): 546–559, 2020.
[39] Elham Semsar-Kazerooni and Khashayar Khorasani. Multi-agent team cooperation: A game theory approach. Automatica, 45(10):2205–2213, 2009.
[40] Yanjiang Li and Chong Tan. A survey of the consensus for multi-agent systems. Systems Science & Control Engineering, 7(1):468–482, 2019.
[41] Yuan-Qing Xia, Yu-Long Gao, Li-Ping Yan, and Meng-Yin Fu. Recent progress in networked control systems—a survey. International Journal of Automation and Computing, 12(4):343–367, 2015.
[42] Ali Dorri, Salil S Kanhere, and Raja Jurdak. Multi-agent systems: A survey. Ieee Access, 6:28573–28593, 2018.
[43] Qing Cui, Dongmei Xie, and Fangcui Jiang. Group consensus tracking control of second-order multi-agent systems with directed fixed topology. Neurocomputing, 218:286–295, 2016.
[44] Yuanshi Zheng, Weisheng Chen, and Long Wang. Finite-time consensus for stochas- tic multi-agent systems. International Journal of Control, 84(10):1644–1652, 2011.
[45] Yanfei Song and Weisheng Chen. Finite-time convergent distributed consensus op- timisation over networks. IET Control Theory & Applications, 10(11):1314–1318, 2016.
[46] Guanghui Wen, Guoqiang Hu, Wenwu Yu, Jinde Cao, and Guanrong Chen. Consen- sus tracking for higher-order multi-agent systems with switching directed topologies and occasionally missing control inputs. Systems & Control Letters, 62(12):1151– 1158, 2013.
[47] Wei Ren, Randal W Beard, and Ella M Atkins. A survey of consensus problems in multi-agent coordination. In Proceedings of the 2005, American Control Confer- ence, 2005., pages 1859–1864. IEEE, 2005.
[48] Pankaj Jalote. Fault tolerance in distributed systems. Prentice-Hall, Inc., 1994.
[49] Christoforos N Hadjicostis. Coding Approaches to Fault Tolerance in Combina- tional and Dynamic Systems, volume 660. Springer Science & Business Media, 2012.
[50] Om Prakash Damani. Optimistic protocols for fault tolerance in distributed systems. The University of Texas at Austin, 1999.
[51] Dong-Joon Shin, Jin-O Kim, Tae-Kyun Kim, Jin-Boo Choo, and C Singh. Opti- mal service restoration and reconfiguration of network using genetic-tabu algorithm. Electric Power Systems Research, 71(2):145–152, 2004.
[52] WP Luan, Malcolm R Irving, and Jeremy S Daniel. Genetic algorithm for supply restoration and optimal load shedding in power system distribution networks. IEE Proceedings-Generation, Transmission and Distribution, 149(2):145–151, 2002.
[53] Sakae Toune, Hiroyuki Fudo, Takamu Genji, Yoshikazu Fukuyama, and Yosuke Nakanishi. Comparative study of modern heuristic algorithms to service restora- tion in distribution systems. IEEE Transactions on Power Delivery, 17(1):173–181, 2002.
[54] Y-T Hsiao and C-Y Chien. Enhancement of restoration service in distribution sys- tems using a combination fuzzy-ga method. IEEE Transactions on Power Systems, 15(4):1394–1400, 2000.
[55] Men-Shen Tsai. Development of an object-oriented service restoration expert system with load variations. IEEE Transactions on Power Systems, 23(1):219–225, 2008.
[56] Takeshi Nagata and Hiroshi Sasaki. A multi-agent approach to power system restora- tion. IEEE transactions on power systems, 17(2):457–462, 2002.
[57] Takeshi Nagata, Yoshihiro Tao, and Hideki Fujita. An autonomous agent for power system restoration. In IEEE Power Engineering Society General Meeting, 2004., pages 1069–1074. IEEE, 2004.
[58] Jignesh M Solanki, Sarika Khushalani, and Noel N Schulz. A multi-agent solution to distribution systems restoration. IEEE Transactions on Power systems, 22(3): 1026–1034, 2007.
[59] Yen-Tsung Pan and Men-Shen Tsai. Development a bdi-based intelligent agent ar- chitecture for distribution systems restoration planning. In 2009 15th International Conference on Intelligent System Applications to Power Systems, pages 1–6. IEEE, 2009.
[60] E Shirazi and S Jadid. A multiagent design for self-healing in electric power distri- bution systems. Electric Power Systems Research, 171:230–239, 2019.
[61] Sridhar Chouhan. A Multi-Agent Design for Smart Distribution Automation System with Distributed Energy Resources and Microgrids. West Virginia University, 2017.
[62] Johannes van der Horst and Jason Noble. Distributed and centralized task allocation: When and where to use them. In 2010 Fourth IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshop, pages 1–8. IEEE, 2010.
[63] Gregory Dudek, Michael RM Jenkin, Evangelos Milios, and David Wilkes. A tax- onomy for multi-agent robotics. Autonomous Robots, 3(4):375–397, 1996.
[64] Thomas L. Casavant and Jon G. Kuhl. A taxonomy of scheduling in general-purpose distributed computing systems. IEEE Transactions on software engineering, 14(2): 141–154, 1988.
[65] Brian P Gerkey and Maja J Mataric´. A formal analysis and taxonomy of task allo- cation in multi-robot systems. The International journal of robotics research, 23(9): 939–954, 2004.
[66] Brian P Gerkey and Maja J Mataric. A framework for studying multi-robot task allocation. 2003.
[67] G Ayorkor Korsah, Anthony Stentz, and M Bernardine Dias. A comprehensive tax- onomy for multi-robot task allocation. The International Journal of Robotics Re- search, 32(12):1495–1512, 2013.
[68] Thomas Lemaire, Rachid Alami, and Simon Lacroix. A distributed tasks allocation scheme in multi-uav context. In IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA’04. 2004, volume 4, pages 3622–3627. IEEE, 2004.
[69] Han-Lim Choi, Luc Brunet, and Jonathan P How. Consensus-based decentralized auctions for robust task allocation. IEEE transactions on robotics, 25(4):912–926, 2009.
[70] Luc Brunet, Han-Lim Choi, and Jonathan How. Consensus-based auction ap- proaches for decentralized task assignment. In AIAA guidance, navigation and con- trol conference and exhibit, page 6839, 2008.
[71] Matthew Argyle, David W Casbeer, and Randy Beard. A multi-team extension of the consensus-based bundle algorithm. In Proceedings of the 2011 American Control Conference, pages 5376–5381. IEEE, 2011.
[72] Darren Smith, Jodie Wetherall, Stephen Woodhead, and Andrew Adekunle. A cluster-based approach to consensus based distributed task allocation. In 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, pages 428–431. IEEE, 2014.
[73] WANG Shuo, SHI DongMei, DONG Yu, and Kai HUANG. Research on distributed task allocation of loitering munition swarm. In 2020 International Conference on In- formation Science, Parallel and Distributed Systems (ISPDS), pages 162–166. IEEE, 2020.
[74] Dieter Fox, Wolfram Burgard, and Sebastian Thrun. The dynamic window approach to collision avoidance. IEEE Robotics & Automation Magazine, 4(1):23–33, 1997.
[75] Tucker Balch and Ronald C Arkin. Behavior-based formation control for multirobot teams. IEEE transactions on robotics and automation, 14(6):926–939, 1998.
[76] Jonathan RT Lawton, Randal W Beard, and Brett J Young. A decentralized approach to formation maneuvers. IEEE transactions on robotics and automation, 19(6):933– 941, 2003.
[77] Petros S Bithas, Emmanouel T Michailidis, Nikolaos Nomikos, Demosthenes Vouyioukas, and Athanasios G Kanatas. A survey on machine-learning techniques for uav-based communications. Sensors, 19(23):5170, 2019.
[78] Herbert G Tanner, George J Pappas, and Vijay Kumar. Leader-to-formation stability. IEEE Transactions on robotics and automation, 20(3):443–455, 2004.
[79] Jakob Fredslund and Maja J Mataric. A general algorithm for robot formations using local sensing and minimal communication. IEEE transactions on robotics and automation, 18(5):837–846, 2002.
[80] Delin Luo, Wenlong Xu, Shunxiang Wu, and Youping Ma. Uav formation flight control and formation switch strategy. In 2013 8th International Conference on Computer Science & Education, pages 264–269. IEEE, 2013.
[81] Randal W Beard, Jonathan Lawton, and Fred Y Hadaegh. A coordination architec- ture for spacecraft formation control. IEEE Transactions on control systems tech- nology, 9(6):777–790, 2001.
[82] Hamed Rezaee and Farzaneh Abdollahi. A decentralized cooperative control scheme with obstacle avoidance for a team of mobile robots. IEEE Transactions on Indus- trial Electronics, 61(1):347–354, 2013.
[83] Wei Ren. Consensus strategies for cooperative control of vehicle formations. IET Control Theory & Applications, 1(2):505–512, 2007.
[84] Ahmad Baranzadeh and Vali Nazarzehi. A decentralized formation building algo- rithm with obstacle avoidance for multi-robot systems. In 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), pages 2513–2518. IEEE, 2015.
[85] Xiwang Dong, Yongzhao Hua, Yan Zhou, Zhang Ren, and Yisheng Zhong. Theory and experiment on formation-containment control of multiple multirotor unmanned aerial vehicle systems. IEEE Transactions on Automation Science and Engineering, 16(1):229–240, 2018.
[86] Javier Alonso-Mora, Eduardo Montijano, Mac Schwager, and Daniela Rus. Dis- tributed multi-robot formation control among obstacles: A geometric and optimiza- tion approach with consensus. pages 5356–5363, 2016.
[87] Hai Zhu, Jelle Juhl, Laura Ferranti, and Javier Alonso-Mora. Distributed multi-robot formation splitting and merging in dynamic environments. In 2019 International Conference on Robotics and Automation (ICRA), pages 9080–9086. IEEE, 2019.
[88] Haibo Min, Fuchun Sun, and Feng Niu. Decentralized uav formation tracking flight control using gyroscopic force. In 2009 IEEE International Conference on Com- putational Intelligence for Measurement Systems and Applications, pages 91–96. IEEE, 2009.
[89] Paulo Leitao, Paul Valckenaers, and Emmanuel Adam. Self-adaptation for robust- ness and cooperation in holonic multi-agent systems. In Transactions on Large-Scale Data-and Knowledge-Centered Systems I, pages 267–288. Springer, 2009.
[90] H Sebastian Seung, Manfred Opper, and Haim Sompolinsky. Query by commit- tee. In Proceedings of the fifth annual workshop on Computational learning theory, pages 287–294, 1992.
[91] Yoav Freund, H Sebastian Seung, Eli Shamir, and Naftali Tishby. Selective sampling using the query by committee algorithm. Machine learning, 28(2):133–168, 1997.
[92] Robert Burbidge, Jem J Rowland, and Ross D King. Active learning for regres- sion based on query by committee. In International conference on intelligent data engineering and automated learning, pages 209–218. Springer, 2007.
[93] Jakub Konecˇny`, H Brendan McMahan, Felix X Yu, Peter Richta´rik, Ananda Theertha Suresh, and Dave Bacon. Federated learning: Strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492, 2016.
[94] Jakub Konecˇny`, H Brendan McMahan, Daniel Ramage, and Peter Richta´rik. Fed- erated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527, 2016.
[95] H Brendan McMahan, Eider Moore, Daniel Ramage, and Blaise Agu¨era y Ar- cas. Federated learning of deep networks using model averaging. arXiv preprint arXiv:1602.05629, 2016.
[96] Qiang Yang, Yang Liu, Tianjian Chen, and Yongxin Tong. Federated machine learn- ing: Concept and applications. ACM Transactions on Intelligent Systems and Tech- nology (TIST), 10(2):1–19, 2019.
[97] MP Huget and S Poslad. The foundation for intelligent physical agents. http://www.fipa.org, 2012.
[98] Wei Ren, Randal W Beard, and Ella M Atkins. Information consensus in multivehi- cle cooperative control. IEEE Control systems magazine, 27(2):71–82, 2007.
[99] Rawad Abdulghafor, Shahrum Shah Abdullah, Sherzod Turaev, and Mohamed Oth- man. An overview of the consensus problem in the control of multi-agent sys- tems. Automatika: cˇasopis za automatiku, mjerenje, elektroniku, racˇunarstvo i ko- munikacije, 59(2):143–157, 2018.
[100] Jingying Ma, Yuanshi Zheng, and Long Wang. Nash equilibrium topology of multi- agent systems with competitive groups. IEEE Transactions on Industrial Electron- ics, 64(6):4956–4966, 2017.
[101] Ragavendran Gopalakrishnan, Sean D Nixon, and Jason R Marden. Stable utility design for distributed resource allocation. In 53rd IEEE Conference on Decision and Control, pages 1161–1166. IEEE, 2014.
[102] Vincent Gramoli. From blockchain consensus back to byzantine consensus. Future Generation Computer Systems, 107:760–769, 2020.
[103] Leslie Lamport, Robert Shostak, and Marshall Pease. The byzantine generals prob- lem. In Concurrency: the Works of Leslie Lamport, pages 203–226. 2019.
[104] Niels A Taatgen, David Huss, Daniel Dickison, and John R Anderson. The acqui- sition of robust and flexible cognitive skills. Journal of Experimental Psychology: General, 137(3):548, 2008.
[105] Youssef Hamadi. Interleaved backtracking in distributed constraint networks. Inter- national Journal on Artificial Intelligence Tools, 11(02):167–188, 2002.
[106] Youssef Hamadi, Christian Bessiere, and Joe¨l Quinqueton. Backtracking in dis- tributed constraint networks. In Proceedings ECAI’98, pages 219–223. Citeseer, 1998.
[107] Takeshi Nagata and S Fukunaga. An autonomous distributed agent approach to power system restoration. In 2011 16th International Conference on Intelligent Sys- tem Applications to Power Systems, pages 1–5. IEEE, 2011.
[108] Peng Li, Bin Song, Wei Wang, and Tiemin Wang. Multi-agent approach for service restoration of microgrid. In 2010 5th IEEE Conference on Industrial Electronics and Applications, pages 962–966. IEEE, 2010.
[109] Haomin Ma, Dan Lin, and Mei Tao. An intelligent voltage control system—training, learning and controlling. In 2011 16th International Conference on Intelligent Sys- tem Applications to Power Systems, pages 1–6. IEEE, 2011.
[110] Feng Qiu and Peijie Li. An integrated approach for power system restoration plan- ning. Proceedings of the IEEE, 105(7):1234–1252, 2017.
[111] V Kumar, RHC Kumar, I Gupta, and HO Gupta. Dg integrated approach for service restoration under cold load pickup. IEEE Transactions on Power Delivery, 2010.
[112] Ehud Kalai and Dov Samet. On weighted shapley values. International journal of game theory, 16(3):205–222, 1987.
[113] Magnus Roos and Jo¨rg Rothe. Complexity of social welfare optimization in mul- tiagent resource allocation. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1-Volume 1, pages 641–648, 2010.
[114] Gerhard Weiss. Multiagent systems: a modern approach to distributed artificial intelligence. MIT press, 1999.
[115] Fabio Luigi Bellifemine, Giovanni Caire, and Dominic Greenwood. Developing multi-agent systems with JADE, volume 7. John Wiley & Sons, 2007.
[116] Haytham MA Ahmed, Ahmed SA Awad, Mohamed Hassan Ahmed, and MMA Salama. Mitigating voltage-sag and voltage-deviation problems in distribution net- works using battery energy storage systems. Electric Power Systems Research, 184: 106294, 2020.
[117] Wu-Chang Wu and Men-Shen Tsai. Application of enhanced integer coded particle swarm optimization for distribution system feeder reconfiguration. IEEE transac- tions on power systems, 26(3):1591–1599, 2011.
[118] Von-Wun Soo and Yen-Bo Peng. A stochastic negotiation approach to power restora- tion problems in a smart grid. In International Conference on Principles and Prac- tice of Multi-Agent Systems, pages 436–447. Springer, 2011.
[119] Takeshi Nagata, Yoshiki Tahara, and Hideki Fujita. An agent approach to bulk power system restoration. In IEEE Power Engineering Society General Meeting, 2005, pages 599–604. IEEE, 2005.
[120] Amila Thibbotuwawa, Peter Nielsen, Grzegorz Bocewicz, and Zbigniew Banaszak. Uavs fleet mission planning subject to weather fore-cast and energy consumption constraints. In Conference on Automation, pages 104–114. Springer, 2019.
[121] Reza Shakeri, Mohammed Ali Al-Garadi, Ahmed Badawy, Amr Mohamed, Tamer Khattab, Abdulla Khalid Al-Ali, Khaled A Harras, and Mohsen Guizani. Design challenges of multi-uav systems in cyber-physical applications: A comprehensive survey and future directions. IEEE Communications Surveys & Tutorials, 21(4): 3340–3385, 2019.
[122] Alaa Khamis, Ahmed Hussein, and Ahmed Elmogy. Multi-robot task allocation: A review of the state-of-the-art. Cooperative Robots and Sensor Networks 2015, pages 31–51, 2015.
[123] Henry L Jones, Stephen M Rock, Dennis Burns, and Steve Morris. Autonomous robots in swat applications: Research, design, and operations challenges. AU- VSI’02, 2002.
[124] Ju¨rgen Scherer, Saeed Yahyanejad, Samira Hayat, Evsen Yanmaz, Torsten Andre, Asif Khan, Vladimir Vukadinovic, Christian Bettstetter, Hermann Hellwagner, and Bernhard Rinner. An autonomous multi-uav system for search and rescue. In Pro- ceedings of the First Workshop on Micro Aerial Vehicle Networks, Systems, and Applications for Civilian Use, pages 33–38, 2015.
[125] Office of the secretary of the defense. Unmanned aircraft systems roadmap 2005-2030. https://fas.org/irp/program/collect/uav_ roadmap2005.pdf, October 2006.