Multi-Agent Coordination: A Reinforcement Learning Approach

Arup Kumar Sadhu, Amit Konar

John Wiley & Sons, Dec 3, 2020 - Computers - 320 pages

Discover the latest developments in multi-robot coordination techniques with this insightful and original resource

Multi-Agent Coordination: A Reinforcement Learning Approach delivers a comprehensive, insightful, and unique treatment of the development of multi-robot coordination algorithms with minimal computational burden and reduced storage requirements when compared to traditional algorithms. The accomplished academics, engineers, and authors provide readers with both a high-level introduction to, and overview of, multi-robot coordination, and in-depth analyses of learning-based planning algorithms.

You'll learn about how to accelerate the exploration of the team-goal and alternative approaches to speeding up the convergence of TMAQL by identifying the preferred joint action for the team. The authors also propose novel approaches to consensus Q-learning that address the equilibrium selection problem and a new way of evaluating the threshold value for uniting empires without imposing any significant computation overhead. Finally, the book concludes with an examination of the likely direction of future research in this rapidly developing field.

Readers will discover cutting-edge techniques for multi-agent coordination, including:

• An introduction to multi-agent coordination by reinforcement learning and evolutionary algorithms, including topics like the Nash equilibrium and correlated equilibrium
• Improving convergence speed of multi-agent Q-learning for cooperative task planning
• Consensus Q-learning for multi-agent cooperative planning
• The efficient computing of correlated equilibrium for cooperative q-learning based multi-agent planning
• A modified imperialist competitive algorithm for multi-agent stick-carrying applications

Perfect for academics, engineers, and professionals who regularly work with multi-agent learning algorithms, Multi-Agent Coordination: A Reinforcement Learning Approach also belongs on the bookshelves of anyone with an advanced interest in machine learning and artificial intelligence as it applies to the field of cooperative or competitive robotics.

Contents

• 1: 104
• Task Planning: 111
• 3: 132
• 4: 140
• A More Details on Experimental Results: 144
• A 2 Additional Details of Experiment 2 2: 159
• Consensus QLearning for Multiagent Cooperative Planning: 167
• An Efficient Computing of Correlated Equilibrium for Cooperative: 183
• A Supporting Algorithm and Mathematical Analysis: 227
• 6: 281

About the author

Arup Kumar Sadhu, PhD, received his doctorate in Multi-Robot Coordination by Reinforcement Learning from Jadavpur University in India in 2017. He works as a scientist with Research & Innovation Labs, Tata Consultancy Services.

Amit Konar, PhD, received his doctorate from Jadavpur University, India in 1994. He is Professor with the Department of Electronics and Tele-Communication Engineering at Jadavpur University where he serves as the Founding Coordinator of the M. Tech. program on intelligent automation and robotics.

Bibliographic information

• Title: Multi-Agent Coordination: A Reinforcement Learning Approach; IEEE Press
• Authors: Arup Kumar Sadhu, Amit Konar
• Edition: illustrated
• Publisher: John Wiley & Sons, 2020
• ISBN: 1119699037, 9781119699033
• Length: 320 pages
• Subjects: Computers / Artificial Intelligence / General; Technology & Engineering / Electrical; Technology & Engineering / Electronics / General