Reinforcement Learning: An Introduction

Front Cover
MIT Press, 1998 - Computers - 322 pages
14 Reviews

Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives when interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning. Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications. The only necessary mathematical background is familiarity with elementary concepts of probability.

The book is divided into three parts. Part I defines the reinforcement learning problem in terms of Markov decision processes. Part II provides basic solution methods: dynamic programming, Monte Carlo methods, and temporal-difference learning. Part III presents a unified view of the solution methods and incorporates artificial neural networks, eligibility traces, and planning; the two final chapters present case studies and consider the future of reinforcement learning.


What people are saying - Write a review

User ratings

5 stars
4 stars
3 stars
2 stars
1 star

Review: Reinforcement Learning: An Introduction

User Review  - Rami alaa - Goodreads

And I read it again actually I'm reading the HTML version Read full review

Review: Reinforcement Learning: An Introduction

User Review  - Fabio Zambetta - Goodreads

That's where you want to start reading about RL. Read full review


Evaluative Feedback
Elementary Solution Methods
A Unified View
Generalization and Function Approximation
Planning and Learning
Dimensions of Reinforcement Learning
Case Studies
Summary of Notation

Common terms and phrases

Popular passages

Page 301 - Proceedings of the Second International Conference on Simulation of Adaptive Behavior: From Animals to Animals, 2, 460-468.

References to this book

All Book Search results »

About the author (1998)

JENNIE SI is Professor of Electrical Engineering, Arizona State University, Tempe, AZ. She is director of Intelligent Systems Laboratory, which focuses on analysis and design of learning and adaptive systems. In addition to her own publications, she is the Associate Editor for IEEE Transactions on Neural Networks, and past Associate Editor for IEEE Transactions on Automatic Control and IEEE Transactions on Semiconductor Manufacturing. She was the co-chair for the 2002 NSF Workshop on Learning and Approximate Dynamic Programming.

ANDREW G. BARTO is Professor of Computer Science, University of Massachusetts, Amherst. He is co-director of the Autonomous Learning Laboratory, which carries out interdisciplinary research on machine learning and modeling of biological learning. He is a core faculty member of the Neuroscience and Behavior Program of the University of Massachusetts and was the co-chair for the 2002 NSF Workshop on Learning and Approximate Dynamic Programming. He currently serves as an associate editor of Neural Computation.

WARREN B. POWELL is Professor of Operations Research and Financial Engineering at Princeton University. He is director of CASTLE Laboratory, which focuses on real-time optimization of complex dynamic systems arising in transportation and logistics.

DONALD C. WUNSCH is the Mary K. Finley Missouri Distinguished Professor in the Electrical and Computer Engineering Department at the University of Missouri, Rolla. He heads the Applied Computational Intelligence Laboratory and also has a joint appointment in Computer Science, and is President-Elect of the International Neural Networks Society.

Bibliographic information