Machine Learning in Non-stationary Environments: Introduction to Covariate Shift Adaptation

Front Cover
MIT Press, 2012 - Computers - 261 pages

Theory, algorithms, and applications of machine learning techniques to overcome "covariate shift" non-stationarity.

As the power of computing has grown over the past few decades, the field of machine learning has advanced rapidly in both theory and practice. Machine learning methods are usually based on the assumption that the data generation mechanism does not change over time. Yet real-world applications of machine learning, including image recognition, natural language processing, speech recognition, robot control, and bioinformatics, often violate this common assumption. Dealing with non-stationarity is one of modern machine learning's greatest challenges. This book focuses on a specific non-stationary environment known as covariate shift, in which the distributions of inputs (queries) change but the conditional distribution of outputs (answers) is unchanged, and presents machine learning theory, algorithms, and applications to overcome this variety of non-stationarity.

After reviewing the state-of-the-art research in the field, the authors discuss topics that include learning under covariate shift, model selection, importance estimation, and active learning. They describe such real world applications of covariate shift adaption as brain-computer interface, speaker identification, and age prediction from facial images. With this book, they aim to encourage future research in machine learning, statistics, and engineering that strives to create truly autonomous learning machines able to learn under non-stationarity.

 

Contents

II LEARNING UNDER COVARIATE SHIFT
19
III LEARNING CAUSING COVARIATE SHIFT
181
IV CONCLUSIONS
239
List of Symbols and Abbreviations
243
Bibliography
247
Index
259
Copyright

Other editions - View all

Common terms and phrases

About the author (2012)

Masashi Sugiyama is Associate Professor in the Department of Computer Science at Tokyo Institute of Technology. Motoaki Kawanabe is a Postdoctoral Researcher in Intelligent Data Analysis at the Fraunhofer FIRST Institute, Berlin.

Bibliographic information