Evaluation of Text and Speech SystemsLaila Dybkjær, Holmer Hemsen, Wolfgang Minker In its nine chapters, this book provides an overview of the state-of-the-art and best practice in several sub-fields of evaluation of text and speech systems and components. The evaluation aspects covered include speech and speaker recognition, speech synthesis, animated talking agents, part-of-speech tagging, parsing, and natural language software like machine translation, information retrieval, question answering, spoken dialogue systems, data resources, and annotation schemes. With its broad coverage and original contributions this book is unique in the field of evaluation of speech and language technology. This book is of particular relevance to advanced undergraduate students, PhD students, academic and industrial researchers, and practitioners. |
Contents
2 | 28 |
3 | 65 |
References | 92 |
4 | 99 |
5 | 125 |
6 | 163 |
Spoken Dialogue Systems Evaluation Niels Ole Bernsen Laila Dybkjær and Wolfgang Minker 1 Introduction 2 3 4 Evaluation Methods and Criteria | 187 |
Evaluation of the NICE Hans Christian Andersen Prototype | 193 |
Finding Resources | 240 |
Building Resources | 242 |
Conclusion | 259 |
References | 260 |
Towards International Standards for Language Resources Nancy Ide and Laurent Romary 1 Introduction | 263 |
Background | 265 |
The Linguistic Annotation Framework | 268 |
Putting it All Together | 278 |
Evaluation of the SENECA Prototype 5 Conclusion | 207 |
References | 218 |
Linguistic Resources Development and Evaluation of Text and Speech Systems Christopher Cieri | 220 |
Introduction 2 The Linguistic Resource Landscape | 222 |
Background on Linguistic Data and Annotation | 234 |
Data Planning for Technology Development and Evaluation | 237 |
Conclusion | 282 |
References | 283 |
| 285 | |
| 286 | |
Other editions - View all
Evaluation of Text and Speech Systems Laila Dybkjær,Holmer Hemsen,Wolfgang Minker Limited preview - 2007 |
Evaluation of Text and Speech Systems Laila Dybkjær,Holmer Hemsen,Wolfgang Minker No preview available - 2009 |
Evaluation of Text and Speech Systems Laila Dybkjær,Holmer Hemsen,Wolfgang Minker No preview available - 2008 |
Common terms and phrases
accepted accuracy acoustic annotation answer applications Assessment audio chapter collection Communication compared components Conference context conversation corpus correct create criteria defined definition dialogue document error European evaluation example experiment expression Figure format function gesture given head human important input Intelligibility interaction International involved Italy judged language language resources linguistic machine means measures methods metrics movement natural needs objective output parameters parsing participants particular performance possible precision present problem Proceedings Processing produce query question recall recorded reference relations relevant Report represented retrieval score segmentation sentence signal speaker specific speech recognition speech synthesis spoken standard structure subjects Synthetic tagging talking task tion translation TREC types University usability utterance visual volume Workshop
Popular passages
Page ii - Canada Dan Tufis, Romanian Academy of Sciences, Romania Joaquim Llisterri, Universitat Autonoma de Barcelona, Spain Stig Johansson, University of Oslo, Norway Joseph Mariani, LIMSI-CNRS, France The titles published in this series are listed at the end of this volume.
Page xiii - Wolfgang Minker is a Professor at the University of Ulm, Department of Information Technology, Germany. He received his PhD in Engineering Science from the University of Karlsruhe, Germany, in 1997 and his PhD in Computer Science from the University of Paris-Sud, France, in 1998. He was a Researcher at the Laboratoire d'Informatique pour la Mecanique et les Sciences de 1'Ingenieur (LIMSI-CNRS), France, from 1993 to 1999 and a member of the scientific staff at DaimlerChrysler, Research and Technology,...