Developing Enterprise Chatbots: Learning Linguistic Structures

Front Cover
Springer, Apr 4, 2019 - Computers - 559 pages

A chatbot is expected to be capable of supporting a cohesive and coherent conversation and be knowledgeable, which makes it one of the most complex intelligent systems being designed nowadays. Designers have to learn to combine intuitive, explainable language understanding and reasoning approaches with high-performance statistical and deep learning technologies.

Today, there are two popular paradigms for chatbot construction:

1. Build a bot platform with universal NLP and ML capabilities so that a bot developer for a particular enterprise, not being an expert, can populate it with training data;

2. Accumulate a huge set of training dialogue data, feed it to a deep learning network and expect the trained chatbot to automatically learn “how to chat”.

Although these two approaches are reported to imitate some intelligent dialogues, both of them are unsuitable for enterprise chatbots, being unreliable and too brittle.

The latter approach is based on a belief that some learning miracle will happen and a chatbot will start functioning without a thorough feature and domain engineering by an expert and interpretable dialogue management algorithms.

Enterprise high-performance chatbots with extensive domain knowledge require a mix of statistical, inductive, deep machine learning and learning from the web, syntactic, semantic and discourse NLP, ontology-based reasoning and a state machine to control a dialogue. This book will provide a comprehensive source of algorithms and architectures for building chatbots for various domains based on the recent trends in computational linguistics and machine learning. The foci of this book are applications of discourse analysis in text relevant assessment, dialogue management and content generation, which help to overcome the limitations of platform-based and data driven-based approaches.

Supplementary material and code is available at https://github.com/bgalitsky/relevance-based-on-parse-trees

 

What people are saying - Write a review

User Review - Flag as inappropriate

A cool book for chatbot developers

Contents

Introduction
1
Chatbot Components and Architectures
13
Explainable Machine Learning for Chatbots
53
Developing Conversational Natural Language Interface to a Database
85
Assuring Chatbot Relevance at Syntactic Level
121
Semantic Skeleton Thesauri for Question Answering Bots
163
Learning DiscourseLevel Structures for Question Answering
177
Building Chatbot Thesaurus
221
A Content Management System for Chatbots
253
Rhetorical Agreement Maintaining Cohesive Conversations
327
DiscourseLevel Dialogue Management
365
A Social Promotion Chatbot
427
Enabling a Bot with Understanding Argumentation and Providing Arguments
465
Rhetorical Map of an Answer
533
Conclusions
556
Copyright

Other editions - View all

Common terms and phrases

About the author (2019)

Dr. Boris Galitsky has contributed linguistic and machine learning technologies to Silicon Valley startups for the last 25 years, as well as eBay and Oracle, where he is currently an architect of a digital assistant project. An author of two computer science books, 150+ publications and 15+ patents, he is now researching how discourse analysis improves search relevance and supports dialogue management. In his previous book, Dr. Galitsky presented a foundation of autistic reasoning which shed a light on how chatbots should facilitate conversations. Boris is an Apache committer to OpenNLP where he created the OpenNLP.Similarity component that is a basis for chatbot development.

Bibliographic information