Cross-language Information Retrieval
Search for information is no longer exclusively limited within the native language of the user, but is more and more extended to other languages. This gives rise to the problem of cross-language information retrieval (CLIR), whose goal is to find relevant information written in a different language to a query. In addition to the problems of monoligual information retrieval (IR), translation is the key problem in CLIR: one should translate either the query or the documents from a language to another. However, this translation problem is not identical to full-text machine translation (MT): the goal is not to produce a human-readable translation, but a translation suitable for finding relevant documents. Specific translation methods are thus required
The goal of this book is to provide a comprehensive description of the specific problems arisen in CLIR, the solutions proposed in this area, as well as the remaining problems. The book starts with a general description of the monolingual IR and CLIR problems. Different classes of approaches to translation are then presented: approaches using an MT system, dictionary-based translation and approaches based on parallel and comparable corpora. In addition, the typical retrieval effectiveness using different approaches is also compared. It will be shown that translation approaches specifically designed for CLIR can rival and outperform high-quality MT systems. Finally, the book offers a look into the future that draws a strong parallel between query expansion in monolingual IR and query translation in CLIR, suggesting that many approaches developed in monolingual IR can be adapted to CLIR
The book can be used as an introduction to CLIR. Advanced readers can also find more technical details and discussions about the remaining research challenges in the future. It is suitable to new researchers who intend to carry out research on CLIR.
What people are saying - Write a review
We haven't found any reviews in the usual places.
chapter 2 Using Manually Constructed Translation Systems and Resources for CLIR
chapter 3 Translation Based on Parallel and Comparable Corpora
chapter 4 Other Methods to Improve CLIR
ambiguous anchor texts argmax Barack Obama bigram bilingual dictionary Chinese CLIR effectiveness CLIR experiments co-occurrence combined comparable corpora comparable texts containing context correct translation corresponding cross-language information retrieval described determine different languages document translation drogue el norte Newspaper English example expansion terms exploit extracted French Google heuristic IBM model identify interlingua Kraaij language model methods monolingual MT systems multilingual n-grams original query parallel corpora parallel corpus parallel texts phrase phrase-based pivot language post-translation expansion proper names pseudo-relevance feedback query expansion query terms query translation related terms relevant documents retrieval effectiveness retrieved documents rule-based MT segmentation selection semantic similar source language statistical translation model strongly related Systran target language test collections thesaurus tion trans translated query translation approach translation candidates translation disambiguation translation in CLIR translation probability translation relations translation terms translation words transliteration TREC vector space model