We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Effect of OCR error correction on Arabic retrieval.
- Authors
Magdy, Walid; Darwish, Kareem
- Abstract
Arabic documents that are available only in print continue to be ubiquitous and they can be scanned and subsequently OCR'ed to ease their retrieval. This paper explores the effect of context-based OCR correction on the effectiveness of retrieving Arabic OCR documents using different index terms. Different OCR correction techniques based on language modeling with different correction abilities were tested on real OCR and synthetic OCR degradation. Results show that the reduction of word error rates needs to pass a certain limit to get a noticeable effect on retrieval. If only moderate error reduction is available, then using short character n-gram for retrieval without error correction is not a bad strategy. Word-based correction in conjunction with language modeling had a statistically significant impact on retrieval even for character 3-grams, which are known to be among the best index terms for OCR degraded Arabic text. Further, using a sufficiently large language model for correction can minimize the need for morphologically sensitive error correction.
- Subjects
INFORMATION retrieval; INFORMATION storage &; retrieval systems; LANGUAGE &; languages; ERROR; PASS (Information retrieval system); DOCUMENTATION; INDEXES; ERROR rates; INFORMATION science
- Publication
Information Retrieval Journal, 2008, Vol 11, Issue 5, p405
- ISSN
1386-4564
- Publication type
Article
- DOI
10.1007/s10791-008-9055-y