We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
A corpus-based finite-state morphological toolkit for contemporary arabic.
- Authors
Attia, Mohammed; Pecina, Pavel; Toral, Antonio; van Genabith, Josef
- Abstract
We develop an open-source large-scale finite-state morphological processing toolkit (AraComLex) for Modern Standard Arabic (MSA) distributed under the GPLv3 license (http://aracomlex.sourceforge.net). The morphological transducer is based on a lexical database specifically constructed for this purpose. In contrast to previous resources, the database is tuned to MSA, eliminating lexical entries no longer attested in contemporary use. The database is built using a corpus of 1,089,111,204 word tokens, a pre-annotation tool, machine learning techniques and knowledge-based pattern matching to automatically acquire lexical knowledge. Our morphological transducer is evaluated and compared to LDC's SAMA(Standard Arabic Morphological Analyser). We also develop a finite-state morphological guesser as part of a methodology for extracting unknown word forms, lemmatizing them, and giving them a priority weight for inclusion in the lexicon.
- Subjects
LEXICON; LEXICAL grammar; MACHINE learning; COMPARATIVE studies; INCLUSIVE education; TRANSDUCERS
- Publication
Journal of Logic & Computation, 2014, Vol 24, Issue 2, p455
- ISSN
0955-792X
- Publication type
Article
- DOI
10.1093/logcom/exs070