We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Levenshtein Distances Fail to Identify Language Relationships Accurately.
- Authors
Greenhill, Simon J.
- Abstract
The Levenshtein distance is a simple distance metric derived from the number of edit operations needed to transform one string into another. This metric has received recent attention as a means of automatically classifying languages into genealogical subgroups. In this article I test the performance of the Levenshtein distance for classifying languages by subsampling three language subsets from a large database of Austronesian languages. Comparing the classification proposed by the Levenshtein distance to that of the comparative method shows that the Levenshtein classification is correct only 40% of the time. Standardizing the orthography increases the performance, but only to a maximum of 65% accuracy within language subgroups. The accuracy of the Levenshtein classification decreases rapidly with phylogenetic distance, failing to discriminate homology and chance similarity across distantly related languages. This poor performance suggests the need for more linguistically nuanced methods for automated language classification tasks.
- Subjects
ORTHOGRAPHY &; spelling; LANGUAGE &; languages; SEQUENCE alignment; PHONETIC alphabet; PHONOLOGICAL decoding
- Publication
Computational Linguistics, 2011, Vol 37, Issue 4, p689
- ISSN
0891-2017
- Publication type
Article
- DOI
10.1162/COLI_a_00073