We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Code‐mixed Hindi‐English text correction using fuzzy graph and word embedding.
- Authors
Jain, Minni; Jindal, Rajni; Jain, Amita
- Abstract
Interaction via social media involves frequent code‐mixed text, spelling errors and noisy elements, which creates a bottleneck in the performance of natural language processing applications. This proposed work is the first approach for code‐mixed Hindi‐English social media text that comprises language identification, detection and correction of non‐word (Out of Vocabulary) errors as well as real‐word errors occurring simultaneously. Each identified language (Devanagari Hindi, Roman Hindi, and English) has its own complexities and challenges. Errors are detected individually for each language and a suggestive list of the erroneous words is created. After this, a fuzzy graph between different words of the suggestive lists is generated using various semantic relations in Hindi WordNet. Word embeddings and Fuzzy graph‐based centrality measures are used to find the correct word. Several experiments are performed on different social media datasets taken from Instagram, Twitter, YouTube comments, Blogs, and WhatsApp. The experimental results demonstrate that the proposed system corrects out‐of‐vocabulary words as well as real‐word errors with a maximum recall of 0.90 and 0.67, respectively for Dev_Hindi and 0.87 and 0.66, respectively for Rom_Hindi. The proposed method is also applied for state‐of‐art sentiment analysis approaches where the F1‐score has been visibly improved.
- Subjects
WHATSAPP Inc.; NATURAL language processing; SOCIAL media; FUZZY graphs; SENTIMENT analysis; SPELLING errors
- Publication
Expert Systems, 2024, Vol 41, Issue 7, p1
- ISSN
0266-4720
- Publication type
Article
- DOI
10.1111/exsy.13328