We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Annotating reliability to enhance disinformation detection: annotation scheme, resource and evaluation.
- Authors
Bonet-Jover, Alba; Sepúlveda-Torres, Robiert; Saquete, Estela; Martínez Barco, Patricio
- Abstract
Disinformation is a critical problem in our society. The COVID-19 pandemic and the Russia-Ukraine war have been key events for the spreading of fake news. Assuming that fake news mixes reliable and unreliable information, we propose RUN-AS (Reliable and Unreliable Annotation Scheme), a fine-grained annotation scheme that labels the structural parts and essential content elements of a news item to enable their classification into Reliable and Unreliable. This type of annotation will be used for training systems to automatically classify the reliability of a news item. To this end, RUN dataset in Spanish was built and annotated with RUN-AS. A set of experiments were conducted to validate the annotation scheme. The experiments evidence the validity of the annotation scheme proposed, obtaining the best Fím, i.e., 0.948.
- Subjects
UKRAINE; RUSSIA; DISINFORMATION; RUSSIAN invasion of Ukraine, 2022-; ANNOTATIONS; FAKE news; NATURAL language processing
- Publication
Procesamiento del Lenguaje Natural, 2023, Vol 70, p15
- ISSN
1135-5948
- Publication type
Article
- DOI
10.26342/2023-70-1