We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
RUN-AS: a novel approach to annotate news reliability for disinformation detection.
- Authors
Bonet-Jover, Alba; Sepúlveda-Torres, Robiert; Saquete, Estela; Martínez-Barco, Patricio; Nieto-Pérez, Mario
- Abstract
The development of the internet and digital technologies has inadvertently facilitated the huge disinformation problem that faces society nowadays. This phenomenon impacts ideologies, politics and public health. The 2016 US presidential elections, the Brexit referendum, the COVID-19 pandemic and the Russia-Ukraine war have been ideal scenarios for the spreading of fake news and hoaxes, due to the massive dissemination of information. Assuming that fake news mixes reliable and unreliable information, we propose RUN-AS (Reliable and Unreliable Annotation Scheme), a fine-grained annotation scheme that enables the labelling of the structural parts and essential content elements of a news item and their classification into Reliable and Unreliable. This annotation proposal aims to detect disinformation patterns in text and to classify the global reliability of news. To this end, a dataset in Spanish was built and manually annotated with RUN-AS and several experiments using this dataset were conducted to validate the annotation scheme by using Machine Learning (ML) and Deep Learning (DL) algorithms. The experiments evidence the validity of the annotation scheme proposed, obtaining the best F 1 m , 0.948, with the Decision Tree algorithm.
- Subjects
UKRAINE; RUSSIA; BREXIT Referendum, 2016; UNITED States presidential election, 2016; PUBLIC health &; politics; DISINFORMATION; RUSSIAN invasion of Ukraine, 2022-; IDEOLOGY; DEEP learning; ONTOLOGY
- Publication
Language Resources & Evaluation, 2024, Vol 58, Issue 2, p609
- ISSN
1574-020X
- Publication type
Article
- DOI
10.1007/s10579-023-09678-9