We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
BERT-based ensemble learning approach for the BioCreative VII challenges: full-text chemical identification and multi-label classification in PubMed articles.
- Authors
Lin, Sheng-Jie; Yeh, Wen-Chao; Chiu, Yu-Wen; Chang, Yung-Chun; Hsu, Min-Huei; Chen, Yi-Shin; Hsu, Wen-Lian
- Abstract
In this research, we explored various state-of-the-art biomedical-specific pre-trained Bidirectional Encoder Representations from Transformers (BERT) models for the National Library of Medicine - Chemistry (NLM CHEM) and LitCovid tracks in the BioCreative VII Challenge, and propose a BERT-based ensemble learning approach to integrate the advantages of various models to improve the system's performance. The experimental results of the NLM-CHEM track demonstrate that our method can achieve remarkable performance, with F1-scores of 85% and 91.8% in strict and approximate evaluations, respectively. Moreover, the proposed Medical Subject Headings identifier (MeSH ID) normalization algorithm is effective in entity normalization, which achieved a F1-score of about 80% in both strict and approximate evaluations. For the LitCovid track, the proposed method is also effective in detecting topics in the Coronavirus disease 2019 (COVID-19) literature, which outperformed the compared methods and achieve state-of-the-art performance in the LitCovid corpus. Database URL : https://www.ncbi.nlm.nih.gov/research/coronavirus/.
- Subjects
NATIONAL Library of Medicine (U.S.); MEDICAL subject headings; COVID-19; SUPERVISED learning; CLASSIFICATION; DRUG delivery systems; TEXT recognition
- Publication
Database: The Journal of Biological Databases & Curation, 2022, Vol 2022, p1
- ISSN
1758-0463
- Publication type
Article
- DOI
10.1093/database/baac056