We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Qualitative analysis of manual annotations of clinical text with SNOMED CT.
- Authors
Miñarro-Giménez, Jose Antonio; Martínez-Costa, Catalina; Karlsson, Daniel; Schulz, Stefan; Gøeg, Kirstine Rosenbeck
- Abstract
SNOMED CT provides about 300,000 codes with fine-grained concept definitions to support interoperability of health data. Coding clinical texts with medical terminologies it is not a trivial task and is prone to disagreements between coders. We conducted a qualitative analysis to identify sources of disagreements on an annotation experiment which used a subset of SNOMED CT with some restrictions. A corpus of 20 English clinical text fragments from diverse origins and languages was annotated independently by two domain medically trained annotators following a specific annotation guideline. By following this guideline, the annotators had to assign sets of SNOMED CT codes to noun phrases, together with concept and term coverage ratings. Then, the annotations were manually examined against a reference standard to determine sources of disagreements. Five categories were identified. In our results, the most frequent cause of inter-annotator disagreement was related to human issues. In several cases disagreements revealed gaps in the annotation guidelines and lack of training of annotators. The reminder issues can be influenced by some SNOMED CT features.
- Subjects
MEDICAL terminology; VASCULAR medicine; BLOOD pressure; COMPUTED tomography; MEDICAL personnel
- Publication
PLoS ONE, 2018, Vol 13, Issue 12, p1
- ISSN
1932-6203
- Publication type
Article
- DOI
10.1371/journal.pone.0209547