Annotation comparison: problem with multiple terms in one sentence

[acksmaggart]

When comparing annotation documents, if one annotator annotates several terms in a sentence as a single annotation and the second annotator annotates them all individually then there will be one match for the first individual annotation with the long annotation and several mismatches for every subsequent annotation. For example, in the sentence "SUBDURAL HEMORRHAGE\nSDH" from document 371824 Shane marked the whole thing as bleeding_present while Arianna marked "SUBDURAL HEMORRHAGE" and "SDH" separately, both as bleeding_present. The algorithm matched "SUBDURAL HEMORRHAGE" with Shane's whole-sentence annotation and left Arianna's "SDH" annotation as a non-overlapping mismatch.