Skip to content

Commit

Permalink
add NER evaluation results
Browse files Browse the repository at this point in the history
  • Loading branch information
konstantinschulz committed Aug 21, 2024
1 parent 60d1321 commit f3286cd
Showing 1 changed file with 17 additions and 1 deletion.
18 changes: 17 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,25 @@
# SEFLAG

**S**ystematic **E**valuation **F**ramework for NLP models and datasets in **L**atin and **A**ncient **G**reek

## Evaluation Results

### Lemmatization on UD test data
#### Ancient Greek: greCy

#### Ancient Greek: greCy

{'accuracy': 0.8942049121548943}

#### Latin: LatinCy

{'accuracy': 0.8843245653143111}

### NER with average metrics (weighted -- micro -- macro)

| | | |
|---------------|--------------------|----------------|
| **Model** | flair_grc_bert_ner | LatinCy |
| **Dataset** | Yousef et al. | Herodotos |
| **Precision** | 96 -- 94 -- 66 | 96 -- 96 -- 59 |
| **Recall** | 94 -- 94 -- 76 | 96 -- 96 -- 60 |
| **F1** | 95 -- 94 -- 64 | 96 -- 96 -- 58 |

0 comments on commit f3286cd

Please sign in to comment.