Modifier Letter Apostrophe was missing

Add additional letter from dialect transcriptions.
giellalt · Nov 16, 2024 · fc1d29e · fc1d29e
1 parent ceacf70
commit fc1d29e
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/tools/tokenisers/tokeniser-disamb-gt-desc.pmscript b/tools/tokenisers/tokeniser-disamb-gt-desc.pmscript
@@ -66,6 +66,7 @@ Define alphabet "a-z" !! * lower-case ASCII
                |"A-Z" !! * upper-case ASCII
                |Lst({àáâãāăȧäảåǎȁȃąạḁæǽǣèéêẽēĕėëẻěȅȇẹȩęḙḛìíîĩīīĭi̇ïỉǐịįȉȋḭɨòóôõōŏȯöỏőǒȍȏơǫọɵøờớỡởợǭộǿœùúûũūŭüủůűǔȕȗưụṳųṷṵừứữửựʉỳýŷỹȳẏÿỷƴỵɏÀÁÂÃĀĂȦÄẢÅǍȀȂĄẠḀÆǼǢÈÉÊẼĒĔĖËẺĚȄȆẸȨĘḘḚÌÍÎĨĪĪĬİÏỈǏỊĮȈȊḬƗÒÓÔÕŌŎȮÖỎŐǑȌȎƠǪỌƟØỜỚỠỞỢǬỘǾŒÙÚÛŨŪŬÜỦŮŰǓȔȖƯỤṲŲṶṴỪỨỮỬỰɄỲÝŶỸȲẎŸỶƳỴɎšžčđðíŋňŧñńŠŽČĐÐÍŊŇŦÑ})
                !! * select extended latin symbols
+	       | Lst({ʼĺšń·e͔i͔t́śźлü‿₍š́āžƞǵñv́h́źēīūōǟd́})
                | "0-9" !! ASCII digits
                | Lst({_§°†}) !! * select symbols
                !! * Combining diacritics as individual symbols,