Data files and scripts that we used for the analysis of the Voynich manuscript in Reddy and Knight (2011).
All data files are in the data/ directory.
First 28551 words from the WSJ Penn Treebank, with each line an article. Devoweled version removes aeiou, but not y.
First 19327 words from the Quran in Buckwalter transcription, without vowels. Each line is a verse.
First 18791 words from the Sinica treebank that's included with NLTK (sinica.wds). Pinyin conversion (pinyin.wds) was done by looking up characters in the CJK library. Please let us know if you find errors in the conversion.