Merge branch 'master' into dev

modernmt · Oct 25, 2017 · 2dd960b · 2dd960b
2 parents 4be52d0 + 54bbd3e
commit 2dd960b
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/monolingual/README.md b/monolingual/README.md
@@ -0,0 +1,5 @@
+For monolingual [Common Crawl](http://commoncrawl.org) data and code to process it please refer to these resources:
+* [University of Edinburgh N-gram site](http://statmt.org/ngrams)
+* Code to process corpora: https://github.com/kpu/preprocess
+* Code to produce raw monolingual files from CommonCrawl: https://github.com/treigerm/CommonCrawlProcessing
+* Alternative monolingual data extraction under development in ParaCrawl project: https://github.com/paracrawl/extractor