Merge pull request #8 from JayBizzle/develop

Added DuckDuckBot user-agent #7
JayBizzle · Apr 24, 2015 · 5e08197 · 5e08197
2 parents adb373b + 0cba7a2
commit 5e08197
Showing 1 changed file with 2 additions and 1 deletion.
diff --git a/tests/crawlers.txt b/tests/crawlers.txt
@@ -555,4 +555,5 @@ python-requests/1.2.0 CPython/2.7.3 Linux/3.2.0-29-virtual
 WeSEE:Ads/PageBot (http://www.wesee.com/bot/)
 Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)
 Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://megaindex.com/crawler)
-GigablastOpenSource/1.0
+GigablastOpenSource/1.0
+DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)