👷 fetch IPs for you.com

alaz · May 20, 2024 · a5fe939 · a5fe939
1 parent 3ea40f3
commit a5fe939
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/lib/legitbot/you.rb b/lib/legitbot/you.rb
@@ -3,6 +3,9 @@
 module Legitbot # :nodoc:
   # https://about.you.com/youbot/
   class You < BotMatch
+    # NOTE: fetching is disabled, because You.com disallows crawlers
+    # @ fetch:url https://about.you.com/youbot/
+    # @fetch:selector section.elementor-section-content-top div.elementor-widget-text-editor pre > code
     ip_ranges %w[
       20.59.40.22
       52.226.199.170