# robots.txt for Northforge Outfitters # Legitimate crawl rules plus honeypot trap paths. Well-behaved crawlers obey # the Disallow lines and never fetch the trap paths; any request to those paths # is treated as a near-certain bot signal by the detection engine. User-agent: * Allow: / Allow: /css/ Allow: /img/ Allow: /js/ Disallow: /internal-data/ Disallow: /admin-portal/ Sitemap: https://honeybot.cdwarea51.com/sitemap.xml