# AI crawlers - GPTBot, ChatGPT-User, Google-Extended, ClaudeBot, PerplexityBot # and the rest - are allowed through the User-agent: * group below and inherit # its Disallow list. # Do NOT give any crawler its own group here. A named group makes that crawler # ignore User-agent: * entirely, which is how /sendy/ and /api/ sat uncovered # for GPTBot, ChatGPT-User and Google-Extended until 2026-08-01. User-agent: * Allow: / Disallow: /php/ Disallow: /webhooks/ Disallow: /data/ Disallow: /sendy/ Disallow: /dna/quiz-subscribe.php Disallow: /dna/quiz-track.php Disallow: /dna/quiz-report.php Disallow: /assess/subscribe.php Disallow: /marketing-audit/ Disallow: /*?access= Disallow: /*tap_a= Disallow: /*tap_s= Disallow: /*irclickid= Disallow: /*irgwc= Disallow: /*visitorId= Disallow: /*seg_id= Disallow: /api/ Disallow: /welcome/checklist-state.json Sitemap: https://smartergerman.com/sitemap.xml Sitemap: https://smartergerman.com/welcome/sitemap.xml