# ========================================================================== # WordPress robots.txt - SEO + AI (version B) # Policy: block AI training crawlers, allow AI search/citation crawlers, # do not block general search engines. # Last reviewed: 2026-06-02 # ========================================================================== # ===== General search engines ===== User-agent: * Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /xmlrpc.php Disallow: /wp-json/wp/v2/users Disallow: /?s= Disallow: /search/ Disallow: /*?replytocom Disallow: /trackback/ Disallow: /comments/feed/ Disallow: /author/ Disallow: /*?attachment_id= # Allow JS/CSS so Google can render pages correctly Allow: /wp-content/uploads/ Allow: /*.js$ Allow: /*.css$ # ===== WooCommerce ===== Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /*add-to-cart= Disallow: /*?orderby= Disallow: /*?filter_ # ===== Block AI training crawlers, keep AI search/citation ===== User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Google-Extended Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: Applebot-Extended Disallow: / # ===== Sitemap ===== Sitemap: https://www.itai.com.tw/sitemap_index.xml