# ============================================ # ROBOTS.TXT - SAVETTOK.ORG # SEO otimizado - Crawler rapido permitido # ============================================ User-agent: * Allow: / Allow: /images/ Allow: /css/ Allow: /js/ Allow: /fonts/ Disallow: /admin/ Disallow: /account/ Disallow: /dashboard/ Disallow: /api/ Disallow: /temp-downloads/ Disallow: /uploads/temp/ # ===== BOTS DE IA (PERMITIDOS) ===== User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Cohere-AI Allow: / # ===== MOTORES DE BUSCA PRINCIPAIS ===== User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: /images/ User-agent: Googlebot-News Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: Yandex Allow: / User-agent: FacebookExternalHit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: Pinterestbot Allow: /images/ User-agent: Discordbot Allow: / User-agent: Whatsapp Allow: / User-agent: TelegramBot Allow: / # ===== VERIFICADORES ===== User-agent: Google-Site-Verification Allow: / User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / # ===== FERRAMENTAS DE SEO ===== User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: Moz Allow: / User-agent: DotBot Allow: / User-agent: DataForSeoBot Allow: / # ===== FERRAMENTAS DE MONITORAMENTO ===== User-agent: UptimeRobot Allow: / User-agent: Pingdom Allow: / User-agent: StatusCake Allow: / # ===== BOTS BLOQUEADOS (PARASITAS) ===== User-agent: Bytespider Disallow: / User-agent: MJ12bot Disallow: / User-agent: rogerbot Disallow: / User-agent: exabot Disallow: / # ===== REGRAS GERAIS ===== Host: https://savettok.org Sitemap: https://savettok.org/sitemap.xml # ============================================ # FIM DO ROBOTS.TXT # ============================================