Spaces:
Paused
Paused
File size: 342 Bytes
bcf46c3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | User-agent: * Allow: / Disallow: /api/ Disallow: /gateway/ Disallow: /admin/ # Allow good bots specifically User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # Block known bad bots User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / Sitemap: https://opticparse.com/sitemap.xml |