Allow indexing of legal pages in robots.txt
Mentions legales, CGU, CGV, hebergement, cookies, RGPD, conformite are now allowed for crawling instead of disallowed. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -22,12 +22,13 @@ Disallow: /mon-compte
|
|||||||
Disallow: /external-redirect
|
Disallow: /external-redirect
|
||||||
Disallow: /my-csp-report
|
Disallow: /my-csp-report
|
||||||
Disallow: /track/
|
Disallow: /track/
|
||||||
Disallow: /mentions-legales
|
Allow: /mentions-legales
|
||||||
Disallow: /cgu
|
Allow: /cgu
|
||||||
Disallow: /cgv
|
Allow: /cgv
|
||||||
Disallow: /hebergement
|
Allow: /hebergement
|
||||||
Disallow: /cookies
|
Allow: /cookies
|
||||||
Disallow: /rgpd
|
Allow: /rgpd
|
||||||
|
Allow: /conformite
|
||||||
Disallow: /unsubscribe/
|
Disallow: /unsubscribe/
|
||||||
|
|
||||||
Sitemap: {$sitemapUrl}
|
Sitemap: {$sitemapUrl}
|
||||||
|
|||||||
Reference in New Issue
Block a user