nixos-wiki-infra/modules/nixos-wiki/robots.txt
2024-05-18 14:05:21 +02:00

21 lines
604 B
Plaintext

User-agent: *
Disallow: /index.php?diff=
Disallow: /index.php?oldid=
Disallow: /index.php?title=Help
Disallow: /index.php?title=Image
Disallow: /index.php?title=MediaWiki
Disallow: /index.php?title=Special:
Disallow: /index.php?title=Template
Disallow: /wiki/Special:
Disallow: /api.php
Disallow: /index.php?returnto=
Disallow: /index.php?*userExpLevel=
# Allows robots to find all the pages containing content
Allow: /wiki/Special:AllPages
# Allow the Internet Archiver to index action=raw and thereby store the raw wikitext of pages
User-agent: ia_archiver
Allow: /*&action=raw
Allow: /*&action=edit