MediaWiki:Robots.txt
From Hindupedia, the Hindu Encyclopedia
#
# # Localisable part of robots.txt for hindupedia.com # # Edit at https://hindupedia.com/index.php?title=MediaWiki:Robots.txt&action=edit # Don't add newlines here. All rules set here are active for every user-agent. # # Please check any changes using a syntax validator # Enter https://hindupedia.com/robots.txt as the URL to check. # #Editing User-agent: * Disallow: /index.php Disallow: /w/ Allow: /en/$1 Sitemap: http://hindupedia.com/sitemap.xml