# robots.txt for http://www.migrationexpert.com/ # Exclude way back machine User-agent: ia_archiver Disallow: / # blocks SE from indexing folders User-agent: * Disallow: /australia/admin/ Disallow: /australia/help/ Disallow: /australia/images/ Disallow: /australia/member/ Disallow: /canada/admin/ Disallow: /canada/help/ Disallow: /canada/images/ Disallow: /canada/member/ Disallow: /uk/admin/ Disallow: /uk/help/ Disallow: /uk/images/ Disallow: /uk/member/ Disallow: /us/admin/ Disallow: /us/help/ Disallow: /us/images/ Disallow: /us/member/ Disallow: /nz/admin/ Disallow: /nz/help/ Disallow: /nz/images/ Disallow: /nz/member/