# Robots.txt file for www.careers-network.co.uk # All robots will spider the domain User-agent: * Sitemap: http://www.careers-network.co.uk/sitemap.xml Disallow: /web_master/ Disallow: /Clients/ Disallow: /Candidates/ Disallow: /linx/