# Disallow all crawlers access to certain pages. User-agent: * Disallow: http://y2007.recanati.tau.ac.il Disallow: http://y2008.recanati.tau.ac.il Disallow: http://y2007.recanati.tau.ac.il/* Disallow: http://y2008.recanati.tau.ac.il/* User-Agent: Googlebot Disallow: http://y2007.recanati.tau.ac.il Disallow: http://y2008.recanati.tau.ac.il Disallow: http://y2007.recanati.tau.ac.il/* Disallow: http://y2008.recanati.tau.ac.il/* # Sitemap files