You have to log in to access /robots.txt