Prevents redirects in the find_robots_txt check#247

sjledoux merged 3 commits intoGoogleChrome:mainGoogleChrome/related-website-sets:mainfrom

erikb-stripe:erikb-246-no-redirectserikb-stripe/related-website-sets:erikb-246-no-redirectsCopy head branch name to clipboard