I noticed you request /robots.txt using open-uri. Since open-uri overrides Kernel#open, it also allows for possible command injection (ex: open("| ls")). I think using Net::HTTP.get would be Good Enough (tm).