Tags: tn3rb/Crawler-Detect
Tags
Update raw crawler list (JayBizzle#235) * Add 18 user agents * Make regex more explicit * Update raw crawler list
Merge pull request JayBizzle#232 from JayBizzle/dev New bots
Merge pull request JayBizzle#226 from JayBizzle/develop Add bots
Merge pull request JayBizzle#223 from jeisinge/wpif_imgsizer Add wpif and imgsizer as crawlers
Merge pull request JayBizzle#214 from JayBizzle/develop 4 bots
Four more user agents (JayBizzle#210) * Add lots of bot user agents * Add four more user agents
Merge pull request JayBizzle#208 from JayBizzle/JayBizzle-patch-1 Check HTTP_X_SCANNER
Merge pull request JayBizzle#206 from JayBizzle/develop Add bots
Merge pull request JayBizzle#203 from JayBizzle/develop Add bot - closes JayBizzle#202
PreviousNext