使用.htaccess阻止PhantomJS机器人

Question

I want to block traffic from something that appears to be a bot or some other malicious traffic (haven't quite figured out what it is, but I suppose I don't want it). So far I have been blocking it by IP, however the traffic keeps coming from different locations.

Common for this traffic is that the user agent is PhantomJS, and they all show the following local address (perhaps with some variations):

file:///home/poo_master/price_parse/resource_cache/140578757867264tmp2.html

Is it possible to use .htaccess to block either PhantomJS or anything containing "poo_master/price_parse/resource_cache/"

Answer 1

To block bots/scrapers by useragent OR by requested URL add these rewrite rules to .htaccess:

RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^.*(PhantomJS|wget|HTTrack|python).*$ [OR]
RewriteCond %{REQUEST_URI} ^.*poo_master/price_parse.*$ 
RewriteRule . - [F,L]

Answer 2

Update your .htaccess file with below code. Hope it will work.

RewriteEngine on
RewriteCond $1 !^(index\.php|resources|robots\.txt)
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteCond %{HTTP_USER_AGENT} ^.*(PhantomJS|wget|HTTrack|python).*$ [OR]
RewriteCond %{REQUEST_URI} ^.*poo_master/price_parse.*$ 
RewriteRule ^(.*)$ index.php/$1 [L,QSA]