如何阻止不良的爬网程序爬行
[英]How to Stop bad crawler from crawling
问题描述
So, I have an eshop (php), and noticed that some competitors are always changing their prices to be lower that mine. 
因此，我有一个eshop（php），并且注意到一些竞争对手一直在改变价格以使其价格低于我的价格。 I think that they are crawling my website for prices. 我认为他们正在搜寻我的网站以获取价格。 Is there any way to stop that? 有什么办法可以阻止这种情况？
I think that one of the solutions would be to block crawlers IP, but I don't know which IP it is. 我认为解决方案之一是阻止搜寻器IP，但是我不知道它是哪个IP。
Could I block it if there are too many request? 如果请求太多，我可以阻止它吗？
1 个解决方案
解决方案1
0
考虑为您的网站启用reCAPTCHA，请参见例如https://www.google.com/recaptcha/intro/index.html
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.
相关问题
PHP爬网程序未爬网所有元素 - PHP Crawler not crawling all elements
如何从Crawler filter（）获取单个值？ - How to get single value from Crawler filter()?
从网站抓取图像 - Crawling images from a website
如何欺骗爬虫/扫描仪检测网络技术？ - How to trick a crawler/scanner from detecting the web technology?
我如何将数据从搜寻器获取到我的网站？ - how i get data from crawler to my site?
如何在PHP中编写此爬虫？ - How to write this crawler in php?
如何隐藏攻击性爬虫？ - How to hide an aggressive crawler?
PHP从网站爬网数据 - PHP crawling data from website
symfony crawler 无法在此站点上运行 - symfony crawler not work from this site
使用.htaccess从子域中排除Crawler - Exclude Crawler from Subdomain with .htaccess
相关标签