通过 HttpWebRequest 向服务器发出多个请求

Question

Friends,i want to scrape a third party web pages and get information from there by httpwebrequest c#.net. I made a simple application in asp.net,c#. and hosted in webserver IIS 7 that enable user to scrape web page easily.

It is working fine by single user. but problem is that when more than one user is requesting at the same time then server block the request. the server allow max 2 concurrent request

My application is running on IIS7, asp.net 4.0.

any help please

Answer 1

If the limit is managed by the remote server then there's probably not much you can do. It's there to prevent spamming and that's what it's doing.

It does sound like you're just hitting the default connection limit for your own machine though. Have a look at the ServicePointManager.DefaultConnectionLimit Property

Use it like this:

ServicePointManager.DefaultConnectionLimit = 1000;

Some reading on it here .