WebRequest 上不允许使用错误 405 方法

Question

我正在尝试从下面的页面中获取页面代码。 它给了我一个 405 错误。 如果我尝试从主页获取页面代码，它可以正常工作，但从这个特定页面我得到 Method not allowed，想法？

        WebRequest request = WebRequest.Create("https://www.realtor.com/realestateandhomes-search/California/counties");
        request.UseDefaultCredentials = true;
        request.Credentials = CredentialCache.DefaultCredentials;
        HttpWebResponse response = (HttpWebResponse)request.GetResponse();
        Stream dataStream = response.GetResponseStream();
        StreamReader reader = new StreamReader(dataStream);
        string responseFromServer = reader.ReadToEnd();

        Console.WriteLine(responseFromServer);

Answer 1

该网站认为您是机器人。

细节：

我用HttpClient尝试过（推荐：在收到非 200 响应代码时不抛出异常），并检查了响应 HTML。 这是重要的片段：

      <p>
        As you were browsing, something about your browser made us think you might be a bot. There are a few reasons this might happen, including:
      </p>
      <ul>
        <li>You're a power user moving through this website with super-human speed</li>
        <li>You've disabled JavaScript and/or cookies in your web browser</li>
        <li>A third-party browser plugin is preventing JavaScript from running. Additional information is available in this
          <a title='Third party browser plugins that block javascript' href='http://ds.tl/help-third-party-plugins' target='_blank'>
            support article
          </a>.
        </li>
      </ul>

如果您想要完整的响应，请尝试运行以下命令：

async void LogResponse()
{
    using System.Net.Http.HttpClient client = new System.Net.Http.HttpClient();
    var response = await client.GetAsync("https://www.realtor.com/realestateandhomes-search/California/counties");
    Console.WriteLine(await response.Content.ReadAsStringAsync());
}

对 realtor.com, 405的侧面投诉（不允许在请求行中指定的方法）是一个相当糟糕的响应代码； 一个403 （服务器理解请求，但拒绝满足它。 ）似乎更适合。