Difficulty Accessing Section of Website using Ruby Mechanize

Question

I am trying to access the calendar data on an airbnb listing and so far have been unsuccessful. I am using the Mechanize gem in Ruby, and when I try to access the link to access the table, I am encountering the following error:

require 'mechanize'
agent = Mechanize.new
page1=agent.get("https://www.airbnb.com/rooms/726348")
page2=agent.get("https://www.airbnb.com/rooms/calendar_tab_inner2/73944?cal_month=11&cal_year=2013&currency=USD")
Mechanize::ResponseCodeError: 400 => Net::HTTPBadRequest for https://www.airbnb.com/rooms/calendar_tab_inner2/726348?cal_month=11&cal_year=2013&currency=USD -- unhandled response

I have also tried to click on the tab that generates the table with the following code, but doing so simply generates the html from the original url.

agent = Mechanize.new
page1=agent.get("https://www.airbnb.com/rooms/726348")
page2=agent.click(page1.link_with(:href => '#calendar'))

Any help would greatly appreciated. Thanks!

Answer 1

我看到了问题，您需要检查请求标头：

page = agent.get url, nil, nil,  {'X-Requested-With' => 'XMLHttpRequest'}