使用 Node.js 访问特定网页时的 400 状态代码。 从我的浏览器点击同一个网页时出现 200 状态代码。 是什么赋予了？

Question

Web URL in question: https://www.theroyalamerican.com/schedule

I am building a node.js script to scrape the web page above using the request-promise package (which grabs the page's html for me). Unfortunately, when I run my code, it gives me a 400 status code from Squarespace (the apparent host of this site).

Strangely, when I browse to the same URL in my web browser, I can pull it up with no problem at all - 200 status code .

I do not have this problem, where my node script and web browser seem to mismatch, with any other web pages. Curious what's going on here...

const rp = require('request-promise');
const $ = require('cheerio');
const url = 'https://www.theroyalamerican.com/schedule';

rp(url)
  .then(function(html) {
     console.log(html);
   })
  .catch(function(err) {
     console.log(err);
    //handle error
  });

Answer 1

Check all the headers that are being sent when you request this page in browser vs in Node.js. Probably some header affects the possible response (like Content-Type maybe? or maybe try passing Origin header)