在R中提交html表单

Question

I am trying to scrape https://www.fbo.gov/ for academic reasons and cannot figure out how to fill out the search filter and submit from the landing page to scrape a pre-filtered list. I would like to filter by Place of Performance = West Virginia. Here is what I have so far

library(tidyverse)  
library(rvest)    
library(stringr)   
library(rebus)     
library(lubridate)
library(Rcrawler)
library(xml2)
library(devtools)


url <- "https://www.fbo.gov/"
web_session <- html_session(url)

# Get forms with searchable fields in current session.
form <- html_form(web_session)


# First, Copy form.
filled.form <- form

# Set values in form #1
filled.form[[1]] <- set_values(filled.form[[1]],
                               dnf_class_values[procurement_notice][zipstate] 
                                   = "West Virginia")  

# Set form url to empty character string to prevent error message when
filled.form[[1]]$url <- ""

When I run this, I get the error below

Error: unexpected '=' in:

"filled.form[[1]] <- set_values(filled.form[[1]],
                               dnf_class_values[procurement_notice][zipstate] ="

I have tried this same method and to submit with other examples and am also having trouble submitting the form to make it run. How can I fill out the form and submit it so that I can scrape a subset of WV opportunities?

Answer 1

Try putting the form field in quotes:

"dnf_class_values[procurement_notice][zipstate]" = "WV"

You can get more details about the form with:

str(filled.form[[1]])