I'm trying to scrape "1,335,000" from the screenshot below (the number is at the bottom of the screenshot). I wrote the following code in R. Howeve ...

I am trying to scrape data from the following websites with 4 dropdown menus - after clicking each dropdown menus they show a table from where I want ...

unable to scrape @href tags from "https://www.theaic.co.uk/aic/analyse-investment-companies" I'm using Python 3.7,scrapy, splash and also tried with s ...

While I was web scraping links from a news site using Rvest tools, I often stumbled upon links that redirects to another links. In those cases, I coul ...

I need to harvest a directory on wix toolset, but this directory will have for name the build version number. I know how to define a static constant, ...

the following code harvests data from a website. I retrieve a list of lists, I want to unlist one of the lists, edit it, then re-nest it back into the ...

My code below is designed to retrieve data (and its metadata) with authentication through an API endpoint, and return all metadata into a dataframe. I ...

I'm trying to harvest data using rvest (also tried using XML and selectr) but I am having difficulties with the following problem: In my browser's we ...

In CKAN, when I try to create a new Harvest Source I get this error: Does anybody know how I can fix this? I'm new to CKAN. I installed from sourc ...

I have a data set where a lot of different categories and data were crammed into one cell. For example, I have one cell that has names of individual ...

I am using the pycsw extension to produce a CSW file. I have harvested data from one CKAN instance [1], into another [2], and am now looking to run th ...

Using Harvest php API http://mdbitz.com/harvest-api/examples/ and my harvest php array prints following data: data: but when using json class to ...

On a ckan instance running ok, I installed the harvester extension following this guide: https://github.com/ckan/ckanext-harvest these are the steps ...

Somebody is trying to phish me, they are pretending to be one of my close friends to humiliate both of us. This person has created a fake email accoun ...

We've been using ckanext-dcat to harvest from remote json sources, sometimes some harvest jobs didn't finish and had to be deleted along with all the ...

I want to prevent data harvesting in my site (except googlebot of course). I am guessing relying on the UserAgent of GB is not strong enough (every bo ...

The bus company I use runs an awful website (Hebrew,English) which making a simple "From A to B timetable today" query a nightmare. I suspect they are ...