Custom data and scrapers
Custom web scraping for public, non-personal data
You know the data is out there, on a supplier's site, a marketplace or a government portal. You just don't want to copy it by hand every week. I collect it, clean it up and deliver it in the format you work in.
A real sample
300 recent Dutch public tenders from the EU's open TED database, with a CSV you can download and a description of every column. It shows what a delivery looks like and how a daily feed of new tenders would work.
Data I collect
- Product prices, stock and catalog details from shops and suppliers
- Public tenders and procurement notices
- Listings: properties, vehicles, rentals, marketplaces
- Job posts, without the names of the people posting them
- Store locations, opening hours, search suggestions, public statistics
Data I won't collect
Personal data. That means no names, email addresses, phone numbers or social profiles of people, no lead lists of individuals and nothing behind a login that isn't yours. I also check a site's robots.txt and terms before I start, and when a site offers an official API or open data download, I use that instead of scraping the pages. If your request needs personal data, I'll say no or suggest a version without it.
How you get the data
- One-off dataset: a CSV, Excel or JSON file with the columns you asked for. From $100.
- Recurring feed: the same collection on a daily or weekly schedule, delivered to a Google Sheet, a CSV link, a JSON endpoint or your own webhook. Only new or changed rows if you want. $100 setup plus from $49 a month.
- Custom Apify Actor: the scraper itself, built as an Apify Actor and handed over to your own Apify account, with an input schema and a README. From $250.
What a feed looks like in practice
Say you sell bike parts and want to know when three competitors change their prices. Every morning the scraper visits their product pages, saves price and stock per product, compares it with yesterday and sends you only the rows that changed. When one of the sites redesigns and the scraper breaks, I get the alert and fix it. You just see the sheet update.
Before you ask
How many rows? The one-off price covers one source and up to about 10,000 rows. Bigger jobs get a quote.
Can you get data from a site that blocks bots? Sometimes, but if a site clearly forbids automated access in its terms, I won't do it.
Packages and prices are also on the home page.
Want one of these?
Send a few lines about what you need. You get a scope, a fixed price and a date back by email.