A price scraper that gets the price you pay, not the old one

Comparing prices across shops means reading one number from thousands of pages, every day, and getting it right. The hard part is not fetching the page. It is picking the right price on it.

Price scraping for price comparison

{"page": "…/p/mug", "price": {"value": "8,99", "confidence": "sure"}}
{"page": "…/p/lamp", "price": {"value": "15,99", "confidence": "sure"}}
{"page": "…/p/vase", "price": {"value": null, "confidence": "none"}}

Nederlands

Why price scrapers get the price wrong

  1. Old and new price. A promotion shows both. Grab the first one and you compare against a price nobody pays.

  2. Split prices. Euros and cents in two elements: "2" and "69" become 2 or 269.

  3. Other products on the page. Related products, bundles and "often bought together" all carry prices of their own.

  4. Price per unit. Per kilo or per litre next to the price per pack. Both are useful, as two fields, not mixed up.

What a price scraping tool should tell you

Not only the price, but how sure it is. A price that comes back "fallback" or "conflict" is a page to look at; a price that silently changed format is a bad row in your comparison.

  1. sure. the main rule matched, as on every example

  2. fallback. a backup rule matched: the page changed, the value is probably still right

  3. conflict. rules that fit your examples disagree: look before you use it

  4. none. the value isn't there (sold out, removed, other layout)

Price scraping tools compared

Reading 1 million product pages, per run. Fetching is extra in every row.

SetupPer page1 million pages
A large AI model on raw HTML1 cent a page and up€10,000+ a run
A small AI model on trimmed HTML0.05 to 0.5 cent a page€500 – €5,000 a run
A headless browserseconds and hundreds of MB a pageservers that grow with the crawl
An extraction script€0 a page, under 1 ms€78 once (5 fields)

More on this

Try it on your own pages

Paste a few links and a couple of values. The look is free, and you hear the price before anything is due.

Try it on your pages