E-commerce
Retailer online store scraping
A retailer sells its own products, at its own price, with stock that differs from one store to the next. That last column — local availability — is the one no comparison site gives you, and often the one that decides.
Data we extract
- Full catalogue and category tree
- Price, struck-through price and promotion window
- Sizes, colours and other variants
- Availability store by store
- Brand, manufacturer reference and barcode
- Specification sheet and description
Example use cases
- Price monitoring on a reference basket
- Following a competitor's promotions
- Mapping local availability
- Aligning a catalogue with the market
Framework & ethics
We work with publicly accessible data, at a controlled pace so as not to disturb the sites we consult. Defining the uses is your responsibility, and we advise you on it.
Other kinds of site we collect
Marketplaces
E-commerce
On a marketplace a product has no single price but as many prices as it has sellers, and the one that wins the basket changes during the day.
Property listings
Real estate
Listing portals publish tens of thousands of properties every day, and pull them just as fast.
Estate agency networks
Real estate
A network's own site does not publish what a portal publishes: it shows a portfolio, a fee scale, a web of branches and the negotiators who run them.
Vehicle listings
Motoring
A used car's price means nothing on its own: it hangs on the model year, the mileage, the trim and who is selling.
Valuations and spec sheets
Motoring
A valuation and a listing say different things: one gives a reference value, the other an asking price.
Job postings
Hiring
The same role appears on several sites under three different titles, then vanishes without notice.
Salaries and employer reviews
Hiring
What a role pays, and what people think of the employer, are not in the job ad.
Tourist accommodation
Travel
A nightly price does not exist outside a date.
All kinds in the same sector: E-commerce scraping
Need data of this kind?
Tell us about your project: sources, fields, volume and frequency. We'll come back with a clear proposal.