Travel & stays
Transport and ticketing scraping
A transport fare is not read, it is requested: it only exists in answer to an origin-destination pair and a date. A useful collection is a whole matrix, not a handful of queries.
Data we extract
- Origin, destination and date
- Timetables, duration and connections
- Price by class and fare condition
- Operator and service number
- Seats left where they are shown
- How the price moves as departure nears
Example use cases
- Fare observatory on a given route
- Finding the best moment to buy
- Competitive monitoring for an operator
- Feeding a comparison site
Framework & ethics
We work with publicly accessible data, at a controlled pace so as not to disturb the sites we consult. Defining the uses is your responsibility, and we advise you on it.
Other kinds of site we collect
Tourist accommodation
Travel
A nightly price does not exist outside a date.
Property listings
Real estate
Listing portals publish tens of thousands of properties every day, and pull them just as fast.
Estate agency networks
Real estate
A network's own site does not publish what a portal publishes: it shows a portfolio, a fee scale, a web of branches and the negotiators who run them.
Vehicle listings
Motoring
A used car's price means nothing on its own: it hangs on the model year, the mileage, the trim and who is selling.
Valuations and spec sheets
Motoring
A valuation and a listing say different things: one gives a reference value, the other an asking price.
Job postings
Hiring
The same role appears on several sites under three different titles, then vanishes without notice.
Salaries and employer reviews
Hiring
What a role pays, and what people think of the employer, are not in the job ad.
Marketplaces
E-commerce
On a marketplace a product has no single price but as many prices as it has sellers, and the one that wins the basket changes during the day.
All kinds in the same sector: Travel and accommodation scraping
Need data of this kind?
Tell us about your project: sources, fields, volume and frequency. We'll come back with a clear proposal.