Web Scraping Service
THIS SERVICE IS NO LONGER AVAILABLE. Instead, you may use your own server or sign up for Rocket Scrape or Scraper API – links available from within Price Comparison Pro.
Some websites use Ajax to display prices on the page AFTER the page has loaded. In that case, a standard scraper will not find the prices inside the HTML. That’s where this scraping service helps – it simulates a Chrome browser and allows you to grab prices from ANY publicly visible website.
- Allows you to scrape any prices that are displayed on page using Ajax – commonly these are event ticket sites or similar sites with more dynamic pricing
- It simulates a browser, so you get the same prices your users see
- Grab prices from ANY source
- Starter license is FREE FOR ONE YEAR
- Allows you to use rotating proxies, or dedicated proxies to scrape prices as if you were in a specific country – great if your server is in one country, but you need to simulate a scrape from another country to grab the correct currency price
If you need to scrape more prices and pages per day, please get in touch and we can set up your own dedicated price scraping server for you.
This scraping service allows you to scrape prices from any website, even websites using ajax to load their prices.
We have a Node.js installation running PhantomJS which simulates a user-browser, meaning you get whatever prices your users see.
How do you tell if a website is using Ajax to display its prices?
Here are the steps to take if you think a website may be using Ajax to display its prices:
- Load the page in your browser and locate the price you wish to scrape on screen, e.g. $1,250
- View the page source – use CTRL+U or CMD+U
- Search for the price – e.g. CTRL+F or CMD+F then 1,250 or 1250 (exclude currency as it may be in a different HTML cell)
- If you find the price, the page is NOT using ajax
- If you can’t find the price, and you searched for 1,250 and 1250 (or your price in your example) then the page is most likely using ajax
If the page is using Ajax, you should subscribe to this service to scrape prices from those pages.
Installation
After purchase, visit your /my-account/ page and locate your API key. Copy this API key and paste it into the API Key box at the bottom of the Price Comparison Pro settings page.
Make sure you also check the radio box to use PhantomJS – basic if you are not proxying, or advanced if you are proxying AND using phantomjs.
Now when you scrape, the scrapes will happen through our PhantomJS scraping service using a ‘headless browser’ which means you get prices even if th
There are no reviews yet.