Update 1.41 – Turn Websites into Useful Data with our New Custom Scraper

Posted on: July 23rd, 2014 by Gareth Brown in Updates

We’ve got a new update for you (version 1.41). Five new data points, a few bug fixes and a new web data scraping feature called the Custom Scraper.

Custom Scraper

The web scraper is gives URL Profiler a new twist. Using a mixture of Regex patterns, XPath or CSS/jQuery selectors you can very quickly extract any data from any URL.

  • Text
  • URLs
  • HTML
  • Inline JavaScript and CSS
  • Tracking codes

We’ve written a quick post on how it works. It’s currently in beta, so please feel free to send us any feedback.

Additional Data

  1. Internal and external link counts to Readability
  2. Returns estimated Reading Time when checking a URLs Readability
  3. A new Shopping Cart Site Type with 35+ e-commerce CMS platforms
  4. Site Type analysis returns the Generator meta tag and the X-Powered-By & Server HTTP Headers
  5. You can now scrape all Social Accounts links at the URL level:
  • Twitter
  • Facebook
  • LinkedIn
  • Youtube
  • Google+
  • Instagram
  • Pinterest

Bug Fixes

There are a couple of stupid typos, which have been corrected!


If you’ve not tried URL Profiler yet, you can start a free 14 day trial here:

The trial is full featured, and you don’t need to give us any payment details to get started.

Existing customers or existing trial users can grab the new update from here:

Gareth Brown

By Gareth Brown

I do all the work and don't have time to write posts. Even if did, Patrick would sign them off as his. He's even got a bigger profile photo - what does that tell you? Follow me on Twitter or circle me on

If You Like the Sound of URL Profiler,
Download a Free Trial Today

(You'll be amazed by how much time it saves you, every day!)

  • Free 14 day trial (full feature)
  • No credit card required
  • License from only £12.95 a month

Ready to take your content auditing seriously?