Tools

• How to Scrape Data From Twitter Profile Pages

  

  Posted on: January 8th, 2016 by Patrick Hathaway in How To, Social, Tools

  Update: 1/8/2019 Twitter has updated their layout to render data primarily through Javascript. You will need to scrape https://mobile.twitter.com rather than https://twitter.com. As mobile twitter still renders html in the source. We will be updating the scraper soon to be able to crawl js rendered content. I have been meaning to write this blog post […]

  Read More >>

• Introducing the Duplicate Content Checker

  

  Posted on: March 9th, 2015 by Patrick Hathaway in SEO, Tools

  For almost as long as SEOs have cared about Google traffic, they have also cared about duplicate content. Well before Panda came along, SEO professionals have fought to ensure their websites remain in Google’s good graces by avoiding duplicate content issues. Checking Duplicate Content The most common way to check if you have duplicate content […]

  Read More >>

• Shit In, Shit Out: Why Link Checkers Are Annoyingly Inaccurate

  

  Posted on: June 20th, 2014 by Patrick Hathaway in SEO, Tools

  So, you have a list of URLs, and you need to know if any of them (still) link to your domain. Either you’re checking links you’ve built, or you’re checking links you’ve unbuilt (aka link removal). Using an automated link checker tool can quickly give you this information. HOWEVER, all link checkers fail at reporting […]

  Read More >>

• Hooking Up APIs & Importing URLs

  

  Posted on: June 8th, 2014 by Patrick Hathaway in Guides, Tools

  URL Profiler does what it says on the tin – it profiles URLs – in bulk, and at speed. To set up the tool to work for you, you need to do 2 things: Import a list of URLs to process Select the data you want the tool to bring back There is also a […]

  Read More >>