ignore

Update 1.55 – Search Analytics API Integration

Search Analytics API
Posted on: August 10th, 2015 by Patrick Hathaway in SEO, Updates

The data you can pull together in URL Profiler is almost everything you could ever need to make decisions on content – link metrics, social shares, visitor counts, indexation, duplicate content, mobile-friendly, readability scores, even PageRank! (for those that still insist on using it…)

But there has always been one thing missing – ranking data. That is, until Google finally released their Search Analytics API.

Search Analytics API

I haven’t noticed as much of a fanfare about this as I expected from the SEO community, which is quite surprising. And if you’re still wondering why this is significant, let AJ Kohn sum it up for you:

AJ Kohn

Keyword data – rankings, impressions, CTR – on a URL by URL basis. Now that sounds right up our street.

Introducing our Search Analytics Integration

Perhaps the lack of excitement was due to the fact that most SEOs don’t have easy access to developers to build tools for them – which would allow them to take advantage of the API.

I guess that’s where we come in. We’ve done the API work, so you don’t have to bother.

URL Level Keyword Data

Before I explain how you can get this data, I’ll first clarify what data you can get.

1. Aggregated Page Data

For any URL you enter, you get the following: Total ranking keywords, total clicks, total impressions, average CTR (%) and average position.

Search Analytics API Output

If you are familiar with Search Analytics, this basically matches the unfiltered Page view:

Page View

 

The data export from URL Profiler contains this aggregated data first (followed by the individual keyword data below). The very first column is the only additional data point not displayed in the Search Console, which is simply the sum of all ranking keywords returned by the API (up to a maximum of 5000). You will notice the other 4 columns match exactly the data as displayed in the Search Console.

2. Top 10 Keywords

For any URL you enter, you also get the following: Top 10 keyword queries, with corresponding clicks, impressions, CTR (%) and position.

The data is presented as Keyword 1 through to 10 – and these are the top 10 keywords based on clicks, for any given URL. Then for each keyword, the export contains clicks, impressions, CTR and average position.

Top Keyword

This is then repeated for the other top 9 keywords.

If you are familiar with Search Analytics, any given row (URL) is equivalent to looking at Query data with a Page filter on.

Search Console Page View

Since we are working on a URL by URL basis, all this data sits in rows side by side. This means you could import your sitemap, then (almost) instantly extract the top 10 ranking keywords for every page.

Pretty sweet, right?

How to Access Search Analytics Data

Once you’ve downloaded the new version, you’ll notice a re-jigged ‘Google’ menu, including the new option ‘Search Analytics’.

Search Analytics Integration

Once you tick this box you’ll be presented with an authentication screen, much like the one for our Google Analytics integration.

Connect to Google Search Console

You’ll need to be logged in to the correct Google account when you click this button, which will take you to an authentication page on Google.

Accepting the permissions allows URL Profiler to connect to any Search Console profiles associated with your account, which you can select from the dropdown menu under ‘Data Settings.’

Google Search Console Data Settings

(now provided)

Hopefully by now you have realised the value of the data that this integration can unlock, and the ease with which you can get it.

Combining this with our Google Analytics integration will give you ranking data alongside visits and engagement data – all in the same convenient spreadsheet.

Just like in the good old days!

Update to Our Update (v1.56)

What is it they say about buses…?

Despite only releasing version 1.55 earlier today, and in reaction to some sterling suggestions from one Jonathan Jones, we have released an update to our update – codename version 1.56 (well, actual name is version 1.56 as well).

This adds to ability to filter the data from Search Console more thoroughly, allowing you to select a specific country or device (the default values remain as ‘All’, for those that prefer full fat data).

Version 1.56 Update

These Search Analytics filters are cryptically entitled ‘Search Analytics Filter’ in the export:

Search Analytics Filter

Bug Fixes & Improvements

We don’t like to launch feature updates without also squashing any bugs that may have landed since the last update, so here’s what else is new:

  • Added: HTTP status on Screen Capture results export.
  • Added: Import CSV now supports semi-colon and tab separated files.
  • Improved: Messaging in export for link metric checks when malformed URLs are entered.
  • Improved: Messaging in export for Google Indexation check – when proxies fail on the first check, don’t do the Info: check.
  • Fixed: Cache date on Google Indexation checks – which had stopped working since Google had changed something.
  • Fixed: Minor issue on Duplicate Content Check export.

Feature Removed – Drop History

We don’t normally do this, but sometimes it’s necessary. We have unfortunately had to drop the check for Drop History (no pun intended).

Long story short, URL Profiler was accessing the data by scraping a 3rd party service provider which made this data freely available. Since our software allows you to run 50,000+ domains at a time, this made life rather uncomfortable for the data provider.

We had already come to a decision on this front that we were going to remove this feature (and give users a bit of warning), as we are not really interested in abusing a company’s service. However, the service provider has forced our hand early by completely removing access, even when proxies are used.

So the feature is now completely redundant, and has been removed from v1.55 of the software.

Downloads

Existing customers or existing trial users can grab the new update from here:

If you’ve not tried URL Profiler yet, you can start a free 14 day trial here. The trial is full featured, and you don’t need to give us any payment details to get started.

Patrick Hathaway

By Patrick Hathaway

I seem to be the one that writes all the blog posts, so I am going to unofficially name myself 'Editor'. In fact, I think I prefer Editor-in-chief. You can follow me on Twitter or 'encircle me' on .

If You Like the Sound of URL Profiler,
Download a Free Trial Today

(You'll be amazed by how much time it saves you, every day!)

  • Free 14 day trial (full feature)
  • No credit card required
  • License from only £9.95 a month

Comments

  • Victor Gras

    That was fast! You guys rock.

    • HathawayP

      Thanks Victor! Benefits of being small eh?

  • Marston Gould

    So I’ll have to admit that I only read the top half of the article.
    What I’d like to be able to do is dump by URL the top ‘n’ keywords with their data.
    Is that at all possible with the new functionality?

    • HathawayP

      Where n=10, yes this is what the new integration does. You import all your site URLs, and it will find the top 10 keywords – by clicks, as reported in the Search Console – and export the click, impression, CTR and average position for each.

  • Niall Flynn

    This is beast 🙂

  • Hi Patrick – this is a great enhancement. However one issue I’m finding is that the Search Console date range is fixed in URLProfiler. In your screenshots it looks like date ranges can be set, however not with mine (i’m using the latest Mac version). Is this a known issue? Screenshot attached.

    • HathawayP

      Hi Mark,
      Yeah that’s an annoying OSX thing where it doesn’t display the calendar. If you click into the boxes you can edit the date. We are working on a totally new UI which will eliminate this issue entirely.

      Glad you like the feature though!

      Thanks,
      Patrick

      • Hi Patrick – thanks for the update. Unfortunately however I can’t click into the calendar boxes to edit the dates which is frustrating. How far off is the new UI?

        Cheers

        • HathawayP

          Hi Mark – although the new UI is not out yet we have tried to address this in our latest update (today) – http://urlprofiler.com/blog/update-1-58/

          Might be worth seeing if this fixes your issue?

Ready to take your content auditing seriously?