ignore

API Limits

URL Profiler integrates with a number of different APIs, some of which are free and some of which require a paid subscription.

With both, there are limits to the amount of data you can request, and the speed with which you can request it.

In this document we will outline these limits for each API we support.

Majestic

Authentication: Access Token

Plan Free Lite Pro API
Monthly Credits 15,000 approx (500 per day*) 5,000 125,000  From 500,000
Rate Limit 300 per second 300 per second 300 per second 300 per second

*Every user gets 500 free daily checks of Majestic metrics (for more details about the free metrics, please read here).

Each Domain request = 1 credit
Each URL request = 1 credit

For details on how to set up your paid Majestic API access token, please read this step-by-step guide.

Note: In April 2017 Majestic changed some of their plan limits, prices and plan names. The legacy plans are still in place, so if you have one of these then the previous API allocations remain:

Plan Free Silver Gold Platinum
Monthly Credits 15,000 approx (500 per day*) 25,000 125,000 500,000
Rate Limit 300 per second 300 per second 300 per second 300 per second

Mozscape

In addition to the free Majestic metrics, every user also gets 500 free daily checks of Moz metrics (for more details about the free metrics, please read here).

Authentication: Access ID & Secret Key

Plan Free/Pro Pro (Legacy*) Low Volume Mid Volume Max Volume
Monthly Credits 25,000 1,000,000 500,000 4,000,000 40,000,000
Rate Limit 1 per second 2 per second** 200 per second 200 per second 200 per second

*As of Feb 3rd 2016, Moz have limited the monthly credits available via API for free or Pro users. Existing Pro members will maintain the previous rate of 1,000,000 per month, but free accounts reduce down to 25,000 per month (read more about Moz’s change here).

**If you have a Pro account, you can increase the rate limit from 1 per second (default) to 2 per second by contacting them and requesting an increased rate limit.

Each Domain request = 1 credit
Each URL request = 1 credit

For details on how to set up a free or paid Moz API key, please read this step-by-step guide.

Ahrefs

Authentication: Access Token

Plan Free Lite Standard Advanced Agency
Monthly Credits 0 50,000 300,000 1,00,000 5,000,000
Rate Limit N/A 300 per second 300 per second 300 per second 300 per second

Each Domain request = 3 credits
Each URL request = 4 credits

For details on how to set up a paid Ahrefs API access token, please read this step-by-step guide.

SEMrush

Authentication: API Key

Early 2017, SEMrush changed all their API allocations, such that ‘Pro’ and ‘Guru’ subscriptions were no longer allocated any API credits – only the ‘Business’ subscription now offers API access (you can also sign up for a ‘Custom Plan‘ to include API access).

In terms of ongoing subscriptions, SEMrush claim that this is ‘case sensitive’, so if you previously had API access but no longer have it then I would suggest contacting SEMrush to clarify. If you do still have access to an older subscription, these plans allowed the following:

Plan Free Pro Guru
Monthly Credits 0 300,000 700,000
Rate Limit N/A 10 per second 10 per second

For details on how to set up a paid SEMrush API access token, please read this step-by-step guide.

Google PageSpeed

With a single Google PageSpeed API key, users are able to extract Desktop PageSpeed data, Mobile PageSpeed data, and Mobile-friendly data.

Authentication: API Key

Plan Free
Daily Credits 25,000
Rate Limit Approx 60 per minute (PageSpeed) & approx 10 per minute (Mobile-friendly)

Each URL (Desktop PageSpeed) request = 1 credit
Each URL (Mobile PageSpeed) request = 1 credit
Each URL (Mobile-friendly) request = 1 credit

For details on how to set up a free Google PageSpeed API key, please read this step-by-step guide.

Google Safe Browsing

Google’s Safe Browsing API allows users to perform malware checks against a list of domains – which compares them to an internal blacklist maintained by Google themselves.

Authentication: API Key

Plan Free
Daily Credits 10,000
Rate Limit 200 per second

Each Domain request = 1 credit

For details on how to set up a free Google Safe Browsing API key, please read this step-by-step guide.

My Addr

URL Profiler allows users to enter a My Addr API key, who provide very cheap and fast access to PageRank, Alexa and Whois data.

Authentication: Username & Password

Plan PageSpeed Alexa Whois
Cost $1.00 per 100,000 URLs $1.00 per 100,000 URLs $1.63 per 1000 URLs
Rate Limit 185 per second 115 per second 2 per second

For details on how to set up a My Addr API key, please read this step-by-step guide.

uClassify

Authentication: API Key

Plan Free Indie/Professional Enterprise/Academic
Daily Credits 5,000 100,000 1,000,000
Rate Limit 25 requests per minute 25 requests per minute 25 requests per minute

Each classifier (on URL) request = 1 credit
(e.g. If you want Topics & Sentiment of a single URL, that is 2 credits. If you just want Topics, that is 1 credit).

For details on how to set up a My Addr API key, please read this step-by-step guide.

For details on how to the (new) Indie/Professional/Enterprise accounts listed above, please read this post.

Copyscape

Authentication: Username & Password

Rate Limit: 10 URLs per minute

Each URL request = $0.05

For details on how to set up a Copyscape API key, please read this step-by-step guide.

Ready to take your content auditing seriously?