January 10, 2011

7 tools to monitor your competitors’ traffic


“Heavy Traffic” by Masakazu “Matto” Matsumoto on Flickr

 

Just how accurate are Alexa, Compete, Quantcast & the others?

This is part of our ongoing series on website optimization and traffic analysis.

Guest post by Sam Crocker
SEOmoz

Today we’re going to examine a number of tools and resources for getting insights into competitors’ traffic data. We’ll assess their strengths and weaknesses as well as the validity and usefulness of the data provided.

We’ve had clients asking us for a better view of overall market size and what kind of traffic their competitors are getting, since it can be tricky to find meaningful predictive data even when you know who your competitors are or should be.

It is worth pointing out that a number of these services suggest they can provide better data if you claim the sites by entering your ownership credentials. I can’t testify to the accuracy of this, and our analysis is based upon the free version of the tools as we did not have paid access to any of the tools.

We tested 25 sites for which we had reliable internal data, giving us insight into just how accurate these tools really are — or aren’t.

 

alexa

alexa-logo

Alexa: Too often, dubious numbers

1Strengths: Alexa is good for comparing different sites traffic and for monitoring general traffic trends. It can be quite useful for comparing one site to a competitor site (up to five sites at a time). The index is massive and contains some data about all of the 25 sites we tested.

Weaknesses: Not so great for the smaller sites. As you can see below, you won’t get any of the traffic charts for sites ranked outside of the top 100,000, which means if Alexa thinks you are getting fewer than 10,000 visits per month you’re unlikely to glean any great information. Accuracy is a serious concern. This does call into question the usefulness of the tool in general. The numbers reported are not helpful for predicting traffic on their own.

Accuracy: We want to keep this all anonymous but let’s just say one site that we know gets 10-20,000 visits per month had an Alexa rank that was more than five times better than a site that we know gets 75,000+ visitors per month. And this was not just a one-off event. So I have to seriously question the reliability of this tool. It didn’t seem to be too bad at predicting the trends for a single site but the charts are extremely difficult to make any real use of. Interestingly it seems to be skewed in favor of sites within the search marketing space. Sites in the search marketing space that we looked at regularly outranked sites receiving more than 10 times as much traffic on a monthly basis.

How to best use Alexa: The tool is interesting for comparing similar sites or sites within an industry, but be very cautious about using this to make any meaningful suggestions or estimates on traffic data. The most accurate data seemed to be the data from the visitors by country — the percentages we looked at were not too far off.

Cost: Free. Options for site audits for $199.

Compete: Good UI, questionable data

2Strengths: Compete has a useful interface, speaks the right language (unique visitors, visits, etc.), offers the ability to compare multiple sites, and its data is easy to understand and well presented.

Weaknesses: Accuracy, somewhat limited number of sites – many sites that it classifies as “low sample sites,” and the cost of the Pro option.

Accuracy: Again, accuracy is a serious concern here. The data was off in some cases by as much as 2,000% for monthly visits. The accuracy seemed to be a bit better for the peaks in traffic and some of the general trends we looked at but was certainly not reliable enough for us to suggest reporting competitor traffic based upon this information.

How to best use Compete: It should come as no surprise that Compete is best used for comparing competitors. The scale of the data is way off but some of the trends seemed to be fairly reliable. I wouldn’t advise reporting any numbers from this data as they do not seem close/reliable at all – often off by a factor of 200% or more — however the trends are reliable. The information could be meaningfully used to look into seasonal trends between competitors.

Cost: Free. The Pro membership is $499 per month.

Google ad planner

Google Ad Planner: Some unique twists

3Strengths: Google Ad Planner has a few things going for it: Its “sites also visited” data is good, the keywords searched for can be quite valuable, and the “audience interests” data is interesting.

Weaknesses:: Accuracy, lack of data for small sites.

Accuracy: The accuracy was really mixed. For many of the sites AdPlanner provided much better data than some of the others. However, they were still off by miles for some sites – off by as much as 1000%. Given the occasional “big miss,” I would not be comfortable using this data to make traffic predictions for a client.

How to best use Google Ad Planner: The data about other sites visited as well as keywords searched for (with affinity) could be extremely valuable as well as some of the other metrics reported on and audience interests. However, the traffic data is not particularly meaningful and can’t be relied upon.

Cost: Free.

Google Insights: Numbers normalized for search

4Strengths: Google Insights offers generalized trends around key phrases and key phrase groups and regional information. Trusted source.

Weaknesses: It was difficult to read the data. There were no hard numbers about traffic. It was hard to compare entire sites to one another.

Accuracy: You can bet that the accuracy of this data is going to be pretty good given that the data provider has access to more data than anyone else on the Internet. However, the fact that the numbers are normalized and more designed for key phrases and search terms and trends than for traffic data means that the search volume will correspond perfectly with the traffic to a site.

How to best use Google Insights: The tool could be quite helpful for finding the most valuable pockets of key phrases and key phrase groups. This could be particularly valuable when looking at a competitor site and trying to figure out which of their key phrases are driving the most traffic. It could help you see which of the key phrases within a key phrase group might be the most valuable.

Cost: Free.

Google Trends: For broad information gathering

5Strengths: Google Trends for Websites is good for illustrating magnitudes of difference between sites. It allows comparison of multiple websites, and it includes regional information.

Weaknesses: It’s not good for comparing sites fairly similar in size. It does not provide information for smaller sites when logged in, it’s accuracy is uneven and it provides no numbers.

Accuracy: The data seem to be more accurate when only trying to compare traffic from search; it does not seem to do as well in assessing overall traffic. When comparing websites with drastically different traffic numbers, the rough visual estimation appears to correspond quite well with the observed analytics data as well. When visiting the site and logged in, Trends it does provide numbers and ranges, though the data looks to be off on a few of the sites I have checked. It is not as far off as the data for the same sites using AdPlanner, but still considerably far off — e.g., reporting 140,000 visits for a site that receives about 320,000 unique visits daily.

How to best use Google Trends for Websites: Trends is great for broad information gathering. It gives some insight into similar searches when comparing sites, and in general it is unlikely that you will find better comparative data out there without direct access to your competitor’s analytics account. However, Trends does not provide numbers and thus can only be used to venture a guess at what sorts of numbers competitors are pulling in.

Cost: Free.

Quantcast: Nifty Media Planner Tool

6Strengths: Quantcast provides traffic numbers that are easy to follow, displays information nicely, offers some demographic information and has an interesting Media Planner Tool.

Weaknesses: Unreliable and often inaccurate, lacks data for small and medium trafficked sites. Inability to compare sites.

Accuracy: The biggest shortcoming of the Quantcast data is accuracy. As with some of the other services, the traffic data is estimated and is nowhere near accurate on the sites for which Quantcast had any data. Data was off by as much as 10 times the actual analytics data for some of the sites.

How to best use Quantcast: Although the data is not particularly reliable for the traffic data, some of the other tools the site has to offer seem quite interesting and worth further investigation. The demographics information provides a reference as to how the data compare against Internet averages.

Cost: Free.

SEMrush: Most accurate of the bunch

7Strengths: SEMrush‘s data includes sites of all sizes, a list of key phrases and rankings for those terms — and provided the most accurate data of all the tools we examined.

Weaknesses: The data were still imperfect. Customers must pay to get full data lists. And the data is only for Google traffic.

Accuracy: The data were not perfectly accurate, though generally speaking SEMrush did not miss the mark for any of the sites we tested the way a number of the other tools did. In the end, the data were surprisingly accurate. As with some of the Google data, the information reported is just the Google search engine traffic, but this is our main area of focus and was quite accurate when drilling down into that specific area of traffic within analytics.

How to best use SEMrush: Although imperfect, this tool came the closest to providing accurate data that I would, at least with a word of warning, be willing to share with a client about potential expectations or about where their competitors’ traffic may be. Most importantly, the add-on options and ability to see the keyword lists and how the competitor ranks for these terms is extraordinarily appealing.

Cost: Free to $499 per month. We used the free version.

A look at two final sites that estimate Web traffic

comScore

Unfortunately, we struggled with comScore. We were unable to get a log-in or sneak a peek at any of the data.

How to best use comScore: comScore offers a number of reports and insights into markets, including reports on local market size as well as information about valuable/important keywords in an industry. It would be very interesting to find out where this data was coming from and how good it was, but we were not able to achieve this in time to publish this information.

Cost: Not disclosed.

HitWise

Unfortunately, we were not able to get data from HitWise in time for publication.

How to best use HitWise: HitWise, similarly to comScore, works on a reporting basis insofar as you speak to them about the types of market reports you would like, or you can create custom reports. While we cannot comment on the accuracy of the data, the services offered look to be better tailored to an SEO‘s needs than do the reports offered by comScore. However, generally speaking HitWise will not work with agencies, which will be a bit of a bummer for some of you.

Cost: Free to $695+ per report

Conclusion

I hope that the findings from all this research will be valuable to you. Ultimately, it’s an incomplete study. For the time being I would rely most heavily on SEMrush for predicting traffic and estimating how well a competitor is doing, but all of these tools add something to the ever-growing traffic toolbelt even if it may be for a purpose other than that which I was hoping they would achieve.

Sam Crocker is SEO Associate Director at OMD UK in London. He is the resident meme expert at OMD and an avid YouTube watcher. Follow him on Twitter. This post orig­i­nally appeared at SEO­moz and is repub­lished with per­mis­sion. The author’s views are entirely his own and may not reflect the views of SEO­moz, Inc. SEO­moz is not affil­i­ated with Socialmedia.biz and has not reviewed this trans­la­tion. SEO­moz pro­vides the Web’s best SEO tools and resources.
SEO & Web traffic articles

Keywords, search marketing and data mining (Socialmedia.biz)

Everything you need to know about SEO (Socialmedia.biz)

The beginner’s checklist for learning SEO (Socialmedia.biz)

25 tips to skyrocket your search engine rankings (Socialmedia.biz)

14 strategies to grow your blog’s audience (Socialmedia.biz)

Launching a new site: 18 steps to successful metrics & marketing (Socialmedia.biz)

Reputation management SEO: 6 advanced tactics (Socialmedia.biz)

Linkscape Visualization and Comparison tool (SEOmoz)

Competitive Link Research tools (SEOmoz)

  • http://www.socialmarketingdynamics.com/ Sydney Shore

    I love that picture that you used in this article, it's so mesmerizing! I've only had used Alexa in the past, and you are quite right that it fails on getting data on smaller sites. I might just try SEMrush one of these days.

    • jdlasica

      I get a little dizzy every time I look at it, Sydney. :~)

  • http://www.improveyourwebsiteposition1155.com Ashley Nixon

    Have you used seoelite software. It does seem to have alot of the answers but not all of them.

  • http://www.agencyplatform.com Daniel

    I have worked on Google Trends and Google Planner before, but this post has helped me in creating a different approach to such tools. Can't wait to check out the other social media tools mentioned. Thanks!

  • http://www.microupdate.co.uk/free-competitor-analysis-offer.php Jonathan Camp

    Great post, there are now many factors that affect competitor analysis and having a good website that competes well is essential.

    We have created a system to creates a 50 page report for free that shows you how you compare to your competitors and what you need to do to make sure your website ranks well. Get your free website competitor analysis guide here

  • http://davida-yemi-akanle.com davida

    I use Alexa most of the time, thanks for the pros and cons, I went to try some of the site mentioned in this article, I don't even get listed at all. Surprising:)

  • http://www.livecasinodirect.com/countries/australia/ Pokie

    I wish I had a tool that tells about social media presence. It would be important with Facebook likes or google plus-es and many other social bookmarking sites.

  • http://socialmedia--management.com/achievement/social-media-management-is-hogwash/ Jo Li-social media

    For pure figures on visitors per day Dropday.com used to project excellent data until It met the Google penguin about a month ago But have to investigate Semrush more thoroughly. Our earlier introduction appeared less than spectacular.

  • http://www.sufalamtech.com/ joomlacmsdeveloper

    This all tools are paid for monitor competitors website traffic per day or visitors. Can you suggest any free tools for monitoring.

  • http://www.isparmo.com/2013/01/iconia-pc-tablet-dengan-windows-8.html norack

    I think you must review the Majestic SEO and Google Analytics http://www.isparmo.com/2013/01/iconia-pc-tablet-dengan-windows-8.html

  • http://www.franchisebazar.com sowmyanatarajan

    Found it interesting and very informative. My website http://www.franchisebazar.com is not supporting any tools other than alexa

  • RakiaOffer

    You wrote an excellent reference but have not mention SimilarWeb (http://www.similarweb.com/) , which in my eye is both reliable and accurate tool. The site is built on a diverse global panel which ensure the quality of the data you receive. In addition the site has a great UI and its main goal is to bring you clear insights on any website on the internet.

    • Etai

      Yea, I agree. Very surprised SimilarWeb isn’t in there.

  • VindhyaArkalgud

    its almost 2 years since this post was written…have there been any changes in any of the tools mentioned?

    • Ernest Oppetit

      yeah Google Trends for Websites doesn’t exist anymore

  • http://colibritool.com jasonmark

    Monitoring your competitors is one step  to be recognize by traffic algorithm of search engines. With this, there are many tools, best tools that can help you monitor your competitors traffic such as Colibri. It is what I am using and a recommend tool for others. You can check it here: http://colibritool.com

  • KaisSayahi

    rencontre, rencontre en ligne, rencontre mariage, amour, amitié, chat, chat room, chat vidéo, http://www.revescom .com

  • http://colibritool.com/ leestacey01

    Many SEO professionals have found gold by using the social network as a way of getting interest and attention of the audience. To monitor the backlinks of my competitors,You may use ColibriTool at http://colibritool.com .

  • abu utsman

    I think you must review the Majestic SEO and Google Analytics

    http://mahirseogoogle.blogspot.com/2013/07/cari-uang-lewat-ekioskucom.html

  • http://www.eemes.com/ Eemes

    Check out the best tools for SEO here in terms of Ranking fluctuations http://www.eemes.com/blog/serptools-rankingfluctuations-21august

  • yaray1

    i think Google trends and planner have god performance. ASUS Fonepad Tablet 7 Inci Dengan Fungsi Telepon

  • Dingy

    SEMRush seems good but you can’t use it to measure sites in other countries like the philippines for example. Trying to get the site analytics of a competing site http://www.rent.ph

  • http://www.t20worldcuplive.com/ Prem Baweja

    Add Majestic seo to the list

  • Newton

    We’re trying to estimate publisher traffic. Do you know the call you made through the API to get this through SEMrush? Gotta love the nofollow comment spam you’re getting by the way. Ridiculous. Anyways, any help would be great.

  • http://hargahpterbarui.blogspot.com/2014/02/harga-dan-spesifikasi-blackberry-z3.html Ayu Riska putry
  • Marysata

    When virtue and modesty enlighten her charms, the lustre of a beautiful woman is brighter than the stars of heaven, and the influence of her power it is in vain to resist.
    pembesar payudara
    cream pembesar payudara

  • Bobby

    Great post. A lot of these tools we use for trends – not for actual “real numbers”

    There are other tools such as SpyFu, KeywordSpy, Market Samurai, Moz that can really help understand what your competitors are doing.

    Check out this video that shows these in action:
    http://www.youtube.com/watch?v=_Rww1AUFKCo

  • http://www.butiksahira.com kenziko

    Thanks for compile and share about it. Even this article have been so long, but it’s still useful.. Model Baju Muslim Terbaru

  • Roy

    Hi Sam , Thanks for the post.

    I have another great tools that I’m using that is not here.

    http://www.similarweb.com/ – you basically can see the Google Analytics of your competitors with this amazing tool