x

We've Moved!

Our Website Has Moved

Please check us out at www.bluelinerny.com

Go to bluelinerny.com



Add to Technorati Favorites!
  • Subscribe
    • Google Reader or Homepage
    • Add to My Yahoo!
    • Subscribe with Bloglines
    • Subscribe in NewsGator Online
    • Add to My AOL
    • Subscribe in Rojo
    • Add to Technorati Favorites!
    • Add to netvibes
    • Add this site to your Protopage

Recent Posts

Categories

Archives



Andy Beal over at Marketing Pilgrim wrote a January 5th piece on using scripts to create large numbers of PageFlake (a free RSS reader website) accounts to subscribe to a Feedburner RSS feed.

“It seems that somebody has created a bot [automated script] that would create many profiles on Pageflakes (which is a web-based RSS reader) and then subscribe to BoingBoing in each of these profiles multiple times. The net effect was that BoingBoing reported over 2 million subscribers from Pageflakes, a very very dramatic increase over the numbers that were being reported only days earlier.” Says Nik Cubrolovic.

Obviously, the originators of this process got caught and Feedburner has since rectified the issue, but the point it raises is a good one.

When you are looking to advertise on a blog, or any website for that matter, do you simply look at one metric? Alexa Data, Feedburner Subscribers, Page Views, Unique Visitors? If so you could potentially be throwing valuable marketing dollars down the drain. This is because all these datapoints can be exploited to deceive you and raise their potential income value.

How would someone go about manipulating this data?

We’ll start with the datapoint most prone to manipulation: Alexa. Take a number of computers—your mom’s, brother’s, your best friend’s, your own – and install the Alexa toolbar on each respective computer’s copy of Internet Explorer. Then create a script that refreshes and clicks on each page of your site at least 10-15 minutes a day. (Include the result, something like “voila – your unique visits have leapt by x amount” or something like that.)

Feedburner creates an RSS feed which can be read by RSS subscribers— Feedburner gives you detailed information on the number of people reading the particular data feed. You could easily create a script that creates accounts on Google RSS Feeder, PageFlakes, and many other programs to bolster the number of “unique readers” your site has. To make the process effective you would then need to have those accounts at PageFlakes opened once a week and “view” the content (again, one could easily write a script to handle this)

Page Views is also relatively easy to script for cheating. Simply create a program that reloads pages all over your site. Set this up on a number of different computers and watch your page views soar!

Unique Visitors is one the most difficult common metrics to cheat on, but it too can easily be done by an unscrupulous webmaster with basic hacking skills and knowledge of certain Windows XP flaw (or access to a Trojan horse). By utilizing a group of “zombie computers” (computers that have been hijacked for malicious purposes) to all hit your websites—this could be hundreds or thousands of computers, depending on the resources you have at hand – and dramatically increase the number of overall unique visitors a site appears to have.

When publicly available metrics are so easy to cheat, what can you do to protect the integrity of your marketing dollars? To start with, bear in mind no data set is perfect, but the closer you get to perfect, the stronger an outlook you will have on your website’s actual impact on a given audience. Never make the mistake of imagining the data from one site is more accurate or illustrative than the data from another. Use different sources and all available data to get a complete picture of where best to spend your ad dollars.

Don’t be afraid to ask for a few months’ worth of metric data, actually demand at least 6 months of data. After all, this is your business. If you have a web 2.0 or interactive site, check for signs of life. How many comments does typical entry on the blog get? How many users are signed up and active on the forum? Of course these metrics can be spoofed as well, but when you take multiple variables into account, you should have a good strong picture of your advertising context.

5 Responses to “Why One Web Metric Isn’t Enough”

  1. Rick Klau Says:

    Thanks for bringing this up, I think you raise several good points. First off, you might be interested in a blog post I just put up on our corporate blog that touches on some of these issues:

    http://blogs.feedburner.com/feedburner/archives/2007/01/whats_up_with_that_vol_1.php

    What we haven’t discussed much up until now is the impact of bots on feed analytics. (Come to think of it, that’d make a good subject of a future “what’s up with that?” post.) But as we noted last month, we categorized more than 8,000 unique RSS-consuming applications, many of which are automated systems consuming feed content. Now, it’s entirely possible that someone could create another bot to do what you’re describing (i.e., auto-fetch a feed, auto-render the feed content), but we have a number of protections that are constantly evolving to ensure that feed consumption is by and large done by people, not bots. And one of the advantages of a community of more than 300,000 publishers is that we often receive tips from our publishers about anomalies, which we can then address.

    But an equally important point is that when we sell ads into our ad network, we sell not based on the number of subscribers a feed has, but on the number of ad impressions that feed generates. (All ads that we sell are CPM-based.) So while the number of subscribers could be used to confuse potential readers as to the relative popularity of a site, it wouldn’t really have any impact on the ad server’s calculation of that site’s total potential inventory, nor would it influence the actual ad impression delivery that got charged back to the advertiser.

    I think you’re absolutely right that publishers and advertisers need to be smart when evaluating stats, and that no one provider has a lock on being perfect 100% of the time. Though we try! ;) Ultimately, I think you’re spot-on to suggest that multiple elements should be taken into account: comments, page views, unique visitors, feed subscribers, etc. - they can all combine to paint a broad picture of a site.

    Thanks for starting the conversation, and please keep in touch!

    Regards,

    Rick
    —–
    Rick Klau
    VP, Publisher Services
    FeedBurner
    rickk@feedburner.com
    312.756.0022 x2012

  2. Paul Drago Says:

    Rick,

    It was great to see your company reply so promptly and thank you for the insights.

    I had forgotten all about your CPM feed ads.

    We were glad to see that you all took quick action the rectify this issue. I’ll be sure to add your blog to my feed reader (just want I needed another feed! ;) )

    Paul Drago

  3. Anonymous Says:

    It is impossible to manipulate Alexa the way you’re describing. It was possible years ago, but they filter that now. Just ask Jason Calacanis.

  4. Paul Drago Says:

    Anon–

    long term it is impossible. But for short term it is still rather easy to accomplish. You may not get a top 10,000 ranking but you can easily move a site into the top 50,000. At least short term-wise.

  5. Paul Drago Says:

    actually, not even “impossible” just more difficult.

Leave a Reply