Mobsters, Likeness, Top Friends, Super Wall, Own Your Friends, Bumper Stickers, Movies and Poker - this is just a sampling of the highest engagement applications on Facebook and MySpace. What these applications all have in common is a mass market appeal. They are general enough that just about everyone can find something cute or fun about these applications for at least a day or two. The applications measure success in installs, page views and virility. However, another classification of application, specific to much smaller audiences, is emerging as a stronger player in the application space which requires a different measurement separate than the categorical classification that application developers can choose to place themselves in.

The goal of these other applications is not monetize via CPC, CPM or CPI advertising, nor to be bought by the large application shops RockYou, Slide, Zynga or SGN. Instead, these applications exist primarily to provide a service to their users. These applications will fail when measured using the traditional methods of installs, daily active users and day over day growth. The audiences are much too small. They require a new metric to measure their success. Success within this category isn’t reaching 22%¹ of Facebook’s user base. Success for these applications is defined as increased affinity for a product, service or company. It needs to be measured and reported differently.

This might be measurable through acquisitions, loyalty, usage or retention. Using Twitter as an example, it’s certainly capable of becoming a mainstream product, but hasn’t reached mainstream adoption - at least not yet. Twitter currently reaches an estimated 2.2 million users a month². It’s regarded by some as having moved beyond the early adopters³ and easing into the early majority on the technology adoption lifecycle. The Twitter application launched May 25th along with the Facebook platform. It currently boasts 64.5K monthly users of which is hardly chart topping - in fact, it’s really quite dismal - it’s not even one of the top 500 applications. What the application does though is provide enhanced user experience by integrating status updates between the two sites.

The Twitter application is valued by Adonomics at approximately $105K. However, this number means nothing! The goal of the application isn’t to sell it or even monetize the traffic. Even the overall ranking of the application is irrelevant. A better way to measure the ROI of the application is to measure the interaction and retention. This metric that can accurately quantified by answering a series of questions.

1. Does the application impact the retention and interaction of users for Twitter?
2. Does the application increase usage of Twitter?
3. What overlap in the userbase exists between Facebook and Twitter?

Lacking quantitative data from Facebook and Twitter, you’ll have to settle for my observations.

Does the application impact the retention and interaction of users for Twitter? Yes. I suspect if we could peek into Twitter’s database, we’d see that interactions for users continue for longer periods if they’ve installed the Facebook application. Why do I think this? Read on…

Does the application increase usage of Twitter? Yes. I know from personal experience that I’ve continued using Twitter longer than I had expected to because of the integration. At times I’ve used it only as a status update tool. Sending a SMS or using a phone specific tool is easier than the mobile facebook application available for my phone. Other times I use it as a conversational tool. The main point here - I continue to use it.

What overlap in the user base exists between Facebook and Twitter? Again, this is an estimate but nearly 100%⁴ of the people I follow on Twitter have Facebook accounts. However, only about 20% of my friends on Facebook have (or use) a Twitter account. While Twitter clearly has the potential to be a mainstream tool, it doesn’t have the presence that a MySpace or Facebook does.

The Twitter application likely has positive reprecusions for Facebook as well. By integrating the status update directly from Twitter, Facebook continues to get more content contributing to the “virtuous cycle of sharing” Mark Zuckerberg spoke about at F8 ‘08. Wouldn’t this classify the application as a success? As of this writting, Twitter doesn’t have an official application for MySpace. I expect we’ll see if MySpace allows applications to update the users status.

The question remains, how can we take these difficult to obtain numbers such as audience overlap and integrate it with the more available metrics? We need a metric that holistically evaluates an application. Measuring mass alone is no longer sufficient to define success. I propose they’re measured by interactions, retention and perception. Mix into that formula monthly reach and install and we’ll be able to arrive at a value that more accurately ranks and sorts applications on the whole.

¹ Slide FunSpace reached 22.3 million Facebook users according to the monthly active user count on September 5, 2008

² Compete reports 2,218,330 visitors to Twitter.com in July of 2008.

³ Robert Scoble stated April 9, 2008, “Anyone who joins Twitter after today is not an early adopter. So, not interesting for me to follow.”

⁴ Conducted using PollDaddy and an analysis of people I follow.

Google Analytics does a great job keeping track of visitors, sessions, geographic locations and with the addition of the Benchmarking feature, even compares your traffic to other blogs of similar size and topic. However, there’s a problem. It counts you too! If your using a fancy plug-in to manage your Google Analytics account, you won’t need this. I, however, have been tweaking and tuning my template over time and have my it all stuffed right in header. Today I made a minor tweak to my WordPress template it to suppress my views when I’m logged in and updated to the new tracking code from the old Urchin based code. This snippet is from my ./wp-content/templates/header.php file.

<?php if($user_ID != 1){ ?>
<script type="text/javascript">
var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www.");
document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E"));
</script>
<script type="text/javascript">
var pageTracker = _gat._getTracker("UA-123456-1");
pageTracker._initData();
pageTracker._trackPageview();
</script>
<?php } ?>

Be sure to add the id (or id’s) you want to suppress and to put the correct Google Analytics account information (the UA-123456-1 bit) in your code.
Happy tracking

Compete, one of my favorite website metric tools, shows an interesting trend between three bloggers, two of whom I have met (Rodney Rumford and Nick O’Neill) and have a great deal of respect for. But neither the merits of these individuals or their websites, is the point of this discussion. What concerns me is the lack of quality metrics for this type of comparison. Google Analytics may have the best approach to solving this problem yet. With their new data sharing options, it will be possible for website owners to more accurately track their performance against other websites, including their perceived competitors (assuming they’re running Google Analytics too).

Alexa also offers online metrics and shows some similar trends but neither get the whole picture because the technology used to capture the data is browser based - ie, you install a plugin/toolbar and away you go. This doesn’t accurately capture many devices, including the quickly growing mobile device market, game consoles and non-plugable browsers (Safari anyone?).

Google’s AdSense tool has some drawbacks as well because JavaScript is device dependent - but over time that will become less of an issue as devices become more and more robust. Full integration of plugin enabled browsers on the phones seems much MUCH further away.

Michael Arrington pointed out on TechCrunch, that a share “With Everyone” option was needed. While we can certainly create accounts that have read access to our data and publish that information on our sites - it might be nice to get a 30,000 foot view of multiple sites without needing to authenticate to each and compare the numbers manually. I suggest a full Compete / Alexa type interface allowing users to explore not only a single site, but trends within a vertical, industry or even across industries is where the real data is.

Does the slow and steady decline of these three sites over the last few months indicate burn out on Facebook or is their user audience switching to MySpace centric blogs and news sources? I want to know and quite frankly, I don’t have a good way to find out.