“Missing” Social Media Value

October 12th, 2011
I have no doubt there is some value in social beyond what can be measured, as this has been the case for all marketing since it began ;)  The problem is this value is often situational, not too mention not properly measured using an incremental basis (as you point out).
For example,  to small local businesses who do no other form of advertising, there is a huge amount of relative value to using social media, versus no advertising at all.  Some advertising is much better than none, and since it’s free, the incremental value created by (properly) using social is huge.
On the other hand, I wonder why social analysis seems to forget that people have to be aware of you to “Like” you in the first place.  Further, it seems unlikely a person would “Like” a brand or product if they have not already experienced it, and are already a fan.  If this is not true, if people “Like” a company even thought they do not (paid to Like?), then the problems with social go way beyond analysis…
But if true, , the number of “Likes” doesn’t have as much to do with awareness as it does with size of customer base, and is much more aligned with tracking customer issues (retention, loyalty) than anything to do with awareness / acquisition.
Add the fact many companies are running lots of advertising designed to create awareness, and the incremental value of social as a “media” may be close to zero, or at least less than the cost to analyze the true value of it.
And this last, really, is the core of the issue.  It’s simply not possible to measure “all” the value created by any kind of marketing, and there are hugely diminishing returns as you try to capture the last bits.  I think it’s quite possible the optimism for “value beyond what can be measured” is less than the cost of measuring it *if* people keep looking in the awareness / acquisition field.
Folks who want to find this “missing” social value should start doing customer analysis, and look in the “retention / loyalty” area, where the whole idea of social is a natural, rather than a forced, fit.

Has to be There

I find it really interesting that whenever there is a discussion of measuring the value of social media, there’s such a bias towards believing there is value in social beyond what can be properly measured.  See the comments following this post by Avinash for a good example.  Speculation is fine, but the confidence being expressed that a new tool or method will uncover a treasure trove of social media value seems un-scientific (as in scientific method) at best.

I don’t doubt there is some value in social media beyond what can be measured, as this has been the case for all marketing since marketing measurement began.  These measurement problems are not new to social either:  Marketing value created is often situational, it depends on the business model and environment.  What works in one situation may not work in another.

For example:

To small local businesses who do no other form of advertising, there is a huge amount of relative value to using social media, versus no advertising at all.  Social advertising is much better than none, and since it’s free, the incremental value created by (properly) using social is huge.  It’s also really easy to measure the impact and true value, since the baseline control is “no advertising”.  Lift, or actual net marketing performance, can be pretty obvious in his case.

On the other hand, many companies are running lots of advertising designed to create awareness, and the incremental value of social as a “media” may be close to zero for these companies, or at least less than the cost to analyze the true value of it.  Possible explanation:  Social events such as “Likes” or comments are simply representations or affirmations of awareness already created by other media, so by themselves, create little value.  In other words, events such as Likes might track the value of other media spending, but may not create much additional marketing value.

Why is this plausible?  It seems unlikely a person would “Like” a brand or product if they have not already experienced it, and are already a fan.  This means in the vast majority of cases, little incremental awareness / acquisition is created.  If this case is not true, if people “Like” a company even though they have no reason to (paid to Like?), then the problems with social marketing analysis go way beyond tools – the concept and data driving the analysis itself is flawed.

But if Like really means Like, the number of Likes or any other similar social events do not have as much to do with awareness as they do with the size of a loyal customer base, and are much more aligned with tracking the success of other awareness / acquisition campaigns.

Looking for Love in All the Wrong Places?

That all said, I believe there is some value being created in the acquisition / awareness area from social.  The problem seems to be this value, when measured, is quite a bit less than everyone expects.  So “the hunt for social value” seems never ending, with speculation and measurements contrived from thin air immensely  popular.  This missing value just has to be there, right?

The core problem is an old one: online value measurement definitions are all over the map, so it’s easy to claim value was created by simply inventing a new way to measure success.  I can’t wait for the day when established test and measurement standards (like using control groups) are adopted in the online space.

Meanwhile, I think it’s quite possible if people keep looking in the awareness / acquisition area, the value of social “beyond what can now be measured”, in many cases, is probably less than the cost of actually measuring it.

Alternatively, folks who honestly (read: using the  scientific method) want to find this “missing” social value should start doing customer analysis, and look in the retention / loyalty area, where the whole idea of social is a natural, rather than a forced, fit.  Customers being people (as opposed to events) who generate recurring value.

Why this approach?  Based on my experience, People are Social, Media are not.  So if you want to derive social value, you use people metrics, not media metrics.

Using this approach, I have unbridled optimism for the value of social.

But I won’t go as far as insisting value is there without measuring it properly first.  Because that’s not how science works.

See ya at eMetrics NYC!

P.S.  There’s lots of real experimental science out there on the effects of social media in the marketing space, have you reviewed it?

You will find this material to be a treasure trove of new ideas and proper methods worth pursuing in the social measurement space, examples here, here, here, here.  Get yourself a subscription to Marketing Science or if you are a WAA member, you can request copies of these fully documented social measurement experiments.

Defining Behavioral Segments

May 5th, 2011

The following is from the April 2011 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: I purchased your book and have a few questions you can hopefully help me out with.

A: Thanks for that, and sure!

Q: We have 4 product lines and 2 of them are seasonal. i.e we have customers that year in year out purchase these items consistently but seasonally, for example, every spring and summer.  Then they are dormant for Fall and Winter.  Should I include these customers along with everyone else when doing an RFM segmentation?

A: Well, it kind of depends what you will using the RF(M) model for, what kinds of marketing programs will be activated by using the scores. If you know you have seasonal customers and their habit is to buy each year, AND you wish to aim retention or reactivation programs at them, I would be tempted to divide the customer base so that seasonal customers are their own segment.  Then run two RF(M)  models – one for the seasonals, and one for everyone else.

Q: If I include seasonal customers, and I run RFM say on a monthly basis, these seasonal customers will climb / fall drastically with time depending on the season, so it seems like it may complicate the scoring process.

A: Sure, and you could segment as I said above.  Or, you could run across a longer time frame, say across 2 – 3 years worth of data. This would “normalize” the two segments into one and take account of the seasonality in the scoring – perhaps be more representative of the business model.  However, the scores would become less sensitive due to the long time frame so the actions of customers less accurately predicted by the model.

Q: Can you provide me with some examples as to how segmentation is carried out?  Let’s say I being with RFM and all my customers are rated 5-5, 5-4, 4-5 etc.  What are the next steps, do we overlay with other characteristics like age, gender, etc?  Or are the 5-3 etc. our actual segments?

A: This goes back to what you want to use the RF(M) model for.  In the standard usage, each score will have roughly the same number of customers in it, those with higher scores will be more likely to respond to marketing and purchase, lower scores less likely.

Read the rest of this entry »

Increase Profit Using Customer State

April 5th, 2011

The following is from the March 2011 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: We’ve been playing around with Recency / Frequency scoring in our customer email campaigns as described in your book.  To start, we’re targeting best customers who have stopped interacting with us.  I have just completed a piece of analysis that shows after one of these targeted emails:

1. Purchasers increased 22.9%
2. Transactions increased 69%
3. Revenue increased 71%

A: There you go!

Q: My concern is that what I am seeing is merely a seasonal effect – our revenue peaks in July and August.  So what I should have done is use a control group as you described in the book – which is what I am doing for the October Email.

A: Yep, that’s exactly what control groups are for – to strain out the noise of seasonality, other promotions, etc.  But don’t beat yourself up over it, nothing wrong with poking around and trying to figure out where the levers are first.

Q: Two questions:

1.  What statistical test do I use to demonstrate that the observed changes are not down to chance

2.  How big should my control group be – typically our cohort is 500-800 individuals

A: Good questions…

Read the rest of this entry »

All Talk, No #Measure

March 11th, 2011

Hypocrisy in Web Analytics?

Before every eMetrics (I’ll be in San Fran teaching Basecamp, at the Gala, etc.), I try to ask myself, what is the most critical issue facing the web analyst community right now?  Then, at the show, I ask everyone I run into what they think about this issue.

There’s lots of issues to choose from.  Career path I think is a big area of discussion, given the mergers in the space and trend towards outsourcing.  Then there’s the “we don’t get no respect” thing; senior management doesn’t seem to listen / understand / act on the information provided.  And one of my favorites from the past is still out there, data torture - people being pressured to manipulate data to reach a predetermined analytical outcome.

But seems to me, more important at this juncture is trying to resolve why there is so much written about the importance of “the customer” but very little measurement at the customer level.  Think about it.  Customer experience, customer centricity, the entire social thing, it’s all about customers.

But when folks wants to trot out “proof” that this or that approach is the road to the promised land, they analyze impressions, visits, clicks, etc.  Visitor-level stuff.  Does that seem like the correct approach to you?  Seems to me, if you want to provide knowledge about customers, you should measure customers.

Read the rest of this entry »

But What is an Impression Worth?

March 8th, 2011

Seems like coming up with a value for social media has become a cottage industry, for example, $3.60 Facebook Fan Valuation Is Just the Tip of the Iceberg.  These values are often derived from what is paid for online media.  So you have to ask, if someone is basing the value of a Facebook fan on the value of impressions generated, what is the real value of those impressions?  Because unless this is known, the whole framework is faulty.

Just because you pay $5 / CPM for impressions, does not mean they are worth $5 / CPM, does it?  Do people really still have that kind of mentality?  Is the price of the media equivalent to its value?

For example, I’m sure you have heard of multi-million dollar campaigns that generate very little lift in sales.  Happens frequently in fast food, for example.  What is the value of that media?  Is it the millions paid?

What really blows my mind about this approach is it’s so offline, so old school PR. Do the folks who put forth these kinds of models believe nothing has changed in 50 years?  What happened to the whole rap of online being “different”, that you can’t measure it like offline, blah blah.

Except when it’s convenient to do so?

If you want to know the value of a Facebook fan, why not measure the value of a Facebook fan?  Because it’s hard, and would require organizational discipline?  Too bad.   Substituting the kind of models used in the example above for actually measuring the value of a Facebook fan is misleading at the very best.

Read the rest of this entry »

Optimizing for Customer Value

February 28th, 2011

The following is from the February 2011 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: Thank you for creating this useful website!

A: You’re welcome!

Q: When figuring out retention rate for an annual or a 8 months life time cycle period, how do I pick the starting period?  Do I look at their first orders on a date?  Or I pick a time frame such as one month?

A: It depends on:

1. What kind of “retention” you are talking about, the definition, which is probably impacted by the audience for the data

2.  What you will do with the retention data, what kind of decisions will be made and actions be taken because of the data

You should always ask these questions above  when someone requests “retention data” – or any other kind of analysis, for that matter!  For example, there probably is a huge difference in what you would provide to the Board of Directors for an annual benchmark and what you would provide to Marketing people for executing campaigns.

Read the rest of this entry »

When Does a Visitor Need a Coupon?

December 17th, 2010

The following is from the November 2010 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: First off, I very much appreciate you sharing all this wonderful content on your blog and conferences such as eMetrics.

A: Thanks for that!

Q: My question is a simple one, but I think the answer may be hard: When does a visitor “need” a coupon?  *Need* defined as: visitor would not have placed an order unless presented with the coupon.

A: Hmmm…methinks we’re going to have to define a few concepts and be clear on the goals to make sure we are nailing this down… visitor versus customer, sales versus profit, etc.  In other words, answer is not hard, but could be complex without defining context.

Q: It’s still a mystery to me why so many retailers seem more than willing to hand over all their margins to Groupon or give coupons to basically all visitors.  I am curious whether you would approach this question using  observational data (eg web analytics) or experiments (eg AB testing), or both.

A: Right – is a mystery to me too!

There are certain situations where this approach might be appropriate, but the problem with much web “marketing” (which often is really just advertising without much thought about marketing) is often there is success in a narrow or special situation.  Then the pundits jump on and say “if you’re not doing this you are stupid”, regardless of the business situation and / or without recognizing the special circumstances that are driving success.  This is all the real Marketing stuff people leave out; understanding why it works, under what circumstances, for which segments, involving which products.

Read the rest of this entry »

Freemium Customer Conversion

November 9th, 2010

The following is from the October 2010 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: I was wondering if you’ve done any work with, or given thought to, companies who have a cloud based Freemium business model?

Should they be tracking usage (or anything) at the free level?  Should they be tracking usage at the paid level?  I’m sure defection rates are a big problem, but I’m wondering how many focus on engagement thru mass marketing versus trying to keep what they’ve got, or influence the free users to make the leap to paid.  Any thoughts on this?  Maybe you could do a blog post on it.  It seems like a good fit with your brand of analysis but I’m just starting to think it through…

A: I just finished an analysis that’s a good example of this problem.  Behavior during the Freemium period can predict who is highly likely to become a paying customer, who will need marketing efforts like additional sampling / package discounts, and who will not become a customer no matter what you do.

Read the rest of this entry »

Segmentation by LTD & LifeCycle

August 2nd, 2010

The following is from the July 2010 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: One of the first things I am doing in my new job is to identify the Customer Lifecycle pattern – how many periods (month, year) will it be before a customer is likely buy again.  In enterprise software industry, where software cost easily 6 figures, # of years is a reasonable time frame.

A: Yes, one would assume this.  But these notions would most likely be based on a feeling of the “average” behavior, and on average, it probably does take a long time.

What is not known is this:  if the “average” is composed of short-cycle and long-cycle buyers, who are the short cycle buyers, and what are they like?  What industry SIC code, for example?  And can we get more of them, or at least focus more resources on them, if they are the most profitable?  So the challenge is not only to look for the “average”, but then understand how this average is composed.  If you can break down the average by industry, or by salesperson, for example, this might be highly directional information.

Q: From my internal analysis, however, I discerned from the sales figures something quite counterintuitive – the period between first and next sale is much shorter than I would have thought for the SW industry in general.

Read the rest of this entry »

LTV, RFM, LifeCycles – the Framework

June 18th, 2010

The following is from the May 2010 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: I visited your website because I am trying to understand how to develop a customer LifeTime Value model for the company that I work at.  The reason is we are looking at LTV as a way to standardize the ROI measurement of different customer programs.

Not all of these programs are Marketing, some are Service, and some could be considered “Operations”.  But they all touch the customer, so we were thinking changes in customer value might be a common way to measure and compare the success of these programs.

A: Absolutely!  I just answered a question very much like this the other day, it’s great that people are becoming interested in customer value as the cross-enterprise common denominator for understanding success in any customer program!

If I am the CEO, I control dollars I can invest.  How do I decide where budget is best invested if every silo uses different metrics to prove success?  And even worse, different metrics for success within the same silo?

By establishing changes in customer value as the platform for all customer-related programs to be measured against, everyone is on an equal footing and can “fight” fairly for their share of the budget (or testing?) pie.  By using controlled testing, customers can be exposed to different treatments and lift in value can be compared on an apples to apples basis – even if you are comparing the effect of a Marketing Campaign to changes in the Service Center.

Read the rest of this entry »