Archive for the ‘Measuring Engagement’ Category

Segmentation by LTD & LifeCycle

Monday, August 2nd, 2010

The following is from the July 2010 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: One of the first things I am doing in my new job is to identify the Customer Lifecycle pattern – how many periods (month, year) will it be before a customer is likely buy again.  In enterprise software industry, where software cost easily 6 figures, # of years is a reasonable time frame.

A: Yes, one would assume this.  But these notions would most likely be based on a feeling of the “average” behavior, and on average, it probably does take a long time.

What is not known is this:  if the “average” is composed of short-cycle and long-cycle buyers, who are the short cycle buyers, and what are they like?  What industry SIC code, for example?  And can we get more of them, or at least focus more resources on them, if they are the most profitable?  So the challenge is not only to look for the “average”, but then understand how this average is composed.  If you can break down the average by industry, or by salesperson, for example, this might be highly directional information.

Q: From my internal analysis, however, I discerned from the sales figures something quite counterintuitive – the period between first and next sale is much shorter than I would have thought for the SW industry in general.

A: Pleasant surprise, eh?  I don’t know what kind of figures you are looking at, but make sure the data is in fact what you think it is.  For example, if you want to study software purchase itself, do the “sales” figures you are looking at include transactions involving not the sale of software, but also service, like installation or modification fees?  It would make sense that a “software sale” would be followed pretty quickly by an “installation” sale, for example.  You need to know this to properly segment.

Q: Would you be able to point me to some studies on how often customers wait after the first purchase before contemplating an upgrade of software or something you personally have done in consulting projects for SW companies?  This industry benchmark will then shed some light on whether this trend is something peculiar to our company or not…

A: I am not aware of any published study of this type.  And as you might imagine, these numbers would vary quite widely in the industry and the nature of the information would be a highly guarded corporate secret.  So I don’t think you will find any “benchmark” studies of this type, and sorry, I can’t share client data with you!

Q: The next step for me then is to map out the drivers for this behaviour and then calculate the LTV (LifeTime Value) and take a look at the actual LifeCycle events creating this LTV.

A: Yes, but to be precise, LTV is typically a forecast when working with current customers; it’s not known until the customer actually defects, marking end of  “Life”.  What you are probably looking for is more accurately called “Life to Date” (LTD), the actual sales of a customer from start of relationship until present.

Also, when segmenting customers by LTD, of course look for temporal bias – a 10-year customer is likely to have higher LTD than a 2-year customer.  If there are enough customers, it might be a good idea to first segment by start year, then LTD.  This way you have cohorts of customers who are going through the same experiences together and differences in LTD will be more significant in terms of predictive power – you don’t have to hunt around for external bias (e.g. competitive changes) that might affect LTD.

Think about what I said above about breaking the “average” down into different groups, because this will likely provide the Eureaka! moment and turn the data you are looking at into information.  For example, if you find the LTD of the “average customer”, this is very interesting information indeed, but not highly actionable – what “action” do you take knowing this information?  Can you point to or predict which customers are “average”?

However, if you were to find out the LTD differed dramatically by industry, by salesperson, by country, by time of year, by type of software module installed first – this is highly actionable information, because it provides very direct instruction on where the most profitable areas of business are.

If you lack thoughts in this area, try segmenting by variables that directly affect the experience of becoming a new customer.  At least one of these is most always predictive of LTD, when directly tied to the acquisition of a new customer:

1.  Campaign media (e.g. trade show versus magazine, online versus offline)

2.  Campaign content / offer

3.  Salesperson / Service teams

4.  Product or Category of first purchase

5.  SIC code / Industry (proxy for Product suitability to customer needs)

For example, if you find LTD differs by salesperson, you will find salespeople who create high LTD customers and salespeople who create low LTD customers; the company should study how each salesperson sells and teach the others based on results.

Or perhaps likelihood to purchase again is determined by which customer interface team installed the software – one team does such a good job the customer re-orders the next module very quickly, as compared with other teams.

Knowledge of this type would be extremely valuable to the company – you can use LTD to discover “best practices” hidden within the “average” data, and by spreading those best practices throughout the company, create enormous benefit and increase in profitability.

The secret to creating meaningful customer analysis that delivers high impact is this: always think about what you would **do** with the information you uncover.  If you can’t **do something** with the numbers you evolve, you probably need to drill down a little further and uncover the true meaning of the underlying data.

Hope this helps.  My personal guess based on what I know about behavior would be this: the type of software installed first and the sales / installation / after the sale care team are the two most likely variables predicting speed to next purchase, followed by the industry the buyer comes from.

This is a very interesting project; please keep me informed of your progress and I will help you in any way I can.

Jim

LTV, RFM, LifeCycles – the Framework

Friday, June 18th, 2010

The following is from the May 2010 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment and I’ll reply.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: I visited your website because I am trying to understand how to develop a customer LifeTime Value model for the company that I work at.  The reason is we are looking at LTV as a way to standardize the ROI measurement of different customer programs.

Not all of these programs are Marketing, some are Service, and some could be considered “Operations”.  But they all touch the customer, so we were thinking changes in customer value might be a common way to measure and compare the success of these programs.

A: Absolutely!  I just answered a question very much like this the other day, it’s great that people are becoming interested in customer value as the cross-enterprise common denominator for understanding success in any customer program!

If I am the CEO, I control dollars I can invest.  How do I decide where budget is best invested if every silo uses different metrics to prove success?  And even worse, different metrics for success within the same silo?

By establishing changes in customer value as the platform for all customer-related programs to be measured against, everyone is on an equal footing and can “fight” fairly for their share of the budget (or testing?) pie.  By using controlled testing, customers can be exposed to different treatments and lift in value can be compared on an apples to apples basis – even if you are comparing the effect of a Marketing Campaign to changes in the Service Center.

(more…)

Acting on Buyer Engagement

Thursday, January 21st, 2010

Over the years I’ve argued that there is a single, easy to track metric for buyer engagement – Recency.  Though you can develop really complex models for purchase likelihood, just knowing “weeks since last purchase” gets you a long way to understanding how to optimize Marketing and Service programs for profit.

Which brings me to the latest Marketing Science article I have reviewed for the Web Analytics Association, Dynamic Customer Management and the Value of One-to-One Marketing, where the researchers find “customized promotions yield large increases in revenue and profits relative to uniform promotion policies”.  And what variable is most effective when customizing promotions?

The researchers took 56 weeks of purchase behavior from an online store, and used the first 50 weeks to construct a predictive model of purchase behavior.   Inputs to the model included Price, presence of Banner Ads, 3 types of promotions, order sizes, number of orders, merchandise category, demographics, and weeks since last purchase (Recency).

The last 6 weeks of data were used to test the predictive power of the model, and the answer to which variable is most predictive of purchase is displayed in the chart below, click to enlarge:

Weeks since last purchase dominated the predictive power of the model, controlling not only the Natural purchase rate (labeled Baseline in chart above, people who received no promotions) but the response to all three different types of promotion.

(more…)

Relational vs. Transactional

Friday, October 2nd, 2009

The following is from the September 2009 Drilling Down Newsletter (original title:  Customer Retention for Restaurants).  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment.

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q:  I am hoping you can help answer a question for our team.  By way of introduction, I am the CEO of XXXX.  We are a specialty retailer / restaurant of gourmet pizza, salads and sandwiches.  We would like to know  restaurant industry averages (pizza industry if possible) for customer retention – What percentage of customers that have ordered once from a particular restaurant order from them a second time?  I am hoping with your years of expertise and harnessing data you may be able to assist us with this question.  Look forward to hearing from you.

A:  Unfortunately, in those said years of experience, I have found little hard information on customer retention rates in QSR and restaurants in general (if anyone has data, please leave in Comments).  It’s just the nature of the business that little hard data, if collected, is stored in such a way that one can aggregate at the customer level.  The high percentage of cash transactions doesn’t help matters much; there’s a lot of data missing.

Over the years, sometimes you see data leak out for tests of loyalty programs, and of course clients sometimes have anecdotal or survey data, but this is not much help in getting to a “true” retention rate.  More often than not you discover serious biases in the way the data was collected so at best, you have a biased view of a narrow segment.  Often what you get is a notion of retention among best customers, or customers willing to sign up for a loyalty card, but not all customers.  And the large “middle” group of customers is where all the Marketing leverage is.

What to do about this predicament?  

There are really two issues in your question; the idea of using industry benchmarks when analyzing customer performance, and the measurement of retention in restaurants.

(more…)

RFM versus LifeCycle Grids

Friday, August 28th, 2009

The following is from the August 2009 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment. 

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q:  First of all, thank you for the excellent book!  I’m really excited about digging into our own customer data to see what we’ll learn.

A:  Thank you for the kind words!

Q:  However, when you’re creating the RF Scores, what is the standard timeframe you should use?  I have access to about 5 years worth of purchase data – should I create RF scores based on the last 5 years, 3 years, 2 years, 6 months?

Our sales are quite cyclical, so I think the baseline should probably be at least a year, and I’m considering doing two years.  It seems as though if I get too much larger than that, my results will be too watered down. 

I’m also planning on generating “historical” RF scores by filtering my data to reflect the purchases only up to a certain point.  So, to generate a Q1-09 score, I’d create it from sales data of Q1-07 through Q1-09.  The Q2-09 score would be from Q2-07 through Q2-09, etc.  Does this make sense?  It will allow us to see the changes that have been happening in our company even though we’re only just now looking at the data.  It will give me a picture of what it would have looked like, had I looked at it back then.

A:  I think you have accurately understood the situation and have the right approach!  This type of analysis is very sensitive to time frame.

There are really 2 broad types of customer analysis.  There is analysis for action in the present, a Tactical approach driving towards a “we should do this now” result, and the more Strategic analysis, which is informational and says “this is what we should have done then” and / or “this is why we should make these business changes”.  The shorter time frame is Tactical, the longer timeframe Strategic.

(more…)

Adoption and Abandonment

Friday, August 7th, 2009

Out of the Wharton School we have a nice piece of behavioral research on the effect speed of Adoption has on longer-term commitment.  The article, The Long-term Downside of Overnight Success, describes research finding “the adoption velocity has a negative effect on the cumulative number of adopters”. 

This research dovetails nicely with a lot of the topics discussed here on the blog lately, so I thought I’d use it (with a nod to Godin’s post on Strategy vs. Tactics today) to provide some fodder for thought.

First, the importance of Psychology in Marketing.  So many of the “discoveries” arrived at through  brute force testing of Online Advertising are already well known in the greater discipline of Marketing through Psychology.  For more on this read “The Other 3P’s” and if you’d like to do something about lack of knowledge in this area, make sure to read this comment on source books.

Second, this research is a great example of isolating the true drivers of behavior.  The idea of looking at baby names to isolate the real behavior from “technology and other commercial effects” while including “symbolic meaning about identity” results in a broad, Strategic-level answer to the question, not a Tactical one. 

Why is this important?  It means the results can be applied across a host of different Marketing situations, rather than only a specific one. 

(more…)

Lead Scoring and Nurturing

Friday, July 3rd, 2009

The following Q & A is from the June 2009 Drilling Down Newsletter.

Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, Feel free to leave a comment.  Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q: I received this article (Norms of Reciprocity, measuring value of Social Marketing) via a friend’s Twitter account.  Very interesting.

A:  Glad you enjoyed it!

Q:  It has made open up my ACT! database, and my Outlook databases and add the metric of Growing / Strong / Weakening / Failed to my normal Sales and Business progress metrics.  If I group those categories and correlate to traditional metrics, it’s impressive how they reflect each other.

A:  Yes, most people are surprised.  It’s a very, very simple idea that seems to work across just about any human activity including crime, attendance, and so forth.  

The more Recently someone has done something, the more likely they are to do it again.  Conversely, the longer since an activity last took place, the less likely the person will do it again.  Often called Recency in Psychology and studied quite a bit.

Q:  Now I have to think about how I really use and apply this. : )

A:  Well, if I can guess you are in Sales from your title, typically one of the best applications is in what Strategic Marketing folks might call “allocation of resources”, which probably translates into “lead nurturing” for you.

(more…)

Norms of Reciprocity

Friday, June 26th, 2009

Social Marketing Doesn’t Rely on Social Media

Do you believe human beings share certain fundamental traits that define “being human”?

If so, do you believe that human beings tend to behave in certain ways under certain circumstances?

If so, do you then believe since human behavior has these tendencies, it can often be predicted?

If so, then do you think perhaps the study of Psychology and Sociology might provide you some clues to creating successful businesses, campaigns, products, and services?  While your friends and competitors are all iterating their way into oblivion?

On the web, time and time again, we see the same themes repeating.  Yet with each introduction of a new technology, these themes tend to be treated like a new discovery, even though the theme has been well established in the past.

Norms of Reciprocity is a constant human theme.  You may know the expression of these norms as ”Sharing”.  Web old timers will probably recognize this idea as “Give, then Take” from the I-Sales discussion list as early as 1995.  In various forms, this theme goes back to the beginning of human history, all the way back to the handshake and other greeting gestures.  This same theme is embedded in countless Religions all over the world: “Do onto others as you would wish them do onto you”.  At least a couple centuries old, this idea.

Norms of Reciprocity simply means this: When you do something nice for a human being, help them in some way, this human tends to feel Gratitude towards ”the doer” and tends to do something nice back.  Gratitude drives the desire to Reciprocate, because it’s just what humans do, it’s normal, a “norm”.

Norms of Reciprocity.

(more…)

Hacking the RFM Model

Friday, May 29th, 2009

The following is from the May 2009 Drilling Down Newsletter.  Got a question about Customer Measurement, Management, Valuation, Retention, Loyalty, Defection?  Just ask your question.  Also, feel free to leave a comment. 

Want to see the answers to previous questions?  Here’s the blog archive; the pre-blog newsletter archives are here.

Q:  First of all thank you for your help.  I have some questions I would be pleased if you answer them for me.

A:  No problem!

Q:  1. RFM analysis – is it possible to use some other ranking technique rather than quintiles? Using quintiles for bigger databases will cause many tied values, isn’t it a problem?

A:  Sure, you can use it any way it works best for you.  There is no “magic” behind quintiles, you can use deciles or whatever works best. It’s the idea of ranking by Recency, Frequency, and Value that is the key concept in the model.

I’ve seen dozens and perhaps hundreds of variations on the core RFM model, depending on how you classify a “variation”.  One change that’s common is changing the scaling, as you mention above, to accommodate the size of the database.  Smaller databases use quartiles or even tertiles.  Larger databases, choose the ordered distribution that meets the need.

(more…)

Got Discount Proneness?

Friday, May 15th, 2009

Discount Proneness is what happens when you “teach” customers to expect discounts.  Over time, they won’t buy unless you send them a discount.  They wait for it, expect it.  Unraveling this behavior is a very painful process you do not want to experience.

The latest shiny object where Coupon Proneness comes into play is the “shopping cart recapture” program.  Mark my words, if it is not happening already, these programs are teaching customers to “Add to Cart” and then abandon it, waiting for an e-mail with a discount to “recapture” this sale – a sale that for many receiving the e-mail, would have taken place anyway. 

The best way to measure this effect is to use a Control Group.

When I hear people talking about programs like this (for example, in the Yahoo analytics group) what I hear is “the faster you send the e-mail, the higher the response rate you get”.

That, my friends, is pretty much a guarantee that a majority of the people receiving that e-mail would have bought anyway.  Hold out a random sample of the population and prove it to yourself.  There is a best, most profitable time to send such an e-mail, and that time will be revealed to you using a controlled test.  The correct timing is almost certainly not within 24 or even 48 hours.

That is, if you care about Profits over Sales, and trust me, somebody at your company does.  They just have not told you yet!

When you give away margin you do not have to give away on a sale, that is a cost.  Unless you are including that cost in your campaign analysis, you are not reflecting the true financial nature of the campaigns you are doing.  If you are an analyst, that’s a problem.

If you are using cart recapture campaigns, please do a controlled test sooner rather than later.  Because once your customers have Discount Proneness, it will be very painful to fix.

(more…)