Category Archives: Measuring Engagement

Online, the Web Site is the Ad

A list of the posts in this series on Brand Management is here.

OK, so hopefully we know the difference between a Brand in the classic sense and today’s notion of Branding. I’m going to resist going into the history of Brand Management here because I think many people in this medium simply don’t think the past has any lessons to offer, you know, “it’s different this time“. My experience has been that the channels and the tools may change, but the basic psychology driving human behavior is remarkably resistant to change.

So, instead of a long (and probably boring to most) review, let’s go ahead and just stipulate a couple of things from history to get started:

1. When mass media came on the scene, it was possible for the first time to market a product nationwide instead of market by market against the local offerings. The biggest problem you face doing this is the chatter about the local offering – it is made in town, by a local person, and all the local people use it. There is history – “my mother used it, her other used it”, etc. In other words, Word of Mouth. The mainstream concept of “Brand” was created to address this problem – namely, to create the impression of a premium product superior to the local one you could sell for a higher price than the local offering based on creating aspirational images of the product in people’s minds. “Housewives who really care about their families buy only the purest and most hygienic bathroom tissue”, etc. These aspirational images created Intent (or Interest and Desire, if you prefer the AIDA-S model).

2.Brands worked, perhaps largely because though the advertising might imply that “everybody who is anybody uses Brand X”, there was really no check or balance on this notion. People simply couldn’t communicate frictionlessly enough to handle any kind of “fact checking”, nor did they really want to  Sure, you could ask the neighbor over the fence how he liked his new Ford, but that was about it. Bathroom tissue? Not. Word of mouth was weak and very localized – unlike the mass media Brands concept. In fact, you might not even like the product, but if there were enough really cool ads running on TV about the Ford, your neighbor would be impressed you owned one, and that was enough for you!

So then what happened? We started to get “mass media word of mouth” through the web catching up with the mass media of the Brands, and now you’ve got a problem. There can be too many people counteracting the Brand message if it is not honest. Purely aspirational messages can be deflected or called on the carpet. Consumers can ask peers if “everybody” is using Glade plug-ins or not, and they can directly ascertain what their “risk” is to not provide a “fragrance greeting in every room” based on the experience of others (I’m not picking on Glade here, just an example). Consumers can mentally and somewhat empirically challenge the idea of whether having Glade plug-ins make life “better” in some way. They can even find out if the product is a fire hazard.

All this communication about products on the web fundamentally changes the original Brand model, doesn’t it? When you can do your own fact-checking on any ad or Brand statement in just a few seconds?

You can’t simply trot out aspirational messages anymore or make claims about superior quality without running the risk of getting into Brand trouble. In other words, the Advertising itself has been stripped of the “blind aspirational” role – and with this removal, so goes the Intent portion of the Advertising equation. The Aspirational stuff, and with it the generation of Intent (Interest, Desire), has moved to the web.

If people want to find out if the Brand promises are true, they go to the web. Hopefully, the company has something online that convinces people the Brand promise is true, and that is where Aspiration and Intent then kick in. After the web site experience. Intent leads to trial, and then the aspirational stuff is fed back to the web by consumers who have had a positive experience with the product. Then you have Brand.

Brand is now the experience, the trial, the usage, the service. Brand now requires a peer-confirmed aspirational message.

Without the aspirational role now handled by the web, mass advertising is left with the Awareness job – a job it actually does quite well, thank you. In fact, these ads can drive negative Intent, as the Awareness drives discovery of the underlying negative chatter. If you own a Ford and think it sucks, and everybody on the web says it sucks too, then it sucks. Doesn’t matter what the Brand adssay.

Some folks are taking advantage of this new mixed media model. For example, you can go on the web and tell people yourself how cool your new Ford Fusion is. Have you heard of the Ford Fusion? Seen the mass media ads that encourage you to go on the web and check out “user reviews” (Marketing / IT folks, can we find a better word than “user” for this context, please? How about Owner? Member?) This is mass media doing what mass media is good at – awareness -and the web doing what online is good at – Interaction, Intent, Brand. Each media taking on the task it is best at within an integrated campaign. Mass media generates Awareness through real “weight”, the web site generating Intent through positive Brand interaction. Intent leading to trial. Trial leading to Brand.

Now, let me take a moment to specify that “Brand interaction” at the web site is not playing some goofy game on the Brand’s web site where “exposure to the Brand name” is the end goal. That’s the Awareness thing again. That’s the Brand-ing folks again.”Exposure” is not the function of the web site in this model. Intent (Interest, Desire) is the function of the web site, the aspirational confirmations, the peer reviews, the decision to take a test drive.

There is also a less traditional but no less important Brand role the web site plays under this model, particularly in services  Mass media generates the Awareness, prospects go to web site, the web site sucks. Can’t find any mention of the content from the mass media on the home page, there is no scent. Can’t use the navigation to find any reference to the mass media campaign, and the on-site search can’t find the campaign either. No store locator. Can’t figure out how to open the high interest checking account or request more information. Visit Done, Brand = Bad.

If Intent is generated on the web site, the web site must be up for the job in more ways than one.

So, where does that leave our friend the Banner?  As I said,

I would stop trying to turn the banners themselves into “mass media”; stop worrying about awareness and intent and all that stuff based on the Banner alone. Set the Banners in underneath the mass media campaign as Bridge Media, a “reminder” media reflecting the mass campaign taking folks directly to where you want them to go on the web site or microsite.  And then look at your awareness and intent – not based on the Banners, but on the interaction of visitors with the banners and the web site as a package.  This would be a new media approach to the new media, as opposed to trying to force the old display model into new media.

In simple terms, for online, the web site is the ad, not the Display unit or even the Search unit. The Brand interaction and resulting “Brand Proof” happens at the web site. And that is where you should do your measurement, not on the transitional or Bridge Media leading to the web site.

OK, there’s your model. Let’s go back to our three media quotes that kicked this sequence off:

1. “The net is not a branding tool or a quick-reach vehicle, but when used in conjunction with other media, it helps to seal the deal with the consumer.” – Bill McOwen at MPG, the media buying unit of the mega-agency HAVAS, as reported in the Wall Street Journal (subscription may be required).

My take: Drive authentic Brand interaction and confirm aspirational messages – “seal the deal” – on the web site.

2. “I don’t think banner ads are a total waste of money, but they’re not very effective – Trond Riiber Knudsen, Senior Vice President of Strategic Marketing at Nokia, as reported in the McKinsey Quarterly.

My take: Forget trying to use Banners to generate awareness, unless you are talking about micro-segmentation of some kind, which, let’s face it, will be “not very effective”. If you’re going micro, use Search.

3. (bold emphasis mine) “Banner ads may provide a valuable function in fostering familiarity even if those that view them never click through to the source of the ads. The downside for advertisers is that any evaluation of the positive impressions that this familiarity creates, even one based on false premises, is enough to make those positive feelings vanish. This suggests that familiarity-based advertising may work best for impulse buys, where more detailed evaluations aren’t likely to occur.” – Journal of Consumer Research, as reported here.

My take: Forget using Banners to generate Awareness or Intent- it doesn’t really happen anyway.

So, is executing against this modelvery hard? I mean, other than the politics of which agency gets to “run” the campaign and which silo approves what creative and so forth. That’s a mess, but not strictly a Marketing problem, it’s an Organizational / Vendor issue. I would ask any agency folks in the middle of this to again,simply look at what is happening around you.

Can we be very far away from a time when the interactive agency makes a legitimate pitch to be in charge of the TV for these campaigns? After all, the web site is where the Brand action is. TV – just Awareness, youknow. No “Branding” really going on there. How about some of the direct agencies getting into the Brand game? After all, they understand persuasion, the behavioral linkages required between the media, and are for the most part media agnostic, generally choosing the most efficient way to get the job done. Are you direct folks up for some Brand work?

Stir in a little Google / DoubleClick, a little MSN / aQuantive, plus some Yahoo / Real Media, and I think you just might have the match needed to light this new media Advertising model on fire. When they (especially Google) start testing the true economic value of Display versus Search, and as the Display media moves more towards an auction model, the Brand measurement focus will shift to the web site itself, and away from the Bridge Media generating the visit. As a bonus, this united approach really gets rid of the whole “view-through” measurement problem since the metrics that matter are measured at the site – the “true origin” of the visit becomes much less important.

Agencies, get rid of the old media Display model in the new media. You’ve had a decade plus to make it work.

The web site experience is the Impression, folks. Let’s measure the value of the media based on the behavior of the audience, OK?

The next post in this series is here.

Measuring Engagement Series

This post is an index for the Measuring Engagement series.  The following posts were written sequentially but appear on the blog in reverse chronological order which makes a hell of a mess of trying to understand a somewhat complicated topic.  So instead, try reading them sequentially using this index:

Recency Defines Engagement

Jonesin’ for Some ROI

Recency Defines Engagement: Campaigns

Recency Defines Engagement: Visitors

Recency Defines Engagement: Customers

Book: Managing Customers as Investments

This material is about the Tactical measurement of Engagement and dis-Engagement.  If you’re interested in a Strategic framework for applying these measurements, see A Framework for Engagement.
 

Recency Defines Engagement: Customers

The Measuring Engagement series starts here.  For a clickable index of the 5 part Measuring Engagement series, look here.

The good thing about doing customer analysis as opposed to visitor analysis is that you don’t need a fancy-dancy web analytics set-up to do it.  Most folks will be able to take advantage of the following ideas using some simple queries on the customer database or an export to a spreadsheet.

Last time we addressed the topic of measuring Engagement – and attributing actual Value to it – we were looking at how to predict the effect of Content changes on Revenues using the Current Value / Potential Value visitor segmentation model.  This time, we tackle the same kind of modeling at the commerce customer (online or offline) level.

Recall that with visitors, we looked at a segmentation using under or over 50 visits for Current Value and Last Visit within 2 months or over 2 months to define Potential Value (Engagement).  With e-commerce customers, the value of a single action (purchase) is generally much greater than the value of the average visit, so it’s worth it to create a finer segmentation because the data is more actionable – and the profit potential much greater.

Here we have the entire customer base of an online retailer in the 4 square Current Value / Potential Value grid we have used previously for Campaigns and Visitors – click on the image to enlarge:

As you can see, the vertical Current Value axis is Frequency of Purchase, with finer divisions for lower Purchase Frequency.  This is because as you move up towards greater Frequency, customer behavior becomes more similar, and you don’t want to have “infinite” segments.  On the lower end, the response behavior is different enough between say, a 2x buyer and a 3x buyer, that the segmentation is useful because the different segments respond differently to the same promotion.  The horizontal Potential Value / Engagement axis is made up of Days since Last Purchase (Recency) blocks of 30 days each out to 120 day Recency where, as with Frequency, the behavior starts to become similar so it’s not worth looking at finer detail.

Of course, you can break the customer base into as many segments as you want on either axis, you just want them to be large enough to be worth taking action on.  Smaller customer base, probably fewer segments is better.  Larger customer base, more segments.  And you can certainly define your actions and divide your Quadrants in any way that makes sense to you – usually based on some kind of testing.  Consider this CV / PV customer map a “default” place to start.

The four colors represent the same Four Quadrants we have been working with throughout this series:

Q1 (Green) is the Rocket fuel customer set – highest Current Value and highest Potential Value – they are best customers (Current Value) who are also the most engaged (Potential Value).  Q2 (Yellow) are newer customers with Low Current Value but are still Engaged and so have high Potential Value; the Blue square within the Yellow region contains brand new customers – a very Recent first purchase.  Q3 (Orange) contains former, dis-Engaged Best customers.  Q4 (Violet) contains the dreck of the customer base – 1x or light buyers that never bought again.  These folks are often created by inappropriate or mis-targeted acquisition campaigns.

Why would you want to do this segmentation?  Well, asked another way, does it make any sense to you that the optimal communication and offer stream would be the same for each of these 4 segments?  Think about it.

Q1 folks love your company and are eager buyers, with high likelihood to purchase again.  Do you want to use a heavy discount approach with these folks, giving up margin you would likely capture anyway?  Instead, how about trying to enagage them across multiple product lines or inviting them to participate in feedback panels or other high engagement activities?  At least you know who you are talking to – as opposed to “random surveys” where you have absolutely no idea who you are getting feedback from.

The Q2 area (Yellow) contains up-and-coming best customers, brand new customers, and customer dreck headed for Q4.  You can tell which is which by just looking at the chart – up and comers are top right of Q2, new customers bottom right of Q2, pre-dreck on the left side of Q2 on the border of Q4.  Do you want to send all these groups the same communication stream and offers?  Really?  Is that approach “optimized”, from a marketing perspective?

The Q3 (Orange) folks are former best customers.  ‘Nuff said there.  This group requires special communications handling and depending on their Current Value, are worthy of further research.  This is where a lot of your service problems, over-promising on Brand, and unfulfilled customer expectations lie.  Again, since you know exactly who they are, a survey here might be helpful, don’t you think?

The Q4 (Violet) area needs to be turned inside out and viewed by campaign source, product purchased, and so forth.  Why are you creating dreck customers?  Are your offers too strong?  Your featured products creating negative experiences?  Your list sources not really what they claim to be?

I don’t really want to use the word Persona here to describe the differences between customers and the appropriate messages in these four Quadrants, but the idea is similar.  If you can empathize with the customer based on their demonstrated behavior, you are simply going to be a more effective marketer.  This is the edge of the “right message, to the right customer, at the right time” tactical approach.

Further, your response rate for a particular promotion to any one “cell” on this customer map is going to remain fairly consistent over time.  Why?  Because the population in that cell is replaced by customers with the same behavioral profile each month.

Here’s how it works.  If you think about it, there is a non-stop process of customer migration across the map from right to left through the columns each month.  If a customer makes a purchase, they immediately move back to the right-most column and may move up a row.  Then, customers start to move across to the left again each month.  This pattern is highly visual and represents the LifeCycle of the customer.

Your job as a marketer is to make sure customers don’t march too far to the left, losing Potential Value as they move.  You try to re-engage them with each promotion and if they respond, the customer jumps back to the right and possibly up a row – increasing both their Current and Potential Value.  The most profitable campaign for each customer is defined by which cell the customer resides in at the time the campaign is dropped.  So you can still do a “monthly” newsletter, for example, but to maximize profits, the content / offers for each customer would be defined by what cell the customer is in at the drop point.

While this might sound complex, the good news is that the customers in any cell as a group generally respond at the same level for the same offer every time.  So once you figure out what the optimal campaign is for a cell, it doesn’t really change much over time, unless you further sub-segment (example below).  As customers move through the cells, they are generally exposed to a lot of different campaigns (whatever is highest ROI for the cell) which maximizes the chance of response and reduces promotional burn-out.

For those of you with a programming eye on this, I think you can see how this campaign process could be easily automated because the cells are well defined numerically – if customer has 3 purchases and no purchase in past 2 months, send “Campaign X”, if customer has 3 purchases and no purchase in past 3 months send Campaign “Y”, etc.  This creates a automated stream of “right message, to the right customer, at the right time” communications that are tailored to the actual behavior of the customer.

So how do you act on this info?  Let’s say I have a group of customers who have just passed into Q3 from Q1 – these are best customers who are dis-Engaging.  I know exactly who and how many there are – they are under the column “91 – 120 days” in the Orange Q3 Quadrant.  There are 844 of them (97 + 312 + 435).  What am I going to say to them, based on what I know of their value and current behavior?  How much am I willing to invest to keep them Engaged?  That’s the “drive more sales” angle.

The “drive more profits” angle would be to create control groups and test your messaging to this segment as well as the one preceding it (10+ units, 60 – 91 Days) and the one after it (10+ Units, 121-150 Days) and find out where the highest ROI is.  This type of bevahioral targeting is the fundamental driving force behind the Discount Ladder profit optimization technique.

But that’s just the beginning of using this kind of segmentation.  Consider these ideas:

1.  When you kick off a large scale acquisition campaign, you are going to see the Blue square in Q2 “bulge” with all the new customers.  Then, if you run this chart every month, you will see this bulge “pass through” the chart like a rat through a snake.  Will the bulge head up towards Q1, meaning the campaign is creating Best customers?  Will the bulge move to the left towards Q4, meaning you created a lot of dreck customers?  Will the bulge “fork” and parts of it head to different Quadrants, depending on product of purchase or offer taken?

As a marketer or analyst, is it valuable to be able to predict the long-term results of a campaign before it is over?

2.  You say, “Jim, that’s very cool and all, but the powers that be want all our segmentation by product affinity, you know, we customize communications and offers by the previous products purchased.  So we can’t really use this.”

Hmmm.  Let’s put aside whether this product-based segmentation decision makes any sense at all for the time being (the only sale you are willing to accept from the customer is for a specific product or category?), and take a look at how mapping the customer base using Current and Potential Value can help you put some facts behind these kinds of segmentation questions.

Let’s say for simplicity you have two product lines, hardware and software.  Further, let’s say your customer base is the one in the CV / PV model above, which I will show again below for clarity:

All Customers

OK, so let’s say you take this customer base, and run your product affinity segmentation.  Then you map each product segment by customer using the Current Value / Potential Value model, and this is what you get:

Software Segment

Hardware Segment

Note the label on the first map is “Software” and on the second in “Hardware”.  What do these customer maps tell you?

Well, you have about the same number of customers in each segment – 18,500 in Software and 17,534 in Hardware.  But you knew this.  Take a look at the totals along the bottom of the grid, representing the total number of customers in each Recency / Engagement column.  What do you see?

The Software segment has much higher Potential Value / Engagement than the Hardware segment.

If you look at the 61 – 90 day column, you see both the Software and Hardware segment have an equal number of customers.  But the Software segment is clearly much more Engaged than the Hardware segment, as evidenced by higher totals in the columns to the right of the 61-90 day column for Software than Hardware.  Conversely, in the columns to the left of the 61 – 90 day column, the totals for Hardware are higher than Software – these customers are less Engaged.

In other words, even though the gross customer numbers in these segments are close, the composition of the segments is quite different.  Software has a higher number of very engaged Best customers and potential up-and-comers (Q1 and Q2), where Hardware has a higher number of dis-Engaged Best customers and dreck customers (Q3 and Q4).  Further, you can say with certainty that relative to the Hardware segment, the average customer in the Software segment is going to create more value for the company in the Future.

This ought to tell you something about the way you optimize marketing to each segment, and the way you should market within each segment, not to mention something about the products and / or service satisfaction in each segment.

Just by looking at these maps, I can tell you several things:

1.  The response rate for Software campaigns will be consistently higher, over and over, than the response rate to Hardware campaigns – pretty much regardless of what kind of offer you make, as long as the offers are similar.

2.  For the same dollar spent, the Software segment is driving your business, the Hardware segment is dragging it down.  You can either roll with that situation and reinforce it in your communications, or you can try to fix Hardware.  For example, when you choose to feature an item, all else equal, I’d feature Software, because it has the longest customer legs and drives higher repeat purchase.

3.  For the same dollar spent, I would focus more heavily on Software in new customer acquisition Campaigns because this segment generates better, higher value customers for the business.

Now, at this point, I hope something has occurred to you.  That’s right, you could do this same mapping using any customer segmentation scheme you think is meaningful and compare the value of the customer maps.  Compare the results of Campaigns using these customer maps.  Compare organic search versus paid search.  Compare Geography, if you think that is meaningful.  Compare average price points, order sizes, shipping choices, coupon usage, e-mail opens, whatever customer variable you want – and find out which variables drive the highest customer value.

Further, you can use this model across any kind of “action” you want to map – purchases, visits, downloads, blog posts, phone calls, whatever you want.  You can use it to compare customer value across channels, and start building the knowledge you will need to optimize the business in an omni-channel world.

My final point is somewhat abstract but I want you to consider this: What is the value to the business of having a customer value model you can use to:

1.  Objectively measure the value of content or products to a customer segment without inside-company bias

2.  Predict the value of a customer segment to the company in the Future

3.  Drive the allocation of content, design, or marketing spend towards highest ROI

4.  Provide consistent, repeatable campaign targeting results, so you can actually predict response and ROI

5.  Analyze any customer “action” variable, in any channel, across any segmentation scheme

6.  Present customer valuation concepts to Execs and fresh-faced MBA’s alike in a simple to understand format

The same basic model, over and over, to make highly actionable customer decisions with.

Do you think using this model might streamline the marketing decision making process, result in more accurate decisions being made, reduce campaign turn-around time, and result in higher profitability for your company?

As always, comments and questions on the above are appreciated.

The last post in the Measuring Engagement series is here.