E-Metrics (Business Metrics For The New Economy)
E-Metrics (Business Metrics For The New Economy)
E-Metrics (Business Metrics For The New Economy)
E-Metrics
http://www.netgen.com/emetrics/
NetGenesis Corp. 150 CambridgePark Drive Cambridge, MA 02140-2322 Tel: 617.665.9200 Fax 617.665.9299 www.netgen.com Copyright 2000, NetGenesis Corp.
http://www.netgen.com/emetrics/
Target Marketing 211 East Victoria, Suite E Santa Barbara, CA 93101 Tel: 805.965.3184 Fax 805.965.8687 www.targeting.com
E-Metrics
E-Metrics
Executive Summary
http://www.netgen.com/emetrics/
Table of Contents
Section 1: Introduction......................................................................1
Background Major Research Findings Enter E-Metrics We Dedicate This Report to You 1 2 2 3
http://www.netgen.com/emetrics/
E-Metrics
Section 8: Best Customer Metrics.....................................................36
Recency Frequency Monetary Value Duration Yield 36 37 38 38 39
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor.................................................................51
Personalization Index Life Time Value Loyalty Value Freshness Factor 51 52 53 56
61 61 61 61
http://www.netgen.com/emetrics/
Section 1: Introduction
Traditional management adage: You cannot manage what you do not measure. E-Business addendum: You cannot measure what you do not define. Defining specific metrics for measuring the success of a Web site is a daunting task. The inability to identify proper criteria and meaningful calculations is hampering the e-business worlds capacity to determine the value of corporate Web sites and to set appropriate budgets for their development.
Background
Senior executives in todays cutting-edge e-businesses face intimidating new challenges as the Internet community races headlong into the new millennium. These executives have labored to build highly dynamic, heavily personalized, customercentric e-commerce destinations that are a far cry from the static brochure-ware Web sites of 1996. Todays top sites strive to establish true one-to-one relationships with customers, often generating unique site experiences for each and every user. As the Web makes good on the oft-repeated promise of providing a fundamentally new customer communications channel and as e-business managers travel further into the realm of the unexplored both day-to-day tactical execution and long-term strategic vision become more challenging and more critical. However, e-business managers lack many of the core tools and techniques for successful management. What types of customers are driving profitability? Which Web technology investments yield the greatest return on investment? How can we best respond to new and potential competitive threats? In bricks-and-mortar businesses, senior managers have a significant arsenal of fundamental metrics that reveal major trends, key opportunities, and hidden hazards. These executives can manage by the numbers to confidently plot strategy and navigate through unfamiliar and volatile business conditions. Unfortunately, e-business executives faced with more unfamiliar and volatile business terrain while embracing new techniques like one-to-one personalization and viral marketing have comparatively vague measures on which to base their decisions.
http://www.netgen.com/emetrics/
E-Metrics
Section 1: Introduction
Enter E-Metrics
The business community knows how to measure income and profits and the proverbial bottom line, but is still struggling with what we call e-metricsmetrics for measuring Web site success. As an industry we have identified a variety of measurements that give us specific counts of particular elements, but these alone do not add up to a clear and comprehensive picture of success. The time has come to quantify aggressively what is and is not working in the Internet economy.
http://www.netgen.com/emetrics/
Section 1: Introduction
In working with clients on a day-to-day basis, we have encountered a great deal of frustration and promise about measuring the value of a companys Web efforts. From a desire to help Web-enabled companies quantify their progress, we interviewed 20 leading Web site managers. In the process of these interviews, their frustration crystallized into a cry for help. When asked the biggest problem facing her organization, one manager told us: A lot of e-commerce companies just really dont know how to measure their businesses right now. Nobody really knows because the industry is so new that there isnt a standard of how to really measure your success and how to gauge your growth in the future. Is it going to be by your volume of ordering? Is it going to be by your repeat customers? (Retail company) We also heard that the information that comes from the Web contains powerful business indicators. Another site manager told us: The corporate organizations that could sort of ignore the Web have now realized that its creeping a little too close to the heart of their business, so theyre getting much more involved in the process. (Technology company) The study and definition of e-metrics is a new subject that we are just beginning to explore. Many e-businesses have barely begun to develop new measures for understanding their performance and success. In fact, most Web sites are struggling with basic concepts like hits and page views and visits, let alone something as involved as loyalty or the shape of their lead qualification funnel. At the same time, every company is actively seeking out new innovations and approaches that create competitive advantage. Those organizations at the forefront of metrics development will consistently make better tactical and strategic decisions, and consequently out-innovate and out-manage the competition. If you are looking for that competitive edge, and want to learn about the techniques that will yield key insights into your e-business, read on.
http://www.netgen.com/emetrics/
E-Metrics
Since Ive got all these things I can measure, Im paralyzed by all the opportunities. (Service company) We created this document for those directly managing Web sites at large companies and other Web-enabled firms. These are the leaders in their fields who need the best Web intelligence possible: the men and women who are trying to measure now what the rest will be measuring in due time. These managers live and breathe the new concepts of click-throughs, page views, cookies, clickstreams, attrition, and abandonment.
http://www.netgen.com/emetrics/
n n n n n
Before we delve into these challenging new questions, well quickly recapitulate the traditional starting point.
http://www.netgen.com/emetrics/
E-Metrics
Generally accepted accounting principles operate through fundamental systems of managerial accounting to capture, record, analyze, and interpret a companys health. These appraisals serve as an organizations x-rays, ultrasounds, and EKGs to give management a clear, numeric model of a companys fitness. Without such metrics there would be no way to determine whether a company is larger or smaller, faster or slower, better or worse. At a more detailed level, these numbers allow one to spot anomalies by correlating revenues to cost of goods sold show if a companys sales trends are out of proportion to its earnings. Is a companys debt working for it or against it? How do its earnings per share stack up against the competition? Modern accounting practices have been standardized and carefully honed for hundreds of years. They are tried, true and trusted; they have become a way of business life. But business is changing. Navigating by landmarks alone was insufficient when man began plying the seven and a new vision of a round world was required and new tools were necessary to traverse the open ocean successfully. Those without the vision and the tools perished in their attempts. Decomposing sales and buyer data to gain a better understanding of the way visitors behave is even more important on the Internet than in the bricks-andmortar world. A Matter of Metrics: Using Web Data to Improve Sales Performance, http://knowledge.wharton.upenn.edu/ articles.cfm?catid=4&articleid=162
Suppliers
Back Office
Front Office
E-Business
Mfg, Eng, Finance
Supply Chain
ERP
6
SFA
Copyright 2000, NetGenesis Corp.
http://www.netgen.com/emetrics/
A store in Roundup, Montana can only cater to about 2,000 individual citizens and the handful of tourists passing through, while a Web site can be reached by literally hundreds of millions. A fork lift parts dealer in Barstow, California has a limited number of business customers to sell to. Yet that same dealers Web site can sell forklift parts across the country and around the world.
E-Customer Analytics
E-Commerce Platforms
Always Open used to be the exclusive property of coffee shops and laundromats. Now nearly every company can and must operate 24 x 7 x 365. Creating relationships with cooperative marketing partners used to require a vice president of business development. Now every Web site can have an affiliate program. Communicating long-distance with prospects, customers, and vendors used to require a significant commitment to odd hours to accommodate multiple time zones, an investment in long-distance phone services, and an ability to tolerate airline cuisine. Today, twenty dollars a month buys all the email you can send and receive. E-business is real-time business and the indicators of marketplace trends are recorded as they happen. A banner ad placed on a portal site generates click-through statistics within seconds. An improvement in the navigability of your Web site instantly changes shopping cart activity. A press release that used to take weeks to have a barely perceptible effect on your companys brand and bottom line now can impact your markets propensity to buy within hours. The reason so much attention has been focused on the Internet is not that it is the playground of a handful of esoteric dot-com companies. Rather, it is because it has become a platform for all business. Whether you sell semi-tractor-trailers or semiconductors, music CDs or mule feed, digital signatures or diaper services, there is a way to conduct business on the Internet that will provide a significant return on your investment through increased sales and decreased costs. Finding those sales and savings is a matter of common sense, experimentation, and paying close attention to the results you get in the process, in as close to real-time as possible.
http://www.netgen.com/emetrics/
E-Metrics
One diagram (Figure 3), excerpted from Peter Stevens 1998 CRM forum presentation (www.crm-forum.com/crm_forum_presentations/target/ppr.htm), succinctly illustrates a core difference between e-business and traditional business: timescale. Where traditional marketing managers are concerned about promotion cycles measured in months, e-marketing managers are more likely to perform this kind of analysis on a daily if not hourly basis.
Initial Test
AFTER QUESTION
Feedback
http://www.netgen.com/emetrics/
This broad transition to a customer economy is apparent even at an individual transaction level: if you have ever been asked for your mothers maiden name while using your credit card for a larger-than-usual purchase, you have been detected by software that sifts through thousands of records in tenths of seconds to determine if this purchase is too far outside your normal purchasing routine. Credit card companies also make use of sophisticated software to determine which customers are most likely to cancel their accounts. That information directly affects the routing of incoming phone calls to special representatives trained in the arts of customer retention. The software also selects and suggests the offer most likely to keep that particular customer. There is no doubt that the business world is shifting focus away from production, distribution, and increasing market share toward focusing on customers needs and gaining wallet share. With the Internet lowering the cost of switching from one vendor to another, and with the ability to customize the Web experience for each site user, this focussing on the customer becomes mission critical.
http://www.netgen.com/emetrics/
E-Metrics
Missing, however, is a fundamental understanding of how the measurable elements of e-commerce can be transformed into tangible, actionable online business intelligence. The need is glaring, since the information collected from Web sites is critical to the core business channel. Figure 4 shows that e-metrics are derived from the complex, heterogeneous e-business systems that characterize the one-to-one infrastructures of todays dynamic e-commerce destinations. Figure 4: Modern E-Business Software Infrastructure. Browser
Catalog Server
Collaboration Server
Media Server
Advertising Server
Commerce Server
Personalization Server
Operating System
10
http://www.netgen.com/emetrics/
I think that our [Web] marketing database will actually become the marketing database of the company. We wont be supporting we will be the keynote marketing database because more and more business will be on [the Web]. (Service company) This tidal wave is only a gently rolling surf at the moment. Dot-com companies grasp the value of squeezing every drop of understanding from the deluge of data they are collecting. Other firms large companies with only a toe in the water are just now learning the fundamentals of e-business operations. These larger enterprises are facing rough seas in terms of leveraging customer data due to their relative lack of domain expertise, monolithic legacy systems, and a reluctance to embrace the Web as a critical business tool. More people need to understand the basics of Web traffic. It needs to have as much importance as traditional accounting has in businesses. The Internet is important to a company, and this traffic should be as closely monitored as traditional accounting books. (Publishing company)
Research Methodology
We began our research with general, printed questionnaires handed out at trade shows and industry conferences. The response made it obvious that we had touched a nerve. People were keenly interested in learning the results of those surveys and were very eager to participate. The results confirmed that the majority of people running Web sites are frustrated that they do not have a better handle on what is happening on their sites. They are looking for answers. This led to a change of direction in our methodology. We abandoned the massmarket, quantitative approach and decided to go right to the top. We spoke with 20 senior managers at some of the worlds leading Web sites to find out what they are doing today, what they plan on doing tomorrow, and where they would like to be in the future. In selecting our research participants, we were careful to interview both well-known and up-and-coming e-businesses across multiple sectors including e-retail, business-to-business, financial services, and publishing.
http://www.netgen.com/emetrics/
11
E-Metrics
Survey Participants
These are the organizations at the front line that are creating the Web on a daily basis. The people responsible for these firms sites shared their experiences, perceptions, and Web acumen to help us get a closer look at the e-metrics they manage today and will manage in the future. We are very grateful for their participation. Table 1: Participating organizations. Company 365 Corporation plc Primary URL www.365.co.uk Description 365 is a leading multi-platform digital media company, offering content, community, and communication services to both consumers and small medium-sized businesses in a number of different languages. Since launching its online business in March 1997, barnesandnoble.com has become one of the worlds largest Web sites and the fourth largest e-commerce retailer, according to Media Metrix. Focused largely on the sale of books, music, software, magazines, prints, posters, and related products, the company has capitalized on the recognized brand value of the Barnes & Noble name to become the second largest, and one of the fastest growing, online distributors of books. BBC ONLINE is the British Broadcasting Corporation Web site with more than 200 sites and some quarter of a million individual pages. BBC ONLINE is a gateway to BBC news, information, sport, and education supplemented by relevant BBC audio and video material. The Charles Schwab Corporation, through its principal operating subsidiary, Charles Schwab & Co., Inc., is one of Americas largest financial services firms. As of January 2000, the company served 6.7 million active accounts with $718 billion in customer assets. Fidelity Investments is the nations largest mutual fund company and a leading provider of financial services. As of January 31, 2000, Fidelity had total managed assets of $929 billion. Foofoo.com is a privately-held company creating a new model for destination sites online, leveraging well-known brands and aggregating content, commerce, and advertising to create the leading site for upwardly mobile individuals.
www.bn.com
BBC ONLINE
www.bbc.co.uk
Charles Schwab
www.schwab.com
Fidelity Investments
www.fidelity.com
Foofoo.com
www.foofoo.com
12
http://www.netgen.com/emetrics/
Company Freeserve
Primary URL
Description
www.freeserve.co.uk Freeserve is the leading UK Internet service that delivers free Internet access and, as a portal to the Internet, an integrated offering of UK-focused content, e-commerce, and services. As of 2 January 2000, Freeserve had 1.675 million active registered accounts. www.gomez.com Gomez Advisors is a premier e-commerce portal provider supplying matchmaking services for B2C and B2B ecommerce. ivillage.com: The Womens Network is the leading womens network providing practical solutions and everyday support for women between the ages of 25 and 54. iXL helps businesses identify how the Internet can be used to their competitive advantage and uses its expertise in creative design and systems engineering to design, develop, and deploy advanced Internet applications and solutions. iXL Enterprises, Inc. has over 20 offices in five countries. MapInfo Corporation enables customers to use location to transform information into business advantage. A global company and technology leader, MapInfo provides business intelligence solutions that are deployed across organizations to help them better understand their markets and customers.
Gomez.com
ivillage
www.ivillage.com
iXL
www.ixl.com
MapInfo
www.mapinfo.com
MicroWarehouse
www.microwarehouse. MicroWarehouse, Inc. is a multi-billion dollar specialty com catalog, online retailer, and direct marketer of brand name personal computers, computer software, accessories, peripherals, and networking products to commercial, education, government, and consumer customers. www.msn.com Microsofts goal is to make MSN the most useful network of services on the Internet. In addition to integrating its own category-leading services into a comprehensive network, MSN is committed to working with leading content providers to give customers easy access to the information they are looking for. Combining real-world analog and state-of the-art digital technology, National Semiconductors chips lead many sectors of the personal computer, communications, and consumer markets. National Semiconductor reported sales of $2 billion for its last fiscal year and has 10,500 employees worldwide.
MSN/Microsoft
National Semiconductor
www.national.com
http://www.netgen.com/emetrics/
13
E-Metrics
Company OurHouse.com
Primary URL
Description
www.ourhouse.com OurHouse.com is the first online destination to provide quality, comprehensive home improvement products, services, and how-to information. Partnered with Ace Hardware, OurHouse.com offers consumers access to more than 30,000 products. www.pwcglobal.com PricewaterhouseCoopers is the worlds largest professional services organization. Drawing on the knowledge and skills of more than 150,000 people in 150 countries, PricewaterhouseCoopers helps its clients solve complex business problems and measurably enhance their ability to build value, manage risk, and improve performance in an Internet-enabled world. www.redherring.com Red Herring Communications is an integrated media company that provides strategic technology business information to the leaders of technology-driven businesses. Today, Red Herring Communications produces, distributes and broadcasts its unique blend of news, commentary and analysis online, in print, through events, and on television.
PriceWaterhouse Coopers
Red Herring
www,redrocket.com RedRocket.com is the toy store developed by Nickelodeon RedRocket/ Online. Nickelodeon Onlines mission is to bring together all Nickelodean Direct forms of broadcast and communication through the Internet to empower kids. Nickelodeon Online is a unit of Viacoms MTV Networks Online and is headquartered in New York. T.Shipley www.tshipley.com T.Shipley is a leading high-growth, e-commerce company marketing to the business professional. T.Shipley is the premier provider of executive gifts, fine business products and services, and personal accessories that make the business professional better, faster, and smarter. T.Shipley sells to both the business-to-business and business-toconsumer market through the Internet, print catalog, and in Skymall in-flight catalog.
Travelscape
www.travelscape.com Travelscape.com is the only major travel site developed by an experienced national wholesale tour and travel company. Travelscape.com is ranked as a top online travel provider by independent consumer advisory service BizRate.com.
14
http://www.netgen.com/emetrics/
Figure 5: Percentages of E-Businesses with Standard Definitions for Each of the Core Measurements.
21 21
= Today (100%)
(100%) means that every participant responded to the question, whereas (50%) means that only half of the participants responded
While the industry at large is struggling with a common vernacular to compare one companys Web site to another, most firms are having trouble trying to communicate internally. The seemingly harmless discussion of what is and is not a page view between two technically adept Web professionals can grow contentious as hairs get split. Does a page merely have to be requested or actually delivered? How do you account for frames? What about resources without a typical extension like .htm, .asp, or .cfm? The good news is that 74% of the organizations we talked with have an internal standard definition for a page view. Many e-business feel they have a good grasp on the basic concepts of hits, page views, and impressions. The bad news is that only half have a standard definition for visits or users.
http://www.netgen.com/emetrics/
15
E-Metrics
Why is this bad news? Because this analysis is about understanding customers, not page views or hits. Yet these are related, as illustrated in Figure 6:
User
Visit
Page View
Hit
n A customer (person) uses your Web site. He or she becomes a unique user. n Each time this user explores your site, you receive a visit from that user. Thus, a user may have many unique visits to your site over time. n Each visit by a user is composed of a series of pages that he or she reviews. Thus each visit is composed of a time-ordered series of page views, otherwise known as a clickstream or click path. Note that more frequently than many sites would like to admit a visit can involve only a single page view. n Each page on your site contains many constituent objects such as body text, images, and video files. Each of these results in a hit to your Web site, so each page view comprises many hits. Make sure that your business has standard internal definitions for hits, page views, ad impressions, visits, and users. Document these standards so that they can be referred to and updated as needed. At the lowest levels, you can only understand your customers by piecing together all of their hits, carefully extracting the page views, grouping the page views into individual visits, and attributing the appropriate visits to unique users. This presents significant challenges because calculating visits and users is significantly more subtle and complex than counting page views. As a result, a large company without a standard definition for visits or users is likely to be using many different techniques for arriving at these measures. When the results are brought together for comparative purposes, it becomes especially difficult to tell what is really going on. Are the differences reflective of actual customer behavior or are they due primarily to different measurement methods? For more detail on how a massive amount of raw hit data can be boiled down to a small handful of loyal customers, see Figure 8 on page 18.
16
http://www.netgen.com/emetrics/
50 40 30 20
47 40 37 32 27 27 20 13 16 10
10
5
While page views are the predominant primary measure today, e-marketing managers do not expect this to be the case in the future. Instead, visits, users, and revenue measures will dominate. In stark contrast to the thinking of only a few years ago, just one site considered hits to be a primary measure. In general, there was ready agreement that hits while of limited use for IT capacity planning are a poor yardstick of customer behavior. It is essential to remember that the number of hits a site receives has more to do with page design than human traffic. If we step back a moment from the survey results, a hierarchy of e-metrics begins to emerge from the dual considerations of data volume and business value: n Data Volume: E-business systems produce a staggering amount of raw transaction data, the vast majority of which is hit data. While of little intrinsic value for marketing analysis, hits act as the phytoplankton for the e-customer intelligence ecosystem. Hits are the bottom of the e-metrics food chain, forming a very broad foundation for higher-level, more complex metrics such as users or customers (and potentially households or companies). n Business Value: The storage of hits requires huge volumes of disk space and presents data management nightmares, but offers little in terms of readily actionable information. Not only are user and customer data easier to manage physically, they are substantially more actionable from a management perspective.
http://www.netgen.com/emetrics/
17
E-Metrics
As business value increases, the amount of data that must be managed diminishes dramatically. As you move up this value pyramid (Figure 8), you become increasingly focused on the activities of individual customers. However, the only way to arrive at these customers activities is to start by sifting through the initial raw data set.
Loyal Customers
4,000 Customers
Customer Data
Customers
40,000 Customers
Assume 10% Conversion
Business Value
Users
4000,000 Users
Visits
2,000,000 Visits
E-Business Data
Page Views
10M Page Views
Amount of Data
As noted above, hits are a poor measure of business performance because they reflect site design, thus failing to adequately reflect customer behavior. Hence, hits should not be used as a core metric for measuring success. At the end of the day, however, raw hit data is a necessary evil in a true one-to-one, customer-centered economy. Why? Because while intelligent sampling techniques can be used to predict that you have approximately 4,000 loyal customers, sampling by throwing out raw behavior data will not allow you to locate the unique identity of those crucial, loyal individuals. Knowing that some percentage of your 2,000,000 visits comes from loyal customers is little comfort if you are unable to engage each of those customers in a meaningful, personalized, interactive dialog.
18
http://www.netgen.com/emetrics/
70
60 57
67
67
Real Time
Hourly
Quarterly
Annually
For those who did have a handle on their future data reporting plans (only 32% responded), there is a dramatic shift towards hourly and even real-time reporting time frames. This is indicative of the instant response, lightning-fast mentality that pervades todays e-business operating landscape.
http://www.netgen.com/emetrics/
19
E-Metrics
Taking Action
The e-business managers with whom we spoke are certainly not strangers to taking action based on e-metrics (Figure 10). More than 70% said that they consistently alter their site design, while nearly as many modify their ad campaigns. This is not surprising, as site and ad changes are tactical in nature and can be made quickly. Fewer reported that they make more strategic changes in promotions, partnering, or product mix based on e-metrics results.
Percentage
80 70 60 50 40 30 20 10 0
Modify Site Design Change Ads Alter Promotion Strategy Change Product Mix Rethink Partner Strategy 41 72 67 56 56
The site changes that Web executives are ready to make revolve around serving specific content, advertising, and promotions to specific users based on everchanging user profiles. As peoples interests and behavioral profiles change, the Web site must keep pace or face losing its user audience. In time, our interviewees hope to see not just changes to their content, but more strategic corporate changes like dynamically altering their product merchandising mix as well.
20
http://www.netgen.com/emetrics/
31%
19%
19% 31%
Other
http://www.netgen.com/emetrics/
21
E-Metrics
Data Deluge
Every click leaves a record. Every page view makes its mark. All data entered by a user is recorded. While the result is a knowledge opportunity without equal, the practical result is an overwhelming amount of data (Figure 12). Most of our interviewees put it simply: The problem I have is I have too much data. (Technology company) Some were a bit more colorful: I think working with this volume data is a bit like being in a canoe in front of a tidal wave paddling like hell and just hoping it doesnt overrun you. (Publishing company)
1050 900 Database Size (GB) 600 450 300 150 Millions of Hits per Day 25 50 75 100 125 150 175 750
Others put it into terms that bring the reality into sharp focus: It takes all day to process 14 million filtered URLs. Its a million per hour that were hitting. So, by the time I get the data from 400 machines sewn together and filter out the gifs and the excludes and the impressions, it takes 14 hours to process. (Service company) At a recent industry conference, Netscape webmaster Ohmar Ahmad revealed that serving pages is nowhere near as processor intensive as analyzing server results. Ahmad noted that Netscape sequesters its largest machines for thrashing through the massive behavior data files it creates every day. None of the Web managers we spoke with expected to stem the tide of information influx. They simply lamented the lack of technical power to turn that data into information.
22
http://www.netgen.com/emetrics/
http://www.netgen.com/emetrics/
23
E-Metrics
There is strong desire to automate the integration of data from within the corporation, and the value from the customers perspective is plainly visible. Customers do not want to fill out the same form more than once. They do not want to be pigeonholed into a market segment. They are demanding to be treated as individuals and Web managers are anxious to comply. Well be smarter about targeting individual segments. I suspect were going to become more dynamically reactive by letting the machines, based on our data, make changes to [our site]. (Technology company) Creating specific content to what people do and not have a human do it is one of the biggest things were shooting for. (Retail company) The clearest message we heard from our interviews was that knowledge about their individual customers is central to corporate success: We need to know our customer better. Thats the name of the game. Anything and everything is pretty much useful, its just a matter of putting it in an order that makes sense and is usable as an e-retailer. (Retail company) Sales increases come from our growing ability to understand customer behavior online, make our products easier to find, and from tracking staffing requirements to save money in our call centers. (Retail company) There will be more integration between the measurements driving work-flow events, and distributing information and action items based on the measurements. Web site data will start to have more filters in it to trigger alarms. (Technology company)
24
http://www.netgen.com/emetrics/
100 90 80
88
94 88 81 82 82
.70
60 50 40 30 20 10 0
Capture More Data = 100% Produce More Reports Data Mining Distribute to More People Interactive Analysis Dynamically Alter Content
All of the reasearch participants understand what they can do with the information they haveonce they unlock it. It puts us closer to our users and if you know what your users want, youre better able to serve them. (Publishing company)
http://www.netgen.com/emetrics/
25
E-Metrics
Loyalty
tio n Ch urn At
n ete
ion
Reactivation
h ac Re
do
nm
en
The customer life cycle describes the points in the continuum where you: n n n n n Claim someones attention. Bring them into your sphere of influence. Turn them into a registered and/or paying customer. Keep them as a customer. Turn them into a company advocate.
26
http://www.netgen.com/emetrics/
Our research revealed that many sites track multiple components of the customer life cycle (see Figure 15).
Percentage
70
61 63
68 61 53 47 56 50 50 39 32 39 50 44
39
37
17 11 0 Reach = Now (100%) = Within 6 Months (100%) = Within 12 Months (100%) =No Explicit Plans 5 0 5 6 0 0 Abandonment 0 Attrition Recency 11 6 6 0 Frequency
Conversion
Retention
The lines between these various stages are drawn in different places at different companies and depend on the core business model deployed. Are you primarily selling products or services? Does a typical sale take 5 minutes or 5 months? Are you trying to convince users to purchase a mortgage or register for a personal home page? In a purely retail, B-to-C environment, the stages are typically much more clear-cut than in a B-to-B setting. For instance, determining when a new customer becomes a retained customer at The Gap is a relatively straightforward exercise. Considerably more ambiguity crops up in the B-to-B world where customer relationships are much more complex, contextual, and drawn out. The line between new customer and retained customer can get rather ill-defined for companies that sell jet aircraft.
Reach
In the world of advertising, reach refers to the potential to gain the attention of your target audience. Used as a standard in the television industry, reach is the number of people (or households) who have the opportunity to see your message given a programs total active viewership. For instance, 180 million people might tune in to the Superbowl on any given year, so the reach of your ad that aired during the first timeout in the third quarter would be 180 million people. Of course, as an advertiser you have no guarantee that 7 million people did not change the channel, or that 15 million did not head to the refrigerator.
http://www.netgen.com/emetrics/
27
E-Metrics
A different way to calculate reach is as a percentage of the total potential market. If you are trying to attract the attention of the 5 million buyers of 3-D rendering software tools for architects, you might place a banner ad on an architectural portal Web site. If that site draws one million distinct people a month who fit the description of a potential buyer, your reach on that site is 20 percent of the total universe of 5 million buyers. I dont have a hard number for how many [specific industry professionals] there are in the world. I have a guesstimate and we just tend to track unique visitors against that guesstimate on a monthly basis. (Technology company) Another aspect of reach is total site reach. Assume you decide to promote your software on the Expedia travel site. If Expedia attracts 25 million unique users per month and your ad was shown to 5 million unique users, then your reach to Expedia users was 20 percent for the month. Some companies do not measure their reach until the potential buyer has clicked on the banner. They do not consider that prospect as reached until the message has been delivered, read, and acted on. Others call this step acquisition.
Acquisition
In the reach stage, the goal is primarily one of awareness. Is your target market aware that you are selling toys, or marketplace research results or construction cranes or architectural software? This contrasts with acquisition, where the goal is customer participation. Did members of your target market, having seen and perhaps remembered your promotion, interact with your business in any form? Did they walk into your store? Call you on the telephone? Send you a fax? Email you? Visit your site? For most companies, acquisition has more to do with getting the prospect firmly into the top of the customer life cycle funnel (see page 45). Outside the funnel, prospects are suspects. They might fit the right market segmentation criteria, but it is unknown if they are ready, willing, or able to buy. Once a potential prospect takes an overt action expressing interest (e.g., signing up for a newsletter, taking a survey, joining a discussion list, filling out a form in return for a white paper, or downloading a demo), you have acquired a new prospect. But actually making the sale is still very much in question.
Conversion
Many companies look at conversion as the point at which a sale has been made and the prospect has been converted into a customer. However, in the online realm, conversion has a myriad of meanings depending on the goals of the particular site. An individual may be deemed converted at initial registration after setting up a personal profile, after participating in a chat forum or online discussion, or by using a product configurator to get a fix on product features and price ranges. We measure 16 types of conversion and 15 types of retention. (Portal company)
28
http://www.netgen.com/emetrics/
Tower Records equates conversion with a purchase. An article in the Industry Standard (March 6, 2000) reported that adding one new navigational feature made a significant impact on Towers conversion rate. People looking for artists or song titles do not always know the exact name so Tower implemented a search engine that finds related items, rather than only finding exact matches. Tower doubled their conversion rate. For us, [conversion] means that people go from being strictly a member to people who are transacting members. (Portal company) The process of converting a prospect into a customer is a matter of progressive qualification followed by action. An acquired prospect is only at the first stage of qualification. One million architects may have seen your banner and 25,000 may have clicked on it, but you cannot consider them prospective customers yet. It may take several visits to your site and a series of actions that prove their intent before they can be considered qualified buyers. Do they have a set of needs your software can fulfill? Do they have the right hardware to run it? Do they have the authority to make a purchase decision? Can they afford it? Only if they satisfy all of those criteria are they a qualified prospect, with the likelihood of being converted into a customer. However, those without the need, the desire, and the means will not buy. Less than 5 percent of e-commerce site visitors buy something. But companies spend an average of $250 on marketing and advertising to acquire one customer. The gross income from a typical customer (after operating costs are deducted from the money the customer spent) is $24.50 in the first quarter and $52.50 in every quarter that he or she is a customer. But two-thirds of buyers dont make a repeat purchase so the typical e-commerce firm doesnt make money off of the average customer. From the Industry Standard article Thank You, Please Come Again by Mark Mowrey (who was in turn referencing a recent McKinsey & Company e-commerce research report). http://www.thestandard.com/research/metrics/display/0,2799,13016,00.html
Retention
What began as an all-out effort to secure a purchase order now turns into an investment in encouraging repeat purchases. The one-to-one marketing concept begins with the assumption that it is far less costly to sell additional products or services to an existing, retained customer than it is to find and secure a new customer. Were not just interested in the folks who come and buy because obviously we want the content to be compelling enough for folks to come back. So we spend as much time looking at return visitors as we do return buyers. (Portal company)
http://www.netgen.com/emetrics/
29
E-Metrics
Current customers have made the buying decision once. They already have a relationship with the firm in terms of trust and process. Your deliveries are on time, their quality assurance team has verified the prowess of your manufacturing team or stable of consultants, and they have a general sense that your firm lives up to its promises. This level of trust is necessary to keep the customer coming back from shipment to shipment, or software version to version. Customer care, product quality, and process efficiency all are critical factors. Consistent retention is what makes the cost of customer ownership so much lower than customer acquisition. It is what gives one customer a higher life time value (see page 55) than another. Repeat customers at 10 popular retail sites spent 57 percent more than onetime shoppers. Furthermore, loyal customers appear willing to expand their shopping across categories. For example, almost 70 percent of loyal Gap Online customers said they would consider buying furniture from Gap Online. From a recent study by Boston-based Bain & Company (www.bain.com) While acquisition, conversion, and to some degree reach can be considered time-certain, retention is not so easy to pinpoint. A user is reached at one point in time, becomes a prospect at another point in time, and then buys, becoming a customer. Then that customer buys a second product two weeks later. Is this person considered retained? Some high-churn businesses may not consider someone retained until his or her third or fourth purchase within a given time window. What if the second purchase did not happen until eight months later? Is this customer retained? Deactivated and reactivated? Lost and won back? Unless you are selling commercial aircraft in which case another purchase within eight months would definitely indicate that the customer has been retained or automobiles, where retention is measured in years the timeframe for retention is generally a short one. The data indicates that customer retention is the key for e-commerce firms hoping to eventually make a profit. McKinsey estimates that enhancing customer retention is better for the bottom line than acquiring new visitors, bringing in new buyers or even trimming the cost of retaining customers. A 10 percent increase in repeat customers would mean a 9.5 percent increase in the corporate coffers, according to McKinseys calculations. From the Industry Standard article Thank You, Please Come Again by Mark Mowrey
30
http://www.netgen.com/emetrics/
Loyalty
According to www.dictionary.com, loyalty is defined as the act of binding yourself intellectually or emotionally to a course of action. The customers with the greatest life time value are generally those who are not only loyal to your products, but also loyal to your company. They are the ones who are willing to promote your firm and act as references to other prospects. They run user groups and fan clubs. They tattoo your company logo on their bodies. You know you have a strong brand when a significant portion of your customer base tattoos your logo on their chests and forearms. Just ask Harley Davidson. On the Web, loyalty also refers to site visits over time. People who visit your site more than once a week may be more valuable than those who visit once a month. Prospects who are considering the purchase of an automobile are more likely to buy if they show up on a daily basis for a month. But there is no expectation they will return month after month. Once the buying decision has been made, they usually will stop visiting car sites altogether. Loyalty to me is repeat customers whos visiting our Web site the most, who is actually purchasing product, data, or whatever... (Technology company) Loyalty, then, means very different things to different sites. Those selling advertising space to generate income are completely dedicated to increasing the number of site visits and page views. Yahoo, AltaVista, MSN, and other portal sites are constantly looking for ways to get people to come back more often and stay longer. Were starting to look at defining loyalty in terms of our promotions. Are our customers loyal because of coupons or are they loyal because of the brand? (Retail company) As entrepreneurs invent new business models, they generate new types of Web sites. These can easily be classified on their business versus consumer orientation (Table 2), but how they measure loyalty is a little more complex.
http://www.netgen.com/emetrics/
31
E-Metrics
Sector
Auctions Buying Groups
Orientation
B-to-C B-to-C
Sample Companies
eBay, OnSale MobShop, Mercata
Communities
B-to-C
iVillage, About.com
Content
B-to-C
E-marketers
B-to-B
B-to-C B-to-B
B-to-C
Reverse Auctions
B-to-B
BizBuyer, Import-Quote.com
Services Software
B-to-C
B-to-B
B-to-B
32
http://www.netgen.com/emetrics/
Loyal customers come back frequently, buy often, recommend your company to others, and readily try out new things. They may even come looking for products or services that you do not offer. Perhaps a customer is a regular buyer at BarnesandNoble.com, but does she also buy at Amazon.com? What if BarnesandNoble.com started selling travel? How quickly would she start buying travel from them? She might be a loyal book buyer, but will she be a loyal CD buyer as well? Will she be devoted and buy just about everything she can from Barnes & Noble? Will she recommend Barnes & Noble to her friends?
http://www.netgen.com/emetrics/
33
E-Metrics
Abandonment
One of the curious characteristics of online sales is the shopping cart abandonment factor. In the bricks and mortar world, it is relatively rare for a shopper to fill a cart and then leave it and all of its contents without going through the check-out line. Yet this is a very common occurrence on Web sites. The reasons are many, with studies pointing to causes including poor site navigation and usability. How can a shopper be encouraged to become a buyer? By tracking, measurement, and management. Online stores are taking action based on: n n n n The ratio of abandoned carts to completed purchases per day. The number of items per abandoned cart vs. completed transactions. The profile of items abandoned versus purchased. The profile of a shopper versus a buyer.
When a shopper with a profile resembling that of an abandoner begins placing items in a cart, or the list of items is very similar to those in carts abandoned in the past, a dynamic Web site can take action by offering special incentives or displaying messages regarding the ease of completing the purchase. The goal is to turn more shoppers into buyers. Watching shopping behavior for signs of trouble can prove profitable. Suppose that shoppers at a business telephony Web site tend to buy two or three items at a time. When a shopping cart begins to fill with ten or twelve items, the activity might set off a trigger to include persuasive content on the next screen. The site might offer to open a business account for the shopper, or offer a chat session with an online service representative to discuss the shoppers needs. Abandonment does not apply strictly to electronic shopping carts in online stores selling packaged goods. Any multi-step buying process may suffer from abandonment. An online brokerage wants to make sure that its users do not merely trade, but also add more funds to their portfolios. If a steadily trading client makes no deposits over a given period of time, the site might offer specialized consulting, education, or access to additional investment research. Between clicking on a banner ad and making a purchase, there are many points where a prospective customer may fall out of the life cycle. The overall abandonment rate is the number of people who commence but do not complete the buying process. If the reason is a lack of qualification, you will need to adjust the mechanisms that attract people to your site. If the problem is poor site navigation, a new site design may be in order.
34
http://www.netgen.com/emetrics/
Attrition
Once a customer, always a customer? Not so. The attrition rate is the percentage of existing, converted customers who have ceased buying from you and have gone elsewhere during a specific period of time. As reported widely in the media, when Delta Airlines added a $2 surcharge to fares not booked over the Internet, the marketplace protested that the fees were unfair. The number of people who had previously purchased on a regular basis, but stopped coming back, appeared to grow alarmingly. Had Delta offered a discount for buying online or an additional 1,000 frequent flier miles, like their competitors United Airlines and American Airlines, Delta likely would have avoided this infamous marketing episode. On our email subscriptions, [we measure] how many people have unsubscribed, but thats not readily available. The data is out there, but its not published on a consistent basis. We hope to have that within three months. (Publishing company) Attrition is different from abandonment. If you switch your telephone service from Bell Atlantic to MCI, then Bell Atlantic considers you to have attrited a sure sign of a lack of loyalty. If you call up Bell Atlantic, start to switch over, but then balk at a certain contract term and hang up, then you have abandoned the conversion process. Attrition is the flip side of retention and carries with it the same considerations regarding time scales. If a customer does not buy a new car from you for three, four, or five years, it could mean that she is now purchasing from your competitor, or it may simply be that she likes her current model. If a music lover who buys CDs from your site on a weekly basis does not come by for a month, some sort of recovery action is in order.
Churn
Churn measures how much of your customer base rolls over during a given period of time. To calculate churn, divide the number of customers who attrite during the given time period by the total number of customers at the end of the time period. Christopher Knight provides a concise example of ISP churn in his Churning Out Marketing Ideas to Keep Customers article that appeared in the September 1999 issue of Boardwatch magazine (http://www.boardwatch.com/mag/99/sep/ bwm49.html): Say you have 2,000 subscribers on the first of the month. During the month you add 200 new subscribers. You also lose 50 subscribers. At the end of the month, you have 2,150 subscribers. Your churn rate is 50 divided by 2,150, which equals 2.3 percent, which is your churn ratio. Your growth rate for the month is 200 divided by 2,000, which equals a 10 percent growth rate. Annualized, this means (assuming you continue averaging the same performance each month) your ISP has a 27.6 percent churn rate and a 120 percent annual growth rate. Now that you have an introduction to the basics of the Customer Life Cycle, the next step involves measuring and characterizing your customers effectively.
http://www.netgen.com/emetrics/
35
E-Metrics
Recency
Recency is a core measure that describes how long it has been since your Web site recorded a customer event (e.g., visited the site, purchased a product, etc.). Recency is generally considered to be the strongest indicator of future behavior. According to RFM, the most likely users to purchase tomorrow can be readily calculated from past experience. A loyal luggage buyer may buy a suitcase once every three years. Milk, bread, and egg buyers tend to shop weekly. When browser-based cookies first came on the scene, they were used to welcome people back and let them know how the site had changed since their last visit. More than just a parlor trick and more than just a convenient way of keeping people up to date, knowing when somebody was last at your site is an important part of user profiling. As recency diminishes as the time since the last activity or event increases the potential for future purchases decreases. Eventually, a pre-determined amount of time lapses and the user has officially attrited. In an attempt to reactivate customers, different offers might be targeted to different users as recency fades. If you have shopped at Amazon.com with any regularity, you may have received a we miss you gift certificate. The Amazon system notes the consistency of your visits and purchases and sends off an email enticement should you fall outside of your normal purchasing pattern.
36
http://www.netgen.com/emetrics/
Frequency
I want to know how many people are coming every day and how many people only visit once. (Publishing company) Users may visit hourly, daily, weekly, monthly, or less. Here are three scenarios where frequency means different things to different sites.
A user who only comes to a florist Web site four times a year may be considered a very loyal customer. A wedding anniversary, Valentines Day, a spouses birthday, and Mothers Day are the major flower-giving occasions. A one-time-only user can be encouraged to come back for another holiday as can the user who only comes twice a year. But the user who comes four times needs special enticement to increase his or her frequency. A dollars-off coupon, a bouquet-of-the-month club, or a buy ten, get one free offer may all appeal. Offers can be tested on each level of frequency to increase response rates.
Deciding on the acquisition of an expensive item creates a decidedly different rhythm of site visits. The occasional click-through at the start of the process gives way to a steadily increasing number of visits up to the moment of purchase. If these traffic patterns are properly modeled, they can lead to a clear indication of when the sale may occur. With this knowledge and some clever data mining techniques a company can build predictive models to be more proactive, launch opt-in email campaigns, dynamically alter the site, or have a salesperson call on the prospect. Manufacturers can use information about the frequency of visits to notify their distribution chain about potential sales. Service organizations can watch customer activity to determine the right moment to up-sell and cross-sell. Training departments can track frequency to decide when to offer additional courses.
Frequency becomes even more important when the relationship between parties is long-standing. When extranets are used in the place of electronic data interchange (EDI), the pattern of visits and orders can be very telling as Web site traffic becomes the pulse of the buyer/seller relationship. If a steady customer with a predictable pattern of visits changes her browsing and buying habits, it is a good sign that human intervention can increase the spending potential. Frequency information can yield insight into a customers displeasure, expose a shift in customer personnel, or signal the possibility of increased business.
http://www.netgen.com/emetrics/
37
E-Metrics
Monetary Value
The monetary value of a Web site user can only be estimated until a purchase is made. The user who comes once a day for a week is assigned a much higher probability of purchasing than one who comes once every three months. As soon as a user becomes a customer, actual monetary value can be derived from spend and profit margin data. Over time, how much does the customer buy per month? How profitable are those sales? What are the characteristics of a high spender versus a low spender?
1 1 1 3
Figure 16 shows a three-dimensional representation of 125 customer segments stratified by recency, frequency, and monetary value scores. How might you market to, sell to, and support customers differently in segment 555 versus 111? What about segments 515 and 254? Clearly, different Web sites will have different indexes for purchase probability and profitability. But historical ratings of actual customers are of great value when spread across the users of a single site. These are the figures that help sites recognize which users are most likely to become profitable buyers.
Duration
As is true for recency and frequency, the duration of an individuals visits can be a clear signal of intent and a forecast of a possible change in the relationship. Different companies have different goals for the duration of each users stay on their site. A technology company that caters to technologists may want to do everything in their power to shorten the duration of each visit. Why? Because their customers repeatedly tell them that they are busy, and that they are not coming to the site for entertainment or community, just product information. If the pages load faster, if the information is easier to find, if customers can make a decision more quickly, they are happier.
38
http://www.netgen.com/emetrics/
E-retailers such as Barnesandnoble.com and Amazon.com live in both worlds. They want people to stay as long as possible. They want a user who looks for something as general as cooking to see the wide variety of available products. The customer will find books, of course, but he or she might also find cooking software, kitchen appliances, and cooking games and videos, all arranged in as nice a way as possible to make the user stay. But once a buying decision has been made, both Barnesandnoble.com and Amazon.com make it as easy and fast as possible to buy. Each offer immediate purchase capability Express Checkout at BarnesandNoble.com and 1-ClickSM at Amazon.com) greatly simplifying the purchase process. E-retailers have discovered a trend long understood by their brickand-mortar counterparts: fast check-out reduces shopping cart abandonment. In the case of a considered decision purchase, the length of stay may indicate the seriousness of the buyer. If somebody stops to look at something for only a minute or two, that person profiles differently from the user who spends an hour reviewing options. In Section 11, we will discuss how to measure stickiness getting users to stay longer as well as slipperiness getting them out fast when they are finished shopping. In combination, the elements recency, frequency, monetary value, and duration paint a detailed picture of how a site is being used and where changes can be made to increase its yield.
Yield
According to InvestorWords (www.investorwords.com), yield is defined as the annual rate of return on an investment, expressed as a percentage. While meant to describe yield on general financial investments, this definition aptly fits e-metrics. Yield refers to results, and results depend on goals. The auto manufacturers goal is to get the prospect in touch with the dealer; the high technology companys goal is to help the engineer make a better decision faster; the stock trading sites goal is to encourage people to invest more money with their institution, and so forth. Yield is the measurement of how well your site is reaching its first-level goals. How many people have your promotional efforts attracted to your site? How many of them returned two months later? How often do they come back? The answers determine the shape of your customer life cycle funnel (see page 45) and provide an indication of the monetary value of each user.
http://www.netgen.com/emetrics/
39
E-Metrics
Acquisition Cost
Advertising and Promotional Costs Acquisition Cost = Number of Click-Throughs
The acquisition cost calculation determines the value of a given promotional effort over a given period of time. If $25,000 spent on 1,000,000 banner ad impressions yields a 0.5 percent click-through rate, the result is 5,000 visits, or $5.00 per user acquired. Another campaign draws a few more people and drives the cost per acquired user down to $3.50. If the goal is to acquire customers (generate visits) and nothing further, then the winning campaign is easy to spot.
If you spent $25,000 on marketing programs, acquired 5,000 users for your efforts, and 5% of these prospects convert resulting in 250 new paying customers the cost per conversion was $100. This is good if you are selling real estate to highincome professionals but not sustainable if you are selling stationery to students. The cost per conversion is the number that marketing people use to determine the best investment of their promotional budget. Spending $2 million on a Super Bowl ad campaign may seem like a large check to write. But if the resulting traffic and sales produce an acquisition and conversion cost below alternative means, the cost may not be so alarming.
40
http://www.netgen.com/emetrics/
Net Yield
Net yield determines the effectiveness of a multi-step process where incremental costs are not available, such as creative/banner testing or the comparison of two paths leading to the same goal.
Total Promotion Cost Net Yield = Total Promotion Results Here are two examples to help illustrate how net yield calculations can help in your decision making processes: n Banner A had a high click rate, but a low conversion to sale. Banner B had a low click rate, but a high conversion to sale. By comparing the net yield calculations for Banner A against Banner B, you can quickly identify the betterperforming banner. n For a Web-based contest, some users might receive an intermediate jump page before the registration page, while others might land on the entry form immediately. To determine the optimal path in terms of conversion, the net yield would be calculated by dividing the total number of contest entries by the total entry page visits. This lets you determine if the interstitial jump page helps users understand the contest and makes form completion more likely, or if it gets in the way and causes abandonment before the form is filled out.
Connect Rate
A promotions connect rate is useful for identifying any potential technical issues in page loading or tracking mechanisms. The connect rate measures the number of people who click on a banner or link and then successfully land on the targeted page.
Promotional Page Views Connect Rate = Promotion Click-Throughs Ideally, your connect rate will equal or be very close to 1, showing that every user who clicked on the promotional banner or link successfully received the subsequent promotion page. If your connect rate falls below 0.80, it means at least 1 in 5 clickthroughs failed to reach the destination page. This might be due to your server timing out or would-be users clicking the Stop or Back button. This will in turn affect your acquisition numbers and hence the rest of your customer life cycle funnel.
http://www.netgen.com/emetrics/
41
E-Metrics
If the connect rate drops to 0.80, the bottom line impact is substantial. For 5,000 click-throughs, only 4,000 users actually visit your site, resulting in an acquisition cost of $6.25 rather than $5.00. Assuming the same 5% conversion rate, now 200 customers convert for a cost per conversion of $125. In this case, a connect rate of 0.80 resulted in 50 fewer paying customers and a $25 premium on cost per conversion.
Best Customers
42
http://www.netgen.com/emetrics/
http://www.netgen.com/emetrics/
43
E-Metrics
10
Acquisition
Visitor acquisition cost Marketing dollars spent per visitor $5.68 62.4% $5.11 68.6% 0.7% 3.1%
Conversion
New-customer acquisition cost New-customer conversion rate Marketing dollars spent per customer Percentage of new visitors who become customers $250 4.7% 88.5% $225 5.2% 97.4% 0.8% 2.3% 4.6%
Retention
Repeat-customer maintenance cost Repeat-customer revenue momentum Repeat-customer conversion rate Customer churn rate Operating expenses (less marketing) spent per repeat customer Increase in revenue from repeat customers, 2Qvs. 1Q Percent of customers who become repeat customers Percent of customers not repeating in first half of 1999 $1,931 $1,738 0.7%
44
http://www.netgen.com/emetrics/
10
From a management perspective, the aggregate numbers are the most important result of this tracking. If you know that it takes 1,000 suspects to find 100 qualified prospects and that only 10% of those will end up as customers, then you can use the information about Web site users as a sales forecasting tool. The power of this technique begins to show after reiterating the model over a period of several months. Rather than relying on the best estimates from your front-line sales organization, you can fine-tune your life cycle pipeline model as monthly or weekly sales are posted. This way, it becomes increasingly accurate over time. From a top-line perspective, your Web site metrics become central to decisions about staffing, quotas, promotions, and production capacity.
Prospects may not be learning what they need to know when they need to know it in order to stay in the life cycle funnel. Or, as Ford Motor Company thinks of it, they might have wandered off the path.
45
E-Metrics
10
Figure 19: Customers in different stages of the life cycle pipeline can be shown different types of content when visiting a site.
Suspect
Home Page
Overview
Technical Approach
Product Set
Requirements
Account Application
Closing Customer
Products
Account Creation
Terms of Use
Pricing
Shipping
Order Complete
Referring Customer
Add-on Product
FAQ
Training
Account Status
Once Ford had identified this as a critical step in the optimal site path, they were able to consider ways to encourage people to take this step. Financial calculation tools, expanded financing options, and email and Web-based reminders were put into place to increase the number of users who traversed the optimal site path. Figure 19 shows how an Optimal Site Path (OSP) can reveal where in the life cycle pipeline each customer resides.The boxes in Figure 19 represent either specific pages a prospect must traverse to make a purchase or subject areas where previous customers spent specific amounts of time. It does not matter if that path requires 10 minutes or 10 weeks to traverse. The OSP reveals the viewing habits of real buyers and makes it easier to classify those who have not yet purchased. If those who actually became customers typically looked at the product specifications, the warranty, the success stories, the price, and then the licensing, it is likely that other prospects should have the same experience on their way to becoming customers. This sort of data suggests where you should focus your promotional efforts. If customers are much more interested in one set of specifications over another, then those are the specs that belong in the catalog, in the direct mail piece, or on the banner ad. You can measure the power of your promotional efforts. You can measure the impact of changes you make to your site. You can measure the speed with which you acquire new customers and the effort it takes to keep them. But for those who would take the promise of the Internet and the Web as a starting point, there are entire constellations of new e-metrics waiting to be discovered.
46
http://www.netgen.com/emetrics/
While each of these e-metrics illuminates a different facet of your e-business, each is intrinsically related to the customer life cycle and designed to help you better understand your customers.
Stickiness
An often discussed yet seldom-defined industry metric, stickiness is related to both duration and frequency. Stickiness is a composite measure that captures the effectiveness of your content in terms of consistently holding users attention and allowing them to quickly complete their online tasks. In general, sticky sites are considered more effective than sites that are not very sticky. Little consensus has emerged as to how to calculate stickiness, and many stickiness formulas are potentially valid, actionable, and consistent. Here is one stickiness formula that we feel is particularly succinct: Stickiness = Frequency x Duration x Total Site Reach Where Number of Visits in Time Period T Frequency = Number of Unique Users who Visited in T And Total Amount of Time Spent Viewing All Pages Duration = Number of Unique Users who Visited in T
http://www.netgen.com/emetrics/
47
E-Metrics
11
And Number of Unique Users who Visited in T Total Site Reach = Total Number of Unique Users
The following example illustrates a typical stickiness calculation. Your site has acquired a total of 200,000 unique users. Over the past month, 50,000 unique users went to your site. These 50,000 users accounted for a total of 250,000 visits (average frequency of 5 visits/unique user for the month), and during these visits the users spent a total of 1,000,000 minutes viewing pages on your site. Therefore: 250,000 Visits Monthly Stickiness = 50,000 Active Users Monthly Stickiness = 5 Minutes/User This stickiness calculation can be applied to entire sites or sections of sites, and can also be used to compare trends between different customer segments. The mathematically-inclined reader will recognize that the stickiness formula can be simplified as shown below, although this formulation gives less insight into the individual factors that affect stickiness. Total Amount of Time Spent Viewing All Pages Stickiness = Total Number of Unique Users 1,000,000 Minutes 50,000 Active Users
X
250,000 Visits
X
200,000 Total Users
Slipperiness
Some areas of your site are significantly better if they have very low stickiness. Which areas? The Customer Support section for starters. The last thing your management wants to see is how your customers have to look at lots and lots of pages and spend huge amounts of time reading about product fixes and return policies.
48
http://www.netgen.com/emetrics/
11
In this case, you want the Customer Support section to be slippery, not sticky. This means that users come in, quickly find what they are looking for, and then get out. The check-out/purchase portion of your site gets better as it becomes more slippery. Every additional click required to make a purchase represents another opportunity for the prospect to change his mind and back out. Slipperiness is equivalent to low stickiness. Given the three factors of stickiness, a slippery section is one where visits are short, visit frequencies are low, or users are few or some combination of these conditions.
Focus
Focus is another concept related to page visit behavior within a section of the site. Suppose there are 15 pages in a section. A focused visit may touch 2 or 3 of these, a less focused visit might touch 5 or 6 of them, and an unfocused visit might touch 8 or 10 of them. Therefore:
Average Number of Pages Visited in a Given Section Focus = Total Number of Pages in the Section If the average user views 3 pages in a section out of 15, then the users focus in that content section is 0.20. Smaller values for focus are referred to as narrow focus while larger values are termed wide focus. Is wide or narrow focus better? The answers depend on the type of section and on the user behavior viewed as desirable for that section. A sticky area of content is likely a good sign, but a sticky checkout area at an e-commerce site may signal an unnecessarily complex checkout process. Narrow focus is good at a customer service area of a site, but perhaps not at an online auction section of a site. Table 4 shows stickiness and focus in combination for a given section of the site: High Stickiness
Narrow focus Either consuming interest on the part of users, or users are stuck. Further investigation required. Enjoyable browsing indicates a site magnet area.
Low Stickiness
Either quick satisfaction or perhaps disinterest in this section. Further investigation required. Attempting to locate the correct information.
Wide focus
Table 4: Focus and Stickiness compared. Since certain combinations are open to multiple interpretations, optimal site path analysis will help shed more light on what is really happening. But the combination of the stickiness and focus e-metrics for a whole site or a specific section can often be more powerful than stickiness alone.
http://www.netgen.com/emetrics/
49
E-Metrics
11
Velocity
On a more tactical level, tracking your pipeline gives you the information to improve the Web site itself. Velocity is the measure of how quickly a user moves from one stage of the customer life cycle to the next. Clocking the prospect qualification process gives you the average amount of time it takes for a member of a given market segment to pass from awareness, through deliberation, to decision. This is illustrated in Figure 20: Figure 20: Segmented Velocity Trajectories.
Determined 5 4
Select, Engage
Convinced
Purchase, Sign-up, Agree
Expected
Uncommitted
Stage
3 2 1
Identity, Register Explore, Browse
Researcher
Focus on Details
Unfocused
Anonymous
Time With a specific time span in mind, the site designer can test alternative navigation techniques, while the marketer experiments with different offers. Between the two of them, they can identify seducible moments as well as rough patches.
Seducible Moments
Seducible moments are those junctures where a prospect is exceptionally susceptible to an offer. It may be the rapid purchase button next to a desired product or an up-sell offer at the moment a customer is deciding between two service choices. A seducible moment does not have to be product-related it may be the point where a user must decide to join a discussion group or subscribe to a newsletter. The right encouragement or the right graphic might just do the trick seducible moments will be different on every site. Rough patches, on the other hand, diminish the momentum or the speed at which a browser becomes a buyer. Rough patches often appear as those places where the shape of the customer life cycle funnel suddenly gets narrower because many users are abandoning the process. Reviewing the profiles of the members of a given market segment reveals different attributes of those slow to decide and those quick to buy. Skewing your promotional efforts toward those with a higher velocity rating can have a direct effect on bottom line sales, while altering your persuasion techniques to those who are slow and need more assurance may bring in buyers who have previously been considered unacquirable.
50
http://www.netgen.com/emetrics/
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor
The greatest value of a Web site is its accessibility. From anywhere in the world, at any time of day or night, with nothing more than a computer and a phone line, a prospect or customer can see your Web site and absorb its message. Running a very close second to Web site accessibility is the fact that your Web site can remember everything about the people who decide to visit when they come, what pages they look at, how long they spend on each page, which products they find the most interesting, and more. In e-business, privacy considerations are paramount and must be considered throughout any customer information gathering process. Todays forward-looking organizations are posting privacy policies on their Web sites, adopting the core concepts of fair information practices, and establishing internal data protection teams to stay on top of major privacy-related issues. We strongly recommend that you consider taking similar actions. This section dives into several additional e-metrics including: n n n n Personalization Index Life Time Value Loyalty Value Freshness Factor
Personalization Index
The universe of profile elements is virtually unbounded, covering familiar items such as last name and business address, technical concepts such as IP address and connection speed, and domain specific attributes from pore size (for cosmetics) and lifestyle risk profile (for insurance). Figure 21 shows the four stages of e-customer understanding. By adding incremental profile information, e-business managers are able to transform Category 1 anonymous users into the distinct, real-world Category 4 individuals. Figure 21: The Four Stages of E-Customer Understanding.
Anonymous User Profile Discreet User Identity
Category 1
Category 2
Category 3
Category 4
http://www.netgen.com/emetrics/
51
E-Metrics
12
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor
Collecting information is one thing. Using it in a judicious way is another. The Personalization Index (PI) distinguishes just how well you are using the data you are gathering. The PI is a measure of how effectively an e-business is leveraging this customer data.
Total Number of Profile Elements Used in Customer Interaction Personalization Index = Total Number of Customer Profile Elements Collected If your PI is above 0.75, then you are making the most of the information you are collecting. That means your efforts are not wasted, nor are those of your customers who are providing the raw material. The above assumes that you are using a significant number of elements to make a personalized Web experience. If you are only collecting two elements and using them both, your PI score may be 1.00, but here it means you are only performing market segmentation rather than personalization. You are only able to group your prospects and customers into broad categories. While useful, broad categories are not as powerful as true personalization based on dozens of attributes. Firms struggle to identify profitable individual activity, hobbled by antiquated segment-based approaches. Managing Customer Profitability, Forrester Research When you collect more and more elements, you are able to classify users into more and more clusters. That is where broad segmentation moves towards personalization. That is where you start to foster a customer relationship and turn it into a loyalty relationship, significantly raising the cost for your customer to switch to another vendor. If your PI is less than 0.30, then you are collecting more information than you are using. The good news is that you have a huge untapped reservoir of actionable data about your customers. The bad news is that the data is lying fallow and probably getting stale fast. You need to either start using the data you have more effectively or cut down on how much explicit data you are trying to collect. Most likely, the correct answer is both. You are spinning your wheels collecting that information but you are not using it to benefit your customers, which adversely affects your customers experience.
52
http://www.netgen.com/emetrics/
12
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor
If a customer buys the most expensive item you sell, he might be at the top of the profitability heap but only for a while. If that customer uses more and more company resources in the way of training, services, and additional consideration, his profitability standing will quickly fall (unless these are charged for separately). He may even fall to the same low-profitability level of those customers who only buy the least expensive, lowest margin items, and do not interact with the company thereafter. With the Web, less valuable customers can be brought back up the scale of value by lowering the cost of making the sale, training, answering questions, and solving problems. This concept, sometimes referred to as customer potential, is illustrated in a diagram from a presentation given by Peter Stevens of Sophron Partners (Figure 22) (from www.crm-forum.com/crm_forum_presentations/target/ppr.htm).
Maximized Customer Value
Customer Potential
Time
So go ahead and calculate your normal LTV using retention rates, orders per year, average order size, total revenue, referrals, direct costs, acquisition costs, gross profits, discount rates, and net present value profit. Just remember to discount those costs by the number of times that customers do not call you on the phone because they solved their problems online.
Loyalty Value
When determining the valuation of a Web-enabled company, it would be useful to have a standard, cross-industry e-metric indicating the loyalty of its customers. But loyalty is simply too industry-specific and even site-specific and involves an enormous number of variables. If you have an email account at Yahoo! and you check it every day, you should earn a high loyalty rating from Yahoo!. However, if you also have an email account at Hotmail and check that daily as well, then you are not really as loyal as Yahoo! might imagine. If you check your stock portfolio at Schwab every weekday, but you check your mutual funds at Fidelity, are you still considered loyal? Measuring the loyalty of a Web site user means creating an index you can use daily to see how the changes you make affect your customers. The Bain & Company study (see page 30) indicated that the average Amazon.com customer must remain loyal for approximately 2.5 years to become profitable.
http://www.netgen.com/emetrics/
53
E-Metrics
12
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor
Successful online retailers will start shifting their focus from acquisition to retention by reaching out to customers with unexpected and tangible signs of appreciation with gifts. This proactive customer service will require crossorganizational customer satisfaction metrics that identify who gets which goodies. from Building Loyalty? Its The Thought That Counts, Forrester Research Each site must create a loyalty ranking system of its own depending on its goals and its experience. Here are our three scenarios again, involving the retailer, the considered purchase, and the business-to-business relationship, with different approaches to loyalty as an e-metric.
Customer loyalty here is measured in purchases. How much do they buy? How often do they buy? Are they a profitable customer? The formula for loyalty will include the following variables: n n n n n n n Visit Frequency: Scored based on number of visits per month. Visit Duration: Scored based on number of minutes per visit. Visit Depth: Scored based on number of page views per visit. Purchases per Visit Number of Items Purchased per Visit Total Revenue of Purchases per Visit Profitability of Purchases per Month
If additional marketing programs are implemented, the customer might be evaluated on factors such as: n Number of Referrals per month: Did the customer refer others? n Value of Referrals per month: Did those referrals buy? How much? n Questionnaire Propensity: How willing is the customer to answer survey questions? n Contest Participation: How willing is the customer to participate in contests? n Reward Points Program: How willing is the customer to participate in affinity programs?
Loyalty can be measured on a short-term basis to try to clinch the sale. It can also be measured on a much longer-term time scale. If the customer is buying a refrigerator, chances are excellent that she will not need another one for years. You can keep her in your database for those years while waiting for the right opportunity to remind her of your quality and value. Insurance companies keep information on newborns in their database for decades in order to offer additional auto insurance in fifteen and a half years.
54
http://www.netgen.com/emetrics/
12
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor
Most loyalty calculations will revolve around how the user browses your site. Here we begin with the same variables as above in the Retail Experience, but with a twist: n Visit Frequency: This is scored based on visits per decision period and mapped to a decision-making curve. Buyers of one type of product will visit a certain number of times in the first period, a certain amount in the middle of the process, and signal that a buying decision is actively being made when they increase (or decrease) to a different number of visits in a set time span. n Visit Duration: Scored per session. This is another indication of how close to a decision the user may be. n Visit Depth: Page views per visit are as revealing as frequency and duration. To this list, we add the important analysis of how the user traverses the site: n Site Path: How well is the user following an optimal site path? n Contact: How often does the user send email, engage in a chat session, or fill in a form on the site? What sort of questions does the user ask? n Product Configurator: How many times does the user run the configurator and which features are selected?
The metrics change again when it comes to extranets. In the business-to-business environment, the emphasis on selling is replaced with a focus on service. Taking orders and solving problems are paramount, while a less aggressive eye is kept open for up-selling and cross-selling. Loyalty comes in many shapes and sizes, and hence loyalty metrics naturally tend to differ greatly between different sites with different business models. n Visit Frequency: In this environment, the watchword is consistency. Is the user coming to the site at set intervals and doing what is expected? n Visit Duration: Are there any changes in the amount of time it takes the user to place the order? n Visit Depth: Is the user looking at products above and beyond his or her norm? n Visit Tenure: Time elapsed since first visit. n Purchase Tenure: Time elapsed since first purchase. n Purchase Frequency: Number of purchases per quarter (or month). n Total Lifetime Spending: Total spending since first visit. n Visit Recency: Time elapsed since most recent visit. n Purchase Recency: Time elapsed since most recent purchase. n Required Clicks to First Purchase: Minimum number of clicks required to complete the first purchase in a visit. The first purchase may require more clicks than repeat purchases. n Required Clicks to Repeat Purchase: Minimum number of clicks required to make a repeat purchase. n Actual Clicks to First Purchase: Actual number of clicks until the first purchase was made. n Actual Clicks to Purchase: Number of clicks until a repeat purchase.
http://www.netgen.com/emetrics/
55
E-Metrics
12
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor
Required Clicks to First Purchase First Purchase Momentum = Actual Clicks to First Purchase and Repeat Purchase Momentum:
Required Clicks to Repeat Purchase Repeat Purchase Momentum = Actual Clicks to Repeat Purchase
Freshness Factor
It has long been believed that a Web site must change constantly to hold the interest of any given audience. While this makes sense for sites that depend on users returning daily (news, weather, and sports sites as well as portals like MSN), the constant creation of content is expensive and time consuming. The Freshness Factor (FF) measures the impact of dedicating resources to the job of continuous content publishing. The Freshness Factor is designed to measure how often content is refreshed versus how frequently users visit the site. You will want to perform this calculation against individual customer segments since they will be interested in different site sections and will likely respond to fresh content in different ways.
Average Content Area Refresh Rate Freshness Factor = Average Section Visit Frequency Just as you weight the value of individual data elements collected about a specific customer, you must weight the value of content elements based on a number of factors. The most obvious is timeliness. If this data element is imported from a stock price reporting service or a news feed from a wire service, when does it expire? When should this news article be moved over into the archive section? If this content is part of a series of rotating elements, how recently has it been shown to this specific user? Different articles carry different weight based on their intended use. A white paper on choosing the right vendor may have a shelf-life of years, while updates on legislative issues are only interesting for a month or so.
56
http://www.netgen.com/emetrics/
12
Section 12: Personalization Index, Life Time Value, Loyalty Value, and the Freshness Factor
If your Freshness Factor is less than 1, then on average your customers are visiting that section of your site more frequently than you are updating the content. Thus, they are seeing stale content and you can expect your stickiness numbers to decrease. On the other hand, if your Freshness Factor is greater than 1, then again on average customers see new content each time they visit your site, and your stickiness numbers should improve. If your Freshness Factor goes above 1.5, then you are running the risk of wasting resources to create content that is not being viewed. Be careful of multi-modal distributions. If half of your customers visit every hour, and the other half visit once every 9 hours, then your average frequency is 5 hours. This reveals the general necessity of segmenting your customers and your site and performing all calculations, including Freshness Factor, on customer segments rather than global site populations. Some of the e-metrics described in this document are going to be more valuable to you, for your industry and on your site than others. The e-metrics discussed so far are only the first step - but a very important step indeed.
http://www.netgen.com/emetrics/
57
E-Metrics
Major Takeaways
n The move to a customer-centered economy is well underway. The business culture at the beginning of the 20th Century shifted from the personal attention of the corner store to mass production. Henry Ford mastered the Industrial Age by bringing us the assembly line and vertical integration. The way to win was by producing more goods, faster and cheaper. In the second half of the 20th Century, the focus shifted to distribution. Sam Walton mastered transportation and logistics to show us how mass-produced products could be brought to market faster and cheaper. At the outset of the 21st Century, the Information Age is transforming into the Communication Age with individuals like Jeff Bezos and Michael Dell making the most of the Internet to utilize knowledge about individual customers as never before. We are beginning to come full circle, once again focusing business effort on meeting the needs and requirements of our customers. n The value of knowing customers as discrete individuals is tremendous. The Web gives us the ability to capture, store, and act on information about individual customers as a competitive advantage. With personal information about individual customers we can customize the Web experience for each user, accurately predict buying patterns, customize products and services to meet specific customers needs, lower inventory carrying costs, and ultimately keep customers for life. The result will be the ability for first-movers to lock customers into long-term relationships through increased customer satisfaction and increased profits. If vendors are nimble and can readily meet new client requirements as they occur, the motivation for those clients to find other vendors will be low. Laggards beware. If you make customers unhappy in the physical world, they might each tell six friends. If you make customers unhappy on the Internet, they can each tell 6,000 friends with one message to a newsgroup. If you make them really happy, they can tell 6,000 people about you. You want every customer to become an evangelist for you. Jeff Bezos, Amazon.com, Customer Service Management magazine, November/December, 1999 n The opportunity to analyze more than just customer information is ripe for exploitation. The tide of customer expectations is rising faster than ever. Today, we are struggling to compete armed only with customer profiles that cover such minimal data as gender, zip code, number of visits, and a few preference profile elements. Tomorrow, we will focus more on the interaction rather than just the information delivered during the interaction. Customer profiles will include information on how much customers know and how they like to communicate.
58
http://www.netgen.com/emetrics/
13
Sites should begin building infrastructures to measure user information, as this information will become golden down the road. Eric Schmitt, Forrester Research The rich store of information collected in the course of doing business on the Internet should be carefully archived and protected. Holding onto your raw data today will allow for deeper and deeper analysis tomorrow. Even though sites change so quickly that six month-old behavior data may not have the same relevance to the current site and infrastructure as current data, remember that disk space is inexpensive. Do not throw out tomorrows heritage to save a few megabytes of storage today. n Even the cutting edge e-businesses are not there yet. Our research revealed that many of todays leading sites are inundated with data yet lack the necessary people, technical resources, standard definitions, and domain expertise to extract much of the critical business value out of this data. While most e-businesses recognize they have a long way to go before customercentric e-metrics drive their internal processes and decision making, todays Web executives are looking forward to capturing even more data, performing deeper analytics and data mining, and dynamically altering site content based on this analysis. Lets have the core data sitting somewhere because the real need is the analysis. We can decide over time what tools we need to actually do the analysis. Over time well gradually add different data sets and different analysis tools. So, its an ongoing project. Its never ever going to stop. It just means that well get very, very sophisticated in the way that we actually see [customers] on a one-to-one basis. (Service company) n E-Metrics are critical to long-term success. Without e-metrics, the Web continues to be a grand experiment; a government research project that escaped the lab, mutated, and took over the world. Make money? Sure. Open new territories? Of course. Provide an open channel of communication with your customers? Only if you are good. With e-metrics, you have the opportunity to approach the Web from an objective, systematic perspective. You can move from trial and error to trial, measure, and improve. You can become a customer confidante, a partner in commerce, and a trusted member of the customers value chain.
http://www.netgen.com/emetrics/
59
E-Metrics
13
Closing Thoughts
The course is clear, although it is not effortless. Getting from where you are today to where you need to be to compete will take resources, time, and discipline. The obstacles and the potential benefits are many, but the whole discussion boils down to two important, all-encompassing issues: n The business value of knowing more about your customers. n The need for resources to efficiently unlock that value. Faster service, lower costs, higher customer satisfaction, improved retention, stronger loyalty these are the promises of standardizing on e-metric definitions, tracking customers as individuals, leveraging customer profiles, and harnessing the power of the Web to cater to customers in the most effective way possible. Those who are first to embrace customer-centricity have a front-of-the-line advantage over the laggards. Companies that shift their focus to a customer-centric orientation will find it easier to attract new customers. The cost of switching to another vendor will skyrocket as buyers divulge more information to secure the best discounts and the best services. Converted customers will become less and less willing to start the education process with a competing vendor.
60
http://www.netgen.com/emetrics/
Special Acknowledgement
The authors would like to thank Dr. David Reiner for his significant contribution to this research; his editorial contributions proved invaluable to our efforts. Dr. Reiner, vice president of product strategy and development at NetGenesis, holds a Ph.D. in computer science from the University of Wisconsin, and has extensive experience in developing scalable software systems for customer relationship management in financial services, retail, high-tech, telecommunications, publishing, and business-tobusiness applications.
At NetGenesis, we use the term InfraMarketing to encompass the fundamentally new marketing capabilities that e-business systems enable. The Web lets you understand customers and their behavior in a way that is not possible offline. InfraMarketing is all about revealing a new level of understanding about customers from their underlying behavior on the Web, so you can market to your customers in a revolutionary manner.
TM
Where traditional marketing is aimed at the masses, InfraMarketing is carefully personalized to each individual. Where traditional marketing focuses on blasting out one-way messages and taglines, InfraMarketing is about creating engaging conversations with specific members of the marketplace. And where traditional marketing measures success using traditional metrics, InfraMarketing involves creating new InfraMetrics that reflect the new business realities brought on by Internet technologies.
http://www.netgen.com/emetrics/
61
E-Metrics
http://www.netgen.com/emetrics/
http://www.netgen.com/emetrics/