Defining, Measuring, and Managing Business Reference Value: V. Kumar, J. Andrew Petersen, & Robert P. Leone
Defining, Measuring, and Managing Business Reference Value: V. Kumar, J. Andrew Petersen, & Robert P. Leone
Leone
Keywords: client references, business reference value, customer lifetime value, business-to-business marketing
any firms are trying to capitalize on the power of Microsoft to represent what its sales executives believe are
FIGURE 1
Conceptual Model of the Drivers of BRV
H2a
Length of
Client Relationship
H2b
Business
BRV
Reference Reference Value
H3
Media Format ( )
H4
Reference
Congruency
where
The Incremental Benefit of Firm Size
Research on commitment and trust suggest that when both BRVi = Business reference value of client reference i,
commitment and trust are present, “they produce outcomes Refn = Degree to which references affected the prospect
that promote efficiency, productivity, and effectiveness” n’s purchase decision,
(Morgan and Hunt 1994, p. 22). We predict that larger firms DOIin = Degree of influence of client reference i on con-
verted prospect n,
are a more trusted reference in terms of a stronger signal of
CLVn = CLV of converted prospect n,
quality to the prospect. This suggests that not only should
N = Total number of converted prospect,
larger firms send a positive signal to the prospect, which
r = Discount rate (in months), and
serves to reduce the uncertainty of the purchase decision,
tn = month that converted prospect n became a cus-
but they should incrementally strengthen the other drivers
tomer after the first month of the observation
of the value of the reference. Thus, after controlling for the window.
main effect of firm size, we hypothesize the following:
Equation 1 illustrates that we can compute the contribu-
H5a: When client firms are larger, it further strengthens the
tion of BRV from each prospect that chooses to adopt a
positive impact of (a) longer lengths of client relation-
ships on BRV, (b) richer reference formats on BRV, and
product or service by multiplying the degree of influence
(c) higher congruency on BRV. that client references, in general, had on the decision of that
prospect to adopt (Ref) by the degree that the given client’s
We provide a summary of the main hypotheses in Table 1 reference influenced the prospect to adopt (DOI), and by
and the numbers of the hypotheses on the links between the the profitability of the converted prospect (CLV). When we
constructs in our conceptual model in Figure 1. have this information from each converted prospect, we cal-
TABLE 1
Summary of Hypotheses
Hypothesis Expected Effect Rationale
H1a: Client firm size selection + The larger client firm sends a positive signal,
H1b: Client firm size BRV + which makes it more likely to be selected as a
reference and more likely to have a higher BRV.
H2a: Length of client relationship selection Firms with longer relationships with the seller
H2b: Length of client relationship BRV firm potentially reduce risk and ambiguity of
purchasing. Overembedded firms (i.e., too long
of a relationship) can be problematic for both
selection and level of BRV.
H3: Reference media format BRV + Richer media formats send a stronger signal
and more valuable information, leading to a
higher BRV.
H4: Reference congruency BRV + Homophily between client and prospect
strengthen the value of the information leading
to a higher BRV.
H5a: Firm size relationship length BRV + When firms are larger, it enhances the strength
H5b: Firm size reference media format BRV + of the other drivers of BRV. This leads to an
H5c: Firm size reference congruency BRV + incrementally higher value for BRV.
Computation of BRV
Step 1: Determine whether client references influenced where
adoption. The first step is to determine whether client refer- CLVn = CLV of customer n,
ences in general had any influence on the prospect’s deci- (Purchasesnt) = Profit from purchases of customer
sion to adopt. In this case, we expect that the adoption n in time t,
process is driven by two processes: seller-generated and (Operating Costsnt) = Profit lost from operating costs of
customer-generated marketing. Seller-generated marketing customer n in time t,
efforts tend to include any direct- or mass-marketing efforts Marketingnt = Marketing costs for customer n in
initiated by the seller firm. In this case, client-generated time t,
marketing transpires when the seller firm uses information T = Time horizon of the prediction, and
about the client in influencing the prospect (reference). We r = Discount rate (in months).
compute this value using a constant-sum scale approach. At
Equation 2 shows that the CLV for each new customer n
the time of adoption, we asked the converted prospect to do
is a function of three factors: (1) the profit from purchases,
the following:
(2) the operating costs, and (3) the marketing costs to retain
Allocate a total of 100 points between the following two the customer. In this case, profit from purchases includes
influences: (1) the influence of client references in general the contribution margin from purchases aggregated
and (2) the influence of all other marketing processes (e.g. monthly, profit lost from operating costs includes losses
direct, mass, etc.) and sales initiatives (e.g. personal sell- from product returns and/or costs of customer service
ing).
aggregated monthly, and marketing costs include the costs
We assume that the value given to the influence of client of any marketing efforts the firm expends to the individual
references is, in effect, the percentage of the sale that can be customer n aggregated monthly.
attributed to the influence of client references. We then set For our empirical example, we conducted a field study
the score that was given to the influence of references in during a one-year time period and then observed the pur-
general to the value of Refn. chases, product returns, and marketing efforts for the
remainder of the normal CLV prediction window, over a
Step 2: Determine the influence of each client’s refer- period of three years. In this case, we compute only the
ence. The second step is to determine the influence that actual CLV of converted prospects, not predicting it. In the
each client reference had on the prospect’s decision to case in which the entire prediction window is not observed,
adopt. We compute this value using a similar constant sum we could use the method that Reinartz, Thomas, and Kumar
scale approach as we did for Refn. At the time of adoption, (2005) suggest to predict the CLV of newly acquired cus-
assuming a converted prospect had a value of Refn > 0, we tomers. We then use the resulting value of BRV for each of
asked the converted prospect to do the following: “Allocate the client references as a dependent variable with the
a total of 100 points across each of the client references you antecedents of BRV as independent variables to uncover the
felt influenced your decision to purchase (where more drivers of BRV.
points means the reference had a greater influence).”
All 100 points could be allocated to one client reference
if all other references had no impact, or the points could be An Empirical Example
allocated across any combination of client references To explain the influence and value of client references, we
according to the perceived influence. The value given to provide two empirical examples from two B2B firms, one
each client reference in this step is, in effect, the proportion in the telecommunications industry and another in the
of influence that a given client’s reference had relative to financial services industry. In the following sections, we
the total influence that client references had on a converted describe the data we collected from these two firms, the
prospect’s decision to adopt. We attributed the score given to selection and operationalization of the variables for the con-
structs, and the method used for estimating the model to
the influence of each client’s reference to the value of
empirically determine the drivers of BRV.
DOIin.
Step 3: Compute the CLV of the converted prospect. The Data
third step is to compute the expected future profit, or CLV, The telecommunications firm provides products and ser-
of the converted prospect n. We do so by adapting an equa- vices that include landline phone service, voice over Inter-
tion Petersen and Kumar (2009) use to measure a cus- net Protocol, Internet service, wireless service, maintenance
tomer’s CLV. Petersen and Kumar show at an aggregate contracts, and infrastructure, among other products. The
level how total customer purchases, total operating costs financial services firm provides products and services that
(i.e., product returns/service costs), and total firm-initiated include business checking/savings accounts, payroll deposit
FIGURE 2
A Timeline of the Data Collection
6 Years
The firms collected data The firms conducted a 12- The firms continued to
for three years from the month field test in which they collect data for two years
clients who were used for gathered data on the influence from both the referencing
clients and newly acquired
business references. of references on new customer
customers.
adoption.
ance of BRV. By selecting references according to fit (con- .02). This finding suggests that larger clients are more likely
gruency) and reference media format, and taking into to be selected to provide a reference. In addition, we found
account the synergistic value of client firm size, the addi- that revenue has a positive effect on selection for both the
tional variance of BRV that the model explains is approxi- telecommunications firm (.00026, p < .01) and the financial
mately 40%. services firm (.00046, p = .02). This suggests that the larger a
From the results of the latent class analysis, we found that client’s own revenue, the more likely a client will be selected
there is only one latent segment for our model; thus, we only to provide a reference. These findings support H1a, that the
report the results for the single-segment censored regression seller firm is more likely to select larger clients, in terms of
model. (For the results of the null models, along with the both labor force and scale of operations, as a reference.
full model, for the financial services firm, see Web Appen- Length of client relationship. For length of client rela-
dix W2 at www.marketingpower.com/jm_webappendix; tionship in the selection model, first, we found that CLV has
note that we found similar results for the telecommunica- an inverted U-shaped effect on selection for both the
tions firm.) In addition, the parameter estimates from the telecommunications firm (for CLV: .102, p < .01; for CLV2:
models provide several key insights into the effect of each –.00024, p = .02) and the financial services firm (for CLV:
variable on the BRV for each of the referencing clients. .124, p < .01; for CLV2: –.0003, p = .01). This suggests that,
first, the firm is more likely to select referencing clients that
Selection Model
provide more profit and are more likely to have a longer
Client firm size. For client firm size in the selection relationship duration, to a threshold. Second, we find that
model, we found that the number of employees has a posi- tenure has a positive effect on client selection for both the
tive effect on selection for both the telecommunications firm telecommunications firm (.163; p < .01) and the financial
(.062, p < .01) and the financial services firm (.076, p = services firm (.149; p = .02). This suggests that the seller
A: Selection Model
B: BRV Model
firm is more likely to select clients that have had a longer Censored Regression (BRV Model)
prior relationship as a reference. In general, these findings
Client firm size. We found that both variables that
support H2a, which predicts that, to a threshold, seller firms
describe the client firm size of the referencing client for the
are more likely to select clients that have had and are
telecommunications firm (for employees: .231, p < .01; for
expected to have longer relationships with the seller firm as
a reference. revenue: .0086, p < .01) and the financial services firm (for
employees: .201, p < .01; for revenue: .019, p < .01) are
Summary. In general, all these variables and the signifi- positive and significant, in support of H1b. “This finding
cance of the parameter estimates suggest that the firm does suggests that prospects are more likely to value references
not randomly select the clients that provide references. from clients that are larger, in terms of either labor force or
Instead, the firm is probably selecting larger clients with scale of operations.
stronger relationships with the seller firm (to a threshold).
This finding is also supported by the positive and signifi- Length of client relationship. For length of client rela-
cant coefficient on the pseudo inverse Mills ratio for both tionship, we found that CLV had an inverted U-shaped rela-
the telecommunications firm (.42, p < 0.01) and the finan- tionship for both the telecommunications firm (for CLV:
cial services firm (.41, p < .01), further validating the need .339, p < .01; for CLV2: –.0072, p < .01) and the financial
to accommodate for this selection bias. services firm (for CLV: .409, p < .01; for CLV2: –.0076, p <
TABLE 4
Decile Analysis for BRV and CLV
Telecommunications Financial Services
(n = 9 for All but Tenth Decile) (n = 9 for All but Tenth Decile)
Decile CLV (in Thousands) BRV (in Thousands) CLV (in Thousands) BRV (in Thousands)
1 30.8 34.6 26.2 31.2
2 25.7 40.8 23.6 33.6
3 20.2 49.6 20.5 41.8
4 17.3 55.8 18.1 59.2
5 14.9 61.2 15.7 66.8
6 12.1 30.2 12.8 36.1
7 9.3 6.2 9.6 10.2
8 6.4 3.1 5.5 4.1
9 3.2 1.8 2.9 2.2
10 .8 .2 .4 .18
TABLE 5
Segment Description for High and Low BRV Clients
Telecommunications Financial Services
Variable High BRV (n = 44) Low BRV (n = 44) High BRV (n = 47) Low BRV (n = 47)
Average CLV (in thousands) 18.4 5.8 18.7 5.2
Average tenure (years) 10.3 4.9 14.7 6.8
Most common media format Video “Call me” Video “Call me”
Average number of employees 2710 468 2158 318
Average annual revenue 59.4 11.2 70.6 18.8
(in millions of dollars)
This results in a sample size of 440 (88 ones and 352 zeros)
for the telecommunications firm and 470 (88 ones and 376
zeros) for the financial services firm. In this case, the ones Appendix B
represent 100% of the total stratum population, and the
zeros represent a random sample of approximately 7% of
Latent Class Segmentation
the stratum population for both the telecommunications and The purpose of the latent class segmentation is to uncover
financial services firms. We ran the models multiple times whether there are multiple homogeneous segments of client
with different random samples from the zeros and found no references in the portfolio of references for the telecommu-
significant differences in the model results for either of the nications or financial services firms. To determine if multi-
firms. We then use the following equations for our model- ple segments are present, we use the method Jedidi,
ing framework: Ramaswamy, and DeSarbo (1993) developed.
We carry out the latent class segmentation of clients by
Selection Equation:
setting the number of segments to different numbers and
(A3) z*i = w′γ
i + ui
then determining which segmentation scheme provides the
best results based on the consistent Akaike information cri-
⎧ 1 if z*i > 0 terion (CAIC). We found the following results for the finan-
zi = ⎨ * .
⎪⎩ 0 if z i ≤ 0 cial services firm8:
Number of Segments Log-Likelihood CAIC
Censored Regression Equation:
1 –169.42 416.26
(A4) y*i = x′β
i + e i , if z i = 1; and 2 –166.03 491.45
⎧ y* if y*i > 0 3 –162.71 566.78
yi = ⎨ i * . 4 –159.46 642.25
⎪⎩ 0 if yi ≤ 0
Given that the CAIC is lowest for the one-segment solu-
Transformation Equation: tion, we chose that as the optimal number of segments
(Jedidi, Ramaswami, and DeSarbo 1993), where the CAIC
(A5) u*i = J1 ( u i ) = Φ −1 [ F ( u i )]. is an alternative criteria to the AIC that corrects for the
overestimation bias in AIC by penalizing for overparame-
In these equations, u*i and ei are bivariate normal with
terization. It is defined as follows:
means of 0, standard deviations of 1 and
, and correlation
of , where F(ui) is the pseudo logit model specification as CAICm = −2 × ln ⎣⎡ L (Q m )⎤⎦ + N m ( ln I + 1) ,
described previously. In addition, z is the selection variable,
where if zi = 1 the client was chosen to be a reference and if where
zi = 0 the client was not chosen to be a reference. Finally, yi
is only observed when zi = 1 and yi is censored at 0—where L(Q|m) = The likelihood of the model given segment m,
BRVi = yi. The resulting log-likelihood function must Nm = The effective number of parameters estimated
accommodate the selection/truncation, disproportionate in an m-class solution, and
stratification, and censoring issue. As Maddala (1983) I = The number of observations in the sample.
notes, we get the following log-likelihood function: A one-segment solution means that there is no signifi-
cant benefit to segmenting clients into multiple latent seg-
7Given that the results of the latent class segmentation sug-
ments. However, a one segment solution does not mean that
gested one segment, we do not discuss the integration of the latent
class segmentation in our model estimation steps here. For a dis-
cussion of the latent class segmentation, see Appendix B. 8We find similar results for the telecommunications firm.
REFERENCES
Alderson, Wroe (1965), Dynamic Marketing Behavior. Home- sion: An Accessibility-Diagnosticity Perspective,” Journal of
wood, IL: Richard D. Irwin. Consumer Research, 17 (4), 454–62.
Brown, Jacqueline Johnson and Peter H. Reingen (1987), “Social Jedidi, Kamel, Venkatram Ramaswami, and Wayne S. DeSarbo
Ties and Word-of-Mouth Referral Behavior,” Journal of Con- (1993), “A Maximum Likelihood Method for Latent Class
sumer Research, 14 (3), 350–62. Regression Involving a Censored Dependent Variable,”
Connelly, Brian L., S. Trevis Certo, R. Duane Ireland, and Christo- Pyschometrika, 58 (3), 375–94.
pher R. Reutzel (2011), “Signaling Theory: A Review and Kaufman, Peter, Satish Jayachandran, and Randall L. Rose (2006),
Assessment,” Journal of Management, 37 (1), 39–67. “The Role of Relational Embeddedness in Retail Buyers’
Cramer, Mars, Philip Hans Franses, and Erica Slagter (1999), Selection of New Products,” Journal of Marketing Research,
“Censored Regression Analysis in Large Samples with Many 43 (November), 580–87.
Zero Observations,” Econometric Institute Research Report Kimberly, John R. (1976), “Organizational Size and the Struc-
9939/A, Erasmus University. turalist Perspective: A Review, Critique, and Proposal,” Admin-
Daft, Richard L. and Robert H. Lengel (1986), “Organizational istrative Science Quarterly, 21 (4), 571–97.
Information Requirements, Media Richness and Structural Kumar, V., J. Andrew Petersen, and Robert P. Leone (2007), “How
Design,” Management Science, 32 (5), 554–71. Valuable Is Word of Mouth?” Harvard Business Review, 85
Donkers, Bas, Philip Hans Franses, and Peter C. Verhoef (2003), (10), 139–46.
“Selective Sampling for Binary Choice Models,” Journal of ———, ———, and ——— (2010), “Driving Profitability by
Marketing Research, 40 (November), 492–97. Encouraging Customer Referrals: Who, When, and How,”
Fisher, Robert J. (1993), “Social Desirability Bias and the Validity Journal of Marketing, 74 (September), 1–17.
of Indirect Questioning,” Journal of Consumer Research, 20 Lancaster, Tony and Guido W. Imbens (1991), “Choice Based
(2), 303–315. Sampling: Inference and Optimality,” working paper, Depart-
Fombrun, Charles and Mark Shanley (1990), “What’s in a Name? ment of Economics, Brown University.
Reputation Building and Corporate Strategy,” The Academy of Lee, Lung-Fei (1983), “Generalized Econometric Models with
Management Journal, 33 (2), 233–58. Selectivity,” Econometrica, 51 (2), 507–512.
Gershoff, Andrew D., Susan M. Broniarczyk, and Patricia M. West Libai, Barak, Ruth Bolton, Marnix S. Bügel, Ko de Ruyter, Oliver
(2001), “Recommendation or Evaluation? Task Sensitivity in Götz, Hans Risselada, and Andrew T. Stephen (2010),
Information Source Selection,” Journal of Consumer Research, “Customer-to-Customer Interactions: Broadening the Scope of
28 (3), 418–38. Word of Mouth Research,” Journal of Service Research, 13
Godes, David (2008), “Customer Referencing: Three Programs,” (3), 267–82.
Harvard Business School Note 508-101. Maddala, G.S. (1983), Limited Dependent and Qualitative Variables
——— (2012), “The Strategic Impact of References in Business in Econometrics. New York: Cambridge University Press.
Markets,” Marketing Science, 31 (2), 257–76. McCracken, Grant (1989), “Who Is the Celebrity Endorser? Cul-
Goldenberg, Jacob, Sangman Han, Donald R. Lehmann, and Jae tural Foundations of the Endorsement Process,” Journal of
Weon Hong (2009), “The Role of Hubs in the Adoption Consumer Research, 16 (3), 310–21.
Process,” Journal of Marketing, 73 (March), 1–13. Morgan, Robert M. and Shelby D. Hunt (1994), “The Commitment–
Gulati, Ranjay and Martin Gargiulo (1999), “Where Do Inter- Trust Theory of Relationship Marketing,” Journal of Market-
organizational Networks Come From?” American Journal of ing, 58 (July), 20–38.
Sociology, 104 (5), 1439–93. Moriarty, Rowland T. and Robert E. Spekman (1984), “An
Hada, Mahima, Rajdeep Grewal, and Gary L. Lilien (2011), Empirical Investigation of the Information Sources Used Dur-
“Trade-Offs in Supplier-Initiated Referrals,” working paper, ing the Industrial Buying Process,” Journal of Marketing
The Mary Jean and Frank P. Smeal College of Business, Penn- Research, 21 (May), 137–47.
sylvania State University. Petersen, J. Andrew and V. Kumar (2009), “Are Product Returns a
Heide, Jan B. and George John (1990), “Alliances in Industrial Necessary Evil? Antecedents and Consequences,” Journal of
Purchasing: The Determinants of Joint Action in Buyer–Seller Marketing, 73 (May), 35–51.
Relationships,” Journal of Marketing Research, 27 (February), Prins, Remco and Peter C. Verhoef (2007), “Marketing Communi-
24–36. cation Drivers of Adoption Timing of a New E-Service Among
Helm, Sabrina and Risto T. Salminen (2010), “Basking in Existing Customers,” Journal of Marketing, 71 (April),
Reflected Glory: Using Customer Reference Relationships to 169–83.
Build Reputation in Industrial Markets,” Industrial Marketing Reinartz, Werner J., Jacquelyn S. Thomas, and V. Kumar (2005),
Management, 39 (5), 737–43. “Balancing Acquisition and Retention Resources to Maximize
Herr, Paul M., Frank R. Kardes, and John Kim (1991), “Effects of Customer Profitability,” Journal of Marketing, 69 (January),
Word-of-Mouth and Product-Attribute Information on Persua- 63–79.
Industry:
Product/Service:
Financial Services: (1) Business Checking/Savings, (2) Payroll Deposit, (3) Line of
Credit, (4) Loans, (5) Insurance, (6) Investments, and (7) Other
Telecommunications: (1) Landline Phone Service, (2) VOIP (Voice Over IP), (3) Internet
Service, (4) Wireless Service, (5) Maintenance Contracts, (6) Infrastructure, and (7)
Other
Senior-level positions in the following departments within each firm: (1) Marketing, (2)
Finance, (3) Accounting, (4) Information Technology, (5) Human Resources, (6)
Procurement, and (7) Other
Web Appendix W2: Determining the Key Drivers of BRV – Comparison with Null Models
For each of the three null models we use the same selection equation variables. For the censored
regressions we use different set of variables. We estimate the model using the same algorithm as
described in Appendix A of the paper. Results are as follows.
Selection Equation:
Variable Telecommunications
Intercept 0.18 (0.049)
Client Firm Size
Employees 0.062 (0.021)
Revenue 0.00026 (0.0001)
Length of Client Relationship
CLV 0.102 (0.028)
(CLV)2 -0.00024 (0.0001)
Tenure 0.163 (0.056)