Perasan & Timmermann - Predictability of Stock Returns, Robustness and Economic Significance.
Perasan & Timmermann - Predictability of Stock Returns, Robustness and Economic Significance.
Perasan & Timmermann - Predictability of Stock Returns, Robustness and Economic Significance.
Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at .
http://www.jstor.org/page/info/about/policies/terms.jsp. JSTOR's Terms and Conditions of Use provides, in part, that unless
you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you
may use content in the JSTOR archive only for your personal, non-commercial use.
Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at .
http://www.jstor.org/action/showPublisher?publisherCode=black. .
Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed
page of such transmission.
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact [email protected].
Blackwell Publishing and American Finance Association are collaborating with JSTOR to digitize, preserve
and extend access to The Journal of Finance.
http://www.jstor.org
THE JOURNALOF FINANCE . VOL.L, NO. 4 a SEPTEMBER1995
ABSTRACT
This article examines the robustness of the evidence on predictability of U.S. stock
returns, and addresses the issue of whether this predictability could have been
historically exploited by investors to earn profits in excess of a buy-and-holdstrategy
in the market index. We find that the predictive power of various economicfactors
over stock returns changes through time and tends to vary with the volatility of
returns. The degree to which stock returns were predictableseemed quite low during
the relatively calm markets in the 1960s, but increased to a level where, net of
transaction costs, it could have been exploited by investors in the volatile markets
of the 1970s.
1201
1202 The Journal of Finance
strategy accordingto which shares or bonds are held dependingon whether excess
returns on stocks are predictedto be positive or negative.
A third factor that needs to be taken into account when simulating investors'
portfoliodecisionsin "realtime"is transactioncosts. We analyze portfolioreturns
for zero, low, and high transaction cost scenarios to shed light on whether the
predictablecomponentsin stock returns are economicallyexploitablenet of trans-
action costs. Finally, we also considerthe publicavailabilityof statistical methods
and computertechnologyused by investors to computeone-step ahead forecastsof
excess returns. In developingour forecastingequations we use simple statistical
and computing techniques that clearly were publicly available to any investor
throughout the sample period analyzed in this paper. We also provide evidence
based on forecasting techniques that were not available until well into the sev-
enties, since this offers important insights into the potential usefulness of our
methodology for forecasting of stock returns in the future. The availability of
different model selection criteria also raises the issue of uncertainty over the
choiceof modelselection criteria.This problemis addressedin an Appendixwhere
a new profit-basedhyper-selectionprocedureis proposed.
The plan of the article is as follows: Section I discusses how to identify
predictability of stock returns. Section II sets up the real time simulation
experiments and reports the main prediction results for the monthly observa-
tions on U.S. stock returns. The economic significance of the predictions is
assessed through their use in a trading strategy in Section III, and Section IV
provides a discussion of the main findings.
Suppose that, at each point in time, t, an investor searches over a base set of
K factors or regressors to make one period ahead forecasts of excess returns
using only information that are publicly available at the time.3 We simulate
investor's search for a forecasting model by applying standard statistical
criteria for model selection, as well as financial criteria, to the set of regression
models spanned by all possible permutations of the K factors/regressors {xl,
X2X . . . XXKjin the base set.4This gives a total of 2Kdifferentmodels,each of
which is uniquely identified by a number, i, between 1 and 2K.Consider a K X
1 selection vector, vi, composedof ones and zeros where a one in itsjth element
means that the jth regressor is included in the model, whereas a zero in its jth
element means that this regressor is excluded from the model. Then model i
(denoted by Mj) can be represented by the K-digit string of zeros and ones
corresponding to the binary code of its number. Denoting the number of
regressors included in model Mi by Ki, then Ki = e' vi, where e is a K X 1 vector
of ones. Suppose that pT,the excess return at time T, is forecast by means of
linear regressions
Mi : P =T+1 iTi + 1,i
T = 1, 2, ..., t 1. (1)
The OLS estimates are fairly simple to compute (even in the early 1960s) and,
in view of the Gauss-Markov Theorem, are reasonably robust even in the
presence of nonnormal errors in the excess return equation.
The particular choice of XTjto be used in forecasting of PT+ican be based on
a number of statistical model selection criteria suggested in the literature,
such as the R2, Akaike's Information Criterion (AIC) (Akaike (1973)), or
Schwarz's Bayesian Information Criterion (BIC) (Schwarz (1978)).5 These
3 In this article we shall make the simplifying assumption that the base regressors remain in
effect over the whole sample period. However, in principle, one can also consider the possibility of
revising the base set once clear indications of "regimeswitches" are established.
4 An intercept term is included in all the excess return regressions consideredby the investor.
5 There are, of course, other criteria that couldbe used for choosingthe subset of regressors used
where
t-1
= 1 - S2
Rtji (7)
pt
It is easy to show that, in the context of linear regression models, the R2i and
the TCt i criteria are equivalent, in the sense that they select the same model.
We also considered a model selection criterion based on a measure of direc-
tional accuracy, on the grounds that investors in practice often are interested
in predicting the switches in the sign of the excess return function and not
necessarily the magnitude of changes in the excess returns. The derivation of
the 'sign' criterion (SC) based on the directional accuracy of the forecasts
involves two steps. In the first step, one finds the set of regressors that
maximize the proportionof correctlypredicted signs of the excess returns given
by
it
SCt= - > {I(p)(Ti) + (1 - I - J(pTt))}, (9)
T=1
1206 The Journal of Finance
where I(p) is an indicator function that takes the value of unity if p1> 0, and
zero otherwise, and P - is the forecast of p. based on model Mi. In the case of a
draw, i.e., when two or more models correctly predict the same (maximum)
proportionof signs of excess returns, a second step selects a model recursively
according to the R2 criterion.
From the point of view of assessing the market value of predictability of
stock returns, the above statistical criteria can, however, be criticized on the
grounds that they do not take account of transaction costs, and are not
necessarily in accordance with the investor's loss function. To deal with these
shortcomings, we use a forecasting strategy that directly maximizes financial
criteria. In particular we consider a "recursivewealth" criterion and a recur-
sive Sharpe ratio.6 The recursive wealth criterion maximizes the cumulated
wealth obtained using forecasts from model Mi in a switching portfolio, which
we refer to as portfolio i, at time t. The cumulative wealth from such a portfolio
at time t is given by
Wt i = Wo f7 (1 + rT,i), (10)
7=1
it
t E(rTi- l1T
7=1
Sharpet,i = , (11)
it
t- 1 E (rTi -rt)2
where II is the return on a 1-month T-bill held from the end of one month to
the next, and Tti = t-1 Et=, r
We applied all the above model selection criteria to the linear regressions.
For each of the criteria, and based on data up to period t, the model with the
highest value for the criterion function was chosen to forecast excess returns
for period t + 1. For example, in the case of the recursive Sharpe criterion, the
selected model was that which maximized Sharpet,i given by (11) over all of the
2k portfolios, i = 1, 2, 3, ..., 2k. Notice that our approach makes only very
6
We are grateful to a referee for drawing our attention to this work.
Predictability of Returns: Robustness, Economic Significance 1207
7 See, for example, P6tscher (1991) and the references cited therein.
1208 The Journal of Finance
systematic variation of stock returns over the business cycle include Prime
(1946). Dowrie and Fuller (1950), Rose (1960), and Morgan and Thomas (1962).
Variables suggested by these studies to be systematically linked with stock
returns include short and long interest rates, dividend yields, industrial pro-
duction, company earnings, liquidity measures, and the inflation rate.
Based on a review of the early literature (see Pesaran and Timmermann
(1994c)) we established a benchmark set of regressors over which the search
for a "satisfactory"prediction model could be conductedby a potential investor.
The set consists of a constant, which is always included in the model, as well
as nine regressors, namely Xt = {YSPt-1, EPt-1, I't-1, Ilt-2, I12t-1, I12t-2,
rt-2, AIPt-2, AMt-2}, where YSP is the dividend yield, EP is the earnings-price
ratio, Ii is the 1-month T-bill rate, 112 is the 12-month T-bond rate, 11is the
year-on-year rate of inflation, AlIPis the year-on-year rate of change in indus-
trial output, and AM is the year-on-year growth rate in the narrow money
stock. All variables computed using macroeconomicindicators, such as, AIP
and AM, were measured using 12-month moving averages to decrease the
impact of historical data revisions on the results.
The early studies of stock returns are not always clear on what they consider
to be the appropriate time lags between the changes in the business cycle
variables and stock returns. Here, following standard practice in finance, we
decided to include the most recently available values of the macroeconomic
variables in the base set of regressors. The lag associated with the publication
of macroeconomicindicators means that these variables must be included in
the base set with a 2-month time lag. Since the dividend and earning yields are
based on 12-month moving averages, only a one period lag of these variables
was included in the base set. To allow for the possibility, often mentioned in
financial studies, that changes in interest rates rather than their absolute
levels affect stock returns, we also included a two month as well as a one month
lagged value of the interest variables.
A. Data Sources
All variables were measured at monthly frequencies over the period 1954(1)
to 1992(12), and the data sources were as follows: Stock prices were measured
by the Standard & Poor's 500 index at close on the last trading day of each
month. These stock indices, as well as a monthly average of annualized
dividends and earnings, were taken from Standard & Poor's Statistical Ser-
vice. The 1-month T-bill rate was measured on the last trading day of the
month and computed as the average of the bid and ask yields. The source was
the Fama-Bliss risk free rates file on the Center for Research in Security Prices
(CRSP) tapes. Similarly, the 12-month discount bond rate was measured on
the last trading day of the month, using the Fama-Bliss discount bonds file on
the CRSP tapes as the data source. The inflation rate was computed using the
producer price index for finished goods (source: Citibase), and the rate of
change in industrial production was based on a seasonally adjusted index for
industrial production (source: Citibase). The monetary series were based on
Predictability of Returns: Robustness, Economic Significance 1209
the narrow monetary aggregates published by the Federal Reserve Bank of St.
Louis and provided by Citibase. Finally, the dependent variable, excess re-
turns on stocks, Pt, was computed as Pt = (Pt + Dt - Pt-,)/Pt-, - Ilt-1, where
Pt is the stock price, Dt is dividends and IltJ1 is the return from holding a
1-month T-bill from the end of month t - 1 to the end of month t.
The recursive model selection and estimation strategy was based on monthly
observations over the period 1954(1) to 1992(12). The year 1954 was chosen as
the start of the sample for estimation, since reliable monthly measures for
most macroeconomic time series start to become available only after the
Second World War. Also, it was only after the "accord"between the Fed and the
Treasury in March 1951, and after the presidential election in 1952, that the
Fed stopped pegging interest rates and began to pursue an independent
monetary policy (see Mishkin (1992), p. 453). As far as trading in stocks and
bonds are concerned, we took a rather conservative stand and commenced with
the trading at the start of 1960, thus using 6 years of monthly observations as
a preliminary "training" period for estimation. As noted above, by the early
1960s, a number of studies had already suggested the possibility that stock
returns may be varying systematically over the course of the business cycle.
In each case the model selection criteria set out in Section I were applied to
linear regression models using the excess returns on the S & P 500 portfolio as
the dependent variable and subsets of the base set of regressors as the inde-
pendent variables. For our set of nine regressors, this means comparing 29 =
512 models at each point in time, and over the period 1959(12) to 1992(11) this
gives a total of 202,752 regressions to be computed. Of course, we do not
literally assume that investors proceeded with these computations, but we
emphasize the simplicity of the individual steps involved in such a forecasting
procedure: OLS estimation of the models, followed by model selection using
simple choice criteria and then computation of a one-step-ahead forecast. We
also computed forecasts of monthly excess returns based on a model that
included the entire set of regressors. There is no specification uncertainty
associated with this last procedure, according to which only the parameter
estimates are updated recursively in light of new monthly observations.
To summarize, the recursive model specification proceeds as follows: in
1959(12) the values of the selection criteria are computed for each of the 512
possible combinations of regressors from the base set using monthly data over
the period 1954(1) to 1959(12). An intercept term is included in all the regres-
sions. The model that maximizes the discriminant function of a given model
selection criterion is chosen, and the parameter values estimated with obser-
vations over the 1954(1) to 1959(12) period are used to forecast excess returns
for 1960(1). To forecast monthly excess returns for 1960(2), the procedure is
repeated for all the 512 models using monthly data over the period 1954(1) to
1960(1), and so on. Thus, although computationally demanding, our selection
procedure clearly simulates the search procedure which an investor could have
carried out in real time. It also captures the possibility that an investor may
switch from one model to another in light of new empirical evidence obtained
as the sample size expands.
1210 The Journal of Finance
Figure1. RecuItbr-sieoexces
Creturno foecst uneratentiemoelsletonsrae
returns linearreletonsraesso
m s 1.Recursivheprdceio excess
Figure
esthepreimated sfoeatsudraltedrnative
manslected accordi to
rerstivte th fourmodels
r1951,Rshow:Hw
sel.Emigreca1
namlye 19B92l)
s p IC,
the
ous IC,
Cle any S.
prdcePxesreturnsabasedy hen
bott
supp
on reande
the oi th f
lieaurnrgrssio
Sthek
the
alsolshows atuas
o f theexcesstin returonaderesditioon from a
recursively estimated equation with all the nine variables in the base set
included as regressors.9 The recursive predictions based on the various model
selection criteria have very similar patterns showing quite a high degree of
volatility, especially during the early 1980s. This coincides with the period of
high volatility of nominal interest rates resulting from changes in the operat-
The data files and the details of the estimation and forecastingresults are available from the
8
authors on request.
mNotice, however, that the figures giving the recursive forecasts have a different vertical scale
than the actual values of the excess returns. Due to the relatively high variance of actual excess
returns plotting the excess return forecasts and their realizations on the same scale would have
obscured the differences that exist between the different recursive forecasts.
Predictability of Ret urns: Robustness, Economic Significance 1211
smallerthan ~~~~~~~~~~Mthey
volatility ofth ctaleceseurs
recursive forecasts obtained under the different model selection criteria and
the actual excess returns. The fit of the recursive forecasts is relatively high in
the early 1960s (with values of the r2 being around 0.20), and increases
substantially during 1962, but then starts to decline until the early 1970s.
With increased volatility of the markets in 1974, the fit of the recursive
10 The recursive standard error estimates in Figure 2 show the trend in volatility of excess
returns conditional on the information in the base set of regressors. Similar trends can also be seen
in unconditional measures of volatility, such as the recursively estimated standard deviations of
the actual excess return series.
1212 The Journal of Finance
astmarsured bycin
rneturans of the
reusvsoeastprlaie,
stheafityuohn towhereiatuale
earlyen1962ehere thgues2 volatilit thet marketugalsol etilnt up le toSa
d
simil markecoincluin. cogntricastt in4the sredictandardy eorstock
increase
swichs"l hee theoud01 markets
o arselactivl a
neted ih nvestorhaepkar-
oFture r cursive forecastreturn aftr ,thndrdngt
equations tob 1987 stocthematr
rticularluncertain ofrwhichlforecastingumode tohuefohwrzcrteraiong.Thepsd
calrer, ini ctinrensg ith this epieode hais suomewhatdifferent fbromthe onestin
4.
1re962sman1in7ed e aculaly onouncess perns.
simil arkcocuion.creaotrstedh incread
1974 the
prditability erofrstc
forsachs" ohefr thevariets insignificantly
the bsee orunsegstsors aTbendpvese ant then
rtrsasmauebyteftof the forecasting
recursive afto Otbr18socmarktua
the
ecenagleofunperids wh foreequlativemodelrss including ther caurnsv the sei e
mdels nAs
criteri, herxpe
togbe
aloindcrating batla
thathethisond thea
epeisode This suggewt theAkalikecite ia tend
antdc hatdifrenitabilithe toU
onestoc
a
perahcointaeideridswiher deliegrsosicue in the
vaurfrfraltecursiely selection
Table I
Percentage of Periods Where a Regressor is Included
in Forecasting Equations
The results are based on monthly excess return equations selected and estimated recursively over
the period 1960(1) to 1992(12). Each month the set of regressors that maximizes a given model
selection criterion was determined and used to forecast stock returns one month ahead. For a
definition of the statistical model selection criteria, see Section II of the article. The regressors are
YSP(- 1) = dividend yield lagged one period, EP(- 1) = earnings-price ratio lagged one period
I1(-1) = one-month T-bill rate lagged one period, I1(-2) = one-month T-bill rate lagged two
periods, 112(- 1) = twelve-month T-bill rate lagged one period, 112(-2) = twelve-month T-bill rate
lagged two periods, fl(-2) = inflation rate lagged two periods, AIP(-2) = change in industrial
production lagged two periods, and AM(-2) = monetary growth rate lagged two periods.
Percentages
Selection
Criteria YSP(-1) EP(-1) I1-1) I1(-2) 112(-1) 112(-2) II(-2) AIP(-2) AM(-2)
Akaike 70.5 9.6 98.5 25.0 27.0 31.3 51.8 74.7 84.6
Schwarz 62.9 0.0 93.9 22.0 2.8 34.8 0.0 8.8 28.3
A2 69.7 20.5 99.2 23.0 44.7 42.9 55.8 87.9 89.6
Sign 62.4 44.2 72.5 54.8 49.7 50.0 59.6 58.6 76.5
select more regressors than does the Schwarz criterion. The latter criterion
imposes a much heavier penalty for inclusion of an additional regressor than
do the former criteria, and this difference becomes particularly marked as the
sample size is increased from 72 to 468 observations over the 1960 to 1992
period.
An alternative, and in many respects more comprehensive, method of exam-
ining the robustness of the factors contributing to the predictability of stock
returns would be to consider the time-profile of the inclusion frequencies of the
different factors in the forecasting model. The graphs in Figure 4 provide such
time-profiles for the R2 criterion, and show the periods in which a regressor is
included (the graph takes a value of 1) or excluded (the graph takes a value of
0) from the model used for the one-period ahead prediction of excess returns.
Similar graphs for the other model selection criteria are also available from the
authors, and are not presented here to save space." Since we are searching for
a model specification over a large number of time periods and across different
combinations of regressors, it is possible that a regressor occasionally gets
included by chance and not because it is statistically significant for prediction
of excess returns. In such cases, however, it is unlikely that the regressor
under consideration will be included in the forecasting equation for long in
subsequent periods. In contrast, when a regressor is selected in a large pro-
portion of the time periods and on a continuous basis, then it is reasonable to
11The results for the Akaike criterion were very close to those for the R2 criterion. The Sign
criterion did not provide much information about periods in which specific regressors are included.
Because of the discontinuous nature of this criterion, the number of switches between periods
where a variable is included in the model and periods where it is excluded from the model is much
higher for the Sign criterion than for any of the other model selection criteria.
1214 The Journal of Finance
question Rto
-~h.""t in-.t
regrsso
expect~~~~Rthe an"impotant fac--t
be.W in genertinMthe
-tor4.ob
theqecdiidn
Figure 4 showsuthat yielvariablesith iaseselete indemost pemodsl
from 1970 onwards. This finding supports the many recent studies that find
the yield variable to be statistically significant in predicting stock returns (e.g.,
Campbell (1987), Fama and French (1989)). Our results, however, suggest that
the correlation between yields and excess returns has become particularly
Predictability of Returns: Robustness, Economic Significance 1215
strong only after 1970.12 Compared to the dividend yield variable, the earn-
ings-price ratio lagged one month is not selected as often in the forecasting
models; in fact, this regressor is never chosen by the Schwarz criterion.
The 1-month interest rate variable lagged one month is excluded in the
forecasting models in most periods (see Figure 4), whereas the two-month
lagged value of the 1-month interest rate, I't-2, is included as a regressor in
the forecasting models mainly during the 1975 to 1982 period. In the case of
the longer interest rate lagged one month, J12t-1, it is clear from Figure 4 that
this variable is selected by the R2 criterion (but not by the Schwarz criterion),
during the 1976 to 1979 periods, and again after 1982. This is an interesting
finding since the periods when the J12t-1 variable is not included in the
forecasting model coincide closely with the period from October 1979 to Sep-
tember 1982, when the Federal Reserve ceased to target interest rates. It
suggests that the 12-month interest rate has predictive power over excess
returns in regimes where the Federal Reserve targets interest rates, but not in
regimes where monetary aggregates are targeted. A similar conclusion also
emerges with respect to the 12-month interest rate lagged two months, 112t-2.
Using the R2 model selection criterion, the inflation variable lagged two
periods (t-2) is included in the forecasting equations primarily after the first
oil shock. In contrast, the Schwarz criterion does not select this variable at all.
Figure 4 also shows that the rate of change in industrial production lagged two
periods (AlPt-2) tends to be included in the forecasting models from 1964
onwards, when the R2 model selection criterion is adopted. Once again, by
comparison the Schwarz criterion rarely selects the lPt-2 variable. Finally,
using the R2 criterion, the money growth variable, \Mt-2, gets selected con-
tinuously from 1964 onwards, but the same is not true when the Schwarz
criterion is considered, which selects the money growth variable 28 percent of
the times.
The different outcomes obtained under the R2 and the Akaike Criteria on the
one hand, and under the Schwarz criterion on the other, lies in the fact that
the Schwarz criterion penalizes inclusion of variables more heavily than
either the Akaike or the R2 criteria. This may be a drawback for the Schwarz
criterion since, in the event of a structural break in the underlying data
generating process, this criterion may detect the change at a slower rate than
the other criteria.
In a recent study, Bossaerts and Hillion (1994)13 also find evidence support-
ing the conclusion that the best prediction model for monthly stock returns
changes over time. Bossaerts and Hillion compare the in-sample and out-of-
sample forecasting performance of models selected according to a variety of
standard model selection criteria and develop a new model selection criterion
12 On this point see also the recent papers by Goetzmannand Jorion (1993) and Nelson and Kim
(1993), who find that, after correctingfor lagged endogenousvariable bias, the correlationbetween
lagged values of the dividend yield and excess returns on stocks is particularly strong after the
Second WorldWar.
13
We are grateful to an anonymous referee for bringing this research to our attention.
1216 The Journal of Finance
Table II
Predictive Accuracy of Excess Return Forecasts over 1960(1) to
1992(12) and Three Sub-Periods
The PT statistic is the nonparametric test statistic for market timing proposed in Pesaran and
Timmermann (1992). This test, which is asymptotically equivalent to the Henriksson-Merton
(1981) test of market-timing, has a standardized normal distribution in large samples. All selec-
tion criteria were applied recursively (see Section II). The hyper-selection criterion is described in
the Appendix. The recursive wealth procedure uses as a forecasting model the one that, at each
point in time, generated the largest wealth (net of transaction costs) when its forecasts were used
in a simple trading strategy. The recursive Sharpe criterion is based on a similar procedure with
the difference that it is now the Sharpe ratio corresponding to trading results based on the set of
predictions generated by a particular regression model that is being maximized recursively.
15
For a more detailed discussion of transaction costs and their relation to commissionfees and
bid-ask spreads, see Pesaran and Timmermann(1994a).
Predictability of Returns: Robustness, Economic Significance 1219
Based on the forecast of excess returns for period t + 2, the portfolio allocation
procedure is repeated at the end of period t + 1. The size of the transaction
costs incurred through the reallocation of funds depends on the composition of
the investor's existing portfolio in bonds (Bt) or in stocks (Nt), and on the
selected portfoliocompositionfor period t + 1. This gives four different cases to
be considered:
Case I (Reinvest Cash Dividends in Shares)
Using these formulae the value of the investor's funds at the end of period t + 2
becomes
Wt+2 = Nt+1(Pt+2 + Dt+2) + Bt+1(1 + rt+i). (15)
Table III
Performance Measures for the S&P 500 Switching Portfolio
Relative to the Market Portfolio and T-Bills
(Monthly Results: 1960(1) to 1992(12))
The switching portfolios are based on recursive least squares regressions of excess returns on an
intercept term and a subset of regressors selected from a base set of 9 variables according to
different statistical model selection criteria and financial performancecriteria. See Section II of
the article for a definition of the statistical and financial selection criteria. The hyper-selection
criterion is described in the Appendix. The columns headed Zero, Low, and High refer to the
portfolio returns under the three transaction costs scenarios described in Section III. A of the
article. The final wealth figures assume that investors start off with $100 at the beginning of 1960
and reinvest portfolioincome every month. The recursive wealth procedureuses as a forecasting
model the one that, at each point in time, generated the largest wealth (net of transaction costs)
when its forecasts were used in a simple trading strategy. The recursive Sharpe criterionis based
on a similar procedurewith the only difference that it is now the Sharpe ratio correspondingto
trading results based on the set of predictions generated by a particular regression model that is
being maximized recursively. S.D. is standard deviation.
16This should be compared to the findings in Phillips (1992) which report that a model
specification that includes a large number of autoregressive lags, as well as deterministic trends,
tends to produce worse predictions than models selected recursively according to his Bayesian
Posterior Information Criterion.
1222 The Journal of Finance
annum. Thus, under the low transaction cost scenario, mean returns on the
switching portfolios based on predictions from models selected according to
Schwarz's criterion are now lower than the mean returns on the market
portfolio. In comparison, transaction costs hardly affect the mean return on the
buy-and-hold strategy, since the only turnover associated with this portfolio
arises from reinvestment of the dividends. Even so, under this low transaction
cost scenario, the switching portfolios based on the forecasts produced by
models that either included all regressors or were recursively selected accord-
ing to any of the criteria (apart from the Schwarz's criterion) continue to pay
higher mean returns with a lower standard deviation than the market index.
This is the case despite the fact that the number of portfolio switches is
between two and three per year, depending on which set of forecasts is used.
With "high" transaction costs of 1 percent on shares and 0.1 of a percent on
bonds, the mean return on the switching portfolios based on forecasts using the
R2 and the Akaike criteria still exceed the mean return on the market portfolio.
Furthermore, as witnessed by the values of the Sharpe ratios, even with high
transaction costs the switching portfolios based on predictions using these
model selection criteria still offer a better risk-return trade-off than the mar-
ket portfolio. Notice the sharp decline in the performance of the switching
portfolios based on financial criteria as transaction costs are introduced. This
suggests that a two-step procedure using statistical model selection criteria to
compute recursive forecasts of stock returns and then trading on the basis of
these forecasts may be better at identifying predictability in the stock market
than a more direct procedure based on a forecasting model selected according
to a financial criterion.
Using the test statistic suggested by Gibbons, Ross, and Shanken (GRS)
(1989), we computed the joint significance of the intercept terms in regressions
of monthly excess returns of the eight switching portfolios on a constant and
the excess return on the market portfolio. In the case of zero transaction costs
the value of the GRS test statistic was 3.26 (0.001). But as to be expected, the
GRS test statistic declined to 2.36 (0.017) and 1.96 (0.05) for the low and high
transaction cost scenarios, respectively. Rejection probability values are pro-
vided in brackets after the value of the test statistics.17 Clearly, the mean-
variance efficiency of the buy-and-hold strategy is rejected.
We also analyzed the performance of the switching portfolios over the
sub-periods 1960 to 1969, 1970 to 1979 and 1980 to 1989 (see Table IV). For all
three subperiods, the portfolios based on forecasts using the Akaike, R2, or the
sign criteria paid a higher mean return than the buy-and-hold strategy under
the zero transaction cost scenario. The switching portfolios based on the
remaining model selection criteria only paid a higher mean return than the
market during the 1970s and 1980s, while the switching portfolio using the
Schwarz criterion paid a higher mean return than the market index only
during the 1970s. When transaction costs are introduced, it becomes even
17 Under the null hypothesis that the market portfolio is mean-variance efficient the Gibbons,
Table IV
Risk and Returns of Different Portfolios for Subperiods:
1960s, 1970s, and 1980s
See the notes to Table III for details of the various procedures.
1224 The Journal of Finance
clearer that the higher mean returns on the switching portfolios are concen-
trated in the 1970s. Since the standard deviation of returns in the stock
market was particularly high during the 1970s, these results seem to indicate
that, if ever there was a possibility that investors could improve their market
timing based on a simple forecasting procedure similar to ours, this was during
the volatile periods in the 1970s where macroeconomic risks and volatility in
nominal magnitudes, such as the rate of inflation and nominal interest rates,
mattered the most.
Because the portfolios based on forecasts using models recursively selected
according to the R2, Akaike, and the Sign criteria were quite successful, while
portfolios based on the Schwarz criterion were not as successful in terms of the
values generated for the financial performance measures, it raises the issue of
whether our results can be explained by uncertainty over the choice of model
selection criterion. This problem is addressed in the Appendix, where it is
shown that the switching portfolios continue to strongly outperform the buy-
and-hold strategy, even if the choice of the model selection criterion is made
endogenous to the forecasting and the trading processes. The hyper-selection
procedure advanced in the Appendix for the resolution of the uncertainties
over the choice of model selection criteria and the forecasting model can also be
viewed as an artificial intelligence system capable of detecting unexploited
profit opportunities in the market. Clearly, it would be possible to devise more
comprehensive and sophisticated artificial intelligence systems for the analy-
sis of stock market predictability. However, a comparative analysis of such
systems fall outside the scope of the present paper.
18 One possibility is that, during the periods of high volatility and high inflation in the early
1970s, stocks acted as an inflation hedge making investors more willing to accept low or even
negative expected excess returns of stocks. For a more detailed discussion of the equilibrium
conditionsunder which the predictedexcess return on stocks can be negative in certain states, see
Pesaran and Potter (1993).
1226 The Journal of Finance
Appendix
Uncertainty Over the Choice of Model Selection Criterion-A Profit-Based
Hyper-Selection Criterion
It is clear fromthe empiricalresults reportedin Section III that although most
of the model selection criteria consideredgenerate a profitrelative to the market
index, this is not the case for the Schwarz criterion under the low or high
transaction cost scenarios. Without some rule for choosing a model selection
criterionan investor could not, without the benefit of hindsight, have been guar-
anteed to chooseone of the more successful selection criteria.In this Appendixwe
address this issue and considerthe problemof how an investor could resolve the
uncertainty surroundingthe choice of model selection criterion.
In view of the objective of the exercise we consider a profit-based hyper-
selection criterion that we employ recursively to choose the model selection
criterion to be used subsequently for selecting the forecasting model. The idea
is similar to choosing a subset of regressors from the base set of regressors
explained in detail in Section II. Here, however, there are two levels at which
the search for a suitable forecasting equation needs to be conducted. First, a
model selection criterion needs to be chosen from the base set consisting of the
five statistical model selection criteria, namely the R2, Akaike, Schwarz, and
the Sign criteria, as well as the general model specification that includes all
Predictability of Returns: Robustness, Economic Significance 1227
REFERENCES
Akaike, H., 1973, Informationtheory and an extension of the maximum likelihood principle, in
B.N. Petrov and F. Csaki, Eds., Second International Symposium on Information Theory,
Akademiai Kiado, (Budapest, Hungary), 267-281.
Amemiya, T., 1980, Selection of regressors, International EconomicReview 21, 331-345.
Angas, L.L.B., 1936, Investment for appreciation. Forecasting movements in security prices.
Technique of Trading in Shares for Profit (Macmillan, London).
Balvers, R.J., T.F. Cosimano, and B. McDonald, 1990, Predicting stock returns in an efficient
market, Journal of Finance 45, 1109-1128.
Bossaerts, P., and P. Hillion, 1994, Implementing statistical criteria to select return forecasting
models, Workingpaper, Caltech.
Breen, W., L.R. Glosten, and R. Jagannathan, 1990, Predictablevariations in stock index returns,
Journal of Finance 44, 1177-1189.
1228 The Journal of Finance
Campbell,J.Y., 1987, Stock returns and the term structure, Journal of Financial Economics 18,
373-399.
Cochrane, J.H., 1991, Production-basedasset pricing and the link between stock returns and
economicfluctuations, Journal of Finance 46, 209-238.
Dowrie, G.W. and D.R. Fuller, 1950, Investments (second ed.). (John Wiley, New York).
Fama, E.F., 1991, Efficient capital markets: II, Journal of Finance 46, 1575-1617.
Fama, E.F., and K.R.French, 1989, Business conditionsand expectedreturns on stocks and bonds,
Journal of Financial Economics 25, 23-49.
Ferson, W.E., and C.R. Harvey, 1993, The risk and predictabilityof international equity returns,
Review of Financial Studies 6, 527-566.
French, K.R., G.S. Schwert, and R.F. Stambaugh, 1987, Expected stock returns and volatility,
Journal of Financial Economics 19, 3-30.
Gibbons, M.R., S.A. Ross, and J. Shanken, 1989, A test of the efficiency of a given portfolio,
Econometrica 57, 1121-1152.
Glosten, C.R.,R. Jagannathan, and D.E. Runkle, 1993, On the relation between the expectedvalue
and the volatility of the nominal excess returns on stocks, Journal of Finance 48, 1779-1802.
Goetzmann,W.N., and P. Jorion, 1993, Testing the predictivepower of dividendyields, Journal of
Finance 48, 663-680.
Henriksson, R.D., and R.C. Merton, 1981, On market timing and investment performance.
II. Statistical proceduresfor evaluating forecasting skills, Journal of Business 54, 513-533.
Jensen, M.C., 1978, Some anomalous evidence regarding market efficiency,Journal of Financial
Economics 6, 95-101.
Leitch, G., and J.E. Tanner, 1991, Economicforecast evaluation: Profits versus the conventional
error measures, American Economic Review 81, 580-590.
Mallows, C.P., 1973, Some comments on Cp, Technometrics15, 661-675.
Mishkin, F.S., 1992, The economics of money, banking, and financial markets, Third ed. (Harper
Collins Publishers, New York).
Morgan,E.V., and W.A.Thomas, 1962, The stock exchange. Its history and functions, (Elek Books,
London).
Nelson, C.R., and M.J. Kim, 1993, Predictable stock returns: The role of small sample bias,
Journal of Finance 48, 641-662.
Pesaran, M.H., and S. Potter, 1993, Equilibriumasset pricing models and predictabilityof excess
returns, Department of Applied Economics,Workingpaper, CambridgeUniversity.
Pesaran, M.H., and A. Timmermann, 1992, A simple nonparametric test of predictive perfor-
mance, Journal of Business and Economic Statistics 10, 461-465.
Pesaran, M.H., and A. Timmermann, 1994a, Forecasting stock returns. An examination of stock
market trading in the presence of transaction costs, Journal of Forecasting 13, 335-367.
Pesaran, M.H., and A. Timmermann, 1994b, A generalisation of the nonparametricHenriksson-
Merton test of market timing, Economics Letters 44, 1-7.
Pesaran, M.H., and A. Timmermann, 1994c, The use of recursive model selection strategies in
forecasting stock returns, Department of Applied Economics,University of Cambridge,Work-
ing paper No. 9406.
Phillips, P.C.B., 1992, Bayesian model selection and prediction with empirical applications.
Cowles Foundation Discussion Paper No. 1023, Yale University.
Phillips, P.C.B., and Ploberger, 1994, Posterior odds testing for a unit root with data-based model
selection, Econometric Theory 10, 744-808.
Potscher, B.M., 1991, Effects of model selection on inference, EconometricTheory7, 163-185.
Prime, J.H., 1946, Investment analysis (Prentice Hall, New York).
Rose, H.B., 1960, The economicbackgroundto investment (CambridgeUniversity Press).
Schwarz, G., 1978, Estimating the dimension of a model, Annals of Statistics 6, 461-464.
Shibata, R., 1976, Selection of the order of an autoregressive model by Akaike's information
criterion,Biometrika 63, 117-126.
Theil, H., 1958, Economicforecasts and policy, (Amsterdam,North Holland).
Timmermann,A., 1993, How learning in financial markets generates excess volatility and pre-
dictability in stock prices, Quarterly Journal of Economics, 108, 1135-1145.