Alternative Approaches To Estimating VAR For Hedge Fund Portfolios
Alternative Approaches To Estimating VAR For Hedge Fund Portfolios
Alternative Approaches To Estimating VAR For Hedge Fund Portfolios
qxd
1/29/04
5:11 PM
Page 1
INTRODUCTION This chapter compares four different approaches to estimating value-at-risk (VAR) for hedge fund portfolios. We focus on approaches that are based on the thin-tailed normal, fat-tailed generalised error distributions (GEDs), an extreme value approach that approximates the tails of the return distribution asymptotically, and the Cornish-Fisher (CF) expansion that takes into account skewness and kurtosis of the empirical distribution. The main difficulty common to all these VAR models is the estimation of the required quantile of the loss distribution, since there is no analytical representation of this distribution. The VAR numbers calculated by a specific methodology are compared to the actual losses. The results indicate that accuracy is rather poor for VAR methods relying only on the first two moments of the loss distribution. The inclusion of higher moments through the CF expansion results in more accurate estimates of the actual VAR thresholds. Hedge fund strategies vary substantially. They have great flexibility regarding asset classes, trading styles, markets, level of transparency and liquidity. They hold long and short positions, use leverage through borrowing, exploit arbitrage opportunities and
*The views expressed herein are solely those of the authors and do not necessarily reflect the views of Citigroup Alternative Investments and its affiliates.
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 2
trade in derivatives extensively. There are more than 10 distinct investment strategies used by hedge funds, each offering different riskreturn characteristics. Extent of risk would be different for different hedge fund strategies due to their style of operation and selection of assets and markets. While there is now increasing evidence that hedge funds may offer relatively higher means and lower variances, such funds also give investors third- and fourthmoment attributes that are exactly the opposite to those that are desirable. Hedge fund returns come with negative skewness and higher kurtosis, which in turn causes non-normality in their return distributions. Especially after the collapse of Long-Term Capital Management (LTCM) in August 1998, the importance of sound risk management and measuring the performance on a risk-adjusted basis have been strongly emphasised for hedge funds. Also recently, there has been an increased focus on the determination of capital requirements for hedge funds to meet catastrophic market risk. This increased focus has led to the development of various risk-measurement techniques for hedge fund portfolios. The primary technique is VAR, which determines the maximum expected loss on a portfolio of assets over a certain holding period at a given confidence level (probability).1 Since hedge funds trade in multiple asset classes, a uniform measure of risk is needed. VAR does just that, for any traded instruments. VAR has gained increasing acceptance among many hedge funds in the past few years, and nowadays most hedge funds and funds of funds are using VAR to measure the risk to their portfolios. One advantage of VAR is that it is an intuitively appealing measure of overall risk that can be easily conveyed to senior management and investors. This increased focus on the risk management of hedge funds also motivated academic and practitioner-oriented research in the area of hedge fund risk exposure. Jorion (2000) studies LTCMs VAR and estimates the amount of capital that is necessary to support its risk profile. He finds that LTCM severely underestimates its risk due to its reliance on short-term history and risk concentration. Agarwal and Naik (2002) use a mean-conditional VAR framework, and demonstrate the extent to which the mean-variance framework underestimates the tail risk. They show how the conditional VAR framework that explicitly accounts for the negative tail risk can be applied to construct portfolios of hedge funds. Gupta and
2
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 3
Liang (2001) use the extreme value theory (EVT) to estimate VAR thresholds, and infer capital adequacy from these VARs for the hedge fund industry. They also use the normal distribution to test the empirical performance of the extreme value approach.2 Theory and practice show that standard assumptions either the investors have quadratic utility or the asset returns are jointly normally distributed that justify the use of mean-variance theory cannot be applied to a risk-averse agent investing part of its wealth in a portfolio of hedge funds. Hedge fund instruments usually have significant negative skewness along with high kurtosis, which make their returns distribution far from normal. Geman and Kharoubi (2003) support this hypothesis, and find that the assumption of normality is inappropriate for hedge funds, unlike typical stock and bond benchmarks. Working in a mean-variance framework implies that the investor is missing a significant part of the risk that is inherent in hedge funds. Based on this conclusion, we define a VAR model that takes into account the mean, variance, skewness and kurtosis of the hedge fund returns distribution. We define the risk of the portfolio using the standard VAR corrected by the CF (1937) expansion. We also use an extreme value approach of Bali (2001) that approximates the tails of the return distribution asymptotically instead of imposing a symmetric thin-tailed functional form like the normal or lognormal distribution. Although VAR measures based on the traditional parametric approach with normal density may provide acceptable estimates of the maximum likely loss under normal market conditions, Longin (2000), McNeil and Frey (2000) and Bali (2001) show that they fail to account for extremely volatile periods corresponding to financial crises. The previous literature on EVT indicates that the VAR measures based on the distribution of extreme returns, instead of the distribution of all returns, provide good predictions of catastrophic market risks during extraordinary periods. We compare four alternative approaches to calculating VAR for hedge fund indices. We focus on approaches that are based on the thin-tailed normal distribution, the fat-tailed GED, an extreme value approach that approximates the tails of the return distribution asymptotically, and the CF expansion that takes into account skewness and kurtosis of the empirical distribution. The main difficulty common to all these VAR models is the estimation of the required
3
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 4
quantile of the loss distribution, since there is no analytical representation of this distribution. The VAR numbers calculated by a specific methodology are compared to the actual losses using alternative performance measures: Determination Coefficient (or regression R2), Theil Inequality Coefficient (TIC), heteroskedasticityadjusted mean absolute (HMAE) and root mean square errors (HRMSE). The results indicate that the accuracy of VAR methods that rely only on the first two moments of the loss distribution is rather poor. The inclusion of higher moments through the CF expansion and the modelling of extreme tails of the return distribution, yield more accurate estimates of the actual VAR thresholds. The chapter is organised as follows. The next section presents alternative VAR models. The following section, Data, describes the hedge fund index returns data. The section Empirical results provides the empirical result and the following section concludes the chapter. VALUE-AT-RISK MODELS The traditional VAR models assume that the probability distribution of log-price changes (log returns) is normal. However, the distributions of log returns of financial assets are usually skewed to the left, have fat tails, and are peaked around the mode. The fat tails suggest that extreme outcomes happen much more frequently than would be predicted by the normal distribution.3 This section presents alternative VAR models based on the normal distribution, the GED, the EVT and the CF expansion.4 In continuous time diffusion models, (log)-stock price movements are described by the following stochastic differential equation, dlnPt dt dWt
(1)
where Wt is a standard Wiener process with zero mean and variance of dt, and are the constant drift and diffusion parameters of the geometric Brownian motion. In discrete time, equation (1) yields a return process: ln Pt ln Pt Rt t t
(2)
where t is the length of time interval in which the discrete time t is the Wiener process with zero data are recorded and Wt mean and variance of t since is a random variable drawn from
4
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 5
the standard normal density, ie, E( ) 0 and E( 2) 1. Equation (2) implies that assuming t 1, (R )/ . The critical step in calculating VAR measures is the estimation of the threshold point defining what variation in returns Rt is considered to be extreme. Let be the probability that Rt is less than the threshold . That is,
Pr ( Rt ) Pr a
(3)
where Pr( ) is the underlying probability distribution, and are the mean and standard deviation of Rt. In the traditional parametric VAR model with normal distribution, 1% and a 2.326:5 Normal 2.326
(4)
There is substantial empirical evidence that the distribution of hedge fund returns is typically skewed to the left and leptokurtic. That is, the unconditional return distribution shows high peaks, fat tails and more outliers on the left tail. This implies that extreme events are much more likely to occur in practice than would be predicted by the thin-tailed normal distribution. This also suggests that the normality assumption can produce VAR numbers that are inappropriate measures of the true risk faced by hedge funds. To account for excess kurtosis in the data, we use the fat-tailed GED that accounts for the non-normality of returns and relatively infrequent events. The GED density used to model VAR and observed leptokurtosis in hedge fund data is given by equation (5):
fv ( t ) v exp[( 1/2) t/ ] 2[( v 1)/v] (1/v)
v
(5)
where
(Rt
(1/v) 2 , (3/v)
and v 0 is the degrees of freedom or tail-thickness parameter. For v 2, the GED yields the normal distribution, while for v 1 it yields the Laplace or the double exponential distribution. If v 2, the density has thicker tails than the normal, whereas for v 2 it has thinner tails.
5
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 6
VAR is simply a specific percentile of a portfolios potential loss distribution over a holding period. Assuming Rt fv( t), where fv( t) is the GED density in equation (5), VAR is the solution to:
GED ( )
fv ( )d
(6)
where GED( ) is the VAR threshold based on the GED density with a loss probability of . Equation (6) indicates that VAR can be calculated by integrating the area under the probability density function of the GED given by equation (5). Since hedge fund index returns are skewed and fat-tailed we cannot use a VAR formula that assumes a normal distribution. An alternative method is to use the moments of the distribution. We estimate VAR using the CF (1937) expansion that adjusts the traditional VAR with the skewness and kurtosis of the empirical distribution: CF( ) ( )
(7)
where is the average return, is the standard deviation and ( ) is the critical value based on the loss probability level, skewness and kurtosis of the empirical distribution: ( ) z( ) 1 (z( )2 6 1)S 1 (z( )3 24 3z( ))K
(8)
1 (2z( )3 36
5z( ))S2
where z( ) is the critical value from the normal distribution for probability (1 ), S is the skewness, and K is the excess kurtosis.6 Equation (7) indicates that the CF expansion allows us to compute VAR for a distribution with asymmetry and leptokurtosis. Note that, if the distribution is normal, S and K are equal to zero, which makes ( ) equal to z( ). We should also note that the symmetric GED density does not allow for asymmetric treatment of upside potential and downside risk. In other words, the GED does not take into account skewness although it accounts for leptokurtosis. In practice, we know that portfolios respond asymmetrically to good and bad states. An important advantage of the CF (1937) expansion is that
6
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 7
it allows investors to treat losses and gains asymmetrically. In addition, as presented in Table 1, skewness statistics of hedge fund returns are found to be significant at the 1% or 5% level. Therefore, we expect that the VAR thresholds obtained from the CF (1937) expansion, CF( ), be more accurate than the thresholds estimated by the GED and normal density, GED( ) and Normal( ). An alternative provided in the EVT literature is to work with the extreme value distribution H() instead of Pr( ), and then determine the threshold level by going backwards from to by solving: H() 1
(9)
given the value of . As shown in Bali (2001), the generalised Pareto distribution (GPD) GPDmin ( M; , , ) 1 M
1
(10)
where M denotes the minimal returns, k and n are the number of extremes and the number of total data points, respectively. Once the location ( ), scale ( ) and shape ( ) parameters of the GPD are estimated one can find the VAR threshold, EVT, based on the choice of confidence level .7 As discussed in Panel 1, the regression method, which is based on the order statistics of extremes from a uniform parent, is used to estimate the tails of the hedge fund returns distribution.8 Note that the location and scale parameters of the GPD approximately correspond to the mean and standard deviation parameters of the normal distribution. DATA The hedge fund indices used in this study were obtained from Hedge Fund Research, Inc. (HFR), which is one of the best-known and largest hedge fund databases currently available. There were several reasons behind choosing HFR indices. First, they maintain the
7
IHFI-Bali.qxd
1/29/04
150)
Worst (%) Best (%)
5:11 PM
HFRI index
Page 8
Convertible arbitrage Distressed securities Emerging markets (total) Equity hedge Equity-market-neutral Equity non-hedge Event-driven Fixed income (total) Fixed income: arbitrage index Fixed income: high-yield index Fund-of-funds index Macro index Market-timing index Merger-arbitrage index Relative-value arbitrage index Short-selling index Statistical arbitrage index
0.90 0.85 0.63 1.31 0.80 1.16 1.09 0.70 0.53 0.54 0.63 0.84 0.99 0.94 0.87 0.52 0.73
1.02 1.63 4.64 2.83 0.97 4.33 1.93 0.96 1.29 1.42 1.89 2.28 2.11 1.10 1.00 7.04 1.10
1.31*** 1.81*** 0.75*** 0.30 0.03 0.47*** 1.34*** 1.26*** 2.77*** 1.90*** 0.22 0.02 0.18 2.66*** 2.84*** 0.16 0.17
6.44*** 12.36*** 6.75*** 4.38*** 3.30 3.45* 8.75*** 7.09*** 15.29*** 10.54*** 6.22*** 3.48** 2.35 15.18*** 20.47*** 3.95*** 3.04
79.35*** 428.82*** 69.26*** 9.45*** 0.41 4.62* 171.05*** 97.95*** 772.26*** 303.39*** 44.88*** 1.02 2.38 750.19*** 1,434.12*** 4.29 0.51
3.19 8.50 21.02 7.65 1.67 13.34 8.90 3.27 6.45 7.16 7.47 6.40 3.28 5.69 5.80 21.21 2.00
3.33 5.06 14.80 10.88 3.59 10.74 5.13 3.28 3.04 2.98 6.85 6.82 5.96 2.47 2.80 22.84 3.60
Standard errors of the skewness and kurtosis estimates, computed under the null hypothesis that hedge fund returns are normally distributed, are 6/n and 24/n , respectively. Jarque-Bera, JB n[(S2/6) (K 3)2/24], is a formal test statistic for testing whether the returns are normally distributed, where n denotes the number of observations, S is skewness and K is kurtosis. The test statistic distributed as the Chi-square with two degrees of freedom measures the difference of the skewness and kurtosis of the series with those from the normal distribution. The critical values 4.61, 2 5.99, and 2 9.21. with two degrees of freedom at the 10%, 5%, and 1% level of significance are 2 (2,0.10) (2,0.05) (2,0.01) *, **, *** denote the 10%, 5% and 1% level of significance, respectively.
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 9
and the corresponding excesses by M1, M2, , MNu. The excess distribution function of R is given by: Fl (y) P(R l y|R l) P(M y|R l ), y 0 (II)
Using the threshold l, we now define the probabilities associated with R: P(R P(R where y given by l l) y) F(l ) F(l y) (III) (IV)
Fl (y )
(V)
We thus obtain the Fl (y), the conditional distribution of how extreme a Ri is, given that it already qualifies as an extreme. Pickands (1975) shows that Fl (y) will be very close to the GPD in equation (10) if l is a low threshold:
GPD(M; , , ) 1 M
1
(VI)
where , , and are the location, scale, and shape parameters of the GPD, respectively. The shape parameter , called the tail index, reflects the fatness of the distribution (ie, the weight of the tails), whereas the parameters of scale and of location represent the dispersion and average of the extremes, respectively.
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 10
Estimation procedure
The regression method, which is based on the order statistics of extremes from a uniform parent, is used to estimate the parameters of GPD. As described in Gumbel (1958), the sequence of minimal values Xmin,1, Xmin,2, , Xmin,n is arranged in increasing order to get an order statistic X min,1, X min,2, , X min,n, which satisfies X min,1 X min,2 X min,n. The order statistics of a sample of size n, coming from a uniform U(0,1) parent population are used in the regression method to estimate the parameters of the extreme value distribution. The importance of this population is based on the fact that any other continuous population can be easily transformed to the uniform and some properties of these order statistics can be directly translated to properties of the order statistics of a sample drawn from initial population. The r-th order statistic has the following PDF: fXr:n ( x) x r 1(1 x)n r ; B(r , n r 1 ) 0 x 1,
(VII)
where B(r, n r 1) is the beta function. The ordered maxima, X min,r, have the following mean:
r:n
B(r, n
0
x r (1 x)n r dx r 1 )
r . n 1
(VIII)
For each r ranging from 1 to n, the frequency GPDmin,n (X min,r) is a random variable lying between 0 and 1. The mean of the r-th frequency, r:n E[GPDmin,n (X min,r )], is equal to r/(n 1). The regression method equates the ordered extreme observation GPDmin,n (X min,r ) to its theoretical mean, r/(n 1):
E GPDmin,n ( X min,r ) E 1 min X min,r
min
min
1
min
r (IX) n 1
which can be reduced to an empirically estimable form by taking the logarithm of both sides and adding an error term min: r ln n 1 1
min
ln ln(
min
1
min
min
min ( min
X min,r ))
min
(X)
Consistent parameter estimates of the GPD are obtained by minimising the sum of squared residuals from the nonlinear regression equation given in (X).
10
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 11
performance of the liquidated funds, therefore mitigating notoriously known survivorship bias.10 Second, HFR indices have a critically large number of constituents, which gives a better representation for return distribution of the hedge fund strategies. Finally, HFR indices are equally weighted, which mitigates concentration in a few hedge funds with large assets under management. Our data contain monthly returns from January 1990 to June 2002 for 17 hedge fund strategy indices, which reflect the monthly net of fee returns. Strategies of these indices are described briefly in Panel 2.
Convertible arbitrage hedge funds focus on the mispricing of convertible bonds. A typical position involves a long position in the convertible bond and a short position in the underlying asset. Distressed securities hedge funds take long positions on the equity or debt of companies that are in or facing bankruptcy. Emerging-markets hedge funds invest in equity and fixed-income securities of emerging markets around the world. Equity-hedge hedge funds represent the original hedge fund model of Alfred Winslow Jones. They invest in equities and take long and short positions. Equity-market-neutral hedge funds simultaneously take long and short positions of the same size within the same market to maintain zero market risk. Equity non-hedge hedge funds take long positions in equities. Event-driven hedge funds take positions on corporate events such as a merger, an acquisition or a bankruptcy. Fixed-income arbitrage hedge funds tend to profit from price anomalies between related fixed-income securities. Funds of funds are funds that invest in a pool of hedge funds. Funds of funds could be diversified, allocating capital to the various hedge funds strategies; or niche, investing only specific hedge fund strategy. Macro funds rely on macroeconomic analysis to take bets on major risk factors, such as currencies, equities, interest rates and commodities. Market-timing hedge funds use technical and fundamental models to identify turning points in the markets and take long and short positions based on their view. Merger-arbitrage hedge funds seize the opportunity to invest after merger event has been announced. They take long position on the
11
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 12
shares of the target company, and short position on the shares of the acquiring company. Relative-value arbitrage index covers convertible arbitrage, fixedincome arbitrage, statistical arbitrage and market-neutral strategies. Short-selling hedge funds are essentially equity hedge funds that maintain a consistent net short exposure. Statistical arbitrage hedge funds use market-neutral strategy by taking long and short positions in related securities. These types of hedge fund use quantitative models to determine price anomalies between cointegrated securities.
Table 1 presents descriptive statistics for 17 hedge fund indices.11 More specifically, the table reports the means, standard deviations, skewness, kurtosis, Jarque-Bera statistics, the worst and the best month for each index. The table shows that there is substantial variation between different strategies. Among all indices, short-selling index has the lowest average return, 0.50% per month, with highest standard deviation, 6.61%. Equity hedge index provides the highest average monthly return, 1.52%, with fourth highest volatility, 2.68%. Twelve indices display negative skewness, and 13 indices display significantly higher kurtosis than that of the normal distribution. This means that large negative returns on hedge fund indices are much more likely to occur than would be predicted by the normal distribution. The Jarque-Bera statistics indicate that most hedge fund index returns are not normally distributed. These results signal that the risk profile of hedge funds cannot be accurately described by the mean and standard deviation alone. Investors will also have to measure the distributions skewness, kurtosis and maybe higher moments to assess the risk of their investments more accurately. These results also indicate that, when hedge funds are involved, calculating VAR with the assumption of normality may result in misleading estimates of actual thresholds. EMPIRICAL RESULTS The VAR measures for the normal distribution, Normal, and CF expansion, CF, are obtained using equations (4) and (7), which depend on the mean and standard deviation of returns as well as the critical value related to a given confidence level (or loss probability
12
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 13
level).12,13 As shown in equation (6), the VAR threshold for the GED is calculated by integrating the area under the PDF. The first step for computing GED is to estimate the mean ( ), standard deviation ( ), and tail-thickness (v) parameters of the GED density. The parameters of the GED given in equation (5) are estimated by maximising the log-likelihood function:
LogLGED ln(v/2) 0.5 ln (3/v) 1.5 ln (1/v) ln (1/v))
n
0.5 ln
t 1
t 1
Rt
(12)
Panel 3 shows the maximum likelihood estimates of the GED for the hedge fund index returns. As discussed earlier, for the tail thickness parameter v 2, the GED density equals the standard normal density. However, the estimates of v turn out to be highly significant and less than 2 for all hedge fund indices except for the market-timing index. The tail-thickness parameter is estimated to be 3.21 and significant at the 1% level, which implies that the distribution of returns on the market-timing index has thinner tails than the normal distribution. The degrees-of-freedom parameter, v, for the other 16 hedge fund return indices is estimated to be in the range of 0.86 to 1.92. Although not presented in the paper, comparing the maximised log-likelihood functions of the models estimated with the GED and normal distributions indicates that v is statistically different from 2, implying that the distribution of hedge fund returns is much more leptokurtic than the corresponding normal distribution. As shown in equation (11), the VAR threshold for the extreme value approach, EVT, depends on the estimated location ( ), scale ( ), shape ( ) parameters of the GDP, and the loss probability level ( ). Panel 4 presents the regression method estimates of the GPD for the hedge fund index returns.14 We should note that the extremes (or minimal returns) used in the regressions are obtained from the original monthly data described in Table 1. Following the EVT for the GPD, we define the extremes as excesses over high thresholds (see Embrechts, Kluppelberg and Mikosch, 1997, pp. 3525). Specifically, the extreme monthly returns correspond to the 10% left tail of the empirical distribution.15 As shown in Panel 4,
13
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 14
HFRI index Convertible arbitrage Distressed securities Emerging markets (total) Equity hedge Equity-market-neutral Equity non-hedge Event-driven Fixed income (total) Fixed income: arbitrage index Fixed income: high-yield index Fund-of-funds index Macro Index Market-timing index Merger-arbitrage index Relative-value arbitrage index Short-selling index Statistical arbitrage index 0.0110 (18.351) 0.0115 (10.639) 0.0154 (4.6304) 0.0155 (7.3635) 0.0085 (11.233) 0.0153 (4.2219) 0.0139 (11.381) 0.0103 (19.411) 0.0068 (10.473) 0.0084 (11.230) 0.0084 (7.4113) 0.0132 (6.2713) 0.0113 (6.9715) 0.0123 (24.112) 0.0108 (15.321) 0.0029 (3.7560) 0.0083 (9.0337) 0.00009 (6.4774) 0.00032 (6.5554) 0.00206 (7.1836) 0.00071 (7.9537) 0.00009 (6.8992) 0.00178 (8.0361) 0.00034 (6.8396) 0.00011 (5.8557) 0.00017 (6.0420) 0.00034 (5.7321) 0.00029 (6.7447) 0.00065 (7.5233) 0.00041 (10.405) 0.00012 (6.1758) 0.00011 (6.9415) 0.00434 (7.4301) 0.00012 (8.6775)
v 1.0613 (7.1013) 1.0320 (7.7130) 1.2673 (8.1445) 1.5559 (6.6601) 1.5872 (4.9989) 1.7355 (5.9096) 1.1250 (8.5632) 0.9347 (7.1842) 0.8993 (8.1358) 0.8572 (7.2413) 1.1389 (7.4988) 1.7175 (4.6762) 3.2121 (3.6765) 0.8741 (8.7394) 1.1435 (10.042) 1.4604 (6.1011) 1.9173 (5.5895)
Log-L 493.57 398.05 253.42 330.22 484.62 260.40 391.43 484.20 451.44 400.84 401.30 335.24 372.49 479.39 472.80 195.55 458.26
14
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 15
HFRI index Convertible arbitrage Distressed securities Emerging markets (total) Equity hedge Equity-market-neutral Equity non-hedge Event-driven Fixed income (total) Fixed income: arbitrage index Fixed income: high-yield index Fund-of-funds index Macro Index Market-timing index Merger-arbitrage index Relative-value arbitrage index Short-selling index Statistical arbitrage index 0.001241 ( 1.6094) 0.005771 ( 7.9773) 0.045606 ( 39.871) 0.019301 ( 35.130) 0.001129 (0.9311) 0.037659 ( 16.591) 0.005919 ( 6.8902) 0.001160 ( 1.1893) 0.007122 ( 10.690) 0.005758 (0.9201) 0.010523 ( 20.21) 0.013036 ( 6.3669) 0.014686 ( 22.815) 0.001516 ( 0.9552) 0.001835 ( 4.3789) 0.073448 ( 40.991) 0.004718 ( 2.9738) 0.012181 (7.5701) 0.009458 (6.8114) 0.013918 (6.8220) 0.007216 (6.9112) 0.018314 (6.2403) 0.033898 (7.6781) 0.017125 (10.080) 0.007781 (3.8567) 0.005307 (4.3401) 0.067150 (4.5804) 0.005896 (6.3992) 0.015060 (3.8926) 0.009171 (6.5608) 0.009901 (2.8773) 0.002318 (3.6110) 0.035989 (10.511) 0.008355 (2.4503) 0.036568 ( 0.3703) 0.658291 (5.9661) 0.834502 (7.7112) 0.633852 (5.8606) 0.948581 ( 7.6200) 0.004715 (0.0503) 0.367516 (5.0669) 0.382432 (1.9556) 0.963810 (5.4234) 0.757067 ( 4.5238) 0.759491 (6.3642) 0.129333 (0.6784) 0.241209 ( 2.1176) 0.727790 (2.7998) 1.088906 (4.7789) 0.211926 (3.0456) 0.195574 ( 0.5230)
EVT 0.0281 0.0568 0.1428 0.0569 0.0160 0.1161 0.0679 0.0299 0.0523 0.0674 0.0474 0.0534 0.0309 0.0606 0.0258 0.1802 0.0202
15
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 16
the location parameter ( ) that determines the average of the extremes is estimated to be negative and statistically significant at the 1% or 5% level except for a few cases. The shape parameter ( ), called the tail index, reflects the fatness of the distribution (ie, the weight of the tails).16 The tail-thickness parameter ( ) is generally estimated to be positive, and significant at the 5% level. It is important to note that the commonly used symmetric parametric VAR models do not allow for asymmetries in calculating thresholds since the positive and negative tails of the normal distribution are identical. In other words, the standard parametric VAR approach yields almost the same thresholds for the maximal and minimal changes in risk factors. One advantage of the CF expansion is that asymmetries in the positive and negative tails of the distribution can easily be handled since it separates sudden drops from sudden jumps. This allows us to test whether the two tails are indeed symmetric. Table 2 presents the actual and estimated 1% VAR thresholds for the normal, GED, EVT and CF expansion.17,18 We compare the estimated values with actual, empirical 1% quantiles (actual) estimated over the same period. The results show that the actual VARs are estimated more accurately by the EVT and CF expansion than by the GED and normal distributions. The normal density, GED, CF expansion and EVT yield 1% VAR thresholds that on average underestimate the actual VAR thresholds by 37%, 32%, 10% and 6% respectively. These results show that the extreme value approach and the CF expansion, which models both skewness and kurtosis, outperform the GED and normal distributions in calculating VAR.19 In particular, for convertible arbitrage, distressed securities, event driven and merger arbitrage strategies, VAR with normal and GED distributions are not well suited. This is because these strategies contain large amounts of firm or event-specific risk, and large losses due to these risks cannot be captured by normal market conditions. We also created mean-normal VAR and mean-CF VAR efficient frontiers. These frontiers, displayed in Figure 1, show that mean-normal VAR efficient frontiers significantly underestimate the VAR of the portfolio. So far, VAR estimates imply that the tail areas obtained from the EVT and CF expansion are quite different from, and potentially
16
IHFI-Bali.qxd
HFRI index
CF (%)
EVT (%)
GED (%)
Normal (%)
Normal actual
Convertible arbitrage Distressed securities Emerging markets (total) Equity hedge Equity-market-neutral Equity non-hedge Event-driven Fixed income (total) Fixed income: arbitrage index Fixed income: high-yield index Fund-of-funds index Macro index Market-timing index Merger-arbitrage index Relative-value arbitrage index Short-selling index Statistical arbitrage index
2.99 6.04 16.55 5.98 1.62 12.00 7.30 3.20 6.27 6.67 5.42 5.09 3.14 6.08 3.50 18.73 2.00
2.35 5.99 14.44 5.12 1.39 10.15 6.14 2.82 5.29 6.97 4.94 4.16 3.13 4.40 4.51 16.00 1.80
2.81 5.68 14.28 5.69 1.60 11.61 6.79 2.99 5.23 6.74 4.74 5.34 3.09 6.06 2.58 18.02 2.02
1.45 3.75 10.39 5.02 1.47 8.68 3.53 1.85 2.99 4.45 3.74 4.85 3.11 1.85 1.75 16.49 1.79
1.31 3.09 9.39 4.73 1.31 8.50 3.33 1.52 2.44 3.80 3.15 4.57 3.58 2.08 1.50 14.88 1.76
0.78 0.99 0.87 0.86 0.86 0.85 0.84 0.88 0.84 1.05 0.91 0.82 1.00 0.72 1.29 0.85 0.90
0.94 0.94 0.86 0.95 0.99 0.97 0.93 0.93 0.83 1.01 0.87 1.05 0.98 1.00 0.74 0.96 1.01
0.48 0.62 0.63 0.84 0.91 0.72 0.48 0.58 0.48 0.67 0.69 0.95 0.99 0.30 0.50 0.88 0.90
0.44 0.51 0.57 0.79 0.81 0.71 0.46 0.48 0.39 0.57 0.58 0.90 1.14 0.34 0.43 0.79 0.88
This table presents the actual and estimated 1% VAR thresholds for the normal, GED, EVT and CF expansion. The actual VAR threshold is identified by the 1% left tail of the empirical distribution. The ratios of the actual VARs to the estimated VARs are reported to compare the relative performance of alternative VAR models. The average values of the ratios are CF /actual 0.90, EVT/actual 0.94, GED/actual 0.68, and Normal /actual 0.63.
17
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 18
more useful than, the tails obtained with the GED and normal distributions. The implied VAR estimates are consequently different also. Yet, the real test for the EVT and CF approach is not that it is different from the alternatives, but whether it is any better according to some specific criteria. One of the most popular evaluation criteria is the regression R2 obtained from the regression of actual VAR thresholds on estimated thresholds: actual,i a0 a1estimated,i ui
(13)
where actual,i is the actual VAR threshold for hedge fund index return i, estimated,i is the estimated threshold based on the normal, GED, EVT and CF expansion, ie, estimated Normal, GED, EVT, or CF. R2 values provide information about how well each VAR model is able to estimate the actual VAR threshold. As an alternative to R2 measures, we also compute the TIC, which always lies between zero and one, where zero indicates a perfect fit:
1 n (actual,i estimated,i )2 ni 1 1 n (actual,i )2 ni 1 1 n (estimated,i )2 ni 1
TIC
(14)
18
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 19
The TIC values describe the fit of the normal, GED, EVT and CF expansion for the actual VAR of hedge fund returns. Using the actual and estimated 1% VAR thresholds given in Table 2, we calculate the R2 and TIC values for hedge fund index returns. The results highlight the superior performance of the CF expansion against the GED and normal distributions. Specifically, the R2 values are found to be 98.89% for the EVT, 98.13% for the CF, 89.75% for the GED density and 88.50% for the standard approach with normal density. The TIC measures turn out to be 4.59% for the EVT, 7.82% for the CF, 18.75% for the GED and 22.53% for the normal distribution. As expected, the CF expansion, which accounts for the skewness and kurtosis of hedge fund returns, performs better than the GED and normal distributions. Both the R2 and TIC compute the total variation in actual,i explained by Normal, GED, EVT or CF. Although they provide the direction and magnitude of the relationship between the actual and estimated VAR thresholds, neither R2 nor TIC measures how far the estimated threshold is away from the actual. To compute directly the deviation between actual,i and estimated,i , we use the HMAE and HRMSE:20 1 n ni 1 actual,i 1 estimated,i
2
HMAE
(15)
HRMSE
1 n 1 actual,i n i 1 estimated,i
(16)
These two forecast criteria follow the statistical tradition of reporting statistics based directly on the deviation between actual and estimated, while adjusting for heteroscedasticity in the forecast error. Table 3 provides the HMAE and HRMSE values for alternative VAR models. The average mean absolute (percentage) error turns out to be 7.96% for the EVT, 15.91% for the CF expansion, 61.01% for the GED and 77.30% for the normal density. Similarly, the average root mean square (percentage) error is found to be 11.87% for the EVT, 18.34% for the CF expansion, 82.65% for the GED, and 94.64% for the normal distribution. These results confirm our earlier findings based on the R2 and TIC measures, and indicate that the EVT and
19
IHFI-Bali.qxd
20 HMAE CF (%) 27.42 0.86 14.59 16.62 16.38 18.24 18.78 13.62 18.44 4.35 9.74 22.37 0.11 38.15 22.58 17.07 11.23 15.91 6.41 6.34 15.90 5.10 1.25 3.36 7.51 7.02 19.89 1.04 14.35 4.68 1.62 0.33 35.66 3.94 0.99 7.96 106.21 61.07 59.24 19.02 10.20 38.25 106.66 72.97 109.70 49.78 44.92 4.95 0.80 228.38 99.71 13.55 11.73 61.01 128.23 95.68 76.24 26.41 23.47 41.12 119.31 110.16 157.34 75.18 72.08 11.26 12.51 192.64 132.97 25.83 13.67 77.30 7.52 0.01 2.13 2.76 2.68 3.33 3.53 1.85 3.40 0.19 0.95 5.00 0.00 14.55 5.10 2.91 1.26 18.34 EVT (%) GED (%) Normal (%) CF (%) EVT (%) 0.41 0.40 2.53 0.26 0.02 0.11 0.56 0.49 3.95 0.01 2.06 0.22 0.03 0.00 12.72 0.16 0.01 11.87 HRMSE GED (%) 112.80 37.29 35.09 3.62 1.04 14.63 113.76 53.25 120.34 24.78 20.18 0.24 0.01 521.57 99.43 1.84 1.38 82.65 Normal (%) 164.43 91.55 58.12 6.97 5.51 16.90 142.35 121.35 247.57 56.52 51.96 1.27 1.57 371.09 176.80 6.67 1.87 94.64
1/29/04
5:11 PM
HFRI index
Page 20
Convertible arbitrage Distressed securities Emerging markets (total) Equity hedge Equity-market-neutral Equity non-hedge Event-driven Fixed income (total) Fixed income: arbitrage index Fixed income: high-yield index Fund-of-funds index Macro index Market-timing index Merger-arbitrage index Relative-value arbitrage index Short-selling index Statistical arbitrage index Average
The HMAE and HRMSE are used to compute directly the deviation between actual,i and estimated,i.These two forecast criteria given in equations (15) (16) follow the statistical tradition of reporting statistics based directly on the deviation between actual and estimated, while adjusting for heteroscedasticity in the forecast error.
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 21
CF expansion performs much better than the symmetric fat-tailed GED and thin-tailed normal distributions in capturing the extent of extreme events in the hedge fund market.21 Conclusion We provide an empirical study on how well VAR models capture the behaviour of the tails of the return distribution of hedge fund strategy indices, that is, those rare but important instances in which large losses are realised. This is a fundamental issue in VAR modelling, especially for hedge funds, since most hedge fund return distributions display a significant amount of tail risk. In fact, one of the key motivations of the development of VAR models was to be able to answer the question: if something goes wrong, how much money am I likely to lose? Put differently, hedge fund managers and investors in hedge funds want to be able to assess the extent of losses in the event of adverse movements in financial markets. Thus, the ability to model precisely the tails of the distribution is an important concern. This ability is especially key when the return distribution features fat tail risk as in hedge funds. We compare the empirical performance of the thin-tailed normal, the fat-tailed GEDs, EVT and the CF expansion in computing VAR thresholds for hedge fund index returns. Alternative performance measures R2, TIC, HMAE and HRMSE are used to assess the accuracy and performance of alternative VAR models. The results, based on alternative performance measures, indicate that the size of actual losses is much higher than that predicted by the GED and normal distributions. The symmetric GED density performs better than the symmetric normal distribution, but still does not allow for asymmetric treatment of upside potential and downside risk. An important advantage of the EVT and CF expansion is that it allows investors to treat losses and gains asymmetrically. The EVT and CF methods performed best among those examined here. Estimating EVT parameters, however, is not an easy task. In contrast CF expansion is easily obtained. Although the extreme value approach provides slightly more accurate estimates of the actual VAR thresholds, practitioners may still be willing to use the CF expansion because of its simplicity.
21
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 22
For example, if the given period of time is 1 day and the given probability is 1%, the VAR measure would be an estimate of the decline in portfolio value that could occur with a 1% probability over the next trading day. That is, if the VAR measure is accurate, losses greater than the VAR measure should occur less than 1% of the time. 2 Asness, Krail and Liew (2001) find evidence that strongly suggests non-synchronous pricing problems for hedge funds whether due to stale or managed prices. They conclude that this is a significant issue and can lead to severely understated estimates of hedge fund risk. On the other hand, using reported prices also has limitations because they may not reflect market-clearing prices. 3 Hull and White (1998) and Venkataraman (1997) show that the risk-management performance of standard VAR models that assumes normality increases if one uses a mixture of normal distributions and quasi-Bayesian estimation techniques. 4 The two most popular VAR techniques are the variance-covariance analysis and historical simulation. Historical simulation does not rely on normality and so it does not suffer from the tail-bias problem. By applying the empirical distribution of all assets returns in the trading portfolio, the outcome will reflect the historical frequency of large losses over the specified data window. Unlike the variance-covariance analysis, the historical approach can be used in a natural way to compute VAR for nonlinear positions, such as derivative positions. In addition to these two, fully non-parametric approaches have been proposed and determine the empirical quantile or a smoothed version of it (Harrel and Davis, 1982; Jorion, 1996; Gourieroux, Laurent and Scaillet, 2000). Recently, semi-parametric approaches have been developed. They are based on either extreme value distributions (Longin, 2000; McNeil and Frey, 2000; Bali, 2001) or local likelihood methods (Gourieroux and Jasiak, 1999). For a comprehensive survey on value at risk models, see Duffie and Pan (1997), Dowd (1998) and Jorion (2001). 5 The thresholds for the standard approach, Normal, are computed using the estimated mean and volatility parameters of the normal distribution as well as the critical values: 2.5758, 2.326, 2.1701, 2.0536, 1.960 and 1.645 for the 0.5%, 1%, 1.5%, 2%, 2.5% and 5% VAR tails, respectively. 6 For example, z( ) equals 2.326 ( 1.960) [ 1.645] for the 1% (2.5%) [5%] VAR. 7 The shape parameter , called the tail index, reflects the fatness of the distribution (ie, the weight of the tails), while the parameters of scale and of location represent the dispersion and average of the extremes, respectively. 8 Details and presentation of alternative statistical estimation procedures of GPD can be found in Leadbetter, Lindgren and Rootzen (1983), Castillo (1988), Embrechts, Kluppelberg and Mikosch (1997) and Bali (2001). 9 For example, a random variable distributed as the normal gives l and u . 10 Survivorship bias is caused by eliminating closed or liquidated hedge funds from an index, and keeping only live or successful hedge funds in the index. As a result returns are overestimated. It is a question of whether index returns and higher moments represent only the successful funds or are true representation of all the funds including liquidated ones. 11 It is well known that all major hedge fund data vendors started to collect the defunct hedge fund data beginning in 1994. Hence hedge fund returns prior to 1994 suffer from survivorship bias. As a result, all the statistics based on our sample period (January 1990June 2002) would be affected by this survivorship bias. Therefore, Table 1 reports the descriptive statistics of hedge fund index returns for the sample period of January 1994 to June 2002. We should note that the estimated parameters of the normal, GED and GPD distributions do not change much in the shorter and the longer sample periods. The qualitative results from the period of January 1994June 2002 turn out to be very similar to those reported in our tables. 12 Note that the critical values for CF expansion, ( ), account for skewness and kurtosis of the empirical distribution.
22
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 23
13 The VARs are calculated on a monthly horizon because the HFR data include monthly index returns. 14 Panel 1 provides a short discussion on the estimation procedure of the GPD. 15 Note that the previous studies on EVT use the 2.5% and 5% left tail of the empirical distribution to obtain the excesses over high thresholds. However, the existing literature generally uses daily datasets with large number of observations. Since we do not have large number of observations (150 monthly observations from January 1990 to June 2002), we define the high threshold as the 10% (instead of 2.5% or 5%) left tail of the return distribution. 16 Notice that the GPD presented in equation (10) encompasses the Pareto distribution, the uniform distribution on [ 1, 0], and the standard exponential distribution. For 0, 0, and 0 we obtain the Pareto, uniform and exponential distributions, respectively. The Pareto distribution (with j 0) is fat-tailed as its tail is slowly decreasing; the uniform distribution (with j 0) is short-tailed after a certain point there are no extremes; the exponential distribution (with 0) is thin-tailed as its tail is rapidly decreasing. 17 We also compare the relative performance of normal, GED, EVT, and CF expansion for the 2.5% and 5% VAR thresholds. The results turn out to be very similar to those reported in our tables. To save space, we do not present the empirical findings based on the 2.5% and 5% VARs. They are available upon request. 18 Note that the actual VAR threshold is identified by the 1% left tail of the empirical distribution. Although defining the actual threshold does not need a certain distribution function, it still requires that the return process to be stationary. Although not presented in the chapter, the Augmented Dickey-Fuller (ADF) (1973) statistics indicate rejection of the null hypothesis of a unit root for the hedge fund index returns at the 1% level. The full set of details on the unit root tests is available upon request. 19 To some extent, these results were expected. They reflect the more flexible specifications and the in-sample fitting. Future research should focus on out-of-sample performance. 20 The HMAE and HRMSE are used by Andersen, Bollerslev and Lange (1999). 21 To check the robustness of our results, we use a broader index of Hedge Fund Research, Inc. (HFR) and evaluate the relative performance of alternative VAR models for hedge fund portfolios. These results confirm our earlier findings that the EVT and CF expansion performs extremely well in estimating value at risk of hedge fund portfolios.
REFERENCES Agarwal, V., and N. Naik, 2000, Performance Evaluation of Hedge Funds with Option Based and Buy-and-Hold Strategies, Review of Financial Studies, forthcoming, URL: http://www.GloriaMundi.org/picsresources/rb-vann.pdf. Amin G., and H. Kat, 2003, Hedge Fund Performance 19902000: Do The Money Machines Really Add Value?, Journal of Financial and Quantitative Analysis, 38, pp. 25174. Andersen, T. G., T. Bollerslev, and S. Lange, 1999, Forecasting Financial Market Volatility: Sampling Frequency vis--vis Forecast Horizon, Journal of Empirical Finance, 6, pp. 45777. Asness, C. S., R. J. Krail, and J. M. Liew, 2001, Do Hedge Funds Hedge?, Journal of Portfolio Management, pp. 619, Fall.
23
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 24
Bali, T. G., 2001, An Extreme Value Approach to Estimating Volatility and Value at Risk, Journal of Business, forthcoming, URL: http://www.GloriaMundi.org/picsresources/ rb-tb.pdf. Castillo, E., 1988, Extreme Value Theory in Engineering (San Diego, CA: Academic Press). Cornish, E. A., and R. A. Fisher, 1937, Moments and Cumulants in the specification of distributions, Review of the International Statistical Institute, pp. 30720. De Souza C., and Gokcan S., 2003, Allocation Methodologies and Customizing Hedge Fund Multi-Manager Multi-Strategy Products, Journal of Alternative Investments, forthcoming. Dickey, D., and W. A. Fuller, 1979, Distribution of the Estimates for Autoregressive Time Series with a Unit Root, Journal of the American Statistical Association, 74, pp. 42731. Dowd, K., 1998, Beyond Value at Risk: The New Science of Risk Management (New York: John Wiley & Sons). Duffie, D., and J. Pan, 1997, An Overview of Value at Risk, Journal of Derivatives, pp. 749, Spring. Embrechts, P., C. Kluppelberg, and T. Mikosch, 1997, Modelling Extremal Events (Berlin Heidelberg: Springer). Fung, W., and D. A. Hsieh, 1999, Is Mean-Variance Analysis Applicable to Hedge Funds?, Economics Letters, 62, pp. 538. Geman, H., and C. Kharoubi, 2003, Hedge Funds Revisited: Distributional Characteristics, Dependence Structure and Diversification, Journal of Risk, 5, Summer. Gourieroux, C., and J. Jasiak, 1999, Truncated Local Likelihood and Nonparametric Tail Analysis, DP 99, CREST. Gourieroux, C., J. P. Laurent, and O. Scaillet, 2000, Sensitivity Analysis of Values at Risk, Journal of Empirical Finance, 7, pp. 22545. Gumbell, E. J., 1958, Statistics of Extremes (New York: Columbia University Press). Gupta, A., and B. Liang, 2001, Do Hedge Funds Have Enough Capital? A Value at Risk Approach, Working Paper, Case Reserve Western University, URL: http:// www.GloriaMundi.org/picsresources/gbl.pdf. Harrel, F., and C. Davis, 1982, A New Distribution Free Quantile Estimation, Biometrica, 69, pp. 63540. Hull, J., and A. White, 1998, Value at Risk When Daily Changes in Market Variables Are Not Normally Distributed, Journal of Derivatives, pp. 919, Spring. Jorion, P., 1996, Risk2: Measuring the Risk in Value at Risk, Financial Analysts Journal, 52, pp. 4756. Jorion, P., 2000, Risk Management Lessons From Long Term Capital Management, European Financial Management, 6, pp. 277300. Jorion, P., 2001, Value-at-Risk: The New Benchmark for Controlling Market Risk (Chicago, IL: McGraw-Hill). Leadbetter, M. R., G. Lindgren, and H. Rootzen, 1983, Extremes and Related Properties of Random Sequences and Processes (New York: Springer-Verlag).
24
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 25
Longin, F. M., 2000, From Value at Risk to Stress Testing: The Extreme Value Approach, Journal of Banking and Finance, 24, pp. 10971130. McNeil, A. J., and R. Frey, 2000, Estimation of Tail-Related Risk Measures for Heteroscedastic Financial Time Series: An Extreme Value Approach, Journal of Empirical Finance, 7, pp. 271300. Pickands, J., 1975, Statistical Inference Using Extreme Order Statistics, Annals of Statistics, 3, pp. 11931. Venkataraman, S., 1997, Value at Risk for a Mixture of Normal Distributions: The Use of Quasi-Bayesian Estimation Techniques, Economic Perspectives, Federal Reserve Bank of Chicago, pp. 213, URL: http://www.GloriaMundi.org/picsresources/subu.pdf, March/ April.
25
IHFI-Bali.qxd
1/29/04
5:11 PM
Page 26