Vector Autoregression

vartime-seriesmultivariatemacroeconomicsdsgestate-spaceblock-exogeneitylarge-scale-varstructural-identification

Definition

A Vector Autoregression (VAR) is a linear dynamic system in which each of nn endogenous variables is regressed on pp lags of all variables in the system, plus optional exogenous terms. Introduced by Sims (1980) as a minimally-restricted alternative to large structural econometric models.

Key Ideas

How It Works

Structural Form

A0yt=A1yt1++Apytp+Dzt+εtA_0\, y_t = A_1\, y_{t-1} + \cdots + A_p\, y_{t-p} + D\, z_t + \varepsilon_t

where:

The independence of εt\varepsilon_t is the defining constraint of the structural VAR: it is what allows each shock to be given an unambiguous economic label (technology shock, policy shock, etc.).

Compact Matrix Form

Stacking xt=[yt1,,ytp,zt]Rkx_t = [y_{t-1}',\ldots,y_{t-p}',z_t']' \in \mathbb{R}^k and F=[A1,,Ap,D]Rk×nF = [A_1',\ldots,A_p',D']' \in \mathbb{R}^{k \times n}:

ytA0=xtF+εty_t'\, A_0 = x_t'\, F + \varepsilon_t'

Reduced Form

Pre-multiplying by A01A_0^{-1}:

yt=B1yt1++Bpytp+Czt+uty_t = B_1\, y_{t-1} + \cdots + B_p\, y_{t-p} + C\, z_t + u_t

where B=A01AB_\ell = A_0^{-1} A_\ell, C=A01DC = A_0^{-1} D, and ut=A01εtu_t = A_0^{-1} \varepsilon_t. The reduced-form covariance matrix is:

Σ=E[utut]=(A0A0)1\Sigma = \mathbb{E}[u_t u_t'] = (A_0 A_0')^{-1}

The reduced form is identified without further assumptions and can be estimated by OLS. Recovering A0A_0 from Σ\Sigma is the identification problem.

Stability

The VAR(p) process is stable if

det(IKA1zApzp)0for all z1(Stab)\det(I_K - A_1 z - \cdots - A_p z^p) \neq 0 \quad \text{for all } |z| \leq 1 \tag{Stab}

Stability implies the process is stationary with time-invariant moments. A root at z=1z = 1 (unit root) allows I(1) and cointegrated variables; a root inside the unit circle (z<1|z| < 1) produces explosive dynamics.

Exogeneity Taxonomy

When the VAR includes exogenous variables ztz_t alongside the endogenous yty_t, three exogeneity concepts are relevant (Engle, Hendry, and Richard 1983):

Only super-exogeneity justifies using the conditional VAR model for counterfactual policy experiments; weak exogeneity suffices for estimation.

Overparameterization and Bayesian Estimation

A VAR with nn variables, pp lags, and a constant has n2p+nn^2 p + n free parameters. With n=10n = 10 and p=15p = 15 this yields 1,500 parameters per equation; the Minneapolis Fed 47-variable model had ~8,000 total (Litterman 1986a). Unrestricted OLS fits noise rather than signal in such settings. Zellner (1985) sharpens this critique: a 6-variable multivariate ARMA (MVARMA)(r=3,q=4) has 395 parameters against 480\approx 480 observations (obs/param 1.2\approx 1.2); an unrestricted VAR(10) with 6 variables has 387; a VAR(4) has 159. By contrast, the 3-equation Demand-Supply-Entry structural model has \approx20 parameters — illustrating how theory creates parsimony that data alone cannot.

Standard approaches offer only two options: exclude a variable (exact-zero prior — too rigid) or include it without a prior (flat prior — too diffuse). The Minnesota Prior (Litterman 1986b) resolves this by assigning informative shrinkage priors to every coefficient, encoding the belief that most are near zero while the first own lag is near one (random walk belief). This yields a ridge-type estimator:

β^=(XX+κRR)1(XY+κRr)\hat{\beta} = (X'X + \kappa R'R)^{-1}(X'Y + \kappa R'r)

Monte Carlo simulation with 3,000 draws shows that the Bayesian posterior mean dominates OLS with any fixed variable set and beats stepwise selection, especially when T/kT/k is small or R2R^2 is low (Litterman 1986b, Section 3).

Five-year real-time comparison (1980:2–1985:1) against DRI, Wharton, and Chase commercial forecasters across real gross national product (GNP), GNP deflator, nominal GNP, and unemployment (1,604 total forecasts): the Bayesian VAR (BVAR) was closest to actual 34.8% of the time vs. 16–27% for each commercial service. The BVAR significantly underperformed on inflation (over-forecast by >2 bootstrap standard errors at all horizons) but outperformed on real GNP at 4–7 quarter horizons.

Lag-Order Selection

Longer lags reduce misspecification but increase the parameter count as O(n2p)O(n^2 p), rapidly exhausting degrees of freedom. The Bayesian approach (see Sims-Zha Prior) resolves this by shrinking coefficients rather than truncating lags. Frequentist model selection uses information criteria Akaike Information Criterion (AIC), Hannan-Quinn (HQ), and Schwarz Criterion (SC) (see Lag-Order Selection Criteria).

Prior Comparison for BVAR Forecasting

Kadiyala and Karlsson (1993) compare five prior distributions for Bayesian VAR forecasting across three empirical experiments (Canadian GNP/M2 data and US wheat export data):

Prior Key property Posterior
Minnesota Equation-independent; Ψ\Psi fixed diagonal Analytical (ridge)
Normal-Wishart γΨN\gamma\|\Psi \sim N, ΨIW\Psi \sim IW; conjugate Matrix-tt closed form
Diffuse (Jeffreys') p(γ,Ψ)Ψ(q+1)/2p(\gamma,\Psi) \propto \|\Psi\|^{-(q+1)/2}; OLS-centered Matrix-tt closed form
Normal-Diffuse Minnesota γ\gamma prior + diffuse Ψ\Psi Importance sampling
ENC Drèze-Morales reparametrization; unrestricted Var(γ)\text{Var}(\gamma) Importance sampling

Main finding: The Minnesota prior never provides forecasts significantly better than the more general alternatives. In small samples (17–26 observations) it is significantly worse than the extended natural conjugate (ENC) and Normal-Diffuse priors. OLS is worst in every experiment. The Normal-Wishart and Diffuse priors are most computationally convenient (closed-form posterior moments for IRFs and variance decompositions).

Noninformative Priors for VAR

When a researcher lacks prior information and wishes to use a minimal Bayesian benchmark, two noninformative priors for (Φ,Σ)(\Phi, \Sigma) are commonly considered (Sun-Ni 2005):

See Noninformative Prior for VAR for the propriety conditions and hit-and-run Markov Chain Monte Carlo (MCMC) algorithm.

Bayesian Stochastic Search for VAR Restrictions (George-Sun-Ni 2008)

George, Sun, and Ni extend the stochastic search variable selection (SSVS) framework of George-McCulloch (1993, 1997) to VAR models, simultaneously searching restrictions on the coefficient matrix Φ\Phi (of dimension p×(h+Lp)p \times (h+Lp)) and the off-diagonal elements of the upper-triangular Cholesky factor Ψ\Psi (where Σ1=ΨΨ\Sigma^{-1} = \Psi\Psi'). The total competing submodel space has 2(h+Lp)p+p(p1)/22^{(h+Lp)p + p(p-1)/2} elements.

Why upper-triangular Ψ\Psi: The Cholesky decomposition gives a globally unique mapping ΣΨ\Sigma \to \Psi, ensuring identification. An arbitrary lower-triangular Ψ\Psi satisfies only local rank conditions and may be non-unique (Bekker-Pollock 1986; Amisano-Giannini 1997).

Mixture prior: Binary indicators γi\gamma_i for Φ\Phi elements and ωij\omega_{ij} for off-diagonal Ψ\Psi elements each select between narrow (exclusion) and wide (inclusion) Normal components. Diagonal ψii2Gamma(ai,bi)\psi_{ii}^2 \sim \text{Gamma}(a_i, b_i) — always included — guarantees positive definiteness of every sampled Σ1=ΨΨ\Sigma^{-1} = \Psi\Psi'.

Five-step Gibbs sampler (all conditionals standard, no Metropolis-Hastings (MH) steps):

  1. ψii2Gamma\psi_{ii}^2 \sim \text{Gamma} (Schur complements of the residual sum matrix S(Φ)S(\Phi))
  2. ηjN\eta_j \sim \mathcal{N} (normal-normal conjugate for off-diagonal rows of Ψ\Psi)
  3. ωijBernoulli\omega_{ij} \sim \text{Bernoulli} (Normal density ratio at current ψij\psi_{ij})
  4. ϕN\phi \sim \mathcal{N} (normal-normal conjugate given Ψ\Psi)
  5. γiBernoulli\gamma_i \sim \text{Bernoulli} — does not depend on YY (key property from George-McCulloch (1993))

Rao-Blackwell forecasts average over all visited models, improving out-of-sample mean squared error (MSE) by 20–67% over MLE in simulation. Restricting Φ\Phi improves Ψ\Psi selection and vice versa.

Empirical application: 7-variable producer price index (PPI)→consumer price index (CPI) VAR (L=12L=12), two periods. In 1969–80, the supply-chain contemporaneous structure is confirmed (IM→FC→CPI, UNEMP→FFR). Post-1981, the FF-CM link breaks and the Fed Funds Rate becomes endogenously responsive to commodity, import, and CPI shocks contemporaneously (Volcker disinflation). See Variable Selection for the full SSVS-VAR prior and Gibbs sampler details.

Mean-Adjusted Form

An alternative parametrization exposes the unconditional mean (steady state) as an explicit parameter:

Π(L)(xtΨdt)=εt\Pi(L)(x_t - \Psi d_t) = \varepsilon_t

where μt=Ψdt\mu_t = \Psi d_t is directly identified rather than implicitly defined as Π1(1)Φdt\Pi^{-1}(1)\Phi d_t. This reparametrization enables informative Bayesian priors on the steady state — for example, centering on a central bank's inflation target or a Dynamic Stochastic General Equilibrium (DSGE) model's long-run calibration. See Steady State VAR.

No-Arbitrage VAR (Term Structure)

A VAR may be disciplined by no-arbitrage cross-equation restrictions when the state vector includes bond yields alongside macro variables. In the Ang-Piazzesi (2001) framework, the state XtX_t follows a companion VAR(1) (eq. 8) and bond yields of maturity nn are constrained to lie on an affine surface:

ytn=An+BnXty_t^n = A_n + B_n' X_t

where An,BnA_n, B_n must satisfy the no-arbitrage recursions determined by the stochastic discount factor (see Affine Term Structure Model). These recursions impose tight cross-equation restrictions: all yields must be consistent with a single pricing kernel. Practical consequences:

DSGE-to-VAR Bridge

Any linear (or linearized) DSGE equilibrium can be cast as a state-space (A,B,C,D)(A,B,C,D) system (see State-Space Representation). The Kalman filter applied to this system produces the innovations representation (A,K,C,Σ)(A,K,C,\Sigma), from which the VAR for the observables follows directly:

yt=j=1AjVARytj+Gεt,AjVAR=C(AKC)j1K(17)y_t = \sum_{j=1}^{\infty} A_j^{\text{VAR}}\, y_{t-j} + G\varepsilon_t, \qquad A_j^{\text{VAR}} = C(A-KC)^{j-1}K \tag{17}

The DSGE therefore implies a generically infinite-order VAR (or more precisely a VARMA), not a finite-order VAR. Three conditions govern the quality of a finite-order VAR approximation:

  1. Existence: All eigenvalues of AKCA - KC strictly inside the unit circle → the infinite-order VAR representation exists.
  2. Invertibility: ρ(ABD1C)<1\rho(A - BD^{-1}C) < 1 → the VAR's one-step innovations GεtG\varepsilon_t span the same Hilbert space as the model's economic shocks wtw_t. See Invertibility Problem.
  3. Truncation quality: The dominant eigenvalue of AKCA - KC controls the geometric rate at which VAR lag coefficients decay; faster decay means fewer lags are needed.

When invertibility holds, the Kalman gain collapses to K=BD1K = BD^{-1}, the estimation error covariance is Σ=0\Sigma = 0, and the identification matrix equals the model's DD matrix (G=DG = D). In this case VAR impulse responses exactly recover the economic model's impulse responses — no approximation error. When invertibility fails, no choice of GG can repair the mismatch.

Sims (1980) Empirical Application — U.S. and West Germany

The foundational VAR application in Sims (1980) uses a six-variable quarterly system to demonstrate the methodology.

Variables: money MM, real output Y/PY/P, unemployment UU, nominal wages WW, price level PP, import prices PMPM, plus constant and time trend.

Data: U.S. 1949Q1–1975Q4 (T=108T = 108); West Germany 1958Q1–1976Q2 (T=74T = 74).

Lag length selection. Sims (1980) tests 4 vs. 8 lags using a (Tk)(T-k)-corrected likelihood ratio statistic (where kk is the number of RHS variables per equation) to reduce finite-sample over-rejection:

LR=(Tk)(logΣ^4logΣ^8)χ2(144)LR = (T - k)(\log|\hat\Sigma_4| - \log|\hat\Sigma_8|) \sim \chi^2(144)

Results: U.S. LR=166.09LR = 166.09; Germany LR=142.53LR = 142.53. Both countries accept p=4p = 4 at conventional critical values (χ5%2(144)172\chi^2_{5\%}(144) \approx 172). The 144 degrees of freedom reflect 144 additional parameters when going from p=4p=4 to p=8p=8 in a 6-variable system.

Identification. Cholesky triangularization in the ordering (M,Y,U,W,P,PM)(M, Y, U, W, P, PM): money comes first (does not respond contemporaneously to any other variable within the quarter), import prices last. Orthogonalized innovations are unit-variance by construction.

Variance decompositions (Sims 1980, Tables III–IV). At long horizons, money dominates U.S. nominal variables:

Horizon kk U.S.: % of WW variance due to MM U.S.: % of PP variance due to MM
1 0% 3%
9 37% 30%
33 64% 60%

Germany shows a different pattern: price innovations dominate own forecast error at all horizons (86% at k=1k=1), and real GNP is strongly driven by its own innovations (93% at k=1k=1), reflecting a more supply-side-driven economy.

Block exogeneity tests. The rational expectations market-clearing hypothesis predicts real-sector variables (Y,U,W,P)(Y, U, W, P) should not be Granger-caused by money. Testing this as a zero-restriction Wald test on cross-block lag coefficients:

Hypothesis U.S. χ2\chi^2 (df) Germany χ2\chi^2 (df) Conclusion
Real sector exogenous to MM 64.6364.63 (24), p<0.001p<0.001 52.1052.10 (32), p0.01p\approx 0.01 Rejected both
Real + money jointly exogenous (U.S.) 42.5442.54 (36), p=0.21p=0.21 Not rejected

Money Granger-causes real variables in both countries, contradicting pure market-clearing. See Granger Causality for the block exogeneity test framework.

Large-Scale VARs: Diagonality and Block Exogeneity (Lastrapes 2005)

When n1n_1 (the number of micro/industry variables) is large, estimating an unrestricted VAR is infeasible. Lastrapes (2005) shows that two over-identifying restrictions make the problem tractable. Partition zt=(z1t,z2t)z_t = (z_{1t}', z_{2t}')' where z1tz_{1t} (n1×1n_1\times 1) are micro variables and z2tz_{2t} (n2×1n_2 \times 1) are common/aggregate factors.

Restrictions:

  1. Diagonality: A11hA_{11}^h diagonal for h=0,,ph=0,\ldots,p — variables in z1z_1 are mutually independent after conditioning on z2z_2; all cross-sectional correlation is mediated by the common factors.
  2. Block exogeneity: A21h=0A_{21}^h = 0 — aggregate z2z_2 is not driven by micro z1z_1. Plausible whenever z2z_2 contains macro-level and z1z_1 contains industry- or region-level variables.

Estimation: These restrictions allow the system to be separated into two independent sub-systems: z1t=i=1pB11iz1,ti+i=0pGiz2,ti+vt,z2t=i=1pB22iz2,ti+ϵ2tz_{1t} = \sum_{i=1}^p B_{11}^i z_{1,t-i} + \sum_{i=0}^p G_i z_{2,t-i} + v_t, \qquad z_{2t} = \sum_{i=1}^p B_{22}^i z_{2,t-i} + \epsilon_{2t} with G0=Ω12Ω221G_0 = \Omega_{12}\Omega_{22}^{-1}. The z1z_1 residual covariance H=Ω11Ω12Ω221Ω12H = \Omega_{11} - \Omega_{12}\Omega_{22}^{-1}\Omega_{12}' is diagonal (because A110A_{11}^0 is diagonal), so equation-by-equation OLS is fully efficient — no GLS needed. Each equation in the z1z_1 sub-system contains only its own lags plus z2z_2 and its lags.

Identification: Using Ω=D0D0\Omega = D_0 D_0' with D0=A01D_0 = A_0^{-1}, structural identification proceeds in three steps:

  1. Identify D220D_{22}^0 from Ω22\Omega_{22} alone using standard restrictions on z2z_2 (e.g., Cholesky or Blanchard-Quah long-run).
  2. D120=Ω12(D220)1D_{12}^0 = \Omega_{12}(D_{22}^{0'})^{-1} — recovered automatically, no restrictions on micro-aggregate cross-responses needed.
  3. D110D_{11}^0 — just-identified as positive square roots of diagonal elements of Ω11D120D120\Omega_{11} - D_{12}^0 D_{12}^{0'}.

The full set of structural impulse responses follows from Di=CiD0D_i = C_i D_0. The entire identification burden falls on the n2n_2-dimensional aggregate sub-system, keeping the problem feasible regardless of n1n_1.

Critique of state-by-state estimation: The Carlino-Defina (1998) approach of estimating a separate small VAR for each state or industry — with its own aggregate variables but without imposing block exogeneity jointly — is misleading because the identification of aggregate shocks varies arbitrarily across the separate systems.

Euro Area BVAR Forecasting (Felix-Nunes 2003)

Felix and Nunes (2003) apply Bayesian VAR and Bayesian error correction model (BECM) methods to forecasting six quarterly euro area aggregates — gross domestic product (GDP) (Y), unemployment (U), private consumption deflator (P), nominal wages (W), long-term interest rate (ILT), and nominal exchange rate (S) — with three exogenous variables (external GDP YW, external price index PW, short-term rate IST). Data: 11-country euro area aggregate, 1977:1–1997:4; pseudo out-of-sample evaluation 1989:1–1997:4.

Integration. Augmented Dickey-Fuller (ADF) tests classify Y, U, ILT, S, YW, IST as I(1); P, W, PW as I(2) (unit root in first differences). I(2) variables enter in first differences within levels BVAR specifications.

Twelve models compared (RMSE relative to random walk = 1.000, averaged over 6 variables ×\times 12 horizons):

Model Avg RMSE
BVAR levels 0.731
BECM(EG)-IP 0.754
BECM(J)-IP 0.805
BVAR first-diff 0.839
BECM(EG)-FP 0.857
AR 1.042
VAR levels 1.188
BECM(J)-FP 1.278

All Bayesian models beat all non-Bayesian models. The Minnesota prior is extended with a real/price block structure (hyperparameters λ1,λ2,θ1\lambda_1, \lambda_2, \theta_1θ6\theta_6) and a loading tightness Ω\Omega — see Minnesota Prior for full details. The flat-prior danger in BECM(J)-FP is documented in Cointegration (§ Flat-Prior Pathology).

Capital Gains Forecasting with BVAR and Kalman Filtering (Kim-Miller-Ozanne 2004)

Kim, Miller, and Ozanne (2004) apply BVAR methods to a fiscal-policy forecasting problem: estimating current-year U.S. capital gains realizations and projecting them 10 years ahead for Congressional Budget Office (CBO) revenue scoring. Two BVAR strategies are compared against the CBO historical mean-reversion benchmark (gains/GDP reverts to historical average), which produced a 1-year RMSE of 18.57 pp after tax adjustment.

Two-step method: A BVAR(5) in macro variables (real GDP, labor productivity, output gap, S&P 500, interest-rate spread, compensation per hour, fixed private investment) forecasts explanatory variables; annual tax-adjusted gains growth is then regressed on the forecast changes in those variables. Best 1-year RMSE: 14.80 pp (−20% vs. CBO benchmark).

Integrated quarterly method (best overall): Annual tax-adjusted gains are interpolated to quarterly frequency (three alternatives: linear, economic, in-model) and incorporated directly into a unified BVAR. The Kalman filter delivers current-year estimates that are revised as quarterly macro data arrive throughout the year (E1 = estimation error). At year-end the smoother is applied; the year-ahead projection follows from the BVAR transition equation (E2 = forecast|estimated start). Best variant: linear interpolation BVAR, 1-year RMSE 11.92 pp (−36% vs. CBO).

Why linear interpolation wins: Annual gains residuals are positively serially correlated (Durbin-Watson = 0.78). In the quarterly model, an annual estimation error of ε\varepsilon propagates as 1.6ε1.6\varepsilon (because the quarterly model revises the current-year path more aggressively than the annual model), while in the annual model it is 1.0ε1.0\varepsilon. The extra revision weight amplifies the benefit of within-year data arrivals.

Prior specification: Follows Robertson-Tallman (1999) / Sims-Zha (1998) style with 6 hyperparameters (μ1\mu_1μ6\mu_6) corresponding to: overall tightness, first-lag diagonal shrinkage, intercept variance, higher-lag decay rate, unit-root dummy observation weight, and cointegration dummy observation weight.

Multi-year horizon: BVAR superiority fades beyond 2–3 years; mean reversion or random-walk with drift performs comparably thereafter. The 2001 out-of-sample evaluation (actual −46%; best model −6.9%) illustrates that capital gains tail events driven by asset-price dynamics lie outside the BVAR's macro information set.

Multi-Period Expected Returns and the Fisher Hypothesis (Engsted-Tanggaard 2000)

A VAR can circumvent the overlapping-data problem that afflicts long-horizon return regressions. With the VAR state Xt=[Rts,Rtb,πt,δt,Δit]X_t = [R^s_t, R^b_t, \pi_t, \delta_t, \Delta i_t]' (stock return, bond return, inflation, log dividend-price ratio, change in short rate) estimated at the one-period frequency, multi-period expected values follow directly from the companion matrix AA:

R^t,N(i)=ei ⁣(j=1NAj)Xt,π^t,N=eπ ⁣(j=1NAj)Xt\hat{R}^{(i)}_{t,N} = \mathbf{e}_i'\!\left(\sum_{j=1}^N A^j\right) X_t, \qquad \hat\pi_{t,N} = \mathbf{e}_\pi'\!\left(\sum_{j=1}^N A^j\right) X_t

No time-overlapping observations appear; standard inference applies at any horizon NN. Engsted-Tanggaard (2000) apply this to test the Fisher Hypothesis for US (1926–1997) and Danish (1922–1996) stocks and bonds at N=1,5,10N = 1, 5, 10 years. Key results: US stocks fail Fisher at N=10N=10 (correlation with expected inflation falls from 0.52 at N=5N=5 to 0.38); Danish stocks achieve near-perfect Fisher at N=10N=10 (corr 0.89\approx 0.89, SD ratio 1\approx 1). See Engsted-Tanggaard (2000) for full details.

Multi-Population Mortality (Zhou et al. 2013)

VAR and vector error correction model (VECM) methods extend naturally to stochastic mortality modeling. Under the Lee-Carter structure, the mortality index κt(i)\kappa_t^{(i)} for each of two related populations follows a non-stationary I(1) process. Modeling (κt(1),κt(2))(\kappa_t^{(1)}, \kappa_t^{(2)}) jointly with a VAR in differences:

Δκt(i)=ϕ0(i)+ϕ1(i)Δκt1(1)+ϕ2(i)Δκt1(2)+ϵt(i)\Delta\kappa_t^{(i)} = \phi_0^{(i)} + \phi_1^{(i)}\Delta\kappa_{t-1}^{(1)} + \phi_2^{(i)}\Delta\kappa_{t-1}^{(2)} + \epsilon_t^{(i)}

achieves a symmetric model that does not require assuming which population is dominant. The non-divergence condition (equal long-run drift rates) must be imposed as a parameter constraint. Upgrading to VECM adds error-correction terms and enforces non-divergence automatically. See Lee-Carter Model and Cointegration for the mortality VECM setup.

Why It Matters

Open Questions

Related