Panel analysis

Panel (data) analysis is a statistical method, widely used in social science, epidemiology, and econometrics to analyze two-dimensional (typically cross sectional and longitudinal) panel data.^[1] The data are usually collected over time and over the same individuals and then a regression is run over these two dimensions. Multidimensional analysis is an econometric method in which data are collected over more than two dimensions (typically, time, individuals, and some third dimension).^[2]

A common panel data regression model looks like ${\displaystyle y_{it}=a+bx_{it}+\varepsilon _{it}}$, where ${\displaystyle y}$ is the dependent variable, ${\displaystyle x}$ is the independent variable, ${\displaystyle a}$ and ${\displaystyle b}$ are coefficients, ${\displaystyle i}$ and ${\displaystyle t}$ are indices for individuals and time. The error ${\displaystyle \varepsilon _{it}}$ is very important in this analysis. Assumptions about the error term determine whether we speak of fixed effects or random effects. In a fixed effects model, ${\displaystyle \varepsilon _{it}}$ is assumed to vary non-stochastically over ${\displaystyle i}$ or ${\displaystyle t}$ making the fixed effects model analogous to a dummy variable model in one dimension. In a random effects model, ${\displaystyle \varepsilon _{it}}$ is assumed to vary stochastically over ${\displaystyle i}$ or ${\displaystyle t}$ requiring special treatment of the error variance matrix.^[3]

Panel data analysis has three more-or-less independent approaches:

• independently pooled panels;
• random effects models;
• fixed effects models or first differenced models.

The selection between these methods depends upon the objective of the analysis, and the problems concerning the exogeneity of the explanatory variables.

Key assumption:
There are no unique attributes of individuals within the measurement set, and no universal effects across time.

Key assumption:
There are unique attributes of individuals that do not vary over time. That is, the unique attributes for a given individual ${\displaystyle i}$ are time ${\displaystyle t}$ invariant. These attributes may or may not be correlated with the individual dependent variables y_i. To test whether fixed effects, rather than random effects, is needed, the Durbin–Wu–Hausman test can be used.

Key assumption:
There are unique, time constant attributes of individuals that are not correlated with the individual regressors. Pooled OLS^{[clarification needed]} can be used to derive unbiased and consistent estimates of parameters even when time constant attributes are present, but random effects will be more efficient.

Random effects model is a feasible generalised least squares technique which is asymptotically more efficient than Pooled OLS when time constant attributes are present. Random effects adjusts for the serial correlation which is induced by unobserved time constant attributes.

In the standard random effects (RE) and fixed effects (FE) models, independent variables are assumed to be uncorrelated with error terms. Provided the availability of valid instruments, RE and FE methods extend to the case where some of the explanatory variables are allowed to be endogenous. As in the exogenous setting, RE model with Instrumental Variables (REIV) requires more stringent assumptions than FE model with Instrumental Variables (FEIV) but it tends to be more efficient under appropriate conditions.^[4]

To fix ideas, consider the following model:

${\displaystyle y_{it}=x_{it}\beta +c_{i}+u_{it}}$

where ${\displaystyle c_{i}}$ is unobserved unit-specific time-invariant effect (call it unobserved effect) and ${\displaystyle x_{it}}$ can be correlated with ${\displaystyle u_{is}}$ for s possibly different from t. Suppose there exists a set of valid instruments ${\displaystyle z_{i}=(z_{i1},\ldots ,z_{it})}$.

In REIV setting, key assumptions include that ${\displaystyle z_{i}}$ is uncorrelated with ${\displaystyle c_{i}}$ as well as ${\displaystyle u_{it}}$ for ${\displaystyle t=1,\ldots ,T}$. In fact, for REIV estimator to be efficient, conditions stronger than uncorrelatedness between instruments and unobserved effect are necessary.

On the other hand, FEIV estimator only requires that instruments be exogenous with error terms after conditioning on unobserved effect i.e. ${\displaystyle E[u_{it}\mid z_{i},c_{i}]=0[1]}$.^[4] The FEIV condition allows for arbitrary correlation between instruments and unobserved effect. However, this generality does not come for free: time-invariant explanatory and instrumental variables are not allowed. As in the usual FE method, the estimator uses time-demeaned variables to remove unobserved effect. Therefore, FEIV estimator would be of limited use if variables of interest include time-invariant ones.

The above discussion has parallel to the exogenous case of RE and FE models. In the exogenous case, RE assumes uncorrelatedness between explanatory variables and unobserved effect, and FE allows for arbitrary correlation between the two. Similar to the standard case, REIV tends to be more efficient than FEIV provided that appropriate assumptions hold.^[4]

In contrast to the standard panel data model, a dynamic panel model also includes lagged values of the dependent variable as regressors. For example, including one lag of the dependent variable generates:

${\displaystyle y_{it}=a+bx_{it}+\rho y_{it-1}+\varepsilon _{it}}$

The assumptions of the fixed effect and random effect models are violated in this setting. Instead, practitioners use a technique like the Arellano–Bond estimator.

• Panel study
• Factor analysis
• Hausman test