Home Statistical Dictionary Mixing (Stochastic Processes)
Mixing (Stochastic Processes)
A property describing how quickly a stochastic process's values at widely separated times become statistically close to independent, a graded, quantifiable relaxation of true independence.
In Plain English
Real dependent data, stock returns, temperature readings, a Markov chain's trajectory, is almost never truly independent from one time point to the next, but the dependence usually fades the further apart two observations are. Mixing formalizes exactly how fast that fading happens: a process is 'mixing' if events far apart in time become approximately independent, and different flavors of mixing (strong mixing, alpha-mixing, beta-mixing) quantify that approach to independence with different levels of strictness. This concept matters enormously in practice because it's the standard replacement for the independence assumption needed to prove laws of large numbers and central limit theorems for dependent, time-series-like data.
Definition
A stationary process is said to be strong mixing (or -mixing) if as the time lag , that is, events determined by the distant past and events determined by the far future become asymptotically uncorrelated in probability. Related, more restrictive mixing conditions include -mixing (uniform mixing) and -mixing (absolute regularity), each imposing a stronger rate or form of asymptotic independence, forming a hierarchy where -mixing implies -mixing implies -mixing. Mixing conditions, often combined with a specified decay rate (e.g. exponentially fast mixing, common for ergodic Markov chains and ARMA processes), are the standard technical assumption used to extend classical i.i.d.-based limit theorems, laws of large numbers and central limit theorems, to dependent time series data.
Properties
- Mixing is the technical backbone that lets time series econometrics and applied probability extend classical i.i.d. results, laws of large numbers, central limit theorems, to realistic, dependent data, without a mixing (or similar) condition, standard asymptotic theory for regression and forecasting with time series simply doesn't apply.
- Ergodic Markov chains with 'nice' (e.g. geometrically ergodic) convergence to their stationary distribution are typically strong mixing with an exponentially decaying mixing coefficient, this is the formal link between the Markov-chain-specific ergodic theorem and the general theory of mixing processes.
- The various flavors of mixing (alpha, beta, phi) exist because different limit theorems require different strengths of asymptotic independence to go through, choosing the right mixing condition to assume, and verifying it holds for a given model, is a substantial part of rigorous time series asymptotic theory.
At a Glance