World Library  
Flag as Inappropriate
Email this Article

Asymptotic theory (statistics)

Article Id: WHEBN0026024794
Reproduction Date:

Title: Asymptotic theory (statistics)  
Author: World Heritage Encyclopedia
Language: English
Subject: Statistical inference, Maximum likelihood, Statistics, List of statistics articles, Mathematical statistics
Collection: Asymptotic Statistical Theory, Econometrics, Statistical Theory
Publisher: World Heritage Encyclopedia
Publication
Date:
 

Asymptotic theory (statistics)

In statistics, asymptotic theory, or large sample theory, is a generic framework for assessment of properties of estimators and statistical tests. Within this framework it is typically assumed that the sample size n grows indefinitely, and the properties of statistical procedures are evaluated in the limit as n → ∞.

In practical applications, asymptotic theory is applied by treating the asymptotic results as approximately valid for finite sample sizes as well. Such approach is often criticized for not having any mathematical grounds behind it, yet it is used ubiquitously anyway. The importance of the asymptotic theory is that it often makes possible to carry out the analysis and state many results which cannot be obtained within the standard “finite-sample theory”.

Contents

  • Overview 1
  • Modes of convergence of random variables 2
  • Asymptotic properties 3
    • Estimators 3.1
  • Asymptotic theorems 4
  • Notes 5
  • References 6

Overview

Most statistical problems begin with a dataset of size n. The asymptotic theory proceeds by assuming that it is possible to keep collecting additional data, so that the sample size would grow infinitely:

n \to \infty\,

Under this assumption many results can be obtained that are unavailable for samples of finite sizes. As an example consider the law of large numbers. This law states that for a sequence of iid random variables X1, X2, …, the sample averages \scriptstyle\overline{X}_n converge in probability to the population mean E[Xi] as n → ∞. At the same time for finite n it is impossible to claim anything about the distribution of \scriptstyle\overline{X}_n if the distributions of individual Xi’s is unknown.

For various models slightly different modes of asymptotics may be used:

  • For cross-sectional data (iid) the new observations are sampled independently, from the same fixed distribution. This is the standard case of n → ∞ asymptotics.
  • For longitudinal data (time series) the sampling method may differ from model to model. Sometimes the data is assumed to be ergodic, in other applications it can be integrated or cointegrated. In this case the asymptotic is again taken as the number of observations (usually denoted T in this case) goes to infinity: T → ∞.
  • For panel data, it is commonly assumed that one dimension in the data (T) remains fixed, whereas the other dimension grows: T = const, n → ∞.

Besides these standard approaches, various other “alternative” asymptotic approaches exist:

  • Within the local asymptotic normality framework, it is assumed that the value of the “true parameter” in the model varies slightly with n, such that the n-th model corresponds to \scriptstyle\theta_n\,=\,\theta+h/\sqrt{n}. This approach lets us study the regularity of estimators.
  • When statistical tests are studied for their power to distinguish against the alternatives that are close to the null hypothesis, it is done within the so-called “local alternatives” framework: the null hypothesis is H0: θ = θ0, and the alternative is H1: \scriptstyle\theta\,=\,\theta_0+h/\sqrt{n}. This approach is especially popular for the unit root tests.
  • There are models where the dimension of the parameter space Θn slowly expands with n, reflecting the fact that the more observations a statistician has, the more he is tempted to introduce additional parameters in the model. An example of this is the weak instruments asymptotic.
  • In kernel density estimation and kernel regression additional parameter — the bandwidth h — is assumed. In these models it is typically taken that h → 0 as n → ∞, however the rate of convergence must be chosen carefully, usually hn−1/5.

Modes of convergence of random variables

Asymptotic properties

Estimators

\hat\theta_n\ \xrightarrow{p}\ \theta_0

Generally an estimator is just some, more or less arbitrary, function of the data. The property of consistency requires that the estimator was estimating the quantity we intended it to. As such, it is the most important property in the estimation theory: estimators that are known to be inconsistent are never used in practice.

  • Asymptotic distribution: if it is possible to find sequences of non-random constants {an}, {bn} (possibly depending on the value of θ0), and a non-degenerate distribution G such that
b_n(\hat\theta_n - a_n)\ \xrightarrow{d}\ G ,

then the sequence of estimators \scriptstyle\hat\theta_n is said to have the asymptotic distribution G.

Most often, the estimators encountered in practice have the asymptotically normal distribution, with an = θ0, bn = √n, and G = N(0, V):

\sqrt{n}(\hat\theta_n - \theta_0)\ \xrightarrow{d}\ \mathcal{N}(0, V).

Asymptotic theorems

Notes

References

  •  
  • van der Vaart, A.W. (1998). Asymptotic statistics. Cambridge University Press.  
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
 
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
 
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.
 


Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.