A centered and scaled version of the empirical measure is the signed measure
It induces a map on measurable functions f given by
By the central limit theorem, converges in distribution to a normal random variable N(0, P(A)(1 − P(A))) for fixed measurable set A. Similarly, for a fixed function f, converges in distribution to a normal random variable , provided that and exist.
Definition
is called an empirical process indexed by , a collection of measurable subsets of S.
is called an empirical process indexed by , a collection of measurable functions from S to .
A significant result in the area of empirical processes is Donsker's theorem. It has led to a study of Donsker classes: sets of functions with the useful property that empirical processes indexed by these classes converge weakly to a certain Gaussian process. While it can be shown that Donsker classes are Glivenko–Cantelli classes, the converse is not true in general.
^Mojirsheibani, M. (2007). "Nonparametric curve estimation with missing data: A general empirical process approach". Journal of Statistical Planning and Inference. 137 (9): 2733–2758. doi:10.1016/j.jspi.2006.02.016.
^Wolfowitz, J. (1954). "Generalization of the Theorem of Glivenko-Cantelli". The Annals of Mathematical Statistics. 25: 131–138. doi:10.1214/aoms/1177728852.
Further readingedit
Billingsley, P. (1995). Probability and Measure (Third ed.). New York: John Wiley and Sons. ISBN 0471007102.
Donsker, M. D. (1952). "Justification and Extension of Doob's Heuristic Approach to the Kolmogorov- Smirnov Theorems". The Annals of Mathematical Statistics. 23 (2): 277–281. doi:10.1214/aoms/1177729445.
Dudley, R. M. (1978). "Central Limit Theorems for Empirical Measures". The Annals of Probability. 6 (6): 899–929. doi:10.1214/aop/1176995384.
Dudley, R. M. (1999). Uniform Central Limit Theorems. Cambridge Studies in Advanced Mathematics. Vol. 63. Cambridge, UK: Cambridge University Press.
Kosorok, M. R. (2008). Introduction to Empirical Processes and Semiparametric Inference. Springer Series in Statistics. doi:10.1007/978-0-387-74978-5. ISBN 978-0-387-74977-8.
Shorack, G. R.; Wellner, J. A. (2009). Empirical Processes with Applications to Statistics. doi:10.1137/1.9780898719017. ISBN 978-0-89871-684-9.
van der Vaart, Aad W.; Wellner, Jon A. (2000). Weak Convergence and Empirical Processes: With Applications to Statistics (2nd ed.). Springer. ISBN 978-0-387-94640-5.
Dzhaparidze, K. O.; Nikulin, M. S. (1982). "Probability distributions of the Kolmogorov and omega-square statistics for continuous distributions with shift and scale parameters". Journal of Soviet Mathematics. 20 (3): 2147. doi:10.1007/BF01239992. S2CID 123206522.
External linksedit
Empirical Processes: Theory and Applications, by David Pollard, a textbook available online.
Introduction to Empirical Processes and Semiparametric Inference, by Michael Kosorok, another textbook available online.