Statistics, Statistics, estimators and pivotal quantities
From Vototo
Summary
Statistics is the study of the collection, organization, analysis, interpretation and presentation of data.Dodge, Y. (2006) The Oxford Dictionary of Statistical Terms, OUP. ISBN 0-19-920613-9 It deals with all aspects of data including the planning of data collection in terms of the design of surveys and experiments. When analyzing data, it is possible to use one of two statistics methodologies: descriptive statistics or inferential statistics.
Details
Consider an independent identically distributed (iid) random variables with a given probability distribution: standard statistical inference and estimation theory defines a random sample as the random vector given by the column vector of these iid variables. The population being examined is described by a probability distribution which may have unknown parameters.
A statistic is random variable which is a function of the random sample, but not a function of unknown parameters. The probability distribution of the statistics, though, may have unknown parameters.
Consider now a function of the unknown parameter: an estimator is a statistic used to estimate such function. Commonly used estimators include sample mean, unbiased sample variance and sample covariance.
A random variable which is a function of the random sample and of the unknown parameter, but whose probability distribution does not depend on the unknown parameter is called a pivotal quantity or pivot. Widely used pivots include the z-score, the chi square statistic and Student's t-value.
Between two estimators of a given parameter, the one with lower mean squared error is said to be more efficient. Furthermore an estimator is said to be unbiased if it's expected value is equal to the true value of the unknown parameter which is being estimated and asymptotically unbiased if its expected value converges at the limit to the true value of such parameter.
Other desirable properties for estimators include: UMVUE estimators which have the lowest variance for all possible values of the parameter to be estimated (this is usually an easier property to verify than efficiency) and consistent estimators which converges in probability to the true value of such parameter.
This still leaves the question of how to obtain estimators in a given situation and carry the computation, several methods have been proposed: the method of moments, the maximum likelihood method, the least squares method and the more recent method of estimating equations.
Copyright: Attributeâ€”Share Alike
Related Topics
- Statistics
- Statistics, Scope
- Statistics, Mathematical statistics
- Statistics, Overview
- Statistics, Sampling
- Statistics, Experimental and observational studies
- Statistics, Experiments
- Statistics, Observational study
- Statistics, Type of data
- Statistics, Statistics, estimators and pivotal quantities
- Statistics, Null hypothesis and alternative hypothesis
- Statistics, Error
- Statistics, Interval estimation
- [[Statistics, S
External Links
- Wikipedia