Statistical benchmarking

Summary

(Learn how and when to remove this template message)

In statistics, benchmarking is a method of using auxiliary information to adjust the sampling weights used in an estimation process, in order to yield more accurate estimates of totals.

Suppose we have a population where each unit ${\displaystyle k}$ has a "value" ${\displaystyle Y(k)}$ associated with it. For example, ${\displaystyle Y(k)}$ could be a wage of an employee ${\displaystyle k}$, or the cost of an item ${\displaystyle k}$. Suppose we want to estimate the sum ${\displaystyle Y}$ of all the ${\displaystyle Y(k)}$. So we take a sample of the ${\displaystyle k}$, get a sampling weight W(k) for all sampled ${\displaystyle k}$, and then sum up ${\displaystyle W(k)\cdot Y(k)}$ for all sampled ${\displaystyle k}$.

One property usually common to the weights ${\displaystyle W(k)}$ described here is that if we sum them over all sampled ${\displaystyle k}$, then this sum is an estimate of the total number of units ${\displaystyle k}$ in the population (for example, the total employment, or the total number of items). Because we have a sample, this estimate of the total number of units in the population will differ from the true population total. Similarly, the estimate of total ${\displaystyle Y}$ (where we sum ${\displaystyle W(k)\cdot Y(k)}$ for all sampled ${\displaystyle k}$) will also differ from true population total.

We do not know what the true population total ${\displaystyle Y}$ value is (if we did, there would be no point in sampling!). Yet often we do know what the sum of the ${\displaystyle W(k)}$ are over all units in the population. For example, we may not know the total earnings of the population or the total cost of the population, but often we know the total employment or total volume of sales. And even if we don't know these exactly, there often are surveys done by other organizations or at earlier times, with very accurate estimates of these auxiliary quantities. One important function of a population census is to provide data that can be used for benchmarking smaller surveys.

The benchmarking procedure begins by first breaking the population into benchmarking cells. Cells are formed by grouping units together that share common characteristics, for example, similar ${\displaystyle Y(k)}$, yet anything can be used that enhances the accuracy of the final estimates. For each cell ${\displaystyle C}$, we let ${\displaystyle W(C)}$ be the sum of all ${\displaystyle W(k)}$, where the sum is taken over all sampled ${\displaystyle k}$ in the cell ${\displaystyle C}$. For each cell ${\displaystyle C}$, we let ${\displaystyle T(C)}$ be the auxiliary value for cell ${\displaystyle C}$, which is commonly called the "benchmark target" for cell ${\displaystyle C}$. Next, we compute a benchmark factor ${\displaystyle F(C)=T(C)/W(C)}$. Then, we adjust all weights ${\displaystyle W(k)}$ by multiplying it by its benchmark factor ${\displaystyle F(C)}$, for its cell ${\displaystyle C}$. The net result is that the estimated ${\displaystyle W}$ [formed by summing ${\displaystyle F(C)\cdot W(k)}$] will now equal the benchmark target total ${\displaystyle T}$. But the more important benefit is that the estimate of the total of ${\displaystyle Y}$ [formed by summing ${\displaystyle F(C)\cdot F(k)\cdot Y(k)}$] will tend to be more accurate.

Relationship to stratified sampling edit

Further reading edit