Open main menu
Home
Random
Recent changes
Special pages
Community portal
Preferences
About Wikipedia
Disclaimers
Incubator escapee wiki
Search
User menu
Talk
Dark mode
Contributions
Create account
Log in
Editing
Weighted arithmetic mean
(section)
Warning:
You are not logged in. Your IP address will be publicly visible if you make any edits. If you
log in
or
create an account
, your edits will be attributed to your username, along with other benefits.
Anti-spam check. Do
not
fill this in!
====Reliability weights==== If the weights are instead ''reliability weights'' (non-random values reflecting the sample's relative trustworthiness, often derived from sample variance), we can determine a correction factor to yield an unbiased estimator. Assuming each random variable is sampled from the same distribution with mean <math>\mu</math> and actual variance <math>\sigma_{\text{actual}}^2</math>, taking expectations we have, :<math> \begin{align} \operatorname{E} [\hat \sigma^2] &= \frac{ \sum\limits_{i=1}^N \operatorname{E} [(x_i - \mu)^2]} N \\ &= \operatorname{E} [(X - \operatorname{E}[X])^2] - \frac{1}{N} \operatorname{E} [(X - \operatorname{E}[X])^2] \\ &= \left( \frac{N - 1} N \right) \sigma_{\text{actual}}^2 \\ \operatorname{E} [\hat \sigma^2_\mathrm{w}] &= \frac{\sum\limits_{i=1}^N w_i \operatorname{E} [(x_i - \mu^*)^2] }{V_1} \\ &= \operatorname{E}[(X - \operatorname{E}[X])^2] - \frac{V_2}{V_1^2} \operatorname{E}[(X - \operatorname{E}[X])^2] \\ &= \left(1 - \frac{V_2 }{ V_1^2}\right) \sigma_{\text{actual}}^2 \end{align} </math> where <math>V_1 = \sum_{i=1}^N w_i</math> and <math>V_2 = \sum_{i=1}^N w_i^2</math>. Therefore, the bias in our estimator is <math>\left(1 - \frac{V_2 }{ V_1^2}\right) </math>, analogous to the <math> \left( \frac{N - 1} {N} \right)</math> bias in the unweighted estimator (also notice that <math>\ V_1^2 / V_2 = N_{eff} </math> is the [[effective sample size#weighted samples|effective sample size]]). This means that to unbias our estimator we need to pre-divide by <math>1 - \left(V_2 / V_1^2\right) </math>, ensuring that the expected value of the estimated variance equals the actual variance of the sampling distribution. The final unbiased estimate of sample variance is: :<math> \begin{align} s^2_{\mathrm{w}}\ &= \frac{\hat \sigma^2_\mathrm{w}} {1 - (V_2 / V_1^2)} \\[4pt] &= \frac {\sum\limits_{i=1}^N w_i (x_i - \mu^*)^2} {V_1 - (V_2 / V_1)}, \end{align} </math><ref>{{cite web|url=https://www.gnu.org/software/gsl/manual/html_node/Weighted-Samples.html|title=GNU Scientific Library β Reference Manual: Weighted Samples|website=Gnu.org|access-date=22 December 2017}}</ref> where <math>\operatorname{E}[s^2_{\mathrm{w}}] = \sigma_{\text{actual}}^2</math>. The degrees of freedom of this weighted, unbiased sample variance vary accordingly from ''N'' β 1 down to 0. The standard deviation is simply the square root of the variance above. As a side note, other approaches have been described to compute the weighted sample variance.<ref>{{cite web |url=http://www.analyticalgroup.com/download/WEIGHTED_MEAN.pdf |title=Weighted Standard Error and its Impact on Significance Testing (WinCross vs. Quantum & SPSS), Dr. Albert Madansky| website=Analyticalgroup.com| access-date=22 December 2017}}</ref>
Edit summary
(Briefly describe your changes)
By publishing changes, you agree to the
Terms of Use
, and you irrevocably agree to release your contribution under the
CC BY-SA 4.0 License
and the
GFDL
. You agree that a hyperlink or URL is sufficient attribution under the Creative Commons license.
Cancel
Editing help
(opens in new window)