Weighted sum

A weight function is a mathematical device used when performing a sum, integral, or average to give some elements more "weight" or influence on the result than other elements in the same set. They occur frequently in statistics and analysis, and are closely related to the concept of a measure. Weight functions can be employed in both discrete and continuous settings. They can be used to construct systems of calculus called "weighted calculus"[1] and "meta-calculus".[2]

Discrete weights

General definition

In the discrete setting, a weight function \scriptstyle w\colon A \to {\Bbb R}^+ is a positive function defined on a discrete set A, which is typically finite or countable. The weight function w(a) := 1 corresponds to the unweighted situation in which all elements have equal weight. One can then apply this weight to various concepts.

If the function \scriptstyle f\colon A \to {\Bbb R} is a real-valued function, then the unweighted sum of f on A is defined as

\sum_{a \in A} f(a);

but given a weight function \scriptstyle w\colon A \to {\Bbb R}^+, the weighted sum or conical combination is defined as

\sum_{a \in A} f(a) w(a).

One common application of weighted sums arises in numerical integration.

If B is a finite subset of A, one can replace the unweighted cardinality |B| of B by the weighted cardinality

\sum_{a \in B} w(a).

If A is a finite non-empty set, one can replace the unweighted mean or average

\frac{1}{|A|} \sum_{a \in A} f(a)

by the weighted mean or weighted average

\frac{\sum_{a \in A} f(a) w(a)}{\sum_{a \in A} w(a)}.

In this case only the relative weights are relevant.

Statistics

Weighted means are commonly used in statistics to compensate for the presence of bias. For a quantity f measured multiple independent times f_i with variance \scriptstyle\sigma^2_i, the best estimate of the signal is obtained by averaging all the measurements with weight \scriptstyle w_i=\frac 1 {\sigma_i^2}, and the resulting variance is smaller than each of the independent measurements \scriptstyle\sigma^2=1/\sum w_i. The Maximum likelihood method weights the difference between fit and data using the same weights w_i.

Mechanics

The terminology weight function arises from mechanics: if one has a collection of n objects on a lever, with weights \scriptstyle w_1, \dotsc, w_n (where weight is now interpreted in the physical sense) and locations :\scriptstyle\boldsymbol{x}_1,\dotsc,\boldsymbol{x}_n, then the lever will be in balance if the fulcrum of the lever is at the center of mass

\frac{\sum_{i=1}^n w_i \boldsymbol{x}_i}{\sum_{i=1}^n w_i},

which is also the weighted average of the positions \scriptstyle\boldsymbol{x}_i.

Continuous weights

In the continuous setting, a weight is a positive measure such as w(x) dx on some domain \Omega,which is typically a subset of a Euclidean space \scriptstyle{\Bbb R}^n, for instance \Omega could be an interval [a,b]. Here dx is Lebesgue measure and \scriptstyle w\colon \Omega \to \R^+ is a non-negative measurable function. In this context, the weight function w(x) is sometimes referred to as a density.

General definition

If f\colon \Omega \to {\Bbb R} is a real-valued function, then the unweighted integral

\int_\Omega f(x)\ dx

can be generalized to the weighted integral

\int_\Omega f(x) w(x)\, dx

Note that one may need to require f to be absolutely integrable with respect to the weight w(x) dx in order for this integral to be finite.

Weighted volume

If E is a subset of \Omega, then the volume vol(E) of E can be generalized to the weighted volume

\int_E w(x)\ dx,

Weighted average

If \Omega has finite non-zero weighted volume, then we can replace the unweighted average

\frac{1}{\mathrm{vol}(\Omega)} \int_\Omega f(x)\ dx

by the weighted average

\frac{\int_\Omega f(x)\ w(x) dx}{\int_\Omega w(x)\ dx}

Inner product

If \scriptstyle f\colon \Omega \to {\Bbb R} and \scriptstyle g\colon \Omega \to {\Bbb R} are two functions, one can generalize the unweighted inner product

\langle f, g \rangle := \int_\Omega f(x) g(x)\ dx

to a weighted inner product

\langle f, g \rangle := \int_\Omega f(x) g(x)\ w(x)\ dx.

See the entry on Orthogonality for more details.

See also

References

This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
 
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
 
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.