Misplaced Pages

Σ-algebra: Difference between revisions

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Browse history interactively← Previous editContent deleted Content addedVisualWikitext
Revision as of 04:04, 3 December 2022 edit140.232.175.169 (talk)No edit summaryTags: Manual revert Mobile edit Mobile web edit← Previous edit Latest revision as of 13:46, 8 October 2024 edit undoMathwriter2718 (talk | contribs)Extended confirmed users1,098 edits Sub σ-algebras: Improved example and added formal defn 
(24 intermediate revisions by 21 users not shown)
Line 1: Line 1:
{{Short description|Algebraic structure of set algebra}}
{{lowercase title}}
{{Short description|Algebric structure of set algebra}}
{{for|an algebraic structure admitting a given signature Σ of operations|Universal algebra}} {{for|an algebraic structure admitting a given signature Σ of operations|Universal algebra}}
{{lowercase title}}
In ] and in ], a '''σ-algebra''' (also '''σ-field''') on a set ''X'' is a nonempty collection Σ of ]s of ''X'' ] under ], countable ], and countable ]. The pair (''X'', Σ) is called a ].
In ] and in ], a '''σ-algebra''' ("sigma algebra"; also '''σ-field''', where the σ comes from the ] "Summe"<ref>Elstrodt, J. (2018). Maß- Und Integrationstheorie. Springer Spektrum Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-57939-8</ref>) on a set ''X'' is a nonempty collection Σ of ] of ''X'' ] under ], countable ], and countable ]. The ordered pair <math>(X, \Sigma)</math> is called a ].


The σ-algebras are a subset of the ]s; elements of the latter only need to be closed under the union or intersection of ''finitely'' many subsets, which is a weaker condition.<ref>{{cite web|title=Probability, Mathematical Statistics, Stochastic Processes|url=http://www.math.uah.edu/stat/foundations/Measure.html|website=Random|publisher=University of Alabama in Huntsville, Department of Mathematical Sciences|accessdate=30 March 2016}}</ref> A σ-algebra of subsets is a ] of subsets; elements of the latter only need to be closed under the union or intersection of ''finitely'' many subsets, which is a weaker condition.<ref>{{Cite web |title=11. Measurable Spaces |url=https://www.randomservices.org/random/foundations/Measurable.html |access-date=30 March 2016 |website=Random: Probability, Mathematical Statistics, Stochastic Processes |publisher=University of Alabama in Huntsville, Department of Mathematical Sciences |quote=Clearly a σ-algebra of subsets is also an algebra of subsets, so the basic results for algebras in still hold.}}</ref>


The main use of σ-algebras is in the definition of ]; specifically, the collection of those subsets for which a given measure is defined is necessarily a σ-algebra. This concept is important in ] as the foundation for ], and in ], where it is interpreted as the collection of events which can be assigned probabilities. Also, in probability, σ-algebras are pivotal in the definition of ]. The main use of σ-algebras is in the definition of ]; specifically, the collection of those subsets for which a given measure is defined is necessarily a σ-algebra. This concept is important in ] as the foundation for ], and in ], where it is interpreted as the collection of events which can be assigned probabilities. Also, in probability, σ-algebras are pivotal in the definition of ].
Line 10: Line 10:
In ], (sub) σ-algebras are needed for the formal mathematical definition of a ],<ref name=sufficiency>{{cite book |last1=Billingsley |first1=Patrick |authorlink=Patrick Billingsley |title=Probability and Measure |date=2012 |publisher=Wiley |isbn=978-1-118-12237-2 |edition=Anniversary}}</ref> particularly when the statistic is a function or a random process and the notion of ] is not applicable. In ], (sub) σ-algebras are needed for the formal mathematical definition of a ],<ref name=sufficiency>{{cite book |last1=Billingsley |first1=Patrick |authorlink=Patrick Billingsley |title=Probability and Measure |date=2012 |publisher=Wiley |isbn=978-1-118-12237-2 |edition=Anniversary}}</ref> particularly when the statistic is a function or a random process and the notion of ] is not applicable.


If {{math|''X'' {{=}} {''a'', ''b'', ''c'', ''d''},}} one possible σ-algebra on ''X'' is {{math {{=}} { ∅, {''a'', ''b''}, {''c'', ''d''}, {''a'', ''b'', ''c'', ''d''}},}} where is the ]. In general, a finite algebra is always a σ-algebra. If <math>X = \{a, b, c, d\}</math> one possible σ-algebra on <math>X</math> is <math>\Sigma = \{\varnothing, \{a, b\}, \{c, d\}, \{a, b, c, d\}\},</math> where <math>\varnothing</math> is the ]. In general, a finite algebra is always a σ-algebra.


If {''A''<sub>1</sub>, ''A''<sub>2</sub>, ''A''<sub>3</sub>, …} is a countable ] of ''X'' then the collection of all unions of sets in the partition (including the empty set) is a σ-algebra. If <math>\{A_1, A_2, A_3, \ldots\},</math> is a countable ] of <math>X</math> then the collection of all unions of sets in the partition (including the empty set) is a σ-algebra.


A more useful example is the set of subsets of the ] formed by starting with all ]s and adding in all countable unions, countable intersections, and relative complements and continuing this process (by ] through all ]s) until the relevant closure properties are achieved (a construction known as the ]). A more useful example is the set of subsets of the ] formed by starting with all ]s and adding in all countable unions, countable intersections, and relative complements and continuing this process (by ] through all ]s) until the relevant closure properties are achieved (a construction known as the ]).
Line 20: Line 20:


===Measure=== ===Measure===
A ] on ''X'' is a ] that assigns a non-negative ] to subsets of ''X''; this can be thought of as making precise a notion of "size" or "volume" for sets. We want the size of the union of disjoint sets to be the sum of their individual sizes, even for an infinite sequence of ]. A ] on <math>X</math> is a ] that assigns a non-negative ] to subsets of <math>X;</math> this can be thought of as making precise a notion of "size" or "volume" for sets. We want the size of the union of disjoint sets to be the sum of their individual sizes, even for an infinite sequence of ].


One would like to assign a size to ''every'' subset of ''X'', but in many natural settings, this is not possible. For example, the ] implies that when the size under consideration is the ordinary notion of length for subsets of the real line, then there exist sets for which no size exists, for example, the ]s. For this reason, one considers instead a smaller collection of privileged subsets of ''X''. These subsets will be called the measurable sets. They are closed under operations that one would expect for measurable sets, that is, the complement of a measurable set is a measurable set and the countable union of measurable sets is a measurable set. Non-empty collections of sets with these properties are called σ-algebras. One would like to assign a size to {{em|every}} subset of <math>X,</math> but in many natural settings, this is not possible. For example, the ] implies that when the size under consideration is the ordinary notion of length for subsets of the real line, then there exist sets for which no size exists, for example, the ]s. For this reason, one considers instead a smaller collection of privileged subsets of <math>X.</math> These subsets will be called the measurable sets. They are closed under operations that one would expect for measurable sets, that is, the complement of a measurable set is a measurable set and the countable union of measurable sets is a measurable set. Non-empty collections of sets with these properties are called σ-algebras.


===Limits of sets=== ===Limits of sets===
Many uses of measure, such as the probability concept of ], involve ]. For this, closure under countable unions and intersections is paramount. Set limits are defined as follows on σ-algebras. Many uses of measure, such as the probability concept of ], involve ]. For this, closure under countable unions and intersections is paramount. Set limits are defined as follows on σ-algebras.
* The limit supremum of a sequence ''A''<sub>1</sub>, ''A''<sub>2</sub>, ''A''<sub>3</sub>, ..., each of which is a subset of ''X'', is
::<math>\limsup_{n\to\infty}A_n = \bigcap_{n=1}^\infty\bigcup_{m=n}^\infty A_m.</math>
* The limit infimum of a sequence ''A''<sub>1</sub>, ''A''<sub>2</sub>, ''A''<sub>3</sub>, ..., each of which is a subset of ''X'', is
::<math>\liminf_{n\to\infty}A_n = \bigcup_{n=1}^\infty\bigcap_{m=n}^\infty A_m.</math>
* If, in fact,
::<math>\liminf_{n\to\infty}A_n = \limsup_{n\to\infty}A_n,</math>
:then the <math>\lim_{n\to\infty}A_n</math> exists as that common set.


* The {{em|]}} or {{em|outer limit}} of a sequence <math>A_1, A_2, A_3, \ldots</math> of subsets of <math>X</math> is <math display=block>\limsup_{n\to\infty} A_n = \bigcap_{n=1}^\infty \bigcup_{m=n}^\infty A_m = \bigcap_{n=1}^\infty A_n \cup A_{n+1} \cup \cdots.</math> It consists of all points <math>x</math> that are in infinitely many of these sets (or equivalently, that are in ] of them). That is, <math>x \in \limsup_{n\to\infty} A_n</math> if and only if there exists an infinite ] <math> A_{n_1}, A_{n_2}, \ldots</math> (where <math>n_1 < n_2 < \cdots</math>) of sets that all contain <math>x;</math> that is, such that <math>x \in A_{n_1} \cap A_{n_2} \cap \cdots.</math>
===Sub σ-algebras===
* The {{em|]}} or {{em|inner limit}} of a sequence <math>A_1, A_2, A_3, \ldots</math> of subsets of <math>X</math> is <math display=block>\liminf_{n\to\infty} A_n = \bigcup_{n=1}^\infty \bigcap_{m=n}^\infty A_m = \bigcup_{n=1}^\infty A_n \cap A_{n+1} \cap \cdots.</math> It consists of all points that are in all but finitely many of these sets (or equivalently, that are {{em|eventually}} in all of them). That is, <math>x \in \liminf_{n\to\infty} A_n</math> if and only if there exists an index <math>N \in \N</math> such that <math>A_N, A_{N+1}, \ldots</math> all contain <math>x;</math> that is, such that <math>x \in A_N \cap A_{N+1} \cap \cdots.</math>
In much of probability, especially when ] is involved, one is concerned with sets that represent only part of all the possible information that can be observed. This partial information can be characterized with a smaller σ-algebra which is a subset of the principal σ-algebra; it consists of the collection of subsets relevant only to and determined only by the partial information. A simple example suffices to illustrate this idea.


The inner limit is always a subset of the outer limit: <math display=block>\liminf_{n\to\infty} A_n ~\subseteq~ \limsup_{n\to\infty} A_n.</math>
Imagine you and another person are betting on a game that involves flipping a coin repeatedly and observing whether it comes up Heads (''H'') or Tails (''T''). Since you and your opponent are each infinitely wealthy, there is no limit to how long the game can last. This means the ] Ω must consist of all possible infinite sequences of ''H'' or ''T'':
If these two sets are equal then their limit <math>\lim_{n\to\infty} A_n</math> exists and is equal to this common set:
<math display=block>\lim_{n\to\infty} A_n := \liminf_{n\to\infty} A_n = \limsup_{n\to\infty} A_n.</math>


===Sub σ-algebras===
:<math>\Omega = \{H, T\}^\infty = \{(x_1, x_2, x_3, \dots) : x_i \in \{H, T\}, i \ge 1\}.</math>
In much of probability, especially when ] is involved, one is concerned with sets that represent only part of all the possible information that can be observed. This partial information can be characterized with a smaller σ-algebra which is a subset of the principal σ-algebra; it consists of the collection of subsets relevant only to and determined only by the partial information. Formally, if <math>\Sigma, \Sigma'</math> are σ-algebras on <math>X</math>, then <math>\Sigma'</math> is a sub σ-algebra of <math>\Sigma</math> if <math>\Sigma' \subseteq \Sigma</math>. An example will illustrate how this idea arises.

However, after ''n'' flips of the coin, you may want to determine or revise your betting strategy in advance of the next flip. The observed information at that point can be described in terms of the 2<sup>n</sup> possibilities for the first ''n'' flips. Formally, since you need to use subsets of Ω, this is codified as the σ-algebra

:<math>\mathcal{G}_n = \{A \times \{H, T\}^\infty : A \subset \{H, T\}^n\}.</math>


Imagine two people are betting on a game that involves flipping a coin repeatedly and observing whether it comes up Heads (<math>H</math>) or Tails (<math>T</math>). Both players are assumed to be infinitely wealthy, so there is no limit to how long the game can last. This means the ] Ω must consist of all possible infinite sequences of <math>H</math> or <math>T:</math>
Observe that then
<math display=block>\Omega = \{H, T\}^\infty = \{(x_1, x_2, x_3, \dots) : x_i \in \{H, T\}, i \geq 1\}.</math>


The observed information after <math>n</math> flips have occurred is one of the <math>2^n</math> possibilities describing the sequence of the first <math>n</math> flips. This is codified as the sub σ-algebra
:<math>\mathcal{G}_1 \subset \mathcal{G}_2 \subset \mathcal{G}_3 \subset \cdots \subset \mathcal{G}_\infty,</math>
<math display=block>\mathcal{G}_n = \{A \times \{H, T\}^\infty : A \subseteq \{H, T\}^n\}</math>


which locks down the first <math>n</math> flips and is agnostic about the result of the remaining ones. Observe that then
<math display=block>\mathcal{G}_1 \subseteq \mathcal{G}_2 \subseteq \mathcal{G}_3 \subseteq \cdots \subseteq \mathcal{G}_\infty,</math>
where <math>\mathcal{G}_\infty</math> is the smallest σ-algebra containing all the others. where <math>\mathcal{G}_\infty</math> is the smallest σ-algebra containing all the others.


Line 54: Line 50:


===Definition=== ===Definition===
Let ''X'' be some set, and let <math>P(X)</math> represent its ]. Then a subset <math>\Sigma \subseteq P(X)</math> is called a '''''σ''-algebra''' if it satisfies the following three properties:<ref>{{cite book | last=Rudin | first=Walter | authorlink=Walter Rudin | title=Real & Complex Analysis | publisher=] | year=1987 | isbn=0-07-054234-1}}</ref> Let <math>X</math> be some set, and let <math>P(X)</math> represent its ]. Then a subset <math>\Sigma \subseteq P(X)</math> is called a '''σ-algebra''' if and only if it satisfies the following three properties:<ref>{{cite book | last=Rudin | first=Walter | authorlink=Walter Rudin | title=Real & Complex Analysis | publisher=] | year=1987 | isbn=0-07-054234-1}}</ref>


# <math>X</math> is in <math> \Sigma</math>.
# ''X'' is in Σ, and ''X'' is considered to be the ] in the following context.
# Σ is ''closed under complementation'': If ''A'' is in Σ, then so is its ], {{math|''X'' \ ''A''}}. # <math> \Sigma</math> is ''closed under complementation'': If some set <math>A</math> is in <math> \Sigma,</math> then so is its ], <math>X \setminus A.</math>
# Σ is ''closed under countable unions'': If ''A''<sub>1</sub>, ''A''<sub>2</sub>, ''A''<sub>3</sub>, ... are in Σ, then so is ''A'' = ''A''<sub>1</sub> ''A''<sub>2</sub> ''A''<sub>3</sub> ∪ … . # <math> \Sigma</math> is ''closed under countable unions'': If <math>A_1, A_2, A_3, \ldots</math> are in <math> \Sigma,</math> then so is <math>A = A_1 \cup A_2 \cup A_3 \cup \cdots.</math>


From these properties, it follows that the σ-algebra is also closed under countable ] (by applying ]). From these properties, it follows that the σ-algebra is also closed under countable ] (by applying ]).


It also follows that the ] is in Σ, since by '''(1)''' ''X'' is in Σ and '''(2)''' asserts that its complement, the empty set, is also in Σ. Moreover, since {{math|{''X'', ∅}}} satisfies condition '''(3)''' as well, it follows that {{math|{''X'', ∅}}} is the smallest possible σ-algebra on ''X''. The largest possible σ-algebra on ''X'' is <math>P(X)</math>. It also follows that the ] <math>\varnothing</math> is in <math> \Sigma,</math> since by '''(1)''' <math>X</math> is in <math> \Sigma</math> and '''(2)''' asserts that its complement, the empty set, is also in <math> \Sigma.</math> Moreover, since <math>\{X, \varnothing\}</math> satisfies condition '''(3)''' as well, it follows that <math>\{X, \varnothing\}</math> is the smallest possible σ-algebra on <math>X.</math> The largest possible σ-algebra on <math>X</math> is <math>P(X).</math>


Elements of the ''σ''-algebra are called ]s. An ordered pair {{math|(''X'', Σ)}}, where ''X'' is a set and Σ is a ''σ''-algebra over ''X'', is called a '''measurable space'''. A function between two measurable spaces is called a ] if the ] of every measurable set is measurable. The collection of measurable spaces forms a ], with the ]s as ]s. ] are defined as certain types of functions from a ''σ''-algebra to . Elements of the σ-algebra are called ]s. An ordered pair <math>(X, \Sigma),</math> where <math>X</math> is a set and <math> \Sigma</math> is a σ-algebra over <math>X,</math> is called a '''measurable space'''. A function between two measurable spaces is called a ] if the ] of every measurable set is measurable. The collection of measurable spaces forms a ], with the ]s as ]s. ] are defined as certain types of functions from a σ-algebra to <math>.</math>


A σ-algebra is both a ] and a ] (λ-system). The converse is true as well, by Dynkin's theorem (below). A σ-algebra is both a ] and a ] (λ-system). The converse is true as well, by Dynkin's theorem (see below).


===Dynkin's π-λ theorem=== ===Dynkin's π-λ theorem===
{{See also|π-λ theorem}}

This theorem (or the related ]) is an essential tool for proving many results about properties of specific σ-algebras. It capitalizes on the nature of two simpler classes of sets, namely the following. This theorem (or the related ]) is an essential tool for proving many results about properties of specific σ-algebras. It capitalizes on the nature of two simpler classes of sets, namely the following.
: A ] ''P'' is a collection of subsets of X that is closed under finitely many intersections, and * A ] <math>P</math> is a collection of subsets of <math>X</math> that is closed under finitely many intersections, and
: a ] (or λ-system) ''D'' is a collection of subsets of X that contains X and is closed under complement and under countable unions of ''disjoint'' subsets. * A ] (or λ-system) <math>D</math> is a collection of subsets of <math>X</math> that contains <math>X</math> and is closed under complement and under countable unions of ''disjoint'' subsets.


Dynkin's π-λ theorem says, if ''P'' is a π-system and ''D'' is a Dynkin system that contains ''P'', then the σ-algebra σ(''P'') ] by ''P'' is contained in ''D''. Since certain π-systems are relatively simple classes, it may not be hard to verify that all sets in ''P'' enjoy the property under consideration while, on the other hand, showing that the collection ''D'' of all subsets with the property is a Dynkin system can also be straightforward. Dynkin's π-λ Theorem then implies that all sets in σ(''P'') enjoy the property, avoiding the task of checking it for an arbitrary set in σ(''P''). Dynkin's π-λ theorem says, if <math>P</math> is a π-system and <math>D</math> is a Dynkin system that contains <math>P,</math> then the σ-algebra <math>\sigma(P)</math> ] by <math>P</math> is contained in <math>D.</math> Since certain π-systems are relatively simple classes, it may not be hard to verify that all sets in <math>P</math> enjoy the property under consideration while, on the other hand, showing that the collection <math>D</math> of all subsets with the property is a Dynkin system can also be straightforward. Dynkin's π-λ Theorem then implies that all sets in <math>\sigma(P)</math> enjoy the property, avoiding the task of checking it for an arbitrary set in <math>\sigma(P).</math>


One of the most fundamental uses of the π-λ theorem is to show equivalence of separately defined measures or integrals. For example, it is used to equate a probability for a random variable ''X'' with the ] typically associated with computing the probability: One of the most fundamental uses of the π-λ theorem is to show equivalence of separately defined measures or integrals. For example, it is used to equate a probability for a random variable <math>X</math> with the ] typically associated with computing the probability:
<math display=block>\mathbb{P}(X\in A) = \int_A \,F(dx)</math> for all <math>A</math> in the Borel σ-algebra on <math>\Reals,</math>
where <math>F(x)</math> is the ] for <math>X,</math> defined on <math>\Reals,</math> while <math>\mathbb{P}</math> is a ], defined on a σ-algebra <math> \Sigma</math> of subsets of some ] <math>\Omega.</math>


===Combining σ-algebras===
:<math>\mathbb{P}(X\in A)=\int_A \,F(dx)</math> for all ''A'' in the Borel σ-algebra on '''R''',
Suppose <math>\textstyle\left\{\Sigma_\alpha : \alpha \in \mathcal{A}\right\}</math> is a collection of σ-algebras on a space <math>X.</math>


'''Meet'''
where ''F''(''x'') is the ] for ''X'', defined on '''R''', while <math>\mathbb{P}</math> is a ], defined on a σ-algebra Σ of subsets of some ] Ω.


The intersection of a collection of σ-algebras is a σ-algebra. To emphasize its character as a σ-algebra, it often is denoted by:
===Combining σ-algebras===
Suppose <math>\textstyle\{\Sigma_\alpha\colon\alpha\in\mathcal{A}\}</math> is a collection of σ-algebras on a space ''X''. <math display=block>\bigwedge_{\alpha \in \mathcal{A}} \Sigma_\alpha.</math>


'''Sketch of Proof:''' Let <math>\Sigma^*</math> denote the intersection. Since <math>X</math> is in every <math>\Sigma_\alpha, \Sigma^*</math> is not empty. Closure under complement and countable unions for every <math>\Sigma_\alpha</math> implies the same must be true for <math>\Sigma^*.</math> Therefore, <math>\Sigma^*</math> is a σ-algebra.
* The intersection of a collection of σ-algebras is a σ-algebra. To emphasize its character as a σ-algebra, it often is denoted by:
::<math>\bigwedge_{\alpha\in\mathcal{A}}\Sigma_\alpha.</math>
:'''Sketch of Proof:''' Let {{math|Σ<sup>∗</sup>}} denote the intersection. Since ''X'' is in every {{math|Σ<sub>''α''</sub>, Σ<sup>∗</sup>}} is not empty. Closure under complement and countable unions for every {{math|Σ<sub>''α''</sub>}} implies the same must be true for {{math|Σ<sup>∗</sup>}}. Therefore, {{math|Σ<sup>∗</sup>}} is a σ-algebra.


'''Join'''
* The union of a collection of σ-algebras is not generally a σ-algebra, or even an algebra, but it ] a σ-algebra known as the ] which typically is denoted

::<math>\bigvee_{\alpha\in\mathcal{A}}\Sigma_\alpha=\sigma\left(\bigcup_{\alpha\in\mathcal{A}}\Sigma_\alpha\right).</math>
The union of a collection of σ-algebras is not generally a σ-algebra, or even an algebra, but it ] a σ-algebra known as the join which typically is denoted
:A π-system that generates the join is
::<math>\mathcal{P}=\left \{\bigcap_{i=1}^nA_i:A_i\in\Sigma_{\alpha_i},\alpha_i\in\mathcal{A},\ n\ge1 \right\}.</math> <math display=block>\bigvee_{\alpha \in \mathcal{A}} \Sigma_\alpha = \sigma\left(\bigcup_{\alpha \in \mathcal{A}} \Sigma_\alpha\right).</math>
A π-system that generates the join is
:'''Sketch of Proof:''' By the case ''n'' = 1, it is seen that each <math>\Sigma_\alpha\subset\mathcal{P}</math>, so
::<math>\bigcup_{\alpha\in\mathcal{A}}\Sigma_\alpha\subset\mathcal{P}.</math> <math display=block>\mathcal{P} = \left\{\bigcap_{i=1}^n A_i : A_i \in \Sigma_{\alpha_i}, \alpha_i \in \mathcal{A},\ n \geq 1\right\}.</math>
'''Sketch of Proof:''' By the case <math>n = 1,</math> it is seen that each <math>\Sigma_\alpha\subset\mathcal{P},</math> so
:This implies
::<math>\sigma\left(\bigcup_{\alpha\in\mathcal{A}}\Sigma_\alpha\right)\subset\sigma(\mathcal{P})</math> <math display=block>\bigcup_{\alpha \in \mathcal{A}} \Sigma_\alpha \subseteq \mathcal{P}.</math>
This implies
:by the definition of a σ-algebra ] by a collection of subsets. On the other hand,
::<math>\mathcal{P}\subset\sigma\left(\bigcup_{\alpha\in\mathcal{A}}\Sigma_\alpha\right)</math> <math display=block>\sigma\left(\bigcup_{\alpha \in \mathcal{A}} \Sigma_\alpha\right) \subseteq \sigma(\mathcal{P})</math>
by the definition of a σ-algebra ] by a collection of subsets. On the other hand,
:which, by Dynkin's π-λ theorem, implies
::<math>\sigma(\mathcal{P})\subset\sigma\left(\bigcup_{\alpha\in\mathcal{A}}\Sigma_\alpha\right).</math> <math display=block>\mathcal{P} \subseteq \sigma\left(\bigcup_{\alpha \in \mathcal{A}} \Sigma_\alpha\right)</math>
which, by Dynkin's π-λ theorem, implies
<math display=block>\sigma(\mathcal{P}) \subseteq \sigma\left(\bigcup_{\alpha \in \mathcal{A}} \Sigma_\alpha\right).</math>


===σ-algebras for subspaces=== ===σ-algebras for subspaces===
Suppose ''Y'' is a subset of ''X'' and let (''X'', Σ) be a measurable space. Suppose <math>Y</math> is a subset of <math>X</math> and let <math>(X, \Sigma)</math> be a measurable space.
* The collection {''Y'' ''B'': ''B'' Σ} is a σ-algebra of subsets of ''Y''. * The collection <math>\{Y \cap B : B \in \Sigma\}</math> is a σ-algebra of subsets of <math>Y.</math>
* Suppose (''Y'', Λ) is a measurable space. The collection {''A'' ''X'' : ''A'' ''Y'' Λ} is a σ-algebra of subsets of ''X''. * Suppose <math>(Y, \Lambda)</math> is a measurable space. The collection <math>\{A \subseteq X : A \cap Y \in \Lambda\}</math> is a σ-algebra of subsets of <math>X.</math>


===Relation to σ-ring=== ===Relation to σ-ring===
A ''σ''-algebra Σ is just a ] that contains the universal set ''X''.<ref name=Vestrup2009>{{cite book| last=Vestrup |first=Eric M. |title=The Theory of Measures and Integration |year=2009 |publisher=John Wiley & Sons |isbn=978-0-470-31795-2 |page=12}}</ref> A ''σ''-ring need not be a ''σ''-algebra, as for example measurable subsets of zero Lebesgue measure in the real line are a ''σ''-ring, but not a ''σ''-algebra since the real line has infinite measure and thus cannot be obtained by their countable union. If, instead of zero measure, one takes measurable subsets of finite Lebesgue measure, those are a ] but not a ''σ''-ring, since the real line can be obtained by their countable union yet its measure is not finite. A ''σ''-algebra <math> \Sigma</math> is just a ] that contains the universal set <math>X.</math><ref name=Vestrup2009>{{cite book| last=Vestrup |first=Eric M. |title=The Theory of Measures and Integration |year=2009 |publisher=John Wiley & Sons |isbn=978-0-470-31795-2 |page=12}}</ref> A ''σ''-ring need not be a ''σ''-algebra, as for example measurable subsets of zero Lebesgue measure in the real line are a ''σ''-ring, but not a ''σ''-algebra since the real line has infinite measure and thus cannot be obtained by their countable union. If, instead of zero measure, one takes measurable subsets of finite Lebesgue measure, those are a ] but not a ''σ''-ring, since the real line can be obtained by their countable union yet its measure is not finite.


===Typographic note=== ===Typographic note===
''σ''-algebras are sometimes denoted using ] capital letters, or the ]. Thus {{math|(''X'', Σ)}} may be denoted as <math>\scriptstyle(X,\,\mathcal{F})</math> or <math>\scriptstyle(X,\,\mathfrak{F})</math>. ''σ''-algebras are sometimes denoted using ] capital letters, or the ]. Thus <math>(X, \Sigma)</math> may be denoted as <math>\scriptstyle(X,\,\mathcal{F})</math> or <math>\scriptstyle(X,\,\mathfrak{F}).</math>


==Particular cases and examples== ==Particular cases and examples==


===Separable σ-algebras=== ===Separable σ-algebras===
A '''separable &sigma;-algebra''' (or '''separable &sigma;-field''') is a &sigma;-algebra <math>\mathcal{F}</math> that is a ] when considered as a ] with ] <math>\rho(A,B) = \mu(A \mathbin{\triangle} B)</math> for <math>A,B \in \mathcal{F}</math> and a given ] <math>\mu</math> (and with <math>\triangle</math> being the ] operator).<ref>{{cite journal|last1=Džamonja|first1=Mirna|last2=Kunen|first2=Kenneth|authorlink2=Kenneth Kunen|title=Properties of the class of measure separable compact spaces| journal=]|year=1995|pages=262|url=https://archive.uea.ac.uk/~h020/fundamenta.pdf|quote=If <math>\mu</math> is a Borel measure on <math>X</math>, the measure algebra of <math>(X,\mu)</math> is the Boolean algebra of all Borel sets modulo <math>\mu</math>-null sets. If <math>\mu</math> is finite, then such a measure algebra is also a metric space, with the distance between the two sets being the measure of their symmetric difference. Then, we say that <math>\mu</math> is ''separable'' ] this metric space is separable as a topological space.}}</ref> Note that any &sigma;-algebra generated by a ] collection of ] is separable, but the converse need not hold. For example, the Lebesgue &sigma;-algebra is separable (since every Lebesgue measurable set is equivalent to some Borel set) but not countably generated (since its cardinality is higher than continuum). A '''separable <math>\sigma</math>-algebra''' (or '''separable <math>\sigma</math>-field''') is a <math>\sigma</math>-algebra <math>\mathcal{F}</math> that is a ] when considered as a ] with ] <math>\rho(A,B) = \mu(A \mathbin{\triangle} B)</math> for <math>A,B \in \mathcal{F}</math> and a given finite ] <math>\mu</math> (and with <math>\triangle</math> being the ] operator).<ref>{{cite journal|last1=Džamonja|first1=Mirna|last2=Kunen|first2=Kenneth|authorlink2=Kenneth Kunen|title=Properties of the class of measure separable compact spaces| journal=]|year=1995|pages=262|url=https://archive.uea.ac.uk/~h020/fundamenta.pdf|quote=If <math>\mu</math> is a Borel measure on <math>X,</math> the measure algebra of <math>(X,\mu)</math> is the Boolean algebra of all Borel sets modulo <math>\mu</math>-null sets. If <math>\mu</math> is finite, then such a measure algebra is also a metric space, with the distance between the two sets being the measure of their symmetric difference. Then, we say that <math>\mu</math> is ''separable'' ] this metric space is separable as a topological space.}}</ref> Any <math>\sigma</math>-algebra generated by a ] collection of ] is separable, but the converse need not hold. For example, the Lebesgue <math>\sigma</math>-algebra is separable (since every Lebesgue measurable set is equivalent to some Borel set) but not countably generated (since its cardinality is higher than continuum).


A separable measure space has a natural ] that renders it ] as a ]. The distance between two sets is defined as the measure of the ] of the two sets. Note that the symmetric difference of two distinct sets can have measure zero; hence the pseudometric as defined above need not to be a true metric. However, if sets whose symmetric difference has measure zero are identified into a single ], the resulting ] can be properly metrized by the induced metric. If the measure space is separable, it can be shown that the corresponding metric space is, too. A separable measure space has a natural ] that renders it ] as a ]. The distance between two sets is defined as the measure of the ] of the two sets. The symmetric difference of two distinct sets can have measure zero; hence the pseudometric as defined above need not to be a true metric. However, if sets whose symmetric difference has measure zero are identified into a single ], the resulting ] can be properly metrized by the induced metric. If the measure space is separable, it can be shown that the corresponding metric space is, too.


===Simple set-based examples=== ===Simple set-based examples===
Let ''X'' be any set. Let <math>X</math> be any set.
* The family consisting only of the empty set and the set ''X'', called the minimal or '''trivial σ-algebra''' over ''X''. * The family consisting only of the empty set and the set <math>X,</math> called the minimal or '''trivial σ-algebra''' over <math>X.</math>
* The ] of ''X'', called the '''discrete σ-algebra'''. * The ] of <math>X,</math> called the '''discrete σ-algebra'''.
* The collection {, ''A'', ''A''<sup>c</sup>, ''X''} is a simple σ-algebra generated by the subset ''A''. * The collection <math>\{\varnothing, A, X \setminus A, X\}</math> is a simple σ-algebra generated by the subset <math>A.</math>
* The collection of subsets of ''X'' which are countable or whose complements are countable is a σ-algebra (which is distinct from the power set of ''X'' if and only if ''X'' is uncountable). This is the σ-algebra generated by the ] of ''X''. Note: "countable" includes finite or empty. * The collection of subsets of <math>X</math> which are countable or whose complements are countable is a σ-algebra (which is distinct from the power set of <math>X</math> if and only if <math>X</math> is uncountable). This is the σ-algebra generated by the ] of <math>X.</math> Note: "countable" includes finite or empty.
* The collection of all unions of sets in a countable ] of ''X'' is a σ-algebra. * The collection of all unions of sets in a countable ] of <math>X</math> is a σ-algebra.


===Stopping time sigma-algebras=== ===Stopping time sigma-algebras===
A ] <math>\tau</math> can define a <math>\sigma</math>-algebra <math>\mathcal{F}_{\tau}</math>, the A ] <math>\tau</math> can define a <math>\sigma</math>-algebra <math>\mathcal{F}_\tau,</math> the
so-called ], which in a ] describes the information up to the random time <math>\tau</math> in the sense that, if the filtered probability space is interpreted as a random experiment, the maximum information that can be found out about the experiment from arbitrarily often repeating it until the time <math>\tau</math> is <math>\mathcal{F}_{\tau}</math>.<ref name="Fischer (2013)">{{cite journal|last=Fischer|first=Tom|title=On simple representations of stopping times and stopping time sigma-algebras|journal=Statistics and Probability Letters|year=2013|volume=83|issue=1|pages=345–349|doi=10.1016/j.spl.2012.09.024|url=https://dx.doi.org/10.1016/j.spl.2012.09.024}}</ref> so-called ], which in a ] describes the information up to the random time <math>\tau</math> in the sense that, if the filtered probability space is interpreted as a random experiment, the maximum information that can be found out about the experiment from arbitrarily often repeating it until the time <math>\tau</math> is <math>\mathcal{F}_{\tau}.</math><ref name="Fischer (2013)">{{cite journal|last=Fischer|first=Tom|title=On simple representations of stopping times and stopping time sigma-algebras|journal=Statistics and Probability Letters|year=2013|volume=83|issue=1|pages=345–349|doi=10.1016/j.spl.2012.09.024|arxiv=1112.1603 |url=https://dx.doi.org/10.1016/j.spl.2012.09.024}}</ref>


==σ-algebras generated by families of sets== ==σ-algebras generated by families of sets==
Line 135: Line 136:
===σ-algebra generated by an arbitrary family=== ===σ-algebra generated by an arbitrary family===
{{anchor}} {{anchor}}
Let ''F'' be an arbitrary family of subsets of ''X''. Then there exists a unique smallest σ-algebra which contains every set in ''F'' (even though ''F'' may or may not itself be a σ-algebra). It is, in fact, the intersection of all σ-algebras containing ''F''. (See intersections of σ-algebras above.) This σ-algebra is denoted σ(''F'') and is called '''the σ-algebra generated by ''F'''''. Let <math>F</math> be an arbitrary family of subsets of <math>X.</math> Then there exists a unique smallest σ-algebra which contains every set in <math>F</math> (even though <math>F</math> may or may not itself be a σ-algebra). It is, in fact, the intersection of all σ-algebras containing <math>F.</math> (See intersections of σ-algebras above.) This σ-algebra is denoted <math>\sigma(F)</math> and is called '''the σ-algebra generated by <math>F.</math>'''


If ''F'' is empty, then σ(''F'')={{math|{''X'', ∅}}}. Otherwise σ(''F'') consists of all the subsets of ''X'' that can be made from elements of ''F'' by a countable number of complement, union and intersection operations. If <math>F</math> is empty, then <math>\sigma(\varnothing) = \{\varnothing, X\}.</math> Otherwise <math>\sigma(F)</math> consists of all the subsets of <math>X</math> that can be made from elements of <math>F</math> by a countable number of complement, union and intersection operations.


For a simple example, consider the set ''X'' = {1, 2, 3}. Then the σ-algebra generated by the single subset {1} is {{math|σ(<nowiki>{{1}}</nowiki>) {{=}} {∅, {1}, {2, 3}, {1, 2, 3<nowiki>}}</nowiki>}}. By an ], when a collection of subsets contains only one element, ''A'', one may write σ(''A'') instead of σ({''A''}); in the prior example σ({1}) instead of σ(<nowiki>{{1}}</nowiki>). Indeed, using {{math|σ(''A''<sub>1</sub>, ''A''<sub>2</sub>, ...)}} to mean {{math|σ({''A''<sub>1</sub>, ''A''<sub>2</sub>, ...})}} is also quite common. For a simple example, consider the set <math>X = \{1, 2, 3\}.</math> Then the σ-algebra generated by the single subset <math>\{1\}</math> is
<math>\sigma(\{1\}) = \{\varnothing, \{1\}, \{2, 3\}, \{1, 2, 3\}\}.</math>
By an ], when a collection of subsets contains only one element, <math>A,</math> <math>\sigma(A)</math> may be written instead of <math>\sigma(\{A\});</math> in the prior example <math>\sigma(\{1\})</math> instead of <math>\sigma(\{\{1\}\}).</math> Indeed, using <math>\sigma\left(A_1, A_2, \ldots\right)</math> to mean <math>\sigma\left(\left\{A_1, A_2, \ldots\right\}\right)</math> is also quite common.


There are many families of subsets that generate useful σ-algebras. Some of these are presented here. There are many families of subsets that generate useful σ-algebras. Some of these are presented here.


===σ-algebra generated by a function=== ===σ-algebra generated by a function===
If <math>f</math> is a function from a set <math>X</math> to a set <math>Y</math> and <math>B</math> is a <math>\sigma</math>-algebra of subsets of <math>Y</math>, then the <math>\sigma</math>'''-algebra generated by the function''' <math>f</math>, denoted by <math>\sigma (f)</math>, is the collection of all inverse images <math>f^{-1} (S)</math> of the sets <math>S</math> in <math>B</math>. i.e. If <math>f</math> is a function from a set <math>X</math> to a set <math>Y</math> and <math>B</math> is a <math>\sigma</math>-algebra of subsets of <math>Y,</math> then the <math>\sigma</math>'''-algebra generated by the function''' <math>f,</math> denoted by <math>\sigma (f),</math> is the collection of all inverse images <math>f^{-1} (S)</math> of the sets <math>S</math> in <math>B.</math> That is,
<math display=block>\sigma (f) = \left\{f^{-1}(S) \, : \, S \in B\right\}. </math>


A function <math>f</math> from a set <math>X</math> to a set <math>Y</math> is ] with respect to a σ-algebra <math> \Sigma</math> of subsets of <math>X</math> if and only if <math>\sigma(f)</math> is a subset of <math>\Sigma.</math>
:<math> \sigma (f) = \{ f^{-1}(S) \, | \, S\in B \}. </math>


One common situation, and understood by default if <math>B</math> is not specified explicitly, is when <math>Y</math> is a ] or ] and <math>B</math> is the collection of ]s on <math>Y.</math>
A function ''f'' from a set ''X'' to a set ''Y'' is ] with respect to a σ-algebra Σ of subsets of ''X'' if and only if σ(''f'') is a subset of Σ.


If <math>f</math> is a function from <math>X</math> to <math>\Reals^n</math> then <math>\sigma(f)</math> is generated by the family of subsets which are inverse images of intervals/rectangles in <math>\Reals^n:</math>
One common situation, and understood by default if ''B'' is not specified explicitly, is when ''Y'' is a ] or ] and ''B'' is the collection of ]s on ''Y''.
<math display=block>\sigma(f) = \sigma\left(\left\{f^{-1}(\left \times \cdots \times \left) : a_i, b_i \in \Reals\right\}\right).</math>


A useful property is the following. Assume <math>f</math> is a measurable map from <math>\left(X, \Sigma_X\right)</math> to <math>\left(S, \Sigma_S\right)</math> and <math>g</math> is a measurable map from <math>\left(X, \Sigma_X\right)</math> to <math>\left(T, \Sigma_T\right).</math> If there exists a measurable map <math>h</math> from <math>\left(T, \Sigma_T\right)</math> to <math>\left(S, \Sigma_S\right)</math> such that <math>f(x) = h(g(x))</math> for all <math>x,</math> then <math>\sigma(f) \subseteq \sigma(g).</math> If <math>S</math> is finite or countably infinite or, more generally, <math>\left(S, \Sigma_S\right)</math> is a ] (for example, a separable complete metric space with its associated Borel sets), then the converse is also true.<ref>{{cite book | last=Kallenberg | first=Olav | authorlink=Olav Kallenberg | title=Foundations of Modern Probability |edition=2nd | publisher=] | year=2001 | isbn=0-387-95313-2|page=7}}</ref> Examples of standard Borel spaces include <math>\Reals^n</math> with its Borel sets and <math>\Reals^\infty</math> with the cylinder σ-algebra described below.
If ''f'' is a function from ''X'' to '''R'''<sup>''n''</sup> then σ(''f'') is generated by the family of subsets which are inverse images of intervals/rectangles in '''R'''<sup>''n''</sup>:

:<math>\sigma(f)=\sigma\left(\{f^{-1}(\times\cdots\times):a_i,b_i\in\mathbb{R}\}\right).</math>

A useful property is the following. Assume ''f'' is a measurable map from (''X'', Σ<sub>''X''</sub>) to (''S'', Σ<sub>''S''</sub>) and ''g'' is a measurable map from (''X'', Σ<sub>''X''</sub>) to (''T'', Σ<sub>''T''</sub>). If there exists a measurable map ''h'' from (''T'', Σ<sub>''T''</sub>) to (''S'', Σ<sub>''S''</sub>) such that ''f''(''x'') = ''h''(''g''(''x'')) for all ''x'', then σ(''f'') ⊂ σ(''g''). If ''S'' is finite or countably infinite or, more generally, (''S'', Σ<sub>''S''</sub>) is a ] (e.g., a separable complete metric space with its associated Borel sets), then the converse is also true.<ref>{{cite book | last=Kallenberg | first=Olav | authorlink=Olav Kallenberg | title=Foundations of Modern Probability |edition=2nd | publisher=] | year=2001 | isbn=0-387-95313-2|page=7}}</ref> Examples of standard Borel spaces include '''R'''<sup>''n''</sup> with its Borel sets and '''R'''<sup>∞</sup> with the cylinder σ-algebra described below.


===Borel and Lebesgue σ-algebras=== ===Borel and Lebesgue σ-algebras===
An important example is the ] over any ]: the σ-algebra generated by the ]s (or, equivalently, by the ]s). Note that this σ-algebra is not, in general, the whole power set. For a non-trivial example that is not a Borel set, see the ] or ]. An important example is the ] over any ]: the σ-algebra generated by the ]s (or, equivalently, by the ]s). This σ-algebra is not, in general, the whole power set. For a non-trivial example that is not a Borel set, see the ] or ].


On the ] '''R'''<sup>''n''</sup>, another σ-algebra is of importance: that of all ] sets. This σ-algebra contains more sets than the Borel σ-algebra on '''R'''<sup>''n''</sup> and is preferred in ] theory, as it gives a ]. On the ] <math>\Reals^n,</math> another σ-algebra is of importance: that of all ] sets. This σ-algebra contains more sets than the Borel σ-algebra on <math>\Reals^n</math> and is preferred in ] theory, as it gives a ].


===Product σ-algebra=== ===Product σ-algebra===
Let <math>(X_1,\Sigma_1)</math> and <math>(X_2,\Sigma_2)</math> be two measurable spaces. The σ-algebra for the corresponding ] <math>X_1\times X_2</math> is called the '''product σ-algebra''' and is defined by Let <math>\left(X_1, \Sigma_1\right)</math> and <math>\left(X_2, \Sigma_2\right)</math> be two measurable spaces. The σ-algebra for the corresponding ] <math>X_1 \times X_2</math> is called the '''product σ-algebra''' and is defined by
<math display=block>\Sigma_1 \times \Sigma_2 = \sigma\left(\left\{B_1 \times B_2 : B_1 \in \Sigma_1, B_2 \in \Sigma_2\right\}\right).</math>


:<math>\Sigma_1\times\Sigma_2=\sigma(\{B_1\times B_2:B_1\in\Sigma_1,B_2\in\Sigma_2\}).</math> Observe that <math>\{B_1 \times B_2 : B_1 \in \Sigma_1, B_2 \in \Sigma_2\}</math> is a π-system.


The Borel σ-algebra for <math>\Reals^n</math> is generated by half-infinite rectangles and by finite rectangles. For example,
Observe that <math>\{B_1\times B_2:B_1\in\Sigma_1,B_2\in\Sigma_2\}</math> is a π-system.
<math display=block>\mathcal{B}(\Reals^n) = \sigma \left(\left\{(-\infty, b_1] \times \cdots \times (-\infty, b_n] : b_i \in \Reals\right\}\right) = \sigma\left(\left\{\left(a_1, b_1\right] \times \cdots \times \left(a_n, b_n\right] : a_i, b_i \in \Reals\right\}\right).</math>

The Borel σ-algebra for '''R'''<sup>''n''</sup> is generated by half-infinite rectangles and by finite rectangles. For example,

:<math>\mathcal{B}(\mathbb{R}^n)=\sigma \left(\left \{(-\infty,b_1]\times\cdots\times(-\infty,b_n]:b_i\in\mathbb{R} \right \}\right) = \sigma\left(\left \{(a_1,b_1]\times\cdots\times(a_n,b_n]:a_i,b_i\in\mathbb{R} \right \}\right).</math>


For each of these two examples, the generating family is a π-system. For each of these two examples, the generating family is a π-system.


===σ-algebra generated by cylinder sets=== ===σ-algebra generated by cylinder sets===

Suppose Suppose
<math display=block>X \subseteq \Reals^{\mathbb{T}} = \{f : f(t) \in \Reals,\ t \in \mathbb{T}\}</math>


is a set of real-valued functions. Let <math>\mathcal{B}(\Reals)</math> denote the Borel subsets of <math>\Reals.</math> A ] of <math>X</math> is a finitely restricted set defined as
:<math>X\subset\mathbb{R}^{\mathbb{T}}=\{f:f(t)\in\mathbb{R},\ t\in\mathbb{T}\}</math>
<math display=block>C_{t_1,\dots,t_n}(B_1,\dots,B_n) = \left\{f \in X : f(t_i) \in B_i, 1 \leq i \leq n\right\}.</math>

is a set of real-valued functions. Let <math>\mathcal{B}(\mathbb{R})</math> denote the Borel subsets of '''R'''. A ] of {{mvar|X}} is a finitely restricted set defined as

:<math>C_{t_1,\dots,t_n}(B_1,\dots,B_n)=\{f\in X:f(t_i)\in B_i, 1\le i \le n\}.</math>


Each Each
<math display=block>\left\{C_{t_1,\dots,t_n}\left(B_1, \dots, B_n\right) : B_i \in \mathcal{B}(\Reals), 1 \leq i \leq n\right\}</math>
is a π-system that generates a σ-algebra <math>\textstyle\Sigma_{t_1, \dots, t_n}.</math> Then the family of subsets
<math display=block>\mathcal{F}_X = \bigcup_{n=1}^\infty \bigcup_{t_i \in \mathbb{T},i \leq n}\Sigma_{t_1, \dots, t_n}</math>
is an algebra that generates the '''cylinder σ-algebra''' for <math>X.</math> This σ-algebra is a subalgebra of the Borel σ-algebra determined by the ] of <math>\Reals^{\mathbb{T}}</math> restricted to <math>X.</math>


An important special case is when <math>\mathbb{T}</math> is the set of natural numbers and <math>X</math> is a set of real-valued sequences. In this case, it suffices to consider the cylinder sets
:<math>\{C_{t_1,\dots,t_n}(B_1,\dots,B_n):B_i\in\mathcal{B}(\mathbb{R}), 1\le i \le n\}</math>
<math display=block>C_n\left(B_1, \dots, B_n\right) = \left(B_1 \times \cdots \times B_n \times \Reals^\infty\right) \cap X = \left\{\left(x_1, x_2, \ldots, x_n,x_{n+1},\ldots\right) \in X : x_i \in B_i ,1 \leq i \leq n\right\},</math>

is a π-system that generates a σ-algebra <math>\textstyle\Sigma_{t_1,\dots,t_n}</math>. Then the family of subsets

:<math>\mathcal{F}_X=\bigcup_{n=1}^\infty\bigcup_{t_i\in\mathbb{T},i\le n}\Sigma_{t_1,\dots,t_n}</math>

is an algebra that generates the '''cylinder σ-algebra''' for {{mvar|X}}. This σ-algebra is a subalgebra of the Borel σ-algebra determined by the ] of <math>\mathbb{R}^{\mathbb{T}}</math> restricted to {{mvar|X}}.

An important special case is when <math>\mathbb{T}</math> is the set of natural numbers and {{mvar|X}} is a set of real-valued sequences. In this case, it suffices to consider the cylinder sets

:<math>C_n(B_1,\dots,B_n)=(B_1\times\cdots\times B_n\times\mathbb{R}^\infty)\cap X=\{(x_1,x_2,\dots,x_n,x_{n+1},\dots)\in X:x_i\in B_i,1\le i\le n\},</math>

for which for which
<math display=block>\Sigma_n = \sigma\left(\{C_n\left(B_1, \dots, B_n\right) : B_i \in \mathcal{B}(\Reals), 1 \leq i \leq n\}\right)</math>
is a non-decreasing sequence of σ-algebras.


===Ball σ-algebra===
:<math>\Sigma_n=\sigma(\{C_n(B_1,\dots,B_n):B_i\in\mathcal{B}(\mathbb{R}), 1\le i \le n\})</math>
The ball σ-algebra is the smallest σ-algebra containing all the open (and/or closed) balls. This is never larger than the ]. Note that the two σ-algebra are equal for separable spaces. For some nonseparable spaces, some maps are ball measurable even though they are not Borel measurable, making use of the ball σ-algebra useful in the analysis of such maps.<ref>van der Vaart, A. W., & Wellner, J. A. (1996). Weak Convergence and Empirical Processes. In Springer Series in Statistics. Springer New York. https://doi.org/10.1007/978-1-4757-2545-2</ref>

is a non-decreasing sequence of σ-algebras.


===σ-algebra generated by random variable or vector=== ===σ-algebra generated by random variable or vector===
Suppose <math>(\Omega,\Sigma,\mathbb{P})</math> is a ]. If <math>\textstyle Y:\Omega\to\mathbb{R}^n</math> is measurable with respect to the Borel σ-algebra on '''R'''<sup>''n''</sup> then {{mvar|Y}} is called a ''']''' (''n = 1'') or '''random vector''' (''n'' > 1). The σ-algebra generated by {{mvar|Y}} is Suppose <math>(\Omega, \Sigma, \mathbb{P})</math> is a ]. If <math>\textstyle Y:\Omega\to\Reals^n</math> is measurable with respect to the Borel σ-algebra on <math>\Reals^n</math> then <math>Y</math> is called a ''']''' (<math>n = 1</math>) or '''random vector''' (<math>n > 1</math>). The σ-algebra generated by <math>Y</math> is
<math display=block>\sigma(Y) = \left\{Y^{-1}(A) : A \in \mathcal{B}\left(\Reals^n\right)\right\}.</math>

:<math> \sigma (Y) = \{ Y^{-1}(A): A\in\mathcal{B}(\mathbb{R}^n) \}.</math>


===σ-algebra generated by a stochastic process=== ===σ-algebra generated by a stochastic process===
Suppose <math>(\Omega,\Sigma,\mathbb{P})</math> is a ] and <math>\mathbb{R}^\mathbb{T}</math> is the set of real-valued functions on <math>\mathbb{T}</math>. If <math>\textstyle Y:\Omega\to X\subset\mathbb{R}^\mathbb{T}</math> is measurable with respect to the cylinder σ-algebra <math>\sigma(\mathcal{F}_X)</math> (see above) for {{mvar|X}} then {{mvar|Y}} is called a ''']''' or '''random process'''. The σ-algebra generated by {{mvar|Y}} is Suppose <math>(\Omega,\Sigma,\mathbb{P})</math> is a ] and <math>\Reals^\mathbb{T}</math> is the set of real-valued functions on <math>\mathbb{T}.</math> If <math>\textstyle Y : \Omega\to X \subseteq \Reals^\mathbb{T}</math> is measurable with respect to the cylinder σ-algebra <math>\sigma\left(\mathcal{F}_X\right)</math> (see above) for <math>X</math> then <math>Y</math> is called a ''']''' or '''random process'''. The σ-algebra generated by <math>Y</math> is
<math display=block>\sigma(Y) = \left\{Y^{-1}(A) : A \in \sigma\left(\mathcal{F}_X\right)\right\} = \sigma\left(\left\{Y^{-1}(A) : A \in \mathcal{F}_X\right\}\right),</math>

:<math>\sigma(Y) = \left \{ Y^{-1}(A): A\in\sigma(\mathcal{F}_X) \right \}= \sigma(\{ Y^{-1}(A): A\in\mathcal{F}_X\}),</math>

the σ-algebra generated by the inverse images of cylinder sets. the σ-algebra generated by the inverse images of cylinder sets.


==See also== ==See also==


* {{annotated link|Join (sigma algebra)}}
* {{annotated link|Measurable function}} * {{annotated link|Measurable function}}
* {{annotated link|Sample space}} * {{annotated link|Sample space}}
Line 228: Line 217:


==References== ==References==

{{reflist}} {{reflist}}


==External links== ==External links==
*{{springer|title=Algebra of sets|id=p/a011400}} * {{springer|title=Algebra of sets|id=p/a011400}}
*] from PlanetMath. * ] from PlanetMath.
<!-- http://planetmath.org/encyclopedia/SigmaAlgebra.html --> <!-- http://planetmath.org/encyclopedia/SigmaAlgebra.html -->


{{Authority control}}
]

]
] ]
] ]
] ]

Latest revision as of 13:46, 8 October 2024

Algebraic structure of set algebra For an algebraic structure admitting a given signature Σ of operations, see Universal algebra.

In mathematical analysis and in probability theory, a σ-algebra ("sigma algebra"; also σ-field, where the σ comes from the German "Summe") on a set X is a nonempty collection Σ of subsets of X closed under complement, countable unions, and countable intersections. The ordered pair ( X , Σ ) {\displaystyle (X,\Sigma )} is called a measurable space.

A σ-algebra of subsets is a set algebra of subsets; elements of the latter only need to be closed under the union or intersection of finitely many subsets, which is a weaker condition.

The main use of σ-algebras is in the definition of measures; specifically, the collection of those subsets for which a given measure is defined is necessarily a σ-algebra. This concept is important in mathematical analysis as the foundation for Lebesgue integration, and in probability theory, where it is interpreted as the collection of events which can be assigned probabilities. Also, in probability, σ-algebras are pivotal in the definition of conditional expectation.

In statistics, (sub) σ-algebras are needed for the formal mathematical definition of a sufficient statistic, particularly when the statistic is a function or a random process and the notion of conditional density is not applicable.

If X = { a , b , c , d } {\displaystyle X=\{a,b,c,d\}} one possible σ-algebra on X {\displaystyle X} is Σ = { , { a , b } , { c , d } , { a , b , c , d } } , {\displaystyle \Sigma =\{\varnothing ,\{a,b\},\{c,d\},\{a,b,c,d\}\},} where {\displaystyle \varnothing } is the empty set. In general, a finite algebra is always a σ-algebra.

If { A 1 , A 2 , A 3 , } , {\displaystyle \{A_{1},A_{2},A_{3},\ldots \},} is a countable partition of X {\displaystyle X} then the collection of all unions of sets in the partition (including the empty set) is a σ-algebra.

A more useful example is the set of subsets of the real line formed by starting with all open intervals and adding in all countable unions, countable intersections, and relative complements and continuing this process (by transfinite iteration through all countable ordinals) until the relevant closure properties are achieved (a construction known as the Borel hierarchy).

Motivation

There are at least three key motivators for σ-algebras: defining measures, manipulating limits of sets, and managing partial information characterized by sets.

Measure

A measure on X {\displaystyle X} is a function that assigns a non-negative real number to subsets of X ; {\displaystyle X;} this can be thought of as making precise a notion of "size" or "volume" for sets. We want the size of the union of disjoint sets to be the sum of their individual sizes, even for an infinite sequence of disjoint sets.

One would like to assign a size to every subset of X , {\displaystyle X,} but in many natural settings, this is not possible. For example, the axiom of choice implies that when the size under consideration is the ordinary notion of length for subsets of the real line, then there exist sets for which no size exists, for example, the Vitali sets. For this reason, one considers instead a smaller collection of privileged subsets of X . {\displaystyle X.} These subsets will be called the measurable sets. They are closed under operations that one would expect for measurable sets, that is, the complement of a measurable set is a measurable set and the countable union of measurable sets is a measurable set. Non-empty collections of sets with these properties are called σ-algebras.

Limits of sets

Many uses of measure, such as the probability concept of almost sure convergence, involve limits of sequences of sets. For this, closure under countable unions and intersections is paramount. Set limits are defined as follows on σ-algebras.

  • The limit supremum or outer limit of a sequence A 1 , A 2 , A 3 , {\displaystyle A_{1},A_{2},A_{3},\ldots } of subsets of X {\displaystyle X} is lim sup n A n = n = 1 m = n A m = n = 1 A n A n + 1 . {\displaystyle \limsup _{n\to \infty }A_{n}=\bigcap _{n=1}^{\infty }\bigcup _{m=n}^{\infty }A_{m}=\bigcap _{n=1}^{\infty }A_{n}\cup A_{n+1}\cup \cdots .} It consists of all points x {\displaystyle x} that are in infinitely many of these sets (or equivalently, that are in cofinally many of them). That is, x lim sup n A n {\displaystyle x\in \limsup _{n\to \infty }A_{n}} if and only if there exists an infinite subsequence A n 1 , A n 2 , {\displaystyle A_{n_{1}},A_{n_{2}},\ldots } (where n 1 < n 2 < {\displaystyle n_{1}<n_{2}<\cdots } ) of sets that all contain x ; {\displaystyle x;} that is, such that x A n 1 A n 2 . {\displaystyle x\in A_{n_{1}}\cap A_{n_{2}}\cap \cdots .}
  • The limit infimum or inner limit of a sequence A 1 , A 2 , A 3 , {\displaystyle A_{1},A_{2},A_{3},\ldots } of subsets of X {\displaystyle X} is lim inf n A n = n = 1 m = n A m = n = 1 A n A n + 1 . {\displaystyle \liminf _{n\to \infty }A_{n}=\bigcup _{n=1}^{\infty }\bigcap _{m=n}^{\infty }A_{m}=\bigcup _{n=1}^{\infty }A_{n}\cap A_{n+1}\cap \cdots .} It consists of all points that are in all but finitely many of these sets (or equivalently, that are eventually in all of them). That is, x lim inf n A n {\displaystyle x\in \liminf _{n\to \infty }A_{n}} if and only if there exists an index N N {\displaystyle N\in \mathbb {N} } such that A N , A N + 1 , {\displaystyle A_{N},A_{N+1},\ldots } all contain x ; {\displaystyle x;} that is, such that x A N A N + 1 . {\displaystyle x\in A_{N}\cap A_{N+1}\cap \cdots .}

The inner limit is always a subset of the outer limit: lim inf n A n     lim sup n A n . {\displaystyle \liminf _{n\to \infty }A_{n}~\subseteq ~\limsup _{n\to \infty }A_{n}.} If these two sets are equal then their limit lim n A n {\displaystyle \lim _{n\to \infty }A_{n}} exists and is equal to this common set: lim n A n := lim inf n A n = lim sup n A n . {\displaystyle \lim _{n\to \infty }A_{n}:=\liminf _{n\to \infty }A_{n}=\limsup _{n\to \infty }A_{n}.}

Sub σ-algebras

In much of probability, especially when conditional expectation is involved, one is concerned with sets that represent only part of all the possible information that can be observed. This partial information can be characterized with a smaller σ-algebra which is a subset of the principal σ-algebra; it consists of the collection of subsets relevant only to and determined only by the partial information. Formally, if Σ , Σ {\displaystyle \Sigma ,\Sigma '} are σ-algebras on X {\displaystyle X} , then Σ {\displaystyle \Sigma '} is a sub σ-algebra of Σ {\displaystyle \Sigma } if Σ Σ {\displaystyle \Sigma '\subseteq \Sigma } . An example will illustrate how this idea arises.

Imagine two people are betting on a game that involves flipping a coin repeatedly and observing whether it comes up Heads ( H {\displaystyle H} ) or Tails ( T {\displaystyle T} ). Both players are assumed to be infinitely wealthy, so there is no limit to how long the game can last. This means the sample space Ω must consist of all possible infinite sequences of H {\displaystyle H} or T : {\displaystyle T:} Ω = { H , T } = { ( x 1 , x 2 , x 3 , ) : x i { H , T } , i 1 } . {\displaystyle \Omega =\{H,T\}^{\infty }=\{(x_{1},x_{2},x_{3},\dots ):x_{i}\in \{H,T\},i\geq 1\}.}

The observed information after n {\displaystyle n} flips have occurred is one of the 2 n {\displaystyle 2^{n}} possibilities describing the sequence of the first n {\displaystyle n} flips. This is codified as the sub σ-algebra G n = { A × { H , T } : A { H , T } n } {\displaystyle {\mathcal {G}}_{n}=\{A\times \{H,T\}^{\infty }:A\subseteq \{H,T\}^{n}\}}

which locks down the first n {\displaystyle n} flips and is agnostic about the result of the remaining ones. Observe that then G 1 G 2 G 3 G , {\displaystyle {\mathcal {G}}_{1}\subseteq {\mathcal {G}}_{2}\subseteq {\mathcal {G}}_{3}\subseteq \cdots \subseteq {\mathcal {G}}_{\infty },} where G {\displaystyle {\mathcal {G}}_{\infty }} is the smallest σ-algebra containing all the others.

Definition and properties

Definition

Let X {\displaystyle X} be some set, and let P ( X ) {\displaystyle P(X)} represent its power set. Then a subset Σ P ( X ) {\displaystyle \Sigma \subseteq P(X)} is called a σ-algebra if and only if it satisfies the following three properties:

  1. X {\displaystyle X} is in Σ {\displaystyle \Sigma } .
  2. Σ {\displaystyle \Sigma } is closed under complementation: If some set A {\displaystyle A} is in Σ , {\displaystyle \Sigma ,} then so is its complement, X A . {\displaystyle X\setminus A.}
  3. Σ {\displaystyle \Sigma } is closed under countable unions: If A 1 , A 2 , A 3 , {\displaystyle A_{1},A_{2},A_{3},\ldots } are in Σ , {\displaystyle \Sigma ,} then so is A = A 1 A 2 A 3 . {\displaystyle A=A_{1}\cup A_{2}\cup A_{3}\cup \cdots .}

From these properties, it follows that the σ-algebra is also closed under countable intersections (by applying De Morgan's laws).

It also follows that the empty set {\displaystyle \varnothing } is in Σ , {\displaystyle \Sigma ,} since by (1) X {\displaystyle X} is in Σ {\displaystyle \Sigma } and (2) asserts that its complement, the empty set, is also in Σ . {\displaystyle \Sigma .} Moreover, since { X , } {\displaystyle \{X,\varnothing \}} satisfies condition (3) as well, it follows that { X , } {\displaystyle \{X,\varnothing \}} is the smallest possible σ-algebra on X . {\displaystyle X.} The largest possible σ-algebra on X {\displaystyle X} is P ( X ) . {\displaystyle P(X).}

Elements of the σ-algebra are called measurable sets. An ordered pair ( X , Σ ) , {\displaystyle (X,\Sigma ),} where X {\displaystyle X} is a set and Σ {\displaystyle \Sigma } is a σ-algebra over X , {\displaystyle X,} is called a measurable space. A function between two measurable spaces is called a measurable function if the preimage of every measurable set is measurable. The collection of measurable spaces forms a category, with the measurable functions as morphisms. Measures are defined as certain types of functions from a σ-algebra to [ 0 , ] . {\displaystyle .}

A σ-algebra is both a π-system and a Dynkin system (λ-system). The converse is true as well, by Dynkin's theorem (see below).

Dynkin's π-λ theorem

See also: π-λ theorem

This theorem (or the related monotone class theorem) is an essential tool for proving many results about properties of specific σ-algebras. It capitalizes on the nature of two simpler classes of sets, namely the following.

  • A π-system P {\displaystyle P} is a collection of subsets of X {\displaystyle X} that is closed under finitely many intersections, and
  • A Dynkin system (or λ-system) D {\displaystyle D} is a collection of subsets of X {\displaystyle X} that contains X {\displaystyle X} and is closed under complement and under countable unions of disjoint subsets.

Dynkin's π-λ theorem says, if P {\displaystyle P} is a π-system and D {\displaystyle D} is a Dynkin system that contains P , {\displaystyle P,} then the σ-algebra σ ( P ) {\displaystyle \sigma (P)} generated by P {\displaystyle P} is contained in D . {\displaystyle D.} Since certain π-systems are relatively simple classes, it may not be hard to verify that all sets in P {\displaystyle P} enjoy the property under consideration while, on the other hand, showing that the collection D {\displaystyle D} of all subsets with the property is a Dynkin system can also be straightforward. Dynkin's π-λ Theorem then implies that all sets in σ ( P ) {\displaystyle \sigma (P)} enjoy the property, avoiding the task of checking it for an arbitrary set in σ ( P ) . {\displaystyle \sigma (P).}

One of the most fundamental uses of the π-λ theorem is to show equivalence of separately defined measures or integrals. For example, it is used to equate a probability for a random variable X {\displaystyle X} with the Lebesgue-Stieltjes integral typically associated with computing the probability: P ( X A ) = A F ( d x ) {\displaystyle \mathbb {P} (X\in A)=\int _{A}\,F(dx)} for all A {\displaystyle A} in the Borel σ-algebra on R , {\displaystyle \mathbb {R} ,} where F ( x ) {\displaystyle F(x)} is the cumulative distribution function for X , {\displaystyle X,} defined on R , {\displaystyle \mathbb {R} ,} while P {\displaystyle \mathbb {P} } is a probability measure, defined on a σ-algebra Σ {\displaystyle \Sigma } of subsets of some sample space Ω . {\displaystyle \Omega .}

Combining σ-algebras

Suppose { Σ α : α A } {\displaystyle \textstyle \left\{\Sigma _{\alpha }:\alpha \in {\mathcal {A}}\right\}} is a collection of σ-algebras on a space X . {\displaystyle X.}

Meet

The intersection of a collection of σ-algebras is a σ-algebra. To emphasize its character as a σ-algebra, it often is denoted by: α A Σ α . {\displaystyle \bigwedge _{\alpha \in {\mathcal {A}}}\Sigma _{\alpha }.}

Sketch of Proof: Let Σ {\displaystyle \Sigma ^{*}} denote the intersection. Since X {\displaystyle X} is in every Σ α , Σ {\displaystyle \Sigma _{\alpha },\Sigma ^{*}} is not empty. Closure under complement and countable unions for every Σ α {\displaystyle \Sigma _{\alpha }} implies the same must be true for Σ . {\displaystyle \Sigma ^{*}.} Therefore, Σ {\displaystyle \Sigma ^{*}} is a σ-algebra.

Join

The union of a collection of σ-algebras is not generally a σ-algebra, or even an algebra, but it generates a σ-algebra known as the join which typically is denoted α A Σ α = σ ( α A Σ α ) . {\displaystyle \bigvee _{\alpha \in {\mathcal {A}}}\Sigma _{\alpha }=\sigma \left(\bigcup _{\alpha \in {\mathcal {A}}}\Sigma _{\alpha }\right).} A π-system that generates the join is P = { i = 1 n A i : A i Σ α i , α i A ,   n 1 } . {\displaystyle {\mathcal {P}}=\left\{\bigcap _{i=1}^{n}A_{i}:A_{i}\in \Sigma _{\alpha _{i}},\alpha _{i}\in {\mathcal {A}},\ n\geq 1\right\}.} Sketch of Proof: By the case n = 1 , {\displaystyle n=1,} it is seen that each Σ α P , {\displaystyle \Sigma _{\alpha }\subset {\mathcal {P}},} so α A Σ α P . {\displaystyle \bigcup _{\alpha \in {\mathcal {A}}}\Sigma _{\alpha }\subseteq {\mathcal {P}}.} This implies σ ( α A Σ α ) σ ( P ) {\displaystyle \sigma \left(\bigcup _{\alpha \in {\mathcal {A}}}\Sigma _{\alpha }\right)\subseteq \sigma ({\mathcal {P}})} by the definition of a σ-algebra generated by a collection of subsets. On the other hand, P σ ( α A Σ α ) {\displaystyle {\mathcal {P}}\subseteq \sigma \left(\bigcup _{\alpha \in {\mathcal {A}}}\Sigma _{\alpha }\right)} which, by Dynkin's π-λ theorem, implies σ ( P ) σ ( α A Σ α ) . {\displaystyle \sigma ({\mathcal {P}})\subseteq \sigma \left(\bigcup _{\alpha \in {\mathcal {A}}}\Sigma _{\alpha }\right).}

σ-algebras for subspaces

Suppose Y {\displaystyle Y} is a subset of X {\displaystyle X} and let ( X , Σ ) {\displaystyle (X,\Sigma )} be a measurable space.

  • The collection { Y B : B Σ } {\displaystyle \{Y\cap B:B\in \Sigma \}} is a σ-algebra of subsets of Y . {\displaystyle Y.}
  • Suppose ( Y , Λ ) {\displaystyle (Y,\Lambda )} is a measurable space. The collection { A X : A Y Λ } {\displaystyle \{A\subseteq X:A\cap Y\in \Lambda \}} is a σ-algebra of subsets of X . {\displaystyle X.}

Relation to σ-ring

A σ-algebra Σ {\displaystyle \Sigma } is just a σ-ring that contains the universal set X . {\displaystyle X.} A σ-ring need not be a σ-algebra, as for example measurable subsets of zero Lebesgue measure in the real line are a σ-ring, but not a σ-algebra since the real line has infinite measure and thus cannot be obtained by their countable union. If, instead of zero measure, one takes measurable subsets of finite Lebesgue measure, those are a ring but not a σ-ring, since the real line can be obtained by their countable union yet its measure is not finite.

Typographic note

σ-algebras are sometimes denoted using calligraphic capital letters, or the Fraktur typeface. Thus ( X , Σ ) {\displaystyle (X,\Sigma )} may be denoted as ( X , F ) {\displaystyle \scriptstyle (X,\,{\mathcal {F}})} or ( X , F ) . {\displaystyle \scriptstyle (X,\,{\mathfrak {F}}).}

Particular cases and examples

Separable σ-algebras

A separable σ {\displaystyle \sigma } -algebra (or separable σ {\displaystyle \sigma } -field) is a σ {\displaystyle \sigma } -algebra F {\displaystyle {\mathcal {F}}} that is a separable space when considered as a metric space with metric ρ ( A , B ) = μ ( A B ) {\displaystyle \rho (A,B)=\mu (A{\mathbin {\triangle }}B)} for A , B F {\displaystyle A,B\in {\mathcal {F}}} and a given finite measure μ {\displaystyle \mu } (and with {\displaystyle \triangle } being the symmetric difference operator). Any σ {\displaystyle \sigma } -algebra generated by a countable collection of sets is separable, but the converse need not hold. For example, the Lebesgue σ {\displaystyle \sigma } -algebra is separable (since every Lebesgue measurable set is equivalent to some Borel set) but not countably generated (since its cardinality is higher than continuum).

A separable measure space has a natural pseudometric that renders it separable as a pseudometric space. The distance between two sets is defined as the measure of the symmetric difference of the two sets. The symmetric difference of two distinct sets can have measure zero; hence the pseudometric as defined above need not to be a true metric. However, if sets whose symmetric difference has measure zero are identified into a single equivalence class, the resulting quotient set can be properly metrized by the induced metric. If the measure space is separable, it can be shown that the corresponding metric space is, too.

Simple set-based examples

Let X {\displaystyle X} be any set.

  • The family consisting only of the empty set and the set X , {\displaystyle X,} called the minimal or trivial σ-algebra over X . {\displaystyle X.}
  • The power set of X , {\displaystyle X,} called the discrete σ-algebra.
  • The collection { , A , X A , X } {\displaystyle \{\varnothing ,A,X\setminus A,X\}} is a simple σ-algebra generated by the subset A . {\displaystyle A.}
  • The collection of subsets of X {\displaystyle X} which are countable or whose complements are countable is a σ-algebra (which is distinct from the power set of X {\displaystyle X} if and only if X {\displaystyle X} is uncountable). This is the σ-algebra generated by the singletons of X . {\displaystyle X.} Note: "countable" includes finite or empty.
  • The collection of all unions of sets in a countable partition of X {\displaystyle X} is a σ-algebra.

Stopping time sigma-algebras

A stopping time τ {\displaystyle \tau } can define a σ {\displaystyle \sigma } -algebra F τ , {\displaystyle {\mathcal {F}}_{\tau },} the so-called stopping time sigma-algebra, which in a filtered probability space describes the information up to the random time τ {\displaystyle \tau } in the sense that, if the filtered probability space is interpreted as a random experiment, the maximum information that can be found out about the experiment from arbitrarily often repeating it until the time τ {\displaystyle \tau } is F τ . {\displaystyle {\mathcal {F}}_{\tau }.}

σ-algebras generated by families of sets

σ-algebra generated by an arbitrary family

Let F {\displaystyle F} be an arbitrary family of subsets of X . {\displaystyle X.} Then there exists a unique smallest σ-algebra which contains every set in F {\displaystyle F} (even though F {\displaystyle F} may or may not itself be a σ-algebra). It is, in fact, the intersection of all σ-algebras containing F . {\displaystyle F.} (See intersections of σ-algebras above.) This σ-algebra is denoted σ ( F ) {\displaystyle \sigma (F)} and is called the σ-algebra generated by F . {\displaystyle F.}

If F {\displaystyle F} is empty, then σ ( ) = { , X } . {\displaystyle \sigma (\varnothing )=\{\varnothing ,X\}.} Otherwise σ ( F ) {\displaystyle \sigma (F)} consists of all the subsets of X {\displaystyle X} that can be made from elements of F {\displaystyle F} by a countable number of complement, union and intersection operations.

For a simple example, consider the set X = { 1 , 2 , 3 } . {\displaystyle X=\{1,2,3\}.} Then the σ-algebra generated by the single subset { 1 } {\displaystyle \{1\}} is σ ( { 1 } ) = { , { 1 } , { 2 , 3 } , { 1 , 2 , 3 } } . {\displaystyle \sigma (\{1\})=\{\varnothing ,\{1\},\{2,3\},\{1,2,3\}\}.} By an abuse of notation, when a collection of subsets contains only one element, A , {\displaystyle A,} σ ( A ) {\displaystyle \sigma (A)} may be written instead of σ ( { A } ) ; {\displaystyle \sigma (\{A\});} in the prior example σ ( { 1 } ) {\displaystyle \sigma (\{1\})} instead of σ ( { { 1 } } ) . {\displaystyle \sigma (\{\{1\}\}).} Indeed, using σ ( A 1 , A 2 , ) {\displaystyle \sigma \left(A_{1},A_{2},\ldots \right)} to mean σ ( { A 1 , A 2 , } ) {\displaystyle \sigma \left(\left\{A_{1},A_{2},\ldots \right\}\right)} is also quite common.

There are many families of subsets that generate useful σ-algebras. Some of these are presented here.

σ-algebra generated by a function

If f {\displaystyle f} is a function from a set X {\displaystyle X} to a set Y {\displaystyle Y} and B {\displaystyle B} is a σ {\displaystyle \sigma } -algebra of subsets of Y , {\displaystyle Y,} then the σ {\displaystyle \sigma } -algebra generated by the function f , {\displaystyle f,} denoted by σ ( f ) , {\displaystyle \sigma (f),} is the collection of all inverse images f 1 ( S ) {\displaystyle f^{-1}(S)} of the sets S {\displaystyle S} in B . {\displaystyle B.} That is, σ ( f ) = { f 1 ( S ) : S B } . {\displaystyle \sigma (f)=\left\{f^{-1}(S)\,:\,S\in B\right\}.}

A function f {\displaystyle f} from a set X {\displaystyle X} to a set Y {\displaystyle Y} is measurable with respect to a σ-algebra Σ {\displaystyle \Sigma } of subsets of X {\displaystyle X} if and only if σ ( f ) {\displaystyle \sigma (f)} is a subset of Σ . {\displaystyle \Sigma .}

One common situation, and understood by default if B {\displaystyle B} is not specified explicitly, is when Y {\displaystyle Y} is a metric or topological space and B {\displaystyle B} is the collection of Borel sets on Y . {\displaystyle Y.}

If f {\displaystyle f} is a function from X {\displaystyle X} to R n {\displaystyle \mathbb {R} ^{n}} then σ ( f ) {\displaystyle \sigma (f)} is generated by the family of subsets which are inverse images of intervals/rectangles in R n : {\displaystyle \mathbb {R} ^{n}:} σ ( f ) = σ ( { f 1 ( [ a 1 , b 1 ] × × [ a n , b n ] ) : a i , b i R } ) . {\displaystyle \sigma (f)=\sigma \left(\left\{f^{-1}(\left\times \cdots \times \left):a_{i},b_{i}\in \mathbb {R} \right\}\right).}

A useful property is the following. Assume f {\displaystyle f} is a measurable map from ( X , Σ X ) {\displaystyle \left(X,\Sigma _{X}\right)} to ( S , Σ S ) {\displaystyle \left(S,\Sigma _{S}\right)} and g {\displaystyle g} is a measurable map from ( X , Σ X ) {\displaystyle \left(X,\Sigma _{X}\right)} to ( T , Σ T ) . {\displaystyle \left(T,\Sigma _{T}\right).} If there exists a measurable map h {\displaystyle h} from ( T , Σ T ) {\displaystyle \left(T,\Sigma _{T}\right)} to ( S , Σ S ) {\displaystyle \left(S,\Sigma _{S}\right)} such that f ( x ) = h ( g ( x ) ) {\displaystyle f(x)=h(g(x))} for all x , {\displaystyle x,} then σ ( f ) σ ( g ) . {\displaystyle \sigma (f)\subseteq \sigma (g).} If S {\displaystyle S} is finite or countably infinite or, more generally, ( S , Σ S ) {\displaystyle \left(S,\Sigma _{S}\right)} is a standard Borel space (for example, a separable complete metric space with its associated Borel sets), then the converse is also true. Examples of standard Borel spaces include R n {\displaystyle \mathbb {R} ^{n}} with its Borel sets and R {\displaystyle \mathbb {R} ^{\infty }} with the cylinder σ-algebra described below.

Borel and Lebesgue σ-algebras

An important example is the Borel algebra over any topological space: the σ-algebra generated by the open sets (or, equivalently, by the closed sets). This σ-algebra is not, in general, the whole power set. For a non-trivial example that is not a Borel set, see the Vitali set or Non-Borel sets.

On the Euclidean space R n , {\displaystyle \mathbb {R} ^{n},} another σ-algebra is of importance: that of all Lebesgue measurable sets. This σ-algebra contains more sets than the Borel σ-algebra on R n {\displaystyle \mathbb {R} ^{n}} and is preferred in integration theory, as it gives a complete measure space.

Product σ-algebra

Let ( X 1 , Σ 1 ) {\displaystyle \left(X_{1},\Sigma _{1}\right)} and ( X 2 , Σ 2 ) {\displaystyle \left(X_{2},\Sigma _{2}\right)} be two measurable spaces. The σ-algebra for the corresponding product space X 1 × X 2 {\displaystyle X_{1}\times X_{2}} is called the product σ-algebra and is defined by Σ 1 × Σ 2 = σ ( { B 1 × B 2 : B 1 Σ 1 , B 2 Σ 2 } ) . {\displaystyle \Sigma _{1}\times \Sigma _{2}=\sigma \left(\left\{B_{1}\times B_{2}:B_{1}\in \Sigma _{1},B_{2}\in \Sigma _{2}\right\}\right).}

Observe that { B 1 × B 2 : B 1 Σ 1 , B 2 Σ 2 } {\displaystyle \{B_{1}\times B_{2}:B_{1}\in \Sigma _{1},B_{2}\in \Sigma _{2}\}} is a π-system.

The Borel σ-algebra for R n {\displaystyle \mathbb {R} ^{n}} is generated by half-infinite rectangles and by finite rectangles. For example, B ( R n ) = σ ( { ( , b 1 ] × × ( , b n ] : b i R } ) = σ ( { ( a 1 , b 1 ] × × ( a n , b n ] : a i , b i R } ) . {\displaystyle {\mathcal {B}}(\mathbb {R} ^{n})=\sigma \left(\left\{(-\infty ,b_{1}]\times \cdots \times (-\infty ,b_{n}]:b_{i}\in \mathbb {R} \right\}\right)=\sigma \left(\left\{\left(a_{1},b_{1}\right]\times \cdots \times \left(a_{n},b_{n}\right]:a_{i},b_{i}\in \mathbb {R} \right\}\right).}

For each of these two examples, the generating family is a π-system.

σ-algebra generated by cylinder sets

Suppose X R T = { f : f ( t ) R ,   t T } {\displaystyle X\subseteq \mathbb {R} ^{\mathbb {T} }=\{f:f(t)\in \mathbb {R} ,\ t\in \mathbb {T} \}}

is a set of real-valued functions. Let B ( R ) {\displaystyle {\mathcal {B}}(\mathbb {R} )} denote the Borel subsets of R . {\displaystyle \mathbb {R} .} A cylinder subset of X {\displaystyle X} is a finitely restricted set defined as C t 1 , , t n ( B 1 , , B n ) = { f X : f ( t i ) B i , 1 i n } . {\displaystyle C_{t_{1},\dots ,t_{n}}(B_{1},\dots ,B_{n})=\left\{f\in X:f(t_{i})\in B_{i},1\leq i\leq n\right\}.}

Each { C t 1 , , t n ( B 1 , , B n ) : B i B ( R ) , 1 i n } {\displaystyle \left\{C_{t_{1},\dots ,t_{n}}\left(B_{1},\dots ,B_{n}\right):B_{i}\in {\mathcal {B}}(\mathbb {R} ),1\leq i\leq n\right\}} is a π-system that generates a σ-algebra Σ t 1 , , t n . {\displaystyle \textstyle \Sigma _{t_{1},\dots ,t_{n}}.} Then the family of subsets F X = n = 1 t i T , i n Σ t 1 , , t n {\displaystyle {\mathcal {F}}_{X}=\bigcup _{n=1}^{\infty }\bigcup _{t_{i}\in \mathbb {T} ,i\leq n}\Sigma _{t_{1},\dots ,t_{n}}} is an algebra that generates the cylinder σ-algebra for X . {\displaystyle X.} This σ-algebra is a subalgebra of the Borel σ-algebra determined by the product topology of R T {\displaystyle \mathbb {R} ^{\mathbb {T} }} restricted to X . {\displaystyle X.}

An important special case is when T {\displaystyle \mathbb {T} } is the set of natural numbers and X {\displaystyle X} is a set of real-valued sequences. In this case, it suffices to consider the cylinder sets C n ( B 1 , , B n ) = ( B 1 × × B n × R ) X = { ( x 1 , x 2 , , x n , x n + 1 , ) X : x i B i , 1 i n } , {\displaystyle C_{n}\left(B_{1},\dots ,B_{n}\right)=\left(B_{1}\times \cdots \times B_{n}\times \mathbb {R} ^{\infty }\right)\cap X=\left\{\left(x_{1},x_{2},\ldots ,x_{n},x_{n+1},\ldots \right)\in X:x_{i}\in B_{i},1\leq i\leq n\right\},} for which Σ n = σ ( { C n ( B 1 , , B n ) : B i B ( R ) , 1 i n } ) {\displaystyle \Sigma _{n}=\sigma \left(\{C_{n}\left(B_{1},\dots ,B_{n}\right):B_{i}\in {\mathcal {B}}(\mathbb {R} ),1\leq i\leq n\}\right)} is a non-decreasing sequence of σ-algebras.

Ball σ-algebra

The ball σ-algebra is the smallest σ-algebra containing all the open (and/or closed) balls. This is never larger than the Borel σ-algebra. Note that the two σ-algebra are equal for separable spaces. For some nonseparable spaces, some maps are ball measurable even though they are not Borel measurable, making use of the ball σ-algebra useful in the analysis of such maps.

σ-algebra generated by random variable or vector

Suppose ( Ω , Σ , P ) {\displaystyle (\Omega ,\Sigma ,\mathbb {P} )} is a probability space. If Y : Ω R n {\displaystyle \textstyle Y:\Omega \to \mathbb {R} ^{n}} is measurable with respect to the Borel σ-algebra on R n {\displaystyle \mathbb {R} ^{n}} then Y {\displaystyle Y} is called a random variable ( n = 1 {\displaystyle n=1} ) or random vector ( n > 1 {\displaystyle n>1} ). The σ-algebra generated by Y {\displaystyle Y} is σ ( Y ) = { Y 1 ( A ) : A B ( R n ) } . {\displaystyle \sigma (Y)=\left\{Y^{-1}(A):A\in {\mathcal {B}}\left(\mathbb {R} ^{n}\right)\right\}.}

σ-algebra generated by a stochastic process

Suppose ( Ω , Σ , P ) {\displaystyle (\Omega ,\Sigma ,\mathbb {P} )} is a probability space and R T {\displaystyle \mathbb {R} ^{\mathbb {T} }} is the set of real-valued functions on T . {\displaystyle \mathbb {T} .} If Y : Ω X R T {\displaystyle \textstyle Y:\Omega \to X\subseteq \mathbb {R} ^{\mathbb {T} }} is measurable with respect to the cylinder σ-algebra σ ( F X ) {\displaystyle \sigma \left({\mathcal {F}}_{X}\right)} (see above) for X {\displaystyle X} then Y {\displaystyle Y} is called a stochastic process or random process. The σ-algebra generated by Y {\displaystyle Y} is σ ( Y ) = { Y 1 ( A ) : A σ ( F X ) } = σ ( { Y 1 ( A ) : A F X } ) , {\displaystyle \sigma (Y)=\left\{Y^{-1}(A):A\in \sigma \left({\mathcal {F}}_{X}\right)\right\}=\sigma \left(\left\{Y^{-1}(A):A\in {\mathcal {F}}_{X}\right\}\right),} the σ-algebra generated by the inverse images of cylinder sets.

See also

Families F {\displaystyle {\mathcal {F}}} of sets over Ω {\displaystyle \Omega }
Is necessarily true of F : {\displaystyle {\mathcal {F}}\colon }
or, is F {\displaystyle {\mathcal {F}}} closed under:
Directed
by {\displaystyle \,\supseteq }
A B {\displaystyle A\cap B} A B {\displaystyle A\cup B} B A {\displaystyle B\setminus A} Ω A {\displaystyle \Omega \setminus A} A 1 A 2 {\displaystyle A_{1}\cap A_{2}\cap \cdots } A 1 A 2 {\displaystyle A_{1}\cup A_{2}\cup \cdots } Ω F {\displaystyle \Omega \in {\mathcal {F}}} F {\displaystyle \varnothing \in {\mathcal {F}}} F.I.P.
π-system Yes Yes No No No No No No No No
Semiring Yes Yes No No No No No No Yes Never
Semialgebra (Semifield) Yes Yes No No No No No No Yes Never
Monotone class No No No No No only if A i {\displaystyle A_{i}\searrow } only if A i {\displaystyle A_{i}\nearrow } No No No
𝜆-system (Dynkin System) Yes No No only if
A B {\displaystyle A\subseteq B}
Yes No only if A i {\displaystyle A_{i}\nearrow } or
they are disjoint
Yes Yes Never
Ring (Order theory) Yes Yes Yes No No No No No No No
Ring (Measure theory) Yes Yes Yes Yes No No No No Yes Never
δ-Ring Yes Yes Yes Yes No Yes No No Yes Never
𝜎-Ring Yes Yes Yes Yes No Yes Yes No Yes Never
Algebra (Field) Yes Yes Yes Yes Yes No No Yes Yes Never
𝜎-Algebra (𝜎-Field) Yes Yes Yes Yes Yes Yes Yes Yes Yes Never
Dual ideal Yes Yes Yes No No No Yes Yes No No
Filter Yes Yes Yes Never Never No Yes Yes F {\displaystyle \varnothing \not \in {\mathcal {F}}} Yes
Prefilter (Filter base) Yes No No Never Never No No No F {\displaystyle \varnothing \not \in {\mathcal {F}}} Yes
Filter subbase No No No Never Never No No No F {\displaystyle \varnothing \not \in {\mathcal {F}}} Yes
Open Topology Yes Yes Yes No No No
(even arbitrary {\displaystyle \cup } )
Yes Yes Never
Closed Topology Yes Yes Yes No No
(even arbitrary {\displaystyle \cap } )
No Yes Yes Never
Is necessarily true of F : {\displaystyle {\mathcal {F}}\colon }
or, is F {\displaystyle {\mathcal {F}}} closed under:
directed
downward
finite
intersections
finite
unions
relative
complements
complements
in Ω {\displaystyle \Omega }
countable
intersections
countable
unions
contains Ω {\displaystyle \Omega } contains {\displaystyle \varnothing } Finite
Intersection
Property

Additionally, a semiring is a π-system where every complement B A {\displaystyle B\setminus A} is equal to a finite disjoint union of sets in F . {\displaystyle {\mathcal {F}}.}
A semialgebra is a semiring where every complement Ω A {\displaystyle \Omega \setminus A} is equal to a finite disjoint union of sets in F . {\displaystyle {\mathcal {F}}.}
A , B , A 1 , A 2 , {\displaystyle A,B,A_{1},A_{2},\ldots } are arbitrary elements of F {\displaystyle {\mathcal {F}}} and it is assumed that F . {\displaystyle {\mathcal {F}}\neq \varnothing .}

References

  1. Elstrodt, J. (2018). Maß- Und Integrationstheorie. Springer Spektrum Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-57939-8
  2. "11. Measurable Spaces". Random: Probability, Mathematical Statistics, Stochastic Processes. University of Alabama in Huntsville, Department of Mathematical Sciences. Retrieved 30 March 2016. Clearly a σ-algebra of subsets is also an algebra of subsets, so the basic results for algebras in still hold.
  3. Billingsley, Patrick (2012). Probability and Measure (Anniversary ed.). Wiley. ISBN 978-1-118-12237-2.
  4. Rudin, Walter (1987). Real & Complex Analysis. McGraw-Hill. ISBN 0-07-054234-1.
  5. Vestrup, Eric M. (2009). The Theory of Measures and Integration. John Wiley & Sons. p. 12. ISBN 978-0-470-31795-2.
  6. Džamonja, Mirna; Kunen, Kenneth (1995). "Properties of the class of measure separable compact spaces" (PDF). Fundamenta Mathematicae: 262. If μ {\displaystyle \mu } is a Borel measure on X , {\displaystyle X,} the measure algebra of ( X , μ ) {\displaystyle (X,\mu )} is the Boolean algebra of all Borel sets modulo μ {\displaystyle \mu } -null sets. If μ {\displaystyle \mu } is finite, then such a measure algebra is also a metric space, with the distance between the two sets being the measure of their symmetric difference. Then, we say that μ {\displaystyle \mu } is separable if and only if this metric space is separable as a topological space.
  7. Fischer, Tom (2013). "On simple representations of stopping times and stopping time sigma-algebras". Statistics and Probability Letters. 83 (1): 345–349. arXiv:1112.1603. doi:10.1016/j.spl.2012.09.024.
  8. Kallenberg, Olav (2001). Foundations of Modern Probability (2nd ed.). Springer. p. 7. ISBN 0-387-95313-2.
  9. van der Vaart, A. W., & Wellner, J. A. (1996). Weak Convergence and Empirical Processes. In Springer Series in Statistics. Springer New York. https://doi.org/10.1007/978-1-4757-2545-2

External links

Categories: