Documentation

Atlas.TheoryOfProbability.code.PairwiseIndepSLLN

noncomputable def partialSumIndicators {Ω : Type u_1} (A : Set Ω) (n : ) :
Ω

The partial sum S_n = ∑_{i < n} 1_{A_i} of indicators of the first n events, viewed as a real-valued random variable on Ω.

Instances For
    theorem partialSumIndicators_eq {Ω : Type u_1} [MeasurableSpace Ω] (A : Set Ω) (n : ) :
    partialSumIndicators A n = iFinset.range n, (A i).indicator 1

    Rewrite partialSumIndicators A n as the pointwise sum (function-valued sum) of the individual indicator functions.

    The σ-algebra generated by the indicator 1_s : Ω → ℝ of a set s is contained in the σ-algebra generated by the singleton family {s}.

    Independence of two sets implies independence of their real-valued indicator functions.

    The indicator function 1_s of a measurable set is in for any probability measure.

    theorem indicator_one_sq {Ω : Type u_1} [MeasurableSpace Ω] (s : Set Ω) :

    The square of an indicator function equals the indicator function itself: (1_s)² = 1_s.

    The variance of the indicator of a measurable set is bounded by its probability: Var(1_s) = P(s)(1 - P(s)) ≤ P(s).

    theorem integral_partialSumIndicators {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] (A : Set Ω) (hA : ∀ (i : ), MeasurableSet (A i)) (n : ) :
    (ω : Ω), partialSumIndicators A n ω μ = iFinset.range n, (μ (A i)).toReal

    The expected value E[S_n] = ∑_{i < n} P(A_i) of the partial sum of indicators.

    For pairwise independent events A_i, the variance of the partial sum of indicators is bounded by its expectation: Var(S_n) ≤ E[S_n]. This follows from Var(1_{A_i}) ≤ P(A_i) and the fact that pairwise independence makes covariances vanish.

    theorem ES_tendsto_atTop {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] (A : Set Ω) (hA : ∀ (i : ), MeasurableSet (A i)) (hsum : ∑' (n : ), μ (A n) = ) :

    If ∑ P(A_n) = ∞, then the expectations E[S_n] = ∑_{i<n} P(A_i) of the partial sums tend to .

    theorem ES_mono {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] (A : Set Ω) (hA : ∀ (i : ), MeasurableSet (A i)) :
    Monotone fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ

    The map n ↦ E[S_n] is monotone since each summand P(A_i) is nonnegative.

    theorem ES_step_le_one {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] (A : Set Ω) (hA : ∀ (i : ), MeasurableSet (A i)) (n : ) :
    (ω : Ω), partialSumIndicators A (n + 1) ω μ - (ω : Ω), partialSumIndicators A n ω μ 1

    Successive expectations differ by at most one: E[S_{n+1}] - E[S_n] = P(A_n) ≤ 1.

    noncomputable def sllnSubseq {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} {A : Set Ω} (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) :

    The subsequence φ(k) used in the proof of the pairwise-independent strong law: it chooses the first index n such that E[S_n] ≥ (k+1)². Because the spacing grows quadratically, the Chebyshev tail bounds for S_{φ(k)}/E[S_{φ(k)}] are summable.

    Instances For
      theorem sllnSubseq_spec {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : Set Ω} (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) (k : ) :
      (k + 1) ^ 2 (ω : Ω), partialSumIndicators A (sllnSubseq hES_top k) ω μ

      Defining property of sllnSubseq: at index φ(k) we have E[S_{φ(k)}] ≥ (k+1)².

      theorem sllnSubseq_pos {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : Set Ω} (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) (k : ) :
      0 < sllnSubseq hES_top k

      Every index φ(k) in the subsequence is strictly positive, because E[S_0] = 0 cannot reach (k+1)² > 0.

      theorem sllnSubseq_strictMono {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : Set Ω} (hA : ∀ (i : ), MeasurableSet (A i)) (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) :

      The subsequence φ : ℕ → ℕ is strictly monotone.

      theorem ES_sllnSubseq_pos {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : Set Ω} (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) (k : ) :
      0 < (ω : Ω), partialSumIndicators A (sllnSubseq hES_top k) ω μ

      The expectation E[S_{φ(k)}] along the subsequence is strictly positive (at least (k+1)² > 0).

      The partial-sum random variable S_n is in .

      theorem ae_tendsto_of_ae_eventually_abs_sub_lt {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {f : Ω} {a : } (h : ∀ (m : ), ∀ᵐ (ω : Ω) μ, ∀ᶠ (k : ) in Filter.atTop, |f k ω - a| < 1 / (m + 1)) :
      ∀ᵐ (ω : Ω) μ, Filter.Tendsto (fun (k : ) => f k ω) Filter.atTop (nhds a)

      Almost sure convergence from quantitative tail bounds: if for every m, almost surely |f_k(ω) - a| < 1/(m+1) eventually as k → ∞, then almost surely f_k(ω) → a.

      theorem chebyshev_subseq_bound {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] (A : Set Ω) (hA : ∀ (i : ), MeasurableSet (A i)) (hindep : Pairwise fun (i j : ) => ProbabilityTheory.IndepSet (A i) (A j) μ) (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) (ε : ) ( : 0 < ε) (k : ) :
      μ {ω : Ω | ε |partialSumIndicators A (sllnSubseq hES_top k) ω / (ω' : Ω), partialSumIndicators A (sllnSubseq hES_top k) ω' μ - 1|} ENNReal.ofReal (1 / (ε ^ 2 * (k + 1) ^ 2))

      Chebyshev tail bound along the subsequence: the probability that |S_{φ(k)}/E[S_{φ(k)}] - 1| ≥ ε is bounded by 1/(ε² (k+1)²). This is the summable estimate used to conclude a.s. convergence along the subsequence.

      theorem summable_chebyshev_subseq {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] (A : Set Ω) (hA : ∀ (i : ), MeasurableSet (A i)) (hindep : Pairwise fun (i j : ) => ProbabilityTheory.IndepSet (A i) (A j) μ) (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) (ε : ) ( : 0 < ε) :
      ∑' (k : ), μ {ω : Ω | ε |partialSumIndicators A (sllnSubseq hES_top k) ω / (ω' : Ω), partialSumIndicators A (sllnSubseq hES_top k) ω' μ - 1|}

      Summing the Chebyshev bounds along the subsequence gives a finite total measure, since ∑ 1/(k+1)² < ∞. This is the Borel-Cantelli input for the subsequence.

      theorem partialSumIndicators_mono {Ω : Type u_1} [MeasurableSpace Ω] (A : Set Ω) (ω : Ω) :
      Monotone fun (n : ) => partialSumIndicators A n ω

      Pointwise monotonicity of the partial sum process: for each ω, the map n ↦ S_n(ω) is nondecreasing.

      theorem partialSumIndicators_nonneg {Ω : Type u_1} [MeasurableSpace Ω] (A : Set Ω) (n : ) (ω : Ω) :

      The partial sum S_n(ω) ≥ 0 since it is a sum of nonnegative indicators.

      theorem exists_bracket_of_strictMono (φ : ) ( : StrictMono φ) (n : ) (hn : φ 0 n) :
      ∃ (k : ), φ k n n < φ (k + 1)

      For a strictly monotone sequence φ : ℕ → ℕ and any n ≥ φ 0, there exists k such that φ k ≤ n < φ (k+1). This "bracketing" is used to sandwich a general n between two consecutive subsequence indices.

      theorem ES_sllnSubseq_upper_bound {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : Set Ω} (hA : ∀ (i : ), MeasurableSet (A i)) (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) (k : ) :
      (ω : Ω), partialSumIndicators A (sllnSubseq hES_top k) ω μ < (k + 1) ^ 2 + 1

      Upper bound on E[S_{φ(k)}] by (k+1)² + 1, since the previous index φ(k) - 1 fails the threshold (k+1)² and the expectation grows by at most one per step.

      theorem ES_subseq_ratio_tendsto_one {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : Set Ω} (hA : ∀ (i : ), MeasurableSet (A i)) (hES_top : Filter.Tendsto (fun (n : ) => (ω : Ω), partialSumIndicators A n ω μ) Filter.atTop Filter.atTop) :
      Filter.Tendsto (fun (k : ) => ( (ω : Ω), partialSumIndicators A (sllnSubseq hES_top (k + 1)) ω μ) / (ω : Ω), partialSumIndicators A (sllnSubseq hES_top k) ω μ) Filter.atTop (nhds 1)

      The ratio E[S_{φ(k+1)}] / E[S_{φ(k)}] tends to 1 as k → ∞. This "slow growth" property allows interpolation between the subsequence and the full sequence in the SLLN proof.

      theorem pairwise_indep_slln {Ω : Type u_1} [MeasurableSpace Ω] {μ : MeasureTheory.Measure Ω} [MeasureTheory.IsProbabilityMeasure μ] {A : Set Ω} (hA_meas : ∀ (n : ), MeasurableSet (A n)) (hA_indep : Pairwise fun (i j : ) => ProbabilityTheory.IndepSet (A i) (A j) μ) (hA_sum : ∑' (n : ), μ (A n) = ) :
      ∀ᵐ (ω : Ω) μ, Filter.Tendsto (fun (n : ) => (∑ iFinset.range n, (A i).indicator 1 ω) / iFinset.range n, (μ (A i)).toReal) Filter.atTop (nhds 1)

      Pairwise-independent strong law for indicator sums (Lecture 9): suppose A₁, A₂, … are pairwise independent events with ∑ P(A_n) = ∞, and write S_n = ∑_{i=1}^n 1_{A_i}. Then the ratio S_n / E[S_n] tends almost surely to 1.