Documentation

Mathlib.Probability.Density

Probability density function #

This file defines the probability density function of random variables, by which we mean measurable functions taking values in a Borel space. The probability density function is defined as the Radon–Nikodym derivative of the law of X. In particular, a measurable function f is said to the probability density function of a random variable X if for all measurable sets S, ℙ(X ∈ S) = ∫ x in S, f x dx. Probability density functions are one way of describing the distribution of a random variable, and are useful for calculating probabilities and finding moments (although the latter is better achieved with moment-generating functions).

This file also defines the continuous uniform distribution and proves some properties about random variables with this distribution.

Main definitions #

Main results #

class MeasureTheory.HasPDF {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E := by volume_tac) :

A random variable X : Ω → E is said to have a probability density function (HasPDF) with respect to the measure ℙ on Ω and μ on E if the push-forward measure of ℙ along X is absolutely continuous with respect to μ and they have a Lebesgue decomposition (HaveLebesgueDecomposition).

Instances
    theorem MeasureTheory.hasPDF_iff {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {X : Ω → E} {ℙ : Measure Ω} {μ : Measure E} :
    theorem MeasureTheory.hasPDF_iff_of_aemeasurable {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {X : Ω → E} {ℙ : Measure Ω} {μ : Measure E} (hX : AEMeasurable X ℙ) :
    theorem MeasureTheory.HasPDF.aemeasurable {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E) [HasPDF X ℙ μ] :
    instance MeasureTheory.HasPDF.haveLebesgueDecomposition {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {X : Ω → E} {ℙ : Measure Ω} {μ : Measure E} [HasPDF X ℙ μ] :
    theorem MeasureTheory.HasPDF.absolutelyContinuous {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {X : Ω → E} {ℙ : Measure Ω} {μ : Measure E} [HasPDF X ℙ μ] :
    theorem MeasureTheory.HasPDF.quasiMeasurePreserving_of_measurable {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E) [HasPDF X ℙ μ] (h : Measurable X) :

    A random variable that HasPDF is quasi-measure-preserving.

    theorem MeasureTheory.HasPDF.congr {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {X Y : Ω → E} {ℙ : Measure Ω} {μ : Measure E} (hXY : X =ᵐ[ℙ] Y) [hX : HasPDF X ℙ μ] :
    HasPDF Y ℙ μ
    theorem MeasureTheory.HasPDF.congr_iff {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {X Y : Ω → E} {ℙ : Measure Ω} {μ : Measure E} (hXY : X =ᵐ[ℙ] Y) :
    HasPDF X ℙ μ ↔ HasPDF Y ℙ μ
    theorem MeasureTheory.hasPDF_of_map_eq_withDensity {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {X : Ω → E} {ℙ : Measure Ω} {μ : Measure E} (hX : AEMeasurable X ℙ) (f : E → ENNReal) (hf : AEMeasurable f μ) (h : Measure.map X ℙ = μ.withDensity f) :
    HasPDF X ℙ μ

    X HasPDF if there is a pdf f such that map X ℙ = μ.withDensity f.

    noncomputable def MeasureTheory.pdf {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E := by volume_tac) :
    E → ENNReal

    If X is a random variable, then pdf X ℙ μ is the Radon–Nikodym derivative of the push-forward measure of ℙ along X with respect to μ.

    Equations
    Instances For
      theorem MeasureTheory.pdf_def {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {X : Ω → E} :
      pdf X ℙ μ = (Measure.map X ℙ).rnDeriv μ
      theorem MeasureTheory.pdf_of_not_aemeasurable {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {X : Ω → E} (hX : ¬AEMeasurable X ℙ) :
      pdf X ℙ μ =ᵐ[μ] 0
      theorem MeasureTheory.pdf_of_not_haveLebesgueDecomposition {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {X : Ω → E} (h : ¬(Measure.map X ℙ).HaveLebesgueDecomposition μ) :
      pdf X ℙ μ = 0
      theorem MeasureTheory.aemeasurable_of_pdf_ne_zero {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} (X : Ω → E) (h : ¬pdf X ℙ μ =ᵐ[μ] 0) :
      theorem MeasureTheory.hasPDF_of_pdf_ne_zero {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {X : Ω → E} (hac : (Measure.map X ℙ).AbsolutelyContinuous μ) (hpdf : ¬pdf X ℙ μ =ᵐ[μ] 0) :
      HasPDF X ℙ μ
      theorem MeasureTheory.measurable_pdf {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E := by volume_tac) :
      Measurable (pdf X ℙ μ)
      theorem MeasureTheory.withDensity_pdf_le_map {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {x✝ : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E := by volume_tac) :
      μ.withDensity (pdf X ℙ μ) ≤ Measure.map X ℙ
      theorem MeasureTheory.setLIntegral_pdf_le_map {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E := by volume_tac) (s : Set E) :
      ∫⁻ (x : E) in s, pdf X ℙ μ x ∂μ ≤ (Measure.map X ℙ) s
      theorem MeasureTheory.map_eq_withDensity_pdf {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E := by volume_tac) [hX : HasPDF X ℙ μ] :
      Measure.map X ℙ = μ.withDensity (pdf X ℙ μ)
      theorem MeasureTheory.map_eq_setLIntegral_pdf {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} (X : Ω → E) (ℙ : Measure Ω) (μ : Measure E := by volume_tac) [hX : HasPDF X ℙ μ] {s : Set E} (hs : MeasurableSet s) :
      (Measure.map X ℙ) s = ∫⁻ (x : E) in s, pdf X ℙ μ x ∂μ
      theorem MeasureTheory.pdf.congr {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {X Y : Ω → E} (hXY : X =ᵐ[ℙ] Y) :
      pdf X ℙ μ = pdf Y ℙ μ
      theorem MeasureTheory.pdf.lintegral_eq_measure_univ {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {X : Ω → E} [HasPDF X ℙ μ] :
      ∫⁻ (x : E), pdf X ℙ μ x ∂μ = ℙ Set.univ
      theorem MeasureTheory.pdf.eq_of_map_eq_withDensity {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} [IsFiniteMeasure ℙ] {X : Ω → E} [HasPDF X ℙ μ] (f : E → ENNReal) (hmf : AEMeasurable f μ) :
      Measure.map X ℙ = μ.withDensity f ↔ pdf X ℙ μ =ᵐ[μ] f
      theorem MeasureTheory.pdf.eq_of_map_eq_withDensity' {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} [SigmaFinite μ] {X : Ω → E} [HasPDF X ℙ μ] (f : E → ENNReal) (hmf : AEMeasurable f μ) :
      Measure.map X ℙ = μ.withDensity f ↔ pdf X ℙ μ =ᵐ[μ] f
      theorem MeasureTheory.pdf.ae_lt_top {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} [IsFiniteMeasure ℙ] {μ : Measure E} {X : Ω → E} :
      ∀ᵐ (x : E) ∂μ, pdf X ℙ μ x < ⊤
      theorem MeasureTheory.pdf.ofReal_toReal_ae_eq {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} [IsFiniteMeasure ℙ] {X : Ω → E} :
      (fun (x : E) => ENNReal.ofReal (pdf X ℙ μ x).toReal) =ᵐ[μ] pdf X ℙ μ
      theorem MeasureTheory.pdf.lintegral_pdf_mul {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {X : Ω → E} [HasPDF X ℙ μ] {f : E → ENNReal} (hf : AEMeasurable f μ) :
      ∫⁻ (x : E), pdf X ℙ μ x * f x ∂μ = ∫⁻ (x : Ω), f (X x) ∂ℙ

      The Law of the Unconscious Statistician for nonnegative random variables.

      theorem MeasureTheory.pdf.integrable_pdf_smul_iff {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {F : Type u_3} [NormedAddCommGroup F] [NormedSpace ℝ F] [IsFiniteMeasure ℙ] {X : Ω → E} [HasPDF X ℙ μ] {f : E → F} (hf : AEStronglyMeasurable f μ) :
      Integrable (fun (x : E) => (pdf X ℙ μ x).toReal • f x) μ ↔ Integrable (fun (x : Ω) => f (X x)) ℙ
      theorem MeasureTheory.pdf.integral_pdf_smul {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {F : Type u_3} [NormedAddCommGroup F] [NormedSpace ℝ F] [IsFiniteMeasure ℙ] {X : Ω → E} [HasPDF X ℙ μ] {f : E → F} (hf : AEStronglyMeasurable f μ) :
      ∫ (x : E), (pdf X ℙ μ x).toReal • f x ∂μ = ∫ (x : Ω), f (X x) ∂ℙ

      The Law of the Unconscious Statistician: Given a random variable X and a measurable function f, f ∘ X is a random variable with expectation ∫ x, pdf X x • f x ∂μ where μ is a measure on the codomain of X.

      theorem MeasureTheory.pdf.quasiMeasurePreserving_hasPDF {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {F : Type u_3} [MeasurableSpace F] {ν : Measure F} (X : Ω → E) [HasPDF X ℙ μ] {g : E → F} (hg : Measure.QuasiMeasurePreserving g μ ν) (hmap : (Measure.map g (Measure.map X ℙ)).HaveLebesgueDecomposition ν) :
      HasPDF (g ∘ X) ℙ ν

      A random variable that HasPDF transformed under a QuasiMeasurePreserving map also HasPDF if (map g (map X ℙ)).HaveLebesgueDecomposition μ.

      quasiMeasurePreserving_hasPDF is more useful in the case we are working with a probability measure and a real-valued random variable.

      theorem MeasureTheory.pdf.quasiMeasurePreserving_hasPDF' {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {F : Type u_3} [MeasurableSpace F] {ν : Measure F} (X : Ω → E) [HasPDF X ℙ μ] {g : E → F} [SFinite ℙ] [SigmaFinite ν] (hg : Measure.QuasiMeasurePreserving g μ ν) :
      HasPDF (g ∘ X) ℙ ν

      A real-valued random variable X HasPDF X ℙ λ (where λ is the Lebesgue measure) if and only if the push-forward measure of ℙ along X is absolutely continuous with respect to λ.

      theorem MeasureTheory.pdf.integral_mul_eq_integral {Ω : Type u_1} {m : MeasurableSpace Ω} {ℙ : Measure Ω} {X : Ω → ℝ} [IsFiniteMeasure ℙ] [HasPDF X ℙ volume] :
      ∫ (x : ℝ), x * (pdf X ℙ volume x).toReal = ∫ (x : Ω), X x ∂ℙ

      If X is a real-valued random variable that has pdf f, then the expectation of X equals ∫ x, x * f x ∂λ where λ is the Lebesgue measure.

      theorem MeasureTheory.pdf.hasFiniteIntegral_mul {Ω : Type u_1} {m : MeasurableSpace Ω} {ℙ : Measure Ω} {X : Ω → ℝ} [IsFiniteMeasure ℙ] {f : ℝ → ℝ} {g : ℝ → ENNReal} (hg : pdf X ℙ volume =ᵐ[volume] g) (hgi : ∫⁻ (x : ℝ), ‖f x‖ₑ * g x ≠ ⊤) :
      HasFiniteIntegral (fun (x : ℝ) => f x * (pdf X ℙ volume x).toReal) volume
      theorem MeasureTheory.pdf.indepFun_iff_pdf_prod_eq_pdf_mul_pdf {Ω : Type u_1} {E : Type u_2} [MeasurableSpace E] {m : MeasurableSpace Ω} {ℙ : Measure Ω} {μ : Measure E} {F : Type u_3} [MeasurableSpace F] {ν : Measure F} {X : Ω → E} {Y : Ω → F} [IsFiniteMeasure ℙ] [SigmaFinite μ] [SigmaFinite ν] [HasPDF (fun (ω : Ω) => (X ω, Y ω)) ℙ (μ.prod ν)] :
      ProbabilityTheory.IndepFun X Y ℙ ↔ pdf (fun (ω : Ω) => (X ω, Y ω)) ℙ (μ.prod ν) =ᵐ[μ.prod ν] fun (z : E × F) => pdf X ℙ μ z.1 * pdf Y ℙ ν z.2

      Random variables are independent iff their joint density is a product of marginal densities.