Documentation

LeanPool.PLAcceleratedNesterovLean.Convergence.Coercivity.Main

Lyapunov Coercivity #

The Lyapunov function L_n controls the physical quantities ‖v_n‖² + μ'‖e_n‖² and the potential Ψ(x_n). The constants depend only on a = √(μ'·η).

theorem PLAcceleratedNesterovLean.lyapunov_coercivity_gen {d : } (_hd : 0 < d) (f : E d) (L : NNReal) (_hL : 0 < L) (μ' : ) (hμ' : 0 < μ') (η : ) (_hη : η = 1 / L) (hη_pos : 0 < η) (hμη_lt1 : μ' * η < 1) (S : Set (E d)) (_hM_argmin : S = argminSet f) (π : E dE d) (_hπ_proj : xS, π x = x) (hπ_in_S : ∀ (x : E d), π x S) (P : E d →L[] E d) (_hP_idem : ∀ (x : E d), P (P x) = P x) (_hP_self_adj : ∀ (x y : E d), inner (P x) y = inner x (P y)) (hP_ortho : ∀ (v : E d), v ^ 2 = P v ^ 2 + v - P v ^ 2) (Ω : Set (E d)) (hπ_metric : xΩ, dist x (π x) = Metric.infDist x S) (hQG : xΩ, f x - fStar f μ' / 2 * Metric.infDist x S ^ 2) :
∃ (C_coer : ) (C_Ψ : ), 0 < C_coer 0 < C_Ψ ∀ (s : NesterovState d), have Ln := lyapunovOfState P μ' π f η s; s.x Ωs.lookahead η Ωs.v ^ 2 + μ' * normalDispOfState π η s ^ 2 C_coer * Ln psi f μ' S s.x C_Ψ * Ln

State-based coercivity of the Lyapunov function.

Whenever x_n, x'_n ∈ Ω, the Lyapunov function controls: (1) ‖v_n‖² + μ'‖e_n‖² ≤ C_coer · L_n (2) Ψ(x_n) ≤ C_Ψ · L_n

This version is state-based: it quantifies over arbitrary NesterovStates rather than sequence indices.

theorem PLAcceleratedNesterovLean.lyapunov_coercivity {d : } (_hd : 0 < d) (f : E d) (L : NNReal) (_hL : 0 < L) (μ' : ) (hμ' : 0 < μ') (η : ) (_hη : η = 1 / L) (hη_pos : 0 < η) (hμη_lt1 : μ' * η < 1) (ρ : ) (_hρ : ρ = (1 - (μ' * η)) / (1 + (μ' * η))) (S : Set (E d)) (_hM_argmin : S = argminSet f) (π : E dE d) (_hπ_proj : xS, π x = x) (hπ_in_S : ∀ (x : E d), π x S) (P : E d →L[] E d) (_hP_idem : ∀ (x : E d), P (P x) = P x) (_hP_self_adj : ∀ (x y : E d), inner (P x) y = inner x (P y)) (hP_ortho : ∀ (v : E d), v ^ 2 = P v ^ 2 + v - P v ^ 2) (Ω : Set (E d)) (hπ_metric : xΩ, dist x (π x) = Metric.infDist x S) (hQG : xΩ, f x - fStar f μ' / 2 * Metric.infDist x S ^ 2) :
∃ (C_coer : ) (C_Ψ : ), 0 < C_coer 0 < C_Ψ ∀ (x₁ : E d) (n : ), have s := nesterovSeq f η ρ x₁ n; have Ln := lyapunov P μ' π f η ρ x₁ n; s.x Ωs.lookahead η Ωs.v ^ 2 + μ' * normalDisp π f η ρ x₁ n ^ 2 C_coer * Ln psi f μ' S s.x C_Ψ * Ln

Coercivity of the Lyapunov function.

Whenever x_n, x'_n ∈ Ω, the Lyapunov function controls: (1) ‖v_n‖² + μ'‖e_n‖² ≤ C_coer · L_n (2) Ψ(x_n) ≤ C_Ψ · L_n