Course Schneider
Course Schneider
Rolf Schneider
Universität Freiburg
1/1
A closed convex cone in Rd , briefly a cone, is a closed, convex
6 C ⊆ Rd with λx ∈ C for x ∈ C and λ ≥ 0.
set ∅ =
2/1
A closed convex cone in Rd , briefly a cone, is a closed, convex
6 C ⊆ Rd with λx ∈ C for x ∈ C and λ ≥ 0.
set ∅ =
2/1
3/1
The answer is immediate if C and D happen to be subspaces:
(
0 if dim C + dim D ≤ d,
P(C ∩ ΘD 6= {o}) =
1 if dim C + dim D > d.
4/1
The answer is immediate if C and D happen to be subspaces:
(
0 if dim C + dim D ≤ d,
P(C ∩ ΘD 6= {o}) =
1 if dim C + dim D > d.
The great surprise is that for cones one can define a number,
the statistical dimension, such that a similar result holds
approximately.
4/1
The answer is immediate if C and D happen to be subspaces:
(
0 if dim C + dim D ≤ d,
P(C ∩ ΘD 6= {o}) =
1 if dim C + dim D > d.
The great surprise is that for cones one can define a number,
the statistical dimension, such that a similar result holds
approximately.
4/1
The answer is immediate if C and D happen to be subspaces:
(
0 if dim C + dim D ≤ d,
P(C ∩ ΘD 6= {o}) =
1 if dim C + dim D > d.
The great surprise is that for cones one can define a number,
the statistical dimension, such that a similar result holds
approximately.
4/1
Michael B. McCoy: A geometric analysis of convex demixing. PhD
Thesis, California Institute of Technology, 2013.
Quotation:
5/1
This was continued and expanded in
D. Amelunxen, M. Lotz, M.B. McCoy, J.A. Tropp: Living on the edge:
phase transitions in convex programs with random data. Information
and Inference 3 (2014), 224–294.
(Winner of the “Information and Inference Best Paper Prize”
2015).
6/1
This was continued and expanded in
D. Amelunxen, M. Lotz, M.B. McCoy, J.A. Tropp: Living on the edge:
phase transitions in convex programs with random data. Information
and Inference 3 (2014), 224–294.
(Winner of the “Information and Inference Best Paper Prize”
2015).
6/1
uk(c)
d(c)
Flc' 3' conctnratioh of conic in§insic.volumes' This plor displays thc conic inuinsic volumes,t(c) ofa circularcone c c Rtlt
withangler/6'Thedisributionccrnced'*te§rharplyaroundthe§iati§ticaldimensionä(C)^c32.5.SeeSection3:4lorfurther
discussi,on of this example.
7/1
Applications described in that paper: Phase transitions in
random convex optimization problems
8/1
The core from the viewpoint of convex geometry
C, D are cones, not both subspaces, and Θ is a uniform
random rotation.
9/1
The core from the viewpoint of convex geometry
C, D are cones, not both subspaces, and Θ is a uniform
random rotation.
9/1
The core from the viewpoint of convex geometry
C, D are cones, not both subspaces, and Θ is a uniform
random rotation.
Since C ∩ ΘD is, with probability one, either {o} (in which case
vk (C ∩ ΘD) = 0 for k ≥ 1) or not a subspace, this implies that
b d−1
2
c
1{C ∩ ΘD 6= {o}} = 2
X
v2k+1 (C ∩ ΘD) almost surely
k=0
and hence
b d−1
2
c d
X X
P(C ∩ ΘD 6= {o}) = 2 vi (C)vd+2k+1−i (D).
k=0 i=2k+1
10 / 1
This is the promised explicit answer.
11 / 1
This is the promised explicit answer.
11 / 1
This is the promised explicit answer.
11 / 1
This is the promised explicit answer.
————————————————————————————
11 / 1
Convex cones
Let C ∈ C d .
The dual or polar cone of C is
We have C ◦◦ = C.
12 / 1
T.c,r)
fl",c4
13 / 1
Lemma. (Moreau decomposition)
For all x ∈ Rd ,
x = ΠC (x) + ΠC ◦ (x),
where
hΠC (x), ΠC ◦ (x)i = 0.
14 / 1
Lemma. (Moreau decomposition)
For all x ∈ Rd ,
x = ΠC (x) + ΠC ◦ (x),
where
hΠC (x), ΠC ◦ (x)i = 0.
Proof.
⇒ u ∈ C◦
14 / 1
o ∈ H ⇒ ΠC (x) ⊥ u
⇒ ΠC ◦ (x) = u
⇒ assertion
15 / 1
Conic intrinsic volumes of polyhedral cones
16 / 1
Some explanations:
The distribution of g is the standard Gaussian measure,
Z
1 1 2
γd (A) = √ d e− 2 kxk dx.
2π A
σd−1 (A)
γd (A∨ ) = .
σd−1 (Sd−1 )
17 / 1
We define the internal angle of C at o by
18 / 1
We define the internal angle of C at o by
Recall that
vk (C) := P(ΠC (g) ∈ skelk (C)).
18 / 1
19 / 1
IL
LJ
\)
z
Therefore,
The latter holds since the Gauss measure of a direct sum is the
product of the Gauss measures of the summands.
We conclude that
20 / 1
Relations between conic intrinsic volumes
A duality relation
21 / 1
Relations between conic intrinsic volumes
A duality relation
A trivial relation
v0 + · · · + vd = 1.
21 / 1
A nontrivial relation
22 / 1
A side remark
The identity
23 / 1
Theorem 1. Let E 6= P be a face of P. Then
E⊆F ∈F (P)
The proof, in
24 / 1
The identity
(−1)dim F 1F −N(C,F ) = 0
X
(∗)
F ∈F (C)
25 / 1
Back to the identity
26 / 1
More generally, for a closed convex set K ⊂ Rd , define
27 / 1
With this definition, we have for any polyhedral cone C
d
X
(−1)k vk (C) = χ(C).
k=0
Together with
d
X
vk (C) = 1,
k=0
this yields
b d−1
2
c
X
2 v2k+1 (C) = 1 − χ(C).
k=0
28 / 1
Remark. The relation
b d−1
2
c
X
2 v2k+1 (C) = 1 − χ(C)
k=0
29 / 1
Remark. The relation
b d−1
2
c
X
2 v2k+1 (C) = 1 − χ(C)
k=0
————————————————————————————
29 / 1
Steiner formulas
Then
d
X
ϕf (C) = Ik (f ) · vk (C),
k=0
where
Ik (f ) = ϕf (Lk ), Lk ∈ G(d, k ).
30 / 1
Explicitly,
Z ∞Z ∞
ωk ωd−k 1 2 +s 2 )
Ik (f ) = √ d
f (r 2 , s2 )e− 2 (r r k−1 sd−k−1 ds dr
2π 0 0
for k = 1, . . . , d − 1 and
Z ∞
ωd 1 2
I0 (f ) = √ d f (0, s2 )e− 2 s sd−1 ds,
2π 0
Z ∞
ωd 1 2
Id (f ) = √ d f (r 2 , 0)e− 2 r r d−1 dr .
2π 0
31 / 1
Essentials of the proof:
ϕf (C)
= Ef kΠC (g)k2 , kΠC ◦ (g)k2
d h i
E f kΠC (g)k2 , kΠC ◦ (g)k2 1relint F (ΠC (g) .
X X
=
k=0 F ∈Fk (C)
32 / 1
For F ∈ Fk (C),
h i
E f kΠC (g)k2 , kΠC ◦ (g)k2 1relint F (ΠC (g)
Z
1 1 2
=√ d
f kΠC (z)k2 , kΠC ◦ (z)k2 e− 2 kzk λd (dz)
2π F ⊕N(C,F )
Z Z
1 1 2 +kyk2 )
=√ d
f (kxk2 , ky k2 )e− 2 (kxk λd−k (dy)λk (dx).
2π F N(C,F )
33 / 1
For F ∈ Fk (C),
h i
E f kΠC (g)k2 , kΠC ◦ (g)k2 1relint F (ΠC (g)
Z
1 1 2
=√ d
f kΠC (z)k2 , kΠC ◦ (z)k2 e− 2 kzk λd (dz)
2π F ⊕N(C,F )
Z Z
1 1 2 +kyk2 )
=√ d
f (kxk2 , ky k2 )e− 2 (kxk λd−k (dy)λk (dx).
2π F N(C,F )
{x ∈ Rd : dist(x, C) ≤ λ} = C + λB d .
The choice
1 if b ≤ λ2 ,
f (a, b) =
0 otherwise
in the Master Steiner formula yields
35 / 1
Corollary 1. For a polyhedral cone C, the Gaussian measure
of the parallel set C + λB d is given by
d
X
γd (C + λB d ) = fk (λ) · vk (C)
k=0
with Z λ
ω 1 2
fk (λ) = √ d−k
d−k
e− 2 s sd−k−1 ds
2π 0
for k = 0, . . . , d − 1 and fd ≡ 1.
36 / 1
(b) The spherical Steiner formula
(in a conic interpretation)
37 / 1
The choice
1 if a ≤ b tan2 λ,
f (a, b) =
0 otherwise
in the Master Steiner formula yields:
d
X
γd (Cλa ) = gk (λ) · vk (C)
k=0
with Z λ
ω ω
gk (λ) = k d−k cosk−1 ϕ sind−k−1 ϕ dϕ
ωd 0
for k = 1, . . . , d − 1 and gd ≡ 1.
38 / 1
McCoy and Tropp (2014) have elegant reformulations of the
special Steiner formulas:
Corollary 3. For λ ≥ 0,
d
X
P(dist 2 (g, C) ≤ λ) = P(Xd−k ≤ λ) · vk (C),
k =0
δa (C ◦ , D ◦ ) = δa (C, D)
(Glasauer 1995).
40 / 1
For 0 ≤ λ < π/2, let
µλ (C) := γd (Cλa )
41 / 1
Theorem 3.
To every cone C ∈ C∗d , there exist nonnegative numbers
v0 (C), . . . , vd (C) such that, for every λ with 0 ≤ λ < π/2, the
Gaussian measure of the angular parallel set Cλa is given by
d
X
γd (Cλa ) = gk (λ) · vk (C)
k=1
with Z λ
ω ω
gk (λ) = k d−k cosk−1 ϕ sind−k−1 ϕ dϕ
ωd 0
for k = 1, . . . , d − 1 and gd ≡ 1. Further, vk ({o}) = δk,0 .
Each mapping vk : C d → R is a continuous valuation.
42 / 1
Let us briefly resume where we are.
P(C ∩ ΘD 6= {o}),
b d−1
2
c
X 1 if C ∩ ΘD =
6 {o},
2 v2k+1 (C ∩ ΘD) =
0 if C ∩ ΘD = {o}.
k=0
43 / 1
Recall that Θ is a uniform random rotation, that is, a random
variable with values in the rotation group SOd , with distribution
given by the Haar probability measure ν on SOd .
44 / 1
Theorem 4. (Conic kinematic formula)
If C, D ∈ C d are closed convex cones, then
Z d
X
vk (C ∩ ϑD) ν(dϑ) = vi (C)vd+k−i (D)
SOd i=k
for k = 1, . . . , d, and
Z d X
X d−i
v0 (C ∩ ϑD) ν(dϑ) = vi (C)vj (D).
SOd i=0 j=0
The second part of the theorem follows from the first, since
v0 + · · · + vd = 1.
45 / 1
Duality at work
Theorem 5.
If C, D ∈ C d are closed convex cones, then
Z d−k
X
vd−k (C + ϑD) ν(dϑ) = vi (C)vd−k−i (D)
SOd i=0
for k = 1, . . . , d, and
Z d
X d
X
vd (C + ϑD) ν(dϑ) = vi (C)vj (D).
SOd i=0 j=d−r
46 / 1
In the following, we sketch a new proof, which is due to
47 / 1
Lemma 1. Let C, D ⊂ Rd be polyhedral cones, where
Then Z
vk (C ∩ ϑD) ν(dϑ) = vi (C)vj (D).
SOd
For the proof, recall that we use hCi for the linear hull of the
cone C.
We also use SOhCi for the rotation group of the subspace hCi
and νhCi for its Haar probability measure.
48 / 1
For ν-almost all ϑ ∈ SOd , we have dim(hCi ∩ ϑhDi) = k.
Therefore,
Z
vk (C ∩ ϑD) νdϑ)
SOd
Z
= γhCi∩ϑhDi (C ∩ ϑD) ν(dϑ)
SOd
Z Z
= 1C (x)1ϑD (x)γhCi∩ϑhDi (dx) ν(dϑ).
SOd hCi∩ϑhDi
This gives
49 / 1
Z
vk (C ∩ ϑD) νdϑ)
SOd
Z Z Z
= 1C (x)1D (ρ−1 ϑ−1 x)
SOhDi SOd hCi∩ϑhDi
50 / 1
Thus, we obtain:
Z
vk (C ∩ ϑD) νdϑ)
SOd
Z Z
= vj (D) 1C (x) γhCi∩ϑhDi (dx) ν(dϑ).
SOd hCi∩ϑhDi
51 / 1
Z
vk (C ∩ ϑD) νdϑ)
SOd
Z Z Z
= vj (D) 1C (x)
SOhCi SOd σ(hCi∩ϑhDi)
= vj (D)vi (C),
52 / 1
Lemma 2. Let C, D ⊂ Rd be polyhedral cones, where
Then Z
vd−k (C + ϑD) ν(dϑ) = vi (C)vj (D).
SOd
53 / 1
For ν-almost all ϑ, there is the unique ϑ-decomposition
x = xC,ϑ + xD,ϑ + xϑ
with
with
54 / 1
55 / 1
-1
v4a 6
§
X
+
v\)
4
X /r
t\
l,,\
I t,,
t\
ltt
t\
t\
J \
Thus, we obtain
Z
vd−k (C + ϑD) ν(dϑ)
SOd
as rewritten above
Z Z
= 1C+ϑD+(hCi+ϑhDi)⊥ (x) γd (dx) ν(dϑ)
SOd Rd
(ρϑ)-decomposition of ρx = ρ(ϑ-decomposition of x)
56 / 1
Z Z
= 1C (ρxC,ϑ )1ρϑD (ρxD,ϑ ) γd (dx) ν(dϑ)
SOd Rd
apply Fubini
Z Z "Z #
= 1C (ρxC,ϑ )νhCi (dρ) 1D (ϑ−1 xD,ϑ ) γd (dx) ν(dϑ)
SOd Rd SOhCi
58 / 1
Definition. The cones F , G intersect transversally, written
F t G, if
J = F ∩ ϑG
59 / 1
Therefore,
Z
vk (C ∩ ϑD) ν(dϑ)
SOd
X Z
ϕF ∩ϑD (C ∩ ϑD)1{F t ϑG} ν(dϑ).
X X
=
i+j=k+d F ∈Fi (C) G∈Fj (D) SOd
60 / 1
For ν-almost all ϑ,
= ϕF (C)ϕG (D)
61 / 1
The proof:
Z
vk (F ∩ ϑG)vd−k (N(C, F ) + ϑN(D, G)) ν(dϑ)
SOd
×νhF i (dρ)
62 / 1
apply Lemma 1 in hF i to the integral in brackets
Z
= vi (F ) vk (ϑG ∩ hF i)vd−k (N(C, F ) + ϑN(D, G)) ν(dϑ)
SOd
Fubini
63 / 1
Z "Z #
= vi (F ) vk (σG ∩ ϑ−1 hF i) νhGi (dσ)
SOd SOhGi
apply Lemma 2
= ϕF (C)ϕG (D).
For η ⊂ Rd × Rd , let
65 / 1
Much of what we said about conic intrinsic volumes extends to
conic support measures.
• Explicit representation:
X Z Z
Ωk (C, η) = 1η (x, y ) γhF i⊥ (dy ) γhF i (dx).
F ∈Fk F N(C,F )
• Duality:
• Od -equivariance:
66 / 1
• Master Steiner formula: Set
h i
ϕf (C, η) := E f kΠC (g)k2 , kΠC ◦ (g)k2 1η (ΠC (g), ΠC ◦ (g)) .
Then
d
X
ϕf (C, η) = Ik (f ) · Ωk (C, η).
k=0
• Conic kinematic formula: Define the conic curvature
measures by
Φk (C, A) := Ωk (C, A × Rd ), b d ).
A ∈ B(R
b d ),
Then, for A, B ∈ B(R
Z d
X
Φk (C ∩ ϑD, A ∩ ϑB) ν(dϑ) = Φi (C, A)Φd+k−i (D, B).
SOd i=k
68 / 1
Some references:
68 / 1
Back to the initial question! It now has the following answer:
P (C ∩ ΘD 6= {o}) = E1 {C ∩ ΘD 6= {o}}
b d−1
2
c d
X X
= 2 vj (C)vd+2k+1−j (D)
k=0 j=2k+1
d−1
X d
X
= (1 + (−1)i+1 ) vj (C)vd+i−j (D).
i=1 j=i
69 / 1
Concentration of the conic intrinsic volumes
70 / 1
uk(c)
d(c)
Flc' 3' conctnratioh of conic in§insic.volumes' This plor displays thc conic inuinsic volumes,t(c) ofa circularcone c c Rtlt
withangler/6'Thedisributionccrnced'*te§rharplyaroundthe§iati§ticaldimensionä(C)^c32.5.SeeSection3:4lorfurther
discussi,on of this example.
71 / 1
The statistical dimension
Recall that the conic intrinsic volumes of a cone C satisfy
P(VC = k) = vk (C), k = 0, . . . , d.
By duality,
hence
VC ◦ ∼ d − VC
(where ∼ means equality in distribution).
72 / 1
Definition and Theorem. The statistical dimension of the cone
C ∈ C d is the number
d
X
δ(C) := EVC = kvk (C) = EkΠC (g)k2 .
k=0
= 1 − P(dist2 (g, C ◦ ) ≤ t)
d
X
= 1− P(Xd−k ≤ t)vk (C ◦ )
k =0
d
X
= 1− [1 − P(Xk > t)] vk (C)
k=0
d
X
= P(Xk > t)vk (C).
k=0
R∞
Since 0 P(Xk > t) dt = EXk = k, the assertion follows (then
approximation).
74 / 1
Properties of the statistical dimension:
• intrinsic
• δ(C) + δ(C ◦ ) = d
75 / 1
A variance estimate
By the same argument that above yielded
d
X
EkΠC (g)k2 = (EXk ) vk (C),
k=0
77 / 1
Possibly an improvement: Since VC ◦ ∼ d − VC , we have
Var VC = Var VC ◦
and hence
Var VC ≤ 2(δ(C) ∧ δ(C ◦ )),
where a ∧ b := min{a, b}.
78 / 1
Theorem 6. For a closed convex cone C, define
and
−λ2 /4
pC (λ) := exp for λ ≥ 0.
ω(C)2 + λ/3
Then
P(|VC − δ(C)| ≥ λ) ≤ pC (λ)
for λ ≥ 0.
79 / 1
Theorem 6. For a closed convex cone C, define
and
−λ2 /4
pC (λ) := exp for λ ≥ 0.
ω(C)2 + λ/3
Then
P(|VC − δ(C)| ≥ λ) ≤ pC (λ)
for λ ≥ 0.
Before saying a few words about the proof, we indicate how this
leads to estimates of
P(C ∩ ΘD 6= {o}).
79 / 1
Theorem 7. Let C ∈ C d , and let L be a subspace. Then the
following holds for λ ≥ 0:
80 / 1
Theorem 7. Let C ∈ C d , and let L be a subspace. Then the
following holds for λ ≥ 0:
b d−1
2
c d
X X
P (C ∩ ΘD 6= {o}) = 2 vj (C)vd+2k+1−j (D)
k=0 j=2k+1
81 / 1
Since, by the definition of VC ,
X
P(VC − δ(C) ≥ λ) = vk (C)
k≥δ(C)+λ
assumption m ≥ δ(C) + λ
X
≥ vk (C) = tm (C),
k≥m
we get
by Theorem 6.
82 / 1
Some remarks about the crucial
and
−λ2 /4
pC (λ) := exp for λ ≥ 0.
ω(C)2 + λ/3
Then
P(VC − δ(C) ≥ λ) ≤ pC (λ),
P(VC − δ(C) ≤ −λ) ≤ pC (λ)
for λ ≥ 0.
83 / 1
McCoy and Tropp derive it from the stronger
Theorem 8.
Let C ∈ C d . Define the function ψ by
P {VC − δ(C) ≥ λ}
1 λ ◦ −λ
≤ exp − max δ(C)ψ , δ(C )ψ
2 δ(C) δ(C ◦ )
and
84 / 1
Their proof first expresses the moment generating function of
the intrinsic volume random variable as
1
EeηVC = EeξkΠC (g)k with ξ =
2
1 − e−2η .
2
The proof uses the Master Steiner formula and the moment
generating functions of chi-square random variables.
85 / 1
After the special case C, L, where L is a subspace, it remains to
consider the case of two general cones C, D.
86 / 1
Some remarks about C × D
First remark:
Second remark:
Proof:
87 / 1
Z
2
δ(C ⊕ D) = EkΠC⊕D (g)k = kΠC⊕D (x)k2 γ2d (dx)
R2d
Z Z
= kΠC (y)k2 + kΠD (z)k2 γL2 (dz) γL1 (dy))
L1 L2
= δ(C) + δ(D).
Third remark:
X
vk (C × D) = vi (C)vj (D).
i+j=k
88 / 1
To prove X
vk (C × D) = vi (C)vj (D),
i+j=k
We have
89 / 1
Theorem 9. For closed convex cones C, D, define
and
−λ2 /4
pC,D (λ) := exp for λ ≥ 0.
σ(C, D)2 + λ/3
Then
P(|VC×D − δ(C × D)| ≥ λ) ≤ pC,D (λ)
for λ ≥ 0.
90 / 1
With this, we can write (if C, D are not both subspaces)
b d−1
2
c
X X
P(C ∩ ΘD 6= {o}) = 2 vi (C)vj (D)
k=0 i+j=d+2k+1
b d−1
2
c
X
= 2 vd+2k+1 (C × D)
k=0
= 2hd+1 (C × D).
91 / 1
Theorem 10. Let C, D ∈ C d be cones. Then, for λ ≥ 0,
92 / 1
Theorem 10. Let C, D ∈ C d be cones. Then, for λ ≥ 0,
Proof.
As shown before,
2hd+1 (C × D) ≤ td (C × D).
92 / 1
The assumption δ(C) + δ(D) ≤ d − λ gives
and hence
P(VC×D − δ(C × D) ≥ λ)
X X
= vk (C × D) ≥ vk (C × D) = td (C × D).
k≥δ(C×D)+λ k≥d
Thus,
by Theorem 9.
93 / 1