You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/SPECTRAL_DUAL_LABEL.md
+57-18Lines changed: 57 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ boundary. It does not change defaults, mathematics, or public controls.
10
10
Two different exponents appear when talking about power-law spectra:
11
11
12
12
1. A **density-law** exponent on the eigenvalue density (public HTSR-style α).
13
-
2. A **rank-order** exponent on ordered eigenvalues \(λ_{(r)}\).
13
+
2. A **rank-order** exponent on ordered eigenvalues \(\lambda_{(r)}\).
14
14
15
15
They are related under an **ideal continuous** power-law model, but they are not
16
16
the same control knob. Logging or plotting only one label under the name “alpha”
@@ -23,27 +23,60 @@ control (see also `SCIENTIFIC_INTEGRITY_POLICY.md`).
23
23
24
24
---
25
25
26
-
## 2. Symbols
26
+
## 2. Symbols (collision box)
27
27
28
28
| Symbol | Meaning | In this repo |
29
29
|---|---|---|
30
-
|**Density α** / `target_alpha`| Target for the density-law / WW-style α used by the adapter |**Public** config + manifests; default `2.0`|
31
-
|**Rank-order exponent μ_rank**| Ideal continuous map for ordered eigenvalues |**Derived** at the adapter as \(μ_{\mathrm{rank}} = 1/(α - 1)\); often logged as `derived_external_rank_exponent`|
32
-
|**MP q / Q**| Marchenko–Pastur **aspect ratio**|**Reserved** — do **not** use `q` for the rank-order exponent in joint tables |
30
+
|**Density α** / `target_alpha`| Target for the density-law / WW-style α: \(\rho(\lambda)\propto\lambda^{-\alpha}\) on a fitted tail |**Public** config + manifests; default `2.0`|
31
+
|**Rank-order exponent \(\mu_{\mathrm{rank}}\)**| Ideal continuous map for ordered eigenvalues |**Derived** at the adapter as \(\mu_{\mathrm{rank}} = 1/(\alpha - 1)\); log as `derived_external_rank_exponent`|
32
+
|**MP \(q\) / \(Q\)**| Marchenko–Pastur **aspect ratio**\(N/M\)|**Reserved** — do **not** use bare `q` for the rank-order exponent |
33
+
|**\(\mu_{\mathrm{entry}}\)** (HTSR theory) | Heavy-tailed matrix-**element** tail index (Universality class parameter) |**Not** a public control here; **not** the same object as \(\mu_{\mathrm{rank}}\)|
33
34
34
-
Ideal correspondence (continuous pure power law, α > 1):
35
+
### Ideal density ↔ rank map
36
+
37
+
Continuous pure power law, \(\alpha > 1\) (Newman / Zipf–Pareto algebra):
35
38
36
39
\[
37
-
μ_{\mathrm{rank}} = \frac{1}{α - 1},
40
+
\mu_{\mathrm{rank}} = \frac{1}{\alpha - 1},
38
41
\qquad
39
-
α = 1 + \frac{1}{μ_{\mathrm{rank}}}.
42
+
\alpha = 1 + \frac{1}{\mu_{\mathrm{rank}}}.
40
43
\]
41
44
42
-
Fixed point of that map: **α = 2 ⇔ μ_rank = 1**.
45
+
Fixed point of that map: **α = 2 ⇔ \(\mu_{\mathrm{rank}} = 1\)**.
43
46
44
47
This is an **exponent correspondence under ideal assumptions**, not independent
45
-
evidence that a fitted spectrum is at an RG fixed point. Finite spectra, truncated
46
-
fit windows, and fit noise make the empirical relationship approximate.
48
+
evidence that a fitted spectrum is at an RG fixed point. Finite spectra,
49
+
\(x_{\min}\) selection, truncated tails, and fit noise make the empirical
So **α = 2 corresponds to \(\mu_{\mathrm{entry}} = 2\)** — the VHT / MHT class
66
+
boundary — under that asymptotic VHT map. In the Moderately-Heavy-Tailed class
67
+
the relation is \(\alpha = a\mu + b\) with **strong finite-size** dependence on
68
+
\(M,N\) (Eq. A.4b); do not treat the linear VHT map as universal across classes.
69
+
70
+
**Collision warning:**\(\mu_{\mathrm{entry}}\cdot\mu_{\mathrm{rank}} = 2\) under the
71
+
two ideal maps above is an **algebraic coincidence**, not an identity of
72
+
objects. Always tag which μ you mean.
73
+
74
+
### Eigenvalue vs singular-value density
75
+
76
+
WeightWatcher-style ESDs are usually built from eigenvalues of \(X = W^\top W\)
77
+
(or a scaled form). If \(s = \sqrt{\lambda}\), density exponents convert as
78
+
\(\alpha_s = 2\alpha_\lambda - 1\). A “rank exponent” also needs an
79
+
eigenvalue-vs-singular-value label when comparing notebooks.
47
80
48
81
---
49
82
@@ -54,8 +87,9 @@ When writing analysis code or extending projection CSVs:
54
87
| Do | Don’t |
55
88
|---|---|
56
89
| Keep density `target_alpha` and derived rank exponent as **separate columns**| Overwrite one field with the other |
57
-
| Name the rank column after the map (`derived_external_rank_exponent` / μ_rank) | Call the rank exponent `q` (conflicts with MP aspect) |
90
+
| Name the rank column after the map (`derived_external_rank_exponent` / \(\mu_{\mathrm{rank}}\)) | Call the rank exponent `q` (conflicts with MP aspect) |
58
91
| Record which α convention a WeightWatcher fit used | Assume every package’s “alpha” column is the same estimator |
92
+
| Tag \(\mu_{\mathrm{entry}}\) if you ever log HTSR class maps | Use bare `mu` for both entry-tail and rank-order |
59
93
60
94
Projection / dual-label rows introduced for readability (e.g. density α next to
61
95
derived rank exponent on projection artifacts) are **logging clarity**, not a
@@ -67,19 +101,24 @@ second public training target.
67
101
68
102
`target_alpha = 2.0` is the repository’s default **public spectral target** for
69
103
WW-PGD arms. In broader HTSR discussion, α = 2 is often used as a **boundary**
70
-
marker on plots. Those uses are related but not identical:
104
+
marker on plots (VHT/MHT class boundary via \(\mu_{\mathrm{entry}}\); operational
105
+
“near 2” quality language). Those uses are related but not identical:
71
106
72
107
-**Control:** what the adapter aims at (`target_alpha`).
73
-
-**Description:** where a fitted layer α sits relative to 2 on a baseline plot.
108
+
-**Description:** where a fitted layer α sits relative to 2 on a baseline plot.
109
+
-**Theory class boundary:**\(\mu_{\mathrm{entry}} = 2\) under the VHT map (A.4a).
74
110
75
-
Neither use, by itself, implies a derived universal critical exponent from scale
76
-
counting alone, nor that every healthy run must sit exactly at 2.
111
+
None of these, by itself, implies a **derived universal critical exponent from
112
+
scale counting alone**, nor that every healthy run must sit exactly at 2, nor
113
+
that “α > 2 means random-like” (moderately heavy-tailed spectra commonly sit
114
+
above 2; random-like is an MP / phase statement).
77
115
78
116
---
79
117
80
118
## 5. Related
81
119
82
120
- Root README — public experiment interface (`wwpgd.target_alpha` only).
83
121
-`docs/SCIENTIFIC_INTEGRITY_POLICY.md` — no fabricated fits; rank exponent not independently scannable.
0 commit comments