You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
<img alt="Masked Autoencoder for Distribution Estimation" src="https://raw.githubusercontent.com/janosh/diagrams/main/assets/made/made.svg">
36
36
</picture>
37
37
</a>
38
38
@@ -54,10 +54,10 @@
54
54
description: |
55
55
They introduce the affine coupling layer (RNVP), a major improvement in terms of flexibility over the additive coupling layer (NICE) with unit Jacobian while keeping a single-pass forward and inverse transformation for fast sampling and density estimation, respectively.
<img alt="Diagram of real-valued non-volume preserving (RNVP) coupling layer" src="https://raw.githubusercontent.com/janosh/diagrams/main/assets/rnvp/rnvp.svg">
61
61
</picture>
62
62
</a>
63
63
@@ -92,10 +92,10 @@
92
92
description: |
93
93
Introduces MAF, a stack of autoregressive models forming a normalizing flow suitable for fast density estimation but slow at sampling. Analogous to Inverse Autoregressive Flow (IAF) except the forward and inverse passes are exchanged. Generalization of RNVP.
<img alt="Diagram of the slow (sequential) forward pass of a Masked Autoregressive Flow (MAF) layer" src="https://raw.githubusercontent.com/janosh/tikz/main/assets/maf/maf.svg">
<img alt="Diagram of the slow (sequential) forward pass of a Masked Autoregressive Flow (MAF) layer" src="https://raw.githubusercontent.com/janosh/diagrams/main/assets/maf/maf.svg">
99
99
</picture>
100
100
</a>
101
101
@@ -156,7 +156,7 @@
156
156
- name: Jongyoon Song
157
157
- name: Jaehyeon Kim
158
158
- name: Sungroh Yoon
159
-
description: A flow-based generative model for raw audo synthesis.
159
+
description: A flow-based generative model for raw audio synthesis.
Copy file name to clipboardExpand all lines: readme.md
+14-14Lines changed: 14 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,14 +13,14 @@
13
13
14
14
A list of awesome resources for understanding and applying normalizing flows (NF): a relatively simple yet powerful new tool in statistics for constructing expressive probability distributions from simple base distributions using a chain (flow) of trainable smooth bijective transformations (diffeomorphisms).
<img alt="Diagram of the slow (sequential) forward pass of a Masked Autoregressive Flow (MAF) layer" src="https://raw.githubusercontent.com/janosh/tikz/main/assets/normalizing-flow/normalizing-flow.svg">
<img alt="Diagram of the slow (sequential) forward pass of a Masked Autoregressive Flow (MAF) layer" src="https://raw.githubusercontent.com/janosh/diagrams/main/assets/normalizing-flow/normalizing-flow.svg">
20
20
</picture>
21
21
</a>
22
22
23
-
<sup>_Figure inspired by [Lilian Weng](https://lilianweng.github.io/lil-log/2018/10/13/flow-based-deep-generative-models). Created in TikZ.[View source](https://github.com/janosh/tikz/tree/main/assets/normalizing-flow)._</sup>
23
+
<sup>_Figure inspired by [Lilian Weng](https://lilianweng.github.io/lil-log/2018/10/13/flow-based-deep-generative-models). Created in [CeTZ](https://cetz-package.github.io).[View source](https://github.com/janosh/diagrams/blob/main/assets/normalizing-flow/normalizing-flow.typ)._</sup>
24
24
25
25
<br>
26
26
@@ -183,7 +183,7 @@ A list of awesome resources for understanding and applying normalizing flows (NF
183
183
Introduces autoregressive-like convolutional layers that operate on the channel **and** spatial axes. This improved upon the performance of image datasets compared to the standard 1x1 Convolutions. The trade-off is that the inverse operator is quite expensive however the authors provide a fast C++ implementation. [[Code](https://github.com/ehoogeboom/emerging)]
184
184
185
185
1. 2018-11-06 - [FloWaveNet : A Generative Flow for Raw Audio](https://arxiv.org/abs/1811.02155) by Kim, Lee et al.<br>
186
-
A flow-based generative model for raw audo synthesis. [[Code](https://github.com/ksw0306/FloWaveNet)]
186
+
A flow-based generative model for raw audio synthesis. [[Code](https://github.com/ksw0306/FloWaveNet)]
187
187
188
188
1. 2018-10-02 - [FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models](https://arxiv.org/abs/1810.01367) by Grathwohl, Chen et al.<br>
189
189
Uses Neural ODEs as a solver to produce continuous-time normalizing flows (CNF).
@@ -206,10 +206,10 @@ A list of awesome resources for understanding and applying normalizing flows (NF
206
206
1. 2017-05-19 - [Masked Autoregressive Flow for Density Estimation](https://arxiv.org/abs/1705.07057) by Papamakarios, Pavlakou et al.<br>
207
207
Introduces MAF, a stack of autoregressive models forming a normalizing flow suitable for fast density estimation but slow at sampling. Analogous to Inverse Autoregressive Flow (IAF) except the forward and inverse passes are exchanged. Generalization of RNVP.
<img alt="Diagram of the slow (sequential) forward pass of a Masked Autoregressive Flow (MAF) layer" src="https://raw.githubusercontent.com/janosh/tikz/main/assets/maf/maf.svg">
<img alt="Diagram of the slow (sequential) forward pass of a Masked Autoregressive Flow (MAF) layer" src="https://raw.githubusercontent.com/janosh/diagrams/main/assets/maf/maf.svg">
213
213
</picture>
214
214
</a>
215
215
@@ -222,10 +222,10 @@ A list of awesome resources for understanding and applying normalizing flows (NF
222
222
1. 2016-05-27 - [Density estimation using Real NVP](https://arxiv.org/abs/1605.08803) by Dinh, Sohl-Dickstein et al.<br>
223
223
They introduce the affine coupling layer (RNVP), a major improvement in terms of flexibility over the additive coupling layer (NICE) with unit Jacobian while keeping a single-pass forward and inverse transformation for fast sampling and density estimation, respectively.
0 commit comments