You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+28-28
Original file line number
Diff line number
Diff line change
@@ -11,13 +11,14 @@ issues currently open.
11
11
12
12
## Latest Updates
13
13
14
-
2020-12-21: A new
15
-
[vectorized version of the TF 2 optimizer](https://github.com/tensorflow/privacy/blob/master/tensorflow_privacy/privacy/optimizers/dp_optimizer_keras_vectorized.py)
16
-
is available, which can deliver much faster performance. We recommend trying it
17
-
first, and to fall back to using the original non-vectorized version only if
18
-
this fails. We are thankful to the
19
-
[authors of this paper](https://arxiv.org/abs/2010.09063) for spurring this
20
-
change.
14
+
2023-02-21: A new implementation of efficient per-example gradient clipping is
15
+
now available for
16
+
[DP keras models](https://github.com/tensorflow/privacy/tree/master/tensorflow_privacy/privacy/keras_models)
17
+
consisting only of Dense and Embedding layers. The models use the fast gradient
18
+
calculation results of [this paper](https://arxiv.org/abs/1510.01799). The
19
+
implementation should allow for doing DP training without any meaningful memory
20
+
or runtime overhead. It also removes the need for tuning the number of
21
+
microbatches as it clips the gradient with respect to each example.
21
22
22
23
## Setting up TensorFlow Privacy
23
24
@@ -32,11 +33,11 @@ installation documentation).
32
33
33
34
In addition to TensorFlow and its dependencies, other prerequisites are:
34
35
35
-
*`scipy` >= 0.17
36
+
*`scipy` >= 0.17
36
37
37
-
*`mpmath` (for testing)
38
+
*`mpmath` (for testing)
38
39
39
-
*`tensorflow_datasets` (for the RNN tutorial `lm_dpsgd_tutorial.py` only)
40
+
*`tensorflow_datasets` (for the RNN tutorial `lm_dpsgd_tutorial.py` only)
40
41
41
42
### Installing TensorFlow Privacy
42
43
@@ -84,18 +85,16 @@ GitHub pull requests. To speed the code review process, we ask that:
84
85
## Tutorials directory
85
86
86
87
To help you get started with the functionalities provided by this library, we
87
-
provide a detailed walkthrough [here](tutorials/walkthrough/README.md) that
88
-
will teach you how to wrap existing optimizers
89
-
(e.g., SGD, Adam, ...) into their differentially private counterparts using
90
-
TensorFlow (TF) Privacy. You will also learn how to tune the parameters
91
-
introduced by differentially private optimization and how to
92
-
measure the privacy guarantees provided using analysis tools included in TF
93
-
Privacy.
94
-
95
-
In addition, the
96
-
`tutorials/` folder comes with scripts demonstrating how to use the library
97
-
features. The list of tutorials is described in the README included in the
98
-
tutorials directory.
88
+
provide a detailed walkthrough [here](tutorials/walkthrough/README.md) that will
89
+
teach you how to wrap existing optimizers (e.g., SGD, Adam, ...) into their
90
+
differentially private counterparts using TensorFlow (TF) Privacy. You will also
91
+
learn how to tune the parameters introduced by differentially private
92
+
optimization and how to measure the privacy guarantees provided using analysis
93
+
tools included in TF Privacy.
94
+
95
+
In addition, the `tutorials/` folder comes with scripts demonstrating how to use
96
+
the library features. The list of tutorials is described in the README included
97
+
in the tutorials directory.
99
98
100
99
NOTE: the tutorials are maintained carefully. However, they are not considered
101
100
part of the API and they can change at any time without warning. You should not
@@ -110,8 +109,8 @@ directory, but rather intended as a convenient archive.
110
109
111
110
## TensorFlow 2.x
112
111
113
-
TensorFlow Privacy now works with TensorFlow 2! You can use the new
114
-
Keras-based estimators found in
112
+
TensorFlow Privacy now works with TensorFlow 2! You can use the new Keras-based
0 commit comments