Skip to content

Commit 27e6a1d

Browse files
EnayatUllahfacebook-github-bot
authored andcommitted
Updating Opacus' website and tutorial to include Ghost Clipping DP-SGD (#667)
Summary: Pull Request resolved: #667 We update an existing tutorial on fine-tuning a language model, but now also with GC DP-SGD. Reviewed By: HuanyuZhang Differential Revision: D61411180 fbshipit-source-id: 515d1a112e5cb9b0ba562128c0a0a7ec7d2a985d
1 parent 4823344 commit 27e6a1d

File tree

3 files changed

+131
-39
lines changed

3 files changed

+131
-39
lines changed

tutorials/building_text_classifier.ipynb

Lines changed: 119 additions & 34 deletions
Large diffs are not rendered by default.

website/pages/tutorials/index.js

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -72,6 +72,13 @@ class TutorialHome extends React.Component {
7272
Efficient Per-Sample Gradient Computation for More Layers in Opacus
7373
</a>
7474
</li>
75+
<li>
76+
<a
77+
href="https://pytorch.org/blog/clipping-in-opacus/"
78+
target="_blank">
79+
Enabling Fast Gradient Clipping and Ghost Clipping in Opacus
80+
</a>
81+
</li>
7582
</ol>
7683
<h4>Videos*</h4>
7784
<p>* Note that Opacus API has changed over time and some of the code samples and demos in the videos may not work. The concepts presented in the videos though are concrete and still valid.</p>

website/tutorials.json

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
{
22
"Using Opacus": [
33
{
4-
"id": "building_image_classifier",
5-
"title": "Building image classifier with Differential Privacy"
4+
"id": "building_text_classifier",
5+
"title": "Building text classifier with Fast Gradient Clipping DP-SGD"
66
},
77
{
8-
"id": "building_text_classifier",
9-
"title": "Building text classifier with Differential Privacy"
8+
"id": "building_image_classifier",
9+
"title": "Building image classifier with Differential Privacy"
1010
},
1111
{
1212
"id": "building_lstm_name_classifier",
@@ -27,6 +27,6 @@
2727
{
2828
"id": "ddp_tutorial",
2929
"title": "Training on multiple GPUs with DistributedDataParallel"
30-
}
30+
}
3131
]
3232
}

0 commit comments

Comments
 (0)