-
Notifications
You must be signed in to change notification settings - Fork 372
Open
Labels
enhancementNew feature or requestNew feature or request
Description
🚀 Feature
Augmentation multiplicity as explained in Section 3.1 of https://arxiv.org/abs/2204.13650. Before clipping gradients, we may average gradients over different augmentations.
Motivation
Paper shows improved results compared to no augmentation.
If my understanding is correct, currently this could be implemented by averaging over different augmentations in the loss function, but I am not 100% sure this is correct.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request