Search results

Implement Margin distributions on the feedforward layer in a Transformers model

Experiment

Status: Open.

#9 In Emiller00/pytorch_generalization;

· Emiller00 opened on Feb 2, 2025

Run experiment comparing Margin distributions against Generalization predictions using Neural Function Transformers.

Experiment

Status: Open.

#8 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 25, 2024

Update documentation with full instructions on how to reproduce the margin distribution experiment, with the code used in the PGDL competition

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#7 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 22, 2024

Implement Mouton et al's paper "Input margins can predict generalization too"

New Generalization Algorithm

Status: Open.

#6 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 22, 2024

Implement Natekar et al's paper "Representation Based Complexity Measures for Predicting Generalization in Deep Learning"

New Generalization Algorithm

Status: Open.

#5 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 22, 2024

Ensure Margin distributions can be properly calculated in dense layers

enhancementNew feature or requestNew feature or request

Status: Open.

#4 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 22, 2024

Provide Jupyter notebook to demonstrate how to visualize a margin distribution

good first issueGood for newcomersGood for newcomers

Status: Open.

#3 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 22, 2024

Profile performance of the margin distribution calculation

good first issueGood for newcomersGood for newcomers

Status: Open.

#2 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 22, 2024

Add runable script to perform the complete experiment done in the PGDL competition

Status: Open.

#1 In Emiller00/pytorch_generalization;

· Emiller00 opened on Dec 22, 2024