[P0] Additional intervention arguments are not saved correctly, e.g. add_bias
#82
Labels
bug
Something isn't working
add_bias
#82
Descriptions:
For customizable interventions, people might want to save the interventions with their customized arguments. For instance, the dropout ratio, the activation function type or whether to add a special bias term to any projection matrix. Currently, these additional arguments are not saved.
The main change will be done in
pyvene
tracked by this parent PR: stanfordnlp/pyvene#157. After the parent PR is checked in, we should also verifypyreft
works with updatedpyvene library
.The text was updated successfully, but these errors were encountered: