Skip to content

Commit 53dbf97

Browse files
authored
make cce default to true when using the plugin (axolotl-ai-cloud#2562) [skip ci]
1 parent 2c2563b commit 53dbf97

File tree

3 files changed

+1
-4
lines changed

3 files changed

+1
-4
lines changed

examples/llama-4/scout-qlora-single-h100-flex.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,6 @@ plugins:
1010
liger_glu_activation: true
1111
liger_rms_norm: true
1212
liger_layer_norm: true
13-
cut_cross_entropy: true
1413

1514
llama4_linearized_experts: true # needed with custom linearized experts model
1615
load_in_4bit: true

src/axolotl/integrations/cut_cross_entropy/README.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,8 +27,6 @@ pip3 uninstall -y cut-cross-entropy && pip3 install "cut-cross-entropy[transform
2727
```yaml
2828
plugins:
2929
- axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin
30-
31-
cut_cross_entropy: true
3230
```
3331
3432
## Supported Models

src/axolotl/integrations/cut_cross_entropy/args.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ class CutCrossEntropyArgs(BaseModel):
2828
Input args for Cut Cross Entropy.
2929
"""
3030

31-
cut_cross_entropy: Optional[bool] = None
31+
cut_cross_entropy: Optional[bool] = True
3232

3333
@model_validator(mode="before")
3434
@classmethod

0 commit comments

Comments
 (0)