Skip to content

Conversation

abidlabs
Copy link

@abidlabs abidlabs commented Sep 22, 2025

This PR adds trackio experiment tracking and visualization directly to the gpt-oss-(20B)-Fine-tuning notebook. This is useful as it lets users track and visualize key metrics locally:

image

I started with the gpt-oss-(20B)-Fine-tuning notebook as Trackio is also included in the openai cookbook recipe for finetuning gpt-oss, but the same 2-line change should work for most of the Unsloth AI notebooks!

This notebook demonstrates the integration: https://colab.research.google.com/github/abidlabs/notebooks/blob/add-trackio/nb/gpt-oss-(20B)-Fine-tuning.ipynb
And here is Trackio's documentation: https://huggingface.co/docs/trackio/en/index

@abidlabs abidlabs changed the title Add trackio experiment tracking and visualization directly within the colab notebook Add trackio experiment tracking and visualization directly within the gpt-oss-(20B)-Fine-tuning notebook Sep 22, 2025
@abidlabs abidlabs marked this pull request as ready for review September 22, 2025 18:53
@rolandtannous
Copy link
Contributor

hello i've just added this to the unsloth official container image if you're interested.
For more information on how to use our containers: https://docs.unsloth.ai/new/how-to-train-llms-with-unsloth-and-docker

@abidlabs
Copy link
Author

abidlabs commented Oct 1, 2025

Thanks @rolandtannous! I checked out the official unsloth container image:

% docker run -d -e JUPYTER_PASSWORD="mypassword" \
  -p 8888:8888 -p 2222:22 \
  -v $(pwd)/work:/workspace/work \
  unsloth/unsloth

and looked through the notebooks. I didn't see the reporting to trackio:

image

Am I missing something?

@rolandtannous
Copy link
Contributor

trackio has been added to the packages, so it's readily available to import, just like wandb and tensorboard but it's up to the user to set it up in the notebook. I don't think we'll be standardizing that :). More like leaving it up to the user based on their preferences.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants