EKS example has bad paths

[jimburtoft]

System Info

The Hyperpod training example:
https://huggingface.co/docs/optimum-neuron/training_tutorials/pretraining_hyperpod_llm

depends on a dockerfile that refers to a clm_run script that doesn't exist in its location.  Maybe it was moved?  

https://github.com/huggingface/optimum-neuron/blob/f86ca4bd63e322837bd634d2feb929ae52f9309b/docs/source/training_tutorials/amazon_eks/Dockerfile#L35

Who can help?

@michaelbenayoun

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction (minimal, reproducible, runnable)

View the cp command in the Dockerfile and then look in the project path:

optimum-neuron/docs/source/training_tutorials/amazon_eks/Dockerfile

Line 35 in f86ca4b

RUN cp -r optimum-neuron/examples/language-modeling/requirements.txt workspace/requirements.txt

Expected behavior

I haven't run it, but the paths look off. I would expect that it at leasts refers to directories that exist.

[michaelbenayoun]

Hi @jimburtoft , yes I already notified the team that worked on this example that we had updated things, but for now it has not been updated. We should sync with them, especially with all the refactoring we have been doing since then.