Currently, you would need to add chat templates manually, we should have a way to add them into the training in a more streamlined fashion.