-
Notifications
You must be signed in to change notification settings - Fork 303
Open
Labels
GemmaGemma model specific issuesGemma model specific issuestype:featureNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe.
A LLM fine-tuned with Keras3 cannot be served on any modern engine such as vllm, hexllm, sglang, etc because they all require Huggingface format.
Describe the solution you'd like
A model.export_to_hf(...) method that saves the fine-tuned preset to huggingface/safetensor format (not just an upload to the HF hub).
Describe alternatives you've considered
For Gemma 1 you already have a utility tools/gemma/export_gemma_to_hf.py. It does not work as intended for Gemma2 and 3 is not supported at all. we'd like such a tool for all supported models.
We have already considered maxtext, but it is unnecessarily complicated
Additional context
reachtarunhere
Metadata
Metadata
Assignees
Labels
GemmaGemma model specific issuesGemma model specific issuestype:featureNew feature or requestNew feature or request