demo of DPO with QLoRA (w Llama3 70B Instruct)#858
Open
anchen1011 wants to merge 2 commits intoOptimalScale:mainfrom
Open
demo of DPO with QLoRA (w Llama3 70B Instruct)#858anchen1011 wants to merge 2 commits intoOptimalScale:mainfrom
anchen1011 wants to merge 2 commits intoOptimalScale:mainfrom