Commit Graph

87 Commits

Author SHA1 Message Date
hiyouga
71cfdc2658 release v0.5.0 2024-01-20 20:21:39 +08:00
hiyouga
638234ceee format style 2024-01-20 20:15:56 +08:00
hiyouga
8cbe4e9609 add upcast_lmhead option 2024-01-19 23:54:25 +08:00
hiyouga
b6ec112beb add bf16 lora option 2024-01-19 16:29:03 +08:00
hiyouga
5edf7cce0e fix rm dataset 2024-01-18 14:45:37 +08:00
hiyouga
d9f1cae351 support function calling 2024-01-18 09:54:23 +08:00
hiyouga
42859f0734 support export push_to_hub #2183 2024-01-16 23:59:42 +08:00
hiyouga
a83fb6d3ff fix #2195 2024-01-16 23:53:50 +08:00
hiyouga
65c5b0477c fix args 2023-12-28 18:47:19 +08:00
hiyouga
e165354fac fix export format 2023-12-28 18:40:46 +08:00
hiyouga
6629087e12 update loader 2023-12-24 19:10:23 +08:00
hiyouga
e44b82ee24 update patcher 2023-12-23 15:24:27 +08:00
hiyouga
0bbf7118df fix #1909 2023-12-23 14:42:20 +08:00
hiyouga
7aad0b889d support unsloth 2023-12-23 00:14:33 +08:00
hiyouga
ba69378841 fix param type 2023-12-21 17:33:01 +08:00
hiyouga
71a9c16171 fix tokenizer for Yi chat models #1617 #1875 2023-12-18 17:18:11 +08:00
hiyouga
b87c74289d support dpo-ftx 2023-12-16 19:21:41 +08:00
hiyouga
3524aa1e58 support quantization in export model 2023-12-15 23:44:50 +08:00
hiyouga
0716f5e470 refactor adapter hparam 2023-12-15 20:53:11 +08:00
hiyouga
3a8a50d4d4 remove loftq 2023-12-13 01:53:46 +08:00
hiyouga
6219dfbd93 support loftq 2023-12-12 22:47:06 +08:00
hiyouga
0a9c6e0146 support system column #1765 2023-12-12 19:45:59 +08:00
hiyouga
d5b2c57a35 fix modelscope data hub 2023-12-12 18:33:06 +08:00
hoshi-hiyouga
6382efec52 Merge branch 'main' into feat/support_ms 2023-12-12 17:55:32 +08:00
xingjun.wang
09533e95ed update args for MsDataset.load 2023-12-12 13:02:54 +08:00
hiyouga
8cace77808 update readme 2023-12-12 11:44:30 +08:00
hiyouga
28d5de7e78 fix #1784 2023-12-09 20:53:18 +08:00
yuze.zyz
9c2247d700 support ms dataset 2023-12-08 18:00:57 +08:00
hiyouga
7df4f3ab20 implement rm server #1543 2023-12-03 20:52:54 +08:00
hiyouga
bd42c229b0 patch modelscope 2023-12-01 22:53:15 +08:00
hoshi-hiyouga
00f5c9ee16 Merge branch 'main' into feat/support_ms 2023-12-01 20:23:46 +08:00
hiyouga
a5a248d569 fix err hint 2023-12-01 17:13:22 +08:00
yuze.zyz
d38a2e7341 support ms 2023-11-29 20:36:55 +08:00
hiyouga
475a3fa0f4 fix #1659 2023-11-28 20:52:28 +08:00
hiyouga
859a6ea942 support export size setting 2023-11-26 18:34:09 +08:00
hiyouga
5021062493 update ppo trainer 2023-11-20 21:39:15 +08:00
Yuchen Han
b24635d22b Update finetuning_args.py 2023-11-17 00:15:51 -08:00
hiyouga
1817ffc86f fix rlhf callback 2023-11-16 03:26:19 +08:00
hiyouga
856522a3df fix bug in PPO training 2023-11-16 02:32:54 +08:00
hiyouga
ce78303600 support full-parameter PPO 2023-11-16 02:08:04 +08:00
hiyouga
4907452d95 support multiple modules in freeze training #1514 2023-11-15 17:08:18 +08:00
hiyouga
d125ef5535 fix #1494 2023-11-14 18:07:20 +08:00
hiyouga
442aefb925 refactor evaluation, upgrade trl to 074 2023-11-13 22:20:35 +08:00
hiyouga
a0c31c68c4 add todo 2023-11-10 14:38:18 +08:00
hiyouga
415bca900e tiny fix 2023-11-09 17:20:49 +08:00
Yanqing
3684dffa14 Update finetuning_args.py
更新 chatglm/falcon/bloom 的 lora_target 的名称
2023-11-09 17:04:40 +08:00
hiyouga
01260d9754 fix ppo train and dpo eval 2023-11-07 22:48:51 +08:00
hiyouga
479d0af2dc delete file 2023-11-07 16:20:12 +08:00
hiyouga
b2a60905f3 upgrade peft, fix #1088 #1411 2023-11-07 16:13:36 +08:00
hiyouga
cc8ffa10d8 update data readme (zh) 2023-11-02 23:42:49 +08:00