117 Commits

Author SHA1 Message Date
hiyouga
4966bd7911 support GPTQ tuning #729 #1481 #1545 , fix chatglm template #1453 #1480 #1569
Former-commit-id: 9ea93801459b0d271d21a2d730c44abae9106c51
2023-11-20 22:52:11 +08:00
hiyouga
f06c4c8f7a update ppo trainer
Former-commit-id: 5021062493ed63ad1f6133cfb543e4e7f528d2cc
2023-11-20 21:39:15 +08:00
hiyouga
a7b1632ace fix value head model resuming
Former-commit-id: 2a36fd5064f028f394ac07c25440fd5e965a07b8
2023-11-20 19:01:37 +08:00
hiyouga
682d81caa9 fix #1567
Former-commit-id: 99a3f06377d2886c4000ce7e3583b12ca965534d
2023-11-20 18:46:36 +08:00
hiyouga
d1e03512f4 fix model card network issue
Former-commit-id: 211b2db5a8290f6b52f0a076de56fcc2b06671d6
2023-11-19 23:03:19 +08:00
hiyouga
48d6d925f7 fix #1558
Former-commit-id: 1740131d63d32aefc0370441baf4716ddb5ebcfe
2023-11-19 14:15:47 +08:00
hiyouga
112108d564 fix evaluator and cached_file in 4.31.0
Former-commit-id: ff6056405dea8e89a95fd3741fd309d3c7679896
2023-11-18 19:39:23 +08:00
hiyouga
0d98d1a28c fix quantization
Former-commit-id: ccb0f58e22f55b15531fd0e85f5935b150575bec
2023-11-17 22:21:29 +08:00
hiyouga
f9df6c17ed fix #1550
Former-commit-id: 1bbc1be95eedf0796c0b311568dff8c75f87dfbb
2023-11-17 17:23:13 +08:00
hiyouga
3f53155a90 fix bug in web ui
Former-commit-id: 6efa38be46ed536f80fc67002f23862edcb9df8d
2023-11-16 15:21:24 +08:00
hiyouga
0ed0b8f9c5 fix bug in freeze tuning
Former-commit-id: ff52b1779c909819d0aef83d3f7ea663199cbe54
2023-11-16 14:25:11 +08:00
hiyouga
678052a7ef fix rlhf callback
Former-commit-id: 1817ffc86fe3463ea91e9359c0e3611979a9d53e
2023-11-16 03:26:19 +08:00
hiyouga
b71da932eb fix bug in PPO training
Former-commit-id: 856522a3df4bb9ddfaaa137119eceb9574873950
2023-11-16 02:32:54 +08:00
hiyouga
eb5a852dd5 fix import bug
Former-commit-id: 35b91ea34caade45dd51813b94da5177b852aa4c
2023-11-16 02:27:03 +08:00
hiyouga
f441932bd1 support full-parameter PPO
Former-commit-id: ce783036001397a20b0b4c5da2fea6d0c03389d2
2023-11-16 02:08:04 +08:00
hiyouga
e30290444a support multiple modules in freeze training #1514
Former-commit-id: 4907452d955367ebe987e6deae4fd4213628f2b2
2023-11-15 17:08:18 +08:00
hiyouga
06a4820836 disentangle model from tuner and rename modules
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
2023-11-15 16:29:09 +08:00