12 Commits

Author SHA1 Message Date
hiyouga
33bab0e7c1 update flashattn, fix ppo save model
Former-commit-id: 0fbece85a70222e5262a2295203de07ffe648fda
2023-09-11 17:25:36 +08:00
hiyouga
6a71361a54 remove PeftTrainer
Former-commit-id: b218c271edfb07006ddc34b1aca404088de6c528
2023-09-10 22:23:23 +08:00
hiyouga
43a20c67d4 fix bug in DPO data collator
Former-commit-id: 90bd085ae4c2775f1e82e045ab0157a451774082
2023-09-08 20:45:07 +08:00
hiyouga
e6fa0229f4 fix #809
Former-commit-id: e2bf7c3badbd5d2fd513ca7a00bd74d9c0d62d07
2023-09-07 19:04:32 +08:00
hiyouga
a4fd976048 refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: a9d1fb72f791ae57a4d12f4e3a7e2abccf6a7077
2023-09-01 19:00:45 +08:00
hiyouga
0d0232479f fix import error
Former-commit-id: 2de1a7610a78e41680970b9f308741f98df489fa
2023-08-23 20:45:03 +08:00
hiyouga
38080233a5 fix #649
Former-commit-id: 57146c101f3e8f688b016a44c85e8ad5d1b6f938
2023-08-23 20:21:15 +08:00
hiyouga
d05d535a58 fix #617
Former-commit-id: 5235b15c9181f2b68f7d6caa9a6324b8570d3d0c
2023-08-21 18:16:11 +08:00
hiyouga
fceca0bb6a update training resuming
Former-commit-id: 58f13e22da18babed0d2d4348474e07745da8fa5
2023-08-18 01:41:17 +08:00
hiyouga
2aa2c363ad fix ChatGLM lm_head #494
Former-commit-id: d0199568081f46e5d338ea511266eb420dd43594
2023-08-14 14:14:48 +08:00
hiyouga
e75024fde3 fix #480
Former-commit-id: 2f2fd55d8175eb3c6ce94bc821ab4e6331f79d8e
2023-08-14 00:23:56 +08:00
hiyouga
abdfa26d06 support DPO training (2305.18290)
Former-commit-id: 3ec4351cfdaf2aefcc7d13345e19d79874ed61d3
2023-08-11 03:02:53 +08:00