15 Commits

Author SHA1 Message Date
hiyouga
d6c77d9196 reimplement neftune
Former-commit-id: 7b4acf7265b04cc4a674b3dcafdb90e76f149e39
2023-10-22 16:15:08 +08:00
anvie
3635823fbe add NEFTune optimization
Former-commit-id: 57fb40aa04fec11ca165a97ea463579faeaeebe7
2023-10-21 13:24:10 +07:00
hiyouga
f3fa47fa7d refactor export, fix #1190
Former-commit-id: ea82f8a82a7356bbdf204190d596d0b1c8ef1a84
2023-10-15 16:01:48 +08:00
hiyouga
2562376f84 fix ppo args
Former-commit-id: 11bd271364488d523d5117ec2ea26f39853175b7
2023-10-11 23:40:50 +08:00
hiyouga
927ff702ff refactor finetuning Args
Former-commit-id: 620efe1d8d2429f4bc3fa8009900ec43e1b5ef4b
2023-09-27 22:28:06 +08:00
hiyouga
802494e20a update template
Former-commit-id: 4318347d3f1982c773dad1074636ec7b550770fd
2023-08-22 19:46:09 +08:00
hiyouga
b88f0b396c support ppo score norm (trl 0.5.1.dev required)
Former-commit-id: 53e33418d02ee0f34c783e30ae510b811308c598
2023-08-18 12:02:42 +08:00
hiyouga
03edfd07e7 fix PPO trainer #551 , update readme
Former-commit-id: 90205244186df558cd6b0000728d638348db3a10
2023-08-18 11:43:10 +08:00
hiyouga
79f4ba0d26 Release v0.1.6
Former-commit-id: a48cb0d474ef0648a97387daf5f623498b5e3ee6
2023-08-11 23:25:57 +08:00
hiyouga
abdfa26d06 support DPO training (2305.18290)
Former-commit-id: 3ec4351cfdaf2aefcc7d13345e19d79874ed61d3
2023-08-11 03:02:53 +08:00
hiyouga
921778a7cf update args spec
Former-commit-id: 5453b93db04ee26223b7616dfdf26e749bea7473
2023-08-07 15:23:35 +08:00
hiyouga
9c84c4ed5d support Qwen-7B, fix InternLM-7B inference
Former-commit-id: 87f8f830e20aa839e089559c1d038954742000ef
2023-08-03 15:53:32 +08:00
hiyouga
2e0342dc54 fix #194
Former-commit-id: 8f7819fcaa00f6ddcf59552c2866d8fc5659d0e9
2023-07-19 17:07:33 +08:00
hiyouga
b8b38a9ade create chat model
Former-commit-id: 657cf0f55a7f0886bc837bdd44528971dc5e5caa
2023-07-15 19:26:20 +08:00
hiyouga
a696148d6b modity code structure
Former-commit-id: f75137661358f9070bc70c341dfa2cc5fd69cf94
2023-07-15 16:54:28 +08:00