Commit Graph

120 Commits

Author SHA1 Message Date
hiyouga
abdfa26d06 support DPO training (2305.18290)
Former-commit-id: 3ec4351cfd
2023-08-11 03:02:53 +08:00
hiyouga
4898a0a865 restore from git lfs
Former-commit-id: b9cdff41bb
2023-08-01 16:33:25 +08:00
hiyouga
3b8e33d91c use git lfs
Former-commit-id: 82e793ddb4
2023-08-01 10:14:08 +08:00
hiyouga
ba911f988d update dataset
Former-commit-id: f5c2ccdde4
2023-07-26 17:05:12 +08:00
hiyouga
d46c136c0e update dataset
Former-commit-id: 182b425043
2023-07-23 20:01:43 +08:00
hiyouga
261ca840d0 update readme, fix web ui postprocess
Former-commit-id: 035c966d5c
2023-07-22 14:29:22 +08:00
mrhan1993
cdd887908c 根据GLM Efficient Tuning添加中文README,web添加了server_port
Former-commit-id: 9f0b57b370
2023-07-21 16:57:58 +08:00
hiyouga
fa47c99fa9 add datasets
Former-commit-id: 7159bc54ed
2023-07-19 20:59:15 +08:00
hiyouga
2b0fced03b fix Baichuan-13B
Former-commit-id: 08439d29b2
2023-07-13 23:08:45 +08:00
zxbsmk
3b15aacf02 Support for WebNovel dataset
Former-commit-id: 4955dc9eed
2023-07-12 17:29:47 +08:00
hiyouga
92070c3d7a add open assistant dataset
Former-commit-id: 3154fec979
2023-06-28 23:09:33 +08:00
hiyouga
9155401bf9 add belle multiturn dataset
Former-commit-id: 334d1a6d26
2023-06-16 20:01:16 +08:00
hiyouga
1fbda5d139 support RM metrics, add generating Args
Former-commit-id: cec6524d6b
2023-06-12 15:48:48 +08:00
BUAADreamer
465264f852 update json line file to .jsonl
Former-commit-id: e3b53a67c7
2023-06-11 18:59:19 +08:00
BUAADreamer
c4128832e5 add some
Former-commit-id: 676d910260
2023-06-11 18:55:53 +08:00
BUAADreamer
b1c6ee9cf5 add code for reading from multi files in one directory
Former-commit-id: a2af9df5a9
2023-06-10 16:27:30 +08:00
BUAADreamer
53727aee3e add code for reading from multi files in one directory
Former-commit-id: 3dd5f9a874
2023-06-10 15:53:47 +08:00
hiyouga
ddb456bbcb remove dummy code
Former-commit-id: a72492e649
2023-05-30 16:28:00 +08:00
hiyouga
4c7c96e656 add pre-training script
Former-commit-id: 8ff96509fa
2023-05-29 21:37:22 +08:00
hiyouga
54b8ce7b63 Initial commit
Former-commit-id: 769c6ab56b
2023-05-28 18:09:04 +08:00