Commit Graph

502 Commits

Author SHA1 Message Date
hiyouga
d338ab3e19 fix #1068 #1074
Former-commit-id: d11a545463
2023-09-28 14:39:16 +08:00
hiyouga
650a2a2e01 update readme
Former-commit-id: 4eae061464
2023-09-27 21:57:47 +08:00
hiyouga
108c31e1fc support LongLoRA
Former-commit-id: 90375f600d
2023-09-27 21:55:50 +08:00
hiyouga
88f2e99c73 add CMMLU, update eval script
Former-commit-id: 4dd9b4d982
2023-09-23 21:10:17 +08:00
hiyouga
467c30d591 move file
Former-commit-id: badd2735b5
2023-09-23 11:52:12 +08:00
hiyouga
5ee1bdecdc add MMLU and C-Eval script
Former-commit-id: 465ee8119a
2023-09-23 00:34:17 +08:00
hiyouga
e930682152 fix #1000
Former-commit-id: 5cc7a44784
2023-09-22 15:00:48 +08:00
hiyouga
db21953bf0 update readme
Former-commit-id: 044d4425b4
2023-09-22 14:34:13 +08:00
hiyouga
d04585df59 tiny fix
Former-commit-id: ace3f85a72
2023-09-21 15:25:29 +08:00
hiyouga
65854736c3 update readme
Former-commit-id: acda45e463
2023-09-16 17:33:01 +08:00
hiyouga
1cd0ea1f13 add MathInstruct dataset
Former-commit-id: 026af87e7f
2023-09-13 22:30:14 +08:00
hiyouga
4e86462bad fix #762 #814
Former-commit-id: d4be857e23
2023-09-12 16:10:10 +08:00
hiyouga
4410387859 Release v0.1.8
Former-commit-id: ccb3553576
2023-09-11 17:31:34 +08:00
hiyouga
cf08bcf3d9 truncate readme
Former-commit-id: baac22f4f4
2023-09-10 21:04:20 +08:00
hiyouga
17bc66fce0 update readme
Former-commit-id: 63611de7ae
2023-09-10 21:01:20 +08:00
hiyouga
7a715aac55 update readme
Former-commit-id: 34005252df
2023-09-10 20:52:21 +08:00
hiyouga
8ab5566dc0 support FlashAttention2
Former-commit-id: d8aa1404be
2023-09-10 20:43:56 +08:00
hiyouga
c818a7ff60 support lora target auto find
Former-commit-id: bca1a247bc
2023-09-09 15:38:37 +08:00
hiyouga
c6265e6969 fix chatglm2 tokenizer
Former-commit-id: d8d82ca281
2023-09-09 13:50:29 +08:00
hiyouga
f74b980650 fix baichuan templates
Former-commit-id: 85b1f6632a
2023-09-07 18:54:14 +08:00
hiyouga
51f662860d update baichuan2 template
Former-commit-id: 0531886e1f
2023-09-06 21:43:06 +08:00
hiyouga
0ba72273d2 add Baichuan2 models
Former-commit-id: 60603a94c6
2023-09-06 18:40:11 +08:00
hiyouga
a4fd976048 refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: a9d1fb72f7
2023-09-01 19:00:45 +08:00
codemayq
d9b9d9d1fe add ad gen dataset
Former-commit-id: 604f85487b
2023-08-27 20:35:32 +08:00
hiyouga
802494e20a update template
Former-commit-id: 4318347d3f
2023-08-22 19:46:09 +08:00
hiyouga
03edfd07e7 fix PPO trainer #551 , update readme
Former-commit-id: 9020524418
2023-08-18 11:43:10 +08:00
hiyouga
e93e9641f5 update readme
Former-commit-id: e4eec9ddfd
2023-08-18 01:51:55 +08:00
hiyouga
fceca0bb6a update training resuming
Former-commit-id: 58f13e22da
2023-08-18 01:41:17 +08:00
hiyouga
327e14d3ea update readme
Former-commit-id: ff0aa793b6
2023-08-17 11:00:22 +08:00
hiyouga
5feb2eda89 update readme_zh
Former-commit-id: 2391a84e26
2023-08-14 11:13:25 +08:00
hiyouga
2bcf0025d6 update readme
Former-commit-id: 8a79ded55d
2023-08-12 21:29:06 +08:00
hiyouga
6af7fe15ad update readme
Former-commit-id: 3ea1fa35d1
2023-08-12 21:25:19 +08:00
hiyouga
8686e62dfa update readme
Former-commit-id: 2618e0b5a7
2023-08-12 21:23:05 +08:00
hiyouga
ba65dcb15e update readme
Former-commit-id: 1836c020c5
2023-08-12 21:00:11 +08:00
hiyouga
e86c4ef06c Update README_zh.md
Former-commit-id: 156710a995
2023-08-11 14:06:02 +08:00
hiyouga
abdfa26d06 support DPO training (2305.18290)
Former-commit-id: 3ec4351cfd
2023-08-11 03:02:53 +08:00
hiyouga
733b395822 update readme
Former-commit-id: 20cf27976f
2023-08-07 15:02:02 +08:00
codemayq
ee0f66aaef add detailed model configs
Former-commit-id: 293bd95712
2023-08-07 09:30:23 +08:00
hiyouga
9c84c4ed5d support Qwen-7B, fix InternLM-7B inference
Former-commit-id: 87f8f830e2
2023-08-03 15:53:32 +08:00
hiyouga
534e3320b5 release v0.1.5
Former-commit-id: c689857bbb
2023-08-02 16:10:31 +08:00
hiyouga
40d277ae5e update readme
Former-commit-id: ccde51c5ea
2023-08-01 18:48:27 +08:00
hiyouga
c5ad96375e fix RM save model
Former-commit-id: ac88ce5233
2023-08-01 11:56:17 +08:00
hiyouga
aa4335eac7 release v0.1.4
Former-commit-id: 973a638665
2023-08-01 10:08:47 +08:00
hiyouga
a437424381 update readme
Former-commit-id: 62dca5bb82
2023-07-31 23:42:32 +08:00
hiyouga
e80b75b560 support streaming data, fix #284 #274 #268
Former-commit-id: 0411a4b3e1
2023-07-31 23:33:00 +08:00
hiyouga
f65f0745cc update readme
Former-commit-id: 5ee87138e4
2023-07-28 17:36:00 +08:00
hiyouga
ba911f988d update dataset
Former-commit-id: f5c2ccdde4
2023-07-26 17:05:12 +08:00
hiyouga
c52dd3e86f fix #242
Former-commit-id: 00efa8a07f
2023-07-25 17:04:02 +08:00
hiyouga
d46c136c0e update dataset
Former-commit-id: 182b425043
2023-07-23 20:01:43 +08:00
hiyouga
d370fd724c Update README_zh.md
Former-commit-id: 6a2967ff7a
2023-07-22 14:31:16 +08:00