Commit Graph

562 Commits

Author SHA1 Message Date
hiyouga
0fbaa42752 refactor constants
Former-commit-id: 3697a3dc9a
2023-11-10 14:16:10 +08:00
hiyouga
164559d01d update readme
Former-commit-id: b3572659f5
2023-11-09 16:00:24 +08:00
hiyouga
2627f95ac3 update readme (list in alphabetical order)
Former-commit-id: e1e04cb1f1
2023-11-06 17:18:12 +08:00
hiyouga
a919b6a478 update templates
Former-commit-id: a7eeb8e17c
2023-11-06 12:25:47 +08:00
hiyouga
a9db89a025 update data readme (zh)
Former-commit-id: cc8ffa10d8
2023-11-02 23:42:49 +08:00
hiyouga
a1b0655457 support sharegpt format, add datasets
Former-commit-id: a837172413
2023-11-02 23:10:04 +08:00
hiyouga
b3931f73cc update projects
Former-commit-id: 640a520108
2023-10-29 22:53:47 +08:00
hiyouga
dc8739066b add projects
Former-commit-id: 59f342e76f
2023-10-29 22:07:13 +08:00
hiyouga
bf0faf129d fix vicuna template
Former-commit-id: 52fc24d166
2023-10-27 22:15:25 +08:00
hiyouga
8babfe3b4c update readme
Former-commit-id: 4600c29e93
2023-10-27 19:19:03 +08:00
hiyouga
8a76b1e499 support chatglm3
Former-commit-id: 1c0ab9a908
2023-10-27 19:16:28 +08:00
hiyouga
d6c77d9196 reimplement neftune
Former-commit-id: 7b4acf7265
2023-10-22 16:15:08 +08:00
anvie
3635823fbe add NEFTune optimization
Former-commit-id: 57fb40aa04
2023-10-21 13:24:10 +07:00
hiyouga
95697652f1 fix #1232
Former-commit-id: b665e9e133
2023-10-20 23:28:52 +08:00
hiyouga
f6a8069159 fix #1217
Former-commit-id: 6496a99b7d
2023-10-19 15:52:24 +08:00
hoshi-hiyouga
aa67673c68 Update README.md
Former-commit-id: beacb798ea
2023-10-16 00:23:37 +08:00
hiyouga
fca1e451b5 update readme
Former-commit-id: f5d0da4d2a
2023-10-15 20:28:14 +08:00
hoshi-hiyouga
bff1709a8c Update README.md
Former-commit-id: 25d326e135
2023-10-15 20:23:22 +08:00
hiyouga
f3fa47fa7d refactor export, fix #1190
Former-commit-id: ea82f8a82a
2023-10-15 16:01:48 +08:00
hiyouga
64bf750a74 update readme
Former-commit-id: cb42676694
2023-10-13 13:53:43 +08:00
hiyouga
e2d412da02 update discord link
Former-commit-id: c4102f306a
2023-10-12 21:44:28 +08:00
hiyouga
819b5faa9a rename repository
Former-commit-id: 197c754d73
2023-10-12 21:42:29 +08:00
hiyouga
3ba788fc2c update readme
Former-commit-id: 8e2ed6b8ce
2023-10-09 20:02:50 +08:00
hiyouga
d338ab3e19 fix #1068 #1074
Former-commit-id: d11a545463
2023-09-28 14:39:16 +08:00
hiyouga
650a2a2e01 update readme
Former-commit-id: 4eae061464
2023-09-27 21:57:47 +08:00
hiyouga
108c31e1fc support LongLoRA
Former-commit-id: 90375f600d
2023-09-27 21:55:50 +08:00
hiyouga
88f2e99c73 add CMMLU, update eval script
Former-commit-id: 4dd9b4d982
2023-09-23 21:10:17 +08:00
hiyouga
467c30d591 move file
Former-commit-id: badd2735b5
2023-09-23 11:52:12 +08:00
hiyouga
5ee1bdecdc add MMLU and C-Eval script
Former-commit-id: 465ee8119a
2023-09-23 00:34:17 +08:00
hiyouga
e930682152 fix #1000
Former-commit-id: 5cc7a44784
2023-09-22 15:00:48 +08:00
hiyouga
db21953bf0 update readme
Former-commit-id: 044d4425b4
2023-09-22 14:34:13 +08:00
hiyouga
d04585df59 tiny fix
Former-commit-id: ace3f85a72
2023-09-21 15:25:29 +08:00
hiyouga
65854736c3 update readme
Former-commit-id: acda45e463
2023-09-16 17:33:01 +08:00
hiyouga
1cd0ea1f13 add MathInstruct dataset
Former-commit-id: 026af87e7f
2023-09-13 22:30:14 +08:00
hiyouga
4e86462bad fix #762 #814
Former-commit-id: d4be857e23
2023-09-12 16:10:10 +08:00
hiyouga
4410387859 Release v0.1.8
Former-commit-id: ccb3553576
2023-09-11 17:31:34 +08:00
hiyouga
cf08bcf3d9 truncate readme
Former-commit-id: baac22f4f4
2023-09-10 21:04:20 +08:00
hiyouga
17bc66fce0 update readme
Former-commit-id: 63611de7ae
2023-09-10 21:01:20 +08:00
hiyouga
7a715aac55 update readme
Former-commit-id: 34005252df
2023-09-10 20:52:21 +08:00
hiyouga
8ab5566dc0 support FlashAttention2
Former-commit-id: d8aa1404be
2023-09-10 20:43:56 +08:00
hiyouga
c818a7ff60 support lora target auto find
Former-commit-id: bca1a247bc
2023-09-09 15:38:37 +08:00
hiyouga
c6265e6969 fix chatglm2 tokenizer
Former-commit-id: d8d82ca281
2023-09-09 13:50:29 +08:00
hiyouga
f74b980650 fix baichuan templates
Former-commit-id: 85b1f6632a
2023-09-07 18:54:14 +08:00
hiyouga
51f662860d update baichuan2 template
Former-commit-id: 0531886e1f
2023-09-06 21:43:06 +08:00
hiyouga
0ba72273d2 add Baichuan2 models
Former-commit-id: 60603a94c6
2023-09-06 18:40:11 +08:00
hiyouga
a4fd976048 refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: a9d1fb72f7
2023-09-01 19:00:45 +08:00
codemayq
d9b9d9d1fe add ad gen dataset
Former-commit-id: 604f85487b
2023-08-27 20:35:32 +08:00
hiyouga
802494e20a update template
Former-commit-id: 4318347d3f
2023-08-22 19:46:09 +08:00
hiyouga
03edfd07e7 fix PPO trainer #551 , update readme
Former-commit-id: 9020524418
2023-08-18 11:43:10 +08:00
hiyouga
e93e9641f5 update readme
Former-commit-id: e4eec9ddfd
2023-08-18 01:51:55 +08:00