Commit Graph

1727 Commits

Author SHA1 Message Date
hiyouga
b45fb2b3da Update cal_lr.py
Former-commit-id: fcb2daf7f3
2023-11-14 21:09:30 +08:00
hiyouga
fffb8ea764 add cal_lr.py
Former-commit-id: 42c8fc4fb9
2023-11-14 20:58:37 +08:00
hiyouga
8387f3011c fix #1494
Former-commit-id: d125ef5535
2023-11-14 18:07:20 +08:00
hiyouga
9176b55fe6 fix #1489
Former-commit-id: 3743b7420b
2023-11-14 15:27:05 +08:00
hiyouga
5c4ddebde5 support eval remote dataset
Former-commit-id: 2d42be32c1
2023-11-14 02:42:30 +08:00
hiyouga
42bb8b6400 fix dc link
Former-commit-id: 88ab33254e
2023-11-13 23:22:56 +08:00
hiyouga
4a767e5593 release v0.2.2, fix #1478 #1466
Former-commit-id: 35cc1e28f6
2023-11-13 23:09:05 +08:00
hiyouga
37db26800c fix #424
Former-commit-id: 87390ae3b7
2023-11-13 22:42:23 +08:00
hiyouga
125587b187 refactor evaluation, upgrade trl to 074
Former-commit-id: 442aefb925
2023-11-13 22:20:35 +08:00
hiyouga
d83cf3cbc6 Update wechat.jpg
Former-commit-id: 528d91192a
2023-11-12 22:34:19 +08:00
hiyouga
982e0e79c2 fix flashattn warning
Former-commit-id: 4bd8e3906d
2023-11-10 18:34:54 +08:00
hiyouga
55e097aaac add todo
Former-commit-id: a0c31c68c4
2023-11-10 14:38:18 +08:00
hiyouga
0fbaa42752 refactor constants
Former-commit-id: 3697a3dc9a
2023-11-10 14:16:10 +08:00
hiyouga
6ee32cf71c tiny fix
Former-commit-id: 415bca900e
2023-11-09 17:20:49 +08:00
hoshi-hiyouga
9b98790fb3 Merge pull request #1454 from yyq/main
Update finetuning_args.py

Former-commit-id: 462730cbd7
2023-11-09 17:12:18 +08:00
Yanqing
fc05fd52cf Update finetuning_args.py
更新 chatglm/falcon/bloom 的 lora_target 的名称

Former-commit-id: 3684dffa14
2023-11-09 17:04:40 +08:00
hiyouga
4dbb52750f fix #1452
Former-commit-id: 0e86527d7f
2023-11-09 16:41:32 +08:00
hiyouga
164559d01d update readme
Former-commit-id: b3572659f5
2023-11-09 16:00:24 +08:00
hiyouga
c5b202d5c6 release v0.2.1
Former-commit-id: 1db59832fd
2023-11-09 15:54:16 +08:00
hiyouga
38755bced7 add template, modify datasets
Former-commit-id: 386f590209
2023-11-09 15:53:23 +08:00
hoshi-hiyouga
28a9176784 Merge pull request #1436 from lvzii/main
fix tokenizer config changed after pretrain

Former-commit-id: 7ca32d8e69
2023-11-09 14:30:50 +08:00
hiyouga
f9ebc718d0 support parquet format #1446
Former-commit-id: 3df90b988b
2023-11-09 14:17:40 +08:00
hiyouga
b9f42172dd fix #1438 #1439
Former-commit-id: 33422e1fef
2023-11-09 13:45:10 +08:00
lvzi
13eb365eb7 fix tokenizer config changed after pretrain
Changing tokenizer's attribute at preprocessing stage will result in saving a wrong tokenizer.
for example, baichuan2

Former-commit-id: 043c316ac8
2023-11-08 15:50:46 +08:00
hiyouga
91f406cc99 fix ppo train and dpo eval
Former-commit-id: 01260d9754
2023-11-07 22:48:51 +08:00
hiyouga
100dc4c458 fix #1422
Former-commit-id: 11c1e1e157
2023-11-07 19:42:01 +08:00
hiyouga
ed584b9f52 fix reward model loading
Former-commit-id: c52336d144
2023-11-07 17:20:51 +08:00
hiyouga
b446582bfd fix args
Former-commit-id: d92f112951
2023-11-07 16:36:06 +08:00
hiyouga
53fcc531b5 update info
Former-commit-id: 17c64a0579
2023-11-07 16:28:21 +08:00
hiyouga
1f2c56bff9 delete file
Former-commit-id: 479d0af2dc
2023-11-07 16:20:12 +08:00
hiyouga
d843efc413 fix #1418
Former-commit-id: 7ebd63a609
2023-11-07 16:17:22 +08:00
hiyouga
3d40bdb600 upgrade peft, fix #1088 #1411
Former-commit-id: b2a60905f3
2023-11-07 16:13:36 +08:00
hiyouga
936297aeac update requirements
Former-commit-id: 66a91e1fe3
2023-11-06 19:01:21 +08:00
hiyouga
5c19786f7c use seed in evaluate.py
Former-commit-id: de95b69282
2023-11-06 18:17:51 +08:00
hiyouga
2627f95ac3 update readme (list in alphabetical order)
Former-commit-id: e1e04cb1f1
2023-11-06 17:18:12 +08:00
hiyouga
a919b6a478 update templates
Former-commit-id: a7eeb8e17c
2023-11-06 12:25:47 +08:00
hiyouga
ecdea0036c fix #1383
Former-commit-id: 2e77a5718a
2023-11-06 11:42:23 +08:00
hiyouga
034b658348 fix deepseek template
Former-commit-id: d08f5e8a14
2023-11-05 13:08:46 +08:00
hiyouga
04107b7af6 support deepseek coder #1378
Former-commit-id: 2a8a258195
2023-11-05 12:51:03 +08:00
hiyouga
0d488085b8 fix #1365
Former-commit-id: 63ff909310
2023-11-05 12:21:07 +08:00
hiyouga
c2302a3e70 Update wechat.jpg
Former-commit-id: 5227e18c44
2023-11-05 10:25:59 +08:00
hiyouga
983779c474 tiny fix
Former-commit-id: 05d9fc7eff
2023-11-03 01:26:06 +08:00
hiyouga
574a7d175c fix #1290
Former-commit-id: eb9d9e104a
2023-11-03 00:44:53 +08:00
hiyouga
5507014392 fix bug in data loader, support dpo eval
Former-commit-id: b355f6cac9
2023-11-03 00:34:26 +08:00
hiyouga
b2bf10661b update data readme
Former-commit-id: 2b5e33c338
2023-11-03 00:15:23 +08:00
hiyouga
a9db89a025 update data readme (zh)
Former-commit-id: cc8ffa10d8
2023-11-02 23:42:49 +08:00
hiyouga
a1b0655457 support sharegpt format, add datasets
Former-commit-id: a837172413
2023-11-02 23:10:04 +08:00
hiyouga
89c1a80920 support pagination in webui preview
Former-commit-id: c1edb0cf1b
2023-11-02 21:21:45 +08:00
hiyouga
c3fab5307b fix webui
Former-commit-id: 34d8b2e56c
2023-11-02 18:03:14 +08:00
hiyouga
11ff5d1e43 support warning in webui
Former-commit-id: 9cde5e8af6
2023-11-02 17:57:04 +08:00