Commit Graph

675 Commits

Author SHA1 Message Date
hiyouga
45405a4ec1 Update wechat.jpg
Former-commit-id: 15cec650c7
2023-08-27 01:21:31 +08:00
codemayq
292abfd438 add text format dataset preview in webui
Former-commit-id: 24e68d29f2
2023-08-24 19:45:36 +08:00
codemayq
2b979d39f2 add stage in DatasetAttr
Former-commit-id: ba94c8729d
2023-08-23 20:54:53 +08:00
hiyouga
0d0232479f fix import error
Former-commit-id: 2de1a7610a
2023-08-23 20:45:03 +08:00
hiyouga
38080233a5 fix #649
Former-commit-id: 57146c101f
2023-08-23 20:21:15 +08:00
codemayq
b032dc4c4e add readme for dataset
Former-commit-id: cece66d48a
2023-08-23 19:55:45 +08:00
codemayq
4b29d9d2b0 add dataset stage and filter dataset when stage chosen in webui
Former-commit-id: c0e4d1e81b
2023-08-23 18:54:23 +08:00
hiyouga
2accde2cb7 fix webui
Former-commit-id: 1c702ad538
2023-08-23 11:03:35 +08:00
hoshi-hiyouga
1512891efc Merge pull request #644 from hiyouga/fix-quantization_bit
fix quantization bit is ""

Former-commit-id: c562307476
2023-08-23 10:45:45 +08:00
codemayq
433a96b8c2 fix quantization bit is ""
Former-commit-id: a7cc6c4140
2023-08-23 10:08:17 +08:00
codemayq
7b82ea708d fix quantization is ""
Former-commit-id: ec2047b064
2023-08-23 10:04:03 +08:00
hiyouga
802494e20a update template
Former-commit-id: 4318347d3f
2023-08-22 19:46:09 +08:00
hoshi-hiyouga
1bbdd60843 Merge pull request #629 from panpan0000/main
add rm dataset explanation

Former-commit-id: 4da719c830
2023-08-22 13:41:44 +08:00
Peter Pan
23443e9696 add rm dataset explanation
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>

Former-commit-id: b0ca8fe634
2023-08-22 01:33:59 -04:00
hoshi-hiyouga
a80cd5d86b Merge pull request #619 from hiyouga/feature-templateTest
add template encode test

Former-commit-id: bc7795655f
2023-08-21 20:56:34 +08:00
codemayq
4b83d692b1 add template encode test
Former-commit-id: cbbee7933e
2023-08-21 20:51:24 +08:00
hiyouga
d05d535a58 fix #617
Former-commit-id: 5235b15c91
2023-08-21 18:16:11 +08:00
hiyouga
e6f4eab4ab fix #608
Former-commit-id: 02d69b6fde
2023-08-21 17:49:36 +08:00
hiyouga
d3bef03dc6 fix baichuan template for training #597 #616
Former-commit-id: 0a3f698425
2023-08-21 17:41:51 +08:00
hiyouga
fa15416024 fix #595
Former-commit-id: 5c052836a0
2023-08-20 16:40:00 +08:00
hoshi-hiyouga
d24ece4a57 Merge pull request #596 from beat4ocean/beat
fix KeyError: 'lang' bug

Former-commit-id: 1968d9d1d0
2023-08-20 16:37:40 +08:00
beat4ocean
c81d1d40fa fix KeyError: 'lang' bug
Former-commit-id: 7b45de6b9f
2023-08-20 15:32:36 +08:00
hiyouga
570ccc3618 fix ppo trainer #551
Former-commit-id: 0676497104
2023-08-20 14:07:11 +08:00
hiyouga
8f9f618bcc Update wechat.jpg
Former-commit-id: 290be836b7
2023-08-19 18:03:36 +08:00
hiyouga
acaac6df9e Release v0.1.7
Former-commit-id: 9c9009f49f
2023-08-18 17:21:27 +08:00
hiyouga
9f1688924d tiny fix
Former-commit-id: d75e377b0f
2023-08-18 13:07:35 +08:00
hiyouga
b88f0b396c support ppo score norm (trl 0.5.1.dev required)
Former-commit-id: 53e33418d0
2023-08-18 12:02:42 +08:00
hiyouga
03edfd07e7 fix PPO trainer #551 , update readme
Former-commit-id: 9020524418
2023-08-18 11:43:10 +08:00
hiyouga
e93e9641f5 update readme
Former-commit-id: e4eec9ddfd
2023-08-18 01:51:55 +08:00
hiyouga
429a9e2512 Update .gitignore
Former-commit-id: 10cd6c9171
2023-08-18 01:43:42 +08:00
hiyouga
fceca0bb6a update training resuming
Former-commit-id: 58f13e22da
2023-08-18 01:41:17 +08:00
hoshi-hiyouga
f128cfe880 Merge pull request #434 from niuba/main
add last_checkpoint support

Former-commit-id: 7926432d27
2023-08-18 01:38:31 +08:00
hoshi-hiyouga
49d4ae3704 Merge branch 'main' into main
Former-commit-id: 7252903245
2023-08-18 01:37:23 +08:00
hiyouga
66771352bb support bf16 ppo #551
Former-commit-id: d125218cde
2023-08-18 00:40:32 +08:00
hiyouga
caf4a61e21 fix ChatGLM2 ppo #527 #528
Former-commit-id: 9f4c2adc9a
2023-08-18 00:34:59 +08:00
hiyouga
623a34b16f fix generation bug #532
Former-commit-id: be21fc83f9
2023-08-17 22:21:34 +08:00
hiyouga
a46f277477 fix streaming in pt stage #548 #549
Former-commit-id: b0ed0dec5e
2023-08-17 17:59:26 +08:00
hiyouga
327e14d3ea update readme
Former-commit-id: ff0aa793b6
2023-08-17 11:00:22 +08:00
hiyouga
3021a01b71 fix baichuan and intern template
Former-commit-id: 892fd39373
2023-08-17 01:27:20 +08:00
hiyouga
048f99354f fix generation
Former-commit-id: d9e62711a3
2023-08-16 22:39:54 +08:00
hiyouga
edc15c62fa fix system prompt
Former-commit-id: 7407d9daa1
2023-08-16 01:35:52 +08:00
hiyouga
2ceaecfb42 fix baichuan template #481
Former-commit-id: 273135f595
2023-08-15 11:38:21 +08:00
hoshi-hiyouga
c73e4de046 Merge pull request #516 from liuyanyi/add_gitignore
[Enhance] Add .gitignore file

Former-commit-id: 7f35487c4a
2023-08-15 11:25:40 +08:00
hiyouga
a9ab8f71d7 fix ChatGLM RLHF
Former-commit-id: af6c011fcb
2023-08-15 11:19:20 +08:00
hiyouga
603cb30887 Update wechat.jpg
Former-commit-id: a7dd9611db
2023-08-15 11:13:46 +08:00
Yanyi Liu
d37be06aa0 Add .gitignore
Former-commit-id: 448478f938
2023-08-15 11:13:45 +08:00
hiyouga
d15fe288df alert pad_token source
Former-commit-id: 80b4053602
2023-08-15 00:07:56 +08:00
hiyouga
02a61b08b1 update webui
Former-commit-id: 9d0f6214b6
2023-08-14 22:45:26 +08:00
hoshi-hiyouga
d021d31a9c Merge pull request #511 from hiyouga/feature-autoTemplate
add template match and stage in webui

Former-commit-id: adb0f186e9
2023-08-14 22:44:04 +08:00
codemayq
4a4623cf2d auto match template when change model_name
Former-commit-id: 0bf892ff1a
2023-08-14 20:56:05 +08:00