hiyouga
4a6cb33f0c
Update bug-report.yml
...
Former-commit-id: 438c37456707e6d3b0fc74799507d00197948977
2023-11-16 19:37:35 +08:00
hiyouga
1fd8f1eb72
add issue template
...
Former-commit-id: 9e0bfcfc14c8652428742dde66a1c6a1bf625cdf
2023-11-16 19:35:30 +08:00
hoshi-hiyouga
39735b5750
Update issue templates
...
Former-commit-id: dea176f88ee60866b9a5f91a0c4755b74bc010c0
2023-11-16 18:56:30 +08:00
hiyouga
8454e02313
fix web ui demo
...
Former-commit-id: 10ce87e088ae5934c4c3e61e9d0556cd5378308c
2023-11-16 18:41:55 +08:00
hiyouga
be0fb659d2
fix web ui demo
...
Former-commit-id: 1c80e9a09ed9fce0809e2b893d946306df0f9f7c
2023-11-16 17:12:23 +08:00
hiyouga
11af6c1e39
release v0.3.0
...
Former-commit-id: c4facc03af20d15d5b09ec77dc3742138db68f9d
v0.3.0
2023-11-16 16:00:11 +08:00
hiyouga
763a9305d0
update readme
...
Former-commit-id: 72e6699547d4fd0a20f61225f7a4b2c054ec035b
2023-11-16 15:58:37 +08:00
hoshi-hiyouga
550293badc
Merge #1525 from hiyouga/dev, fix #224 #336 #931 #936 #1011
...
Refactor llmtuner, support full-parameter RLHF
Former-commit-id: f04bc2a42815d02c22935fec8bf7b81438c8ba79
2023-11-16 15:47:13 +08:00
hiyouga
11de514cc6
fix css
...
Former-commit-id: 08f3c114292676699a1921d4395f268a54763428
2023-11-16 15:45:38 +08:00
hiyouga
3f53155a90
fix bug in web ui
...
Former-commit-id: 6efa38be46ed536f80fc67002f23862edcb9df8d
2023-11-16 15:21:24 +08:00
hiyouga
e4f97615f0
update ppo and demo in webui
...
Former-commit-id: 7537dd434f4c0f0bde06bd8c2ac69bf622772316
2023-11-16 14:55:26 +08:00
hiyouga
0ed0b8f9c5
fix bug in freeze tuning
...
Former-commit-id: ff52b1779c909819d0aef83d3f7ea663199cbe54
2023-11-16 14:25:11 +08:00
hiyouga
627212e48b
tiny fix
...
Former-commit-id: 83cee2a6049b8287de1b5ebf41b2a0728e235b11
2023-11-16 03:27:19 +08:00
hiyouga
678052a7ef
fix rlhf callback
...
Former-commit-id: 1817ffc86fe3463ea91e9359c0e3611979a9d53e
2023-11-16 03:26:19 +08:00
hiyouga
b71da932eb
fix bug in PPO training
...
Former-commit-id: 856522a3df4bb9ddfaaa137119eceb9574873950
2023-11-16 02:32:54 +08:00
hiyouga
eb5a852dd5
fix import bug
...
Former-commit-id: 35b91ea34caade45dd51813b94da5177b852aa4c
2023-11-16 02:27:03 +08:00
hiyouga
f441932bd1
support full-parameter PPO
...
Former-commit-id: ce783036001397a20b0b4c5da2fea6d0c03389d2
2023-11-16 02:08:04 +08:00
hiyouga
0c1fab84f1
add demo mode for web UI
...
Former-commit-id: 8350bcf85d5e59b63da46b540c6ad860e8419d9e
2023-11-15 23:51:26 +08:00
hoshi-hiyouga
2ec5c734f3
Create CODE_OF_CONDUCT.md
...
Former-commit-id: 01b9f63465d60108186a7db932fecd92a3d5d8e1
2023-11-15 20:42:15 +08:00
hiyouga
3e0b76650a
update readme and constants
...
Former-commit-id: 1e19cf242a1f843b590feefbe24b2cc0a17712b5
2023-11-15 18:04:37 +08:00
hiyouga
e30290444a
support multiple modules in freeze training #1514
...
Former-commit-id: 4907452d955367ebe987e6deae4fd4213628f2b2
2023-11-15 17:08:18 +08:00
hiyouga
4a0be64ae6
fix imports
...
Former-commit-id: bbbce1f516840f722247edd37057d16502ea0557
2023-11-15 16:47:45 +08:00
hiyouga
06a4820836
disentangle model from tuner and rename modules
...
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
2023-11-15 16:29:09 +08:00
hiyouga
8ee48a9c9e
fix #1507
...
Former-commit-id: 2f02f688e15db8bf8f0dad3b7284863998c207a3
2023-11-15 16:22:32 +08:00
hiyouga
2ba88c6b08
Update cal_lr.py
...
Former-commit-id: 829e879e040cae3b49ace981b3d4a8eaf1e0c4ae
2023-11-14 21:14:42 +08:00
hiyouga
426c2fc340
Update cal_lr.py
...
Former-commit-id: 5619e76dc5aa22bd77da80c33a6e52adb4f517d5
2023-11-14 21:13:01 +08:00
hiyouga
b45fb2b3da
Update cal_lr.py
...
Former-commit-id: fcb2daf7f37af2833404ee8f45b538705a2ce7b3
2023-11-14 21:09:30 +08:00
hiyouga
fffb8ea764
add cal_lr.py
...
Former-commit-id: 42c8fc4fb970775159a68a123d5c7bedb701c8cf
2023-11-14 20:58:37 +08:00
hiyouga
8387f3011c
fix #1494
...
Former-commit-id: d125ef55358837d4d76943739afeb6c70a901cd7
2023-11-14 18:07:20 +08:00
hiyouga
9176b55fe6
fix #1489
...
Former-commit-id: 3743b7420b823c5a56aef6100121d89b677ffb0e
2023-11-14 15:27:05 +08:00
hiyouga
5c4ddebde5
support eval remote dataset
...
Former-commit-id: 2d42be32c1b32b26548ea5af5fc3c810f4d668c1
2023-11-14 02:42:30 +08:00
hiyouga
42bb8b6400
fix dc link
...
Former-commit-id: 88ab33254e02dce7437786fd2d153411118c4594
2023-11-13 23:22:56 +08:00
hiyouga
4a767e5593
release v0.2.2, fix #1478 #1466
...
Former-commit-id: 35cc1e28f675889c44f75a0a3194005c7f23631b
v0.2.2
2023-11-13 23:09:05 +08:00
hiyouga
37db26800c
fix #424
...
Former-commit-id: 87390ae3b70f654d520b9aadb335c9650130a42c
2023-11-13 22:42:23 +08:00
hiyouga
125587b187
refactor evaluation, upgrade trl to 074
...
Former-commit-id: 442aefb925c4ff02b98aa30c49c2e01d04f6496a
2023-11-13 22:20:35 +08:00
hiyouga
d83cf3cbc6
Update wechat.jpg
...
Former-commit-id: 528d91192ab87588e2a751708b0e87ac4ebd37a4
2023-11-12 22:34:19 +08:00
hiyouga
982e0e79c2
fix flashattn warning
...
Former-commit-id: 4bd8e3906d09bf6ec4b8f6b553a347fca9db4f80
2023-11-10 18:34:54 +08:00
hiyouga
55e097aaac
add todo
...
Former-commit-id: a0c31c68c4909637b86c90c319c321fd887c4910
2023-11-10 14:38:18 +08:00
hiyouga
0fbaa42752
refactor constants
...
Former-commit-id: 3697a3dc9a0be8141951dfe65812844f66059517
2023-11-10 14:16:10 +08:00
hiyouga
6ee32cf71c
tiny fix
...
Former-commit-id: 415bca900e5cc3afaddd5b06d35f472d9ead3263
2023-11-09 17:20:49 +08:00
hoshi-hiyouga
9b98790fb3
Merge pull request #1454 from yyq/main
...
Update finetuning_args.py
Former-commit-id: 462730cbd742e8598bfd3e01839165e80f50c531
2023-11-09 17:12:18 +08:00
Yanqing
fc05fd52cf
Update finetuning_args.py
...
更新 chatglm/falcon/bloom 的 lora_target 的名称
Former-commit-id: 3684dffa14ca0551d51027467c0134b884ed1c59
2023-11-09 17:04:40 +08:00
hiyouga
4dbb52750f
fix #1452
...
Former-commit-id: 0e86527d7fae9c9fe0df89d6fbd89035c9d83fe3
2023-11-09 16:41:32 +08:00
hiyouga
164559d01d
update readme
...
Former-commit-id: b3572659f562756375f879b0a97e42d4e2129f54
v0.2.1
2023-11-09 16:00:24 +08:00
hiyouga
c5b202d5c6
release v0.2.1
...
Former-commit-id: 1db59832fd4239e8f70cff2cab8376589550a9df
2023-11-09 15:54:16 +08:00
hiyouga
38755bced7
add template, modify datasets
...
Former-commit-id: 386f590209e466b51c17a7ac8cee55fc3ce928d7
2023-11-09 15:53:23 +08:00
hoshi-hiyouga
28a9176784
Merge pull request #1436 from lvzii/main
...
fix tokenizer config changed after pretrain
Former-commit-id: 7ca32d8e69d5a2790b8ac323f6e6d0aea42600e7
2023-11-09 14:30:50 +08:00
hiyouga
f9ebc718d0
support parquet format #1446
...
Former-commit-id: 3df90b988bd987daa4e3a991c32ae53446481dcd
2023-11-09 14:17:40 +08:00
hiyouga
b9f42172dd
fix #1438 #1439
...
Former-commit-id: 33422e1feff706bb7cfb235b9e40bd2e124222be
2023-11-09 13:45:10 +08:00
lvzi
13eb365eb7
fix tokenizer config changed after pretrain
...
Changing tokenizer's attribute at preprocessing stage will result in saving a wrong tokenizer.
for example, baichuan2
Former-commit-id: 043c316ac8913e10b2274867033f194ea92bfcd6
2023-11-08 15:50:46 +08:00