Marco
a26f68ba47
Update dataset_info.json
...
Added the Nectar dataset already preprocessed and divided in sft and rl to which I added a preprompt to each instruction since it has been seen that this increase instruction following
Former-commit-id: 9468ee9012bfe7124fc5cc2acebcfe03a6d0cdee
2023-11-30 16:21:34 +01:00
hiyouga
3d291a82d3
fix #1597
...
Former-commit-id: 327d7f7efe1fefe4bf4646c07fc4917a42c13383
2023-11-30 21:47:06 +08:00
hiyouga
ba6d290d0b
fix #1668
...
Former-commit-id: 1585962eb7ed042890d4c56422aae749c669dda8
2023-11-30 21:02:00 +08:00
hiyouga
bb6b4823ad
fix #1682
...
Former-commit-id: a38dbf55e32a18838eea7f254fd9022fe33bca08
2023-11-30 20:03:32 +08:00
hiyouga
1c43fb6a41
add models
...
Former-commit-id: 509abe8864ada29ac7fa0f636b662531c8dd3a33
2023-11-30 19:16:13 +08:00
hiyouga
8ec3617f19
add gpu requirement #1657
...
Former-commit-id: 9d38e5687d6edd692a33f10729450e8d9e0ab0bf
2023-11-29 12:05:03 +08:00
hiyouga
ecfc7d1b50
fix #1658
...
Former-commit-id: 77d1b14fc2d9703d15bbd879f67df037db9fbb28
2023-11-28 20:57:24 +08:00
hiyouga
ae1048db6d
fix #1659
...
Former-commit-id: 475a3fa0f4c09d4cfd55ec66271a6d3c9eb5f4d2
2023-11-28 20:52:28 +08:00
hiyouga
33dc25e24f
Update wechat.jpg
...
Former-commit-id: c2d4300ac489e1ec0817adde8e4e754162b72394
2023-11-28 17:27:23 +08:00
hiyouga
b015ac35d8
support export size setting
...
Former-commit-id: 859a6ea9425a09d7263f6436d05102df8129c248
2023-11-26 18:34:09 +08:00
hiyouga
5f2943dc84
support Yi-34B-Chat models
...
Former-commit-id: ff1c289229ee382d3e76578bbb6a5e299b969ded
2023-11-23 19:31:49 +08:00
hiyouga
c4f6cf1270
update readme
...
Former-commit-id: 5085b00a1d84a5a83c857c2716313d4ea84ba424
2023-11-21 13:15:46 +08:00
hiyouga
9697c3e970
set version
...
Former-commit-id: 35c2da3eba064e16b21c20a4cde3355173d5d9fd
2023-11-20 22:57:44 +08:00
hiyouga
4966bd7911
support GPTQ tuning #729 #1481 #1545 , fix chatglm template #1453 #1480 #1569
...
Former-commit-id: 9ea93801459b0d271d21a2d730c44abae9106c51
2023-11-20 22:52:11 +08:00
hiyouga
f06c4c8f7a
update ppo trainer
...
Former-commit-id: 5021062493ed63ad1f6133cfb543e4e7f528d2cc
2023-11-20 21:39:15 +08:00
hoshi-hiyouga
d72f123851
Merge pull request #1553 from hannlp/hans
...
Change the default argument settings for PPO training
Former-commit-id: 48211e3799a16de946360930d3d92f5a40e9d12d
2023-11-20 20:32:55 +08:00
hiyouga
a7b1632ace
fix value head model resuming
...
Former-commit-id: 2a36fd5064f028f394ac07c25440fd5e965a07b8
2023-11-20 19:01:37 +08:00
hiyouga
682d81caa9
fix #1567
...
Former-commit-id: 99a3f06377d2886c4000ce7e3583b12ca965534d
2023-11-20 18:46:36 +08:00
hiyouga
32545bd6d9
better data streaming
...
Former-commit-id: 00baaa990e099d6b75436eaa7a922a07646afa26
2023-11-19 23:32:47 +08:00
hiyouga
d1e03512f4
fix model card network issue
...
Former-commit-id: 211b2db5a8290f6b52f0a076de56fcc2b06671d6
2023-11-19 23:03:19 +08:00
hiyouga
8d82d7e994
fix Mistral template
...
https://github.com/lm-sys/FastChat/pull/2547
Former-commit-id: bfb94331657f385f4653ddcb8f7b57d1c052804d
2023-11-19 16:29:30 +08:00
hiyouga
a53afb27eb
fix #1263
...
Former-commit-id: 065bfaeed490a4e03fb48a5adc0b8af4d835a767
2023-11-19 16:05:18 +08:00
hiyouga
48d6d925f7
fix #1558
...
Former-commit-id: 1740131d63d32aefc0370441baf4716ddb5ebcfe
2023-11-19 14:15:47 +08:00
hiyouga
112108d564
fix evaluator and cached_file in 4.31.0
...
Former-commit-id: ff6056405dea8e89a95fd3741fd309d3c7679896
2023-11-18 19:39:23 +08:00
hiyouga
6d8d8509da
update benchmark
...
Former-commit-id: a2019c8b61753e0a845dc2b3d3b45ae43c0d492f
2023-11-18 11:30:01 +08:00
hiyouga
60fe410f05
update readme
...
Former-commit-id: 90212280d6cc168e5421fd3201a69d2c6ae01e29
2023-11-18 11:15:56 +08:00
hiyouga
3dc7c0a88c
add benchmark
...
Former-commit-id: 329134f58c45746702ec92a5bd76b89334cbc4b6
2023-11-18 11:09:52 +08:00
hiyouga
303956cbb9
update dataset
...
Former-commit-id: 7b1aa6f63c79c0d9cb5249fdb0d6a5f9a04f36bd
2023-11-17 23:19:12 +08:00
hiyouga
0d98d1a28c
fix quantization
...
Former-commit-id: ccb0f58e22f55b15531fd0e85f5935b150575bec
2023-11-17 22:21:29 +08:00
hiyouga
f9df6c17ed
fix #1550
...
Former-commit-id: 1bbc1be95eedf0796c0b311568dff8c75f87dfbb
2023-11-17 17:23:13 +08:00
Yuchen Han
b92259ae02
Update README_zh.md
...
Former-commit-id: 7cab47b822ddf7f94d2ccfbe2ba4836e35f104f4
2023-11-17 00:18:07 -08:00
Yuchen Han
c761a9987c
Update README.md
...
Former-commit-id: c9b499fa7e1de6ff3467a3c6bf44e559deb492f7
2023-11-17 00:17:36 -08:00
Yuchen Han
a419122179
Update workflow.py
...
Former-commit-id: eeb5249d0b6ce0816e1fa47afc3a853c7b267cbf
2023-11-17 00:16:27 -08:00
Yuchen Han
ec910a87c0
Update finetuning_args.py
...
Former-commit-id: b24635d22b3084ad29217ef55c1dd1fa4f85a1fb
2023-11-17 00:15:51 -08:00
hiyouga
d3c4881ccb
fix packages
...
Former-commit-id: 999bc0ed93d15b5d1082c8f706a7d17c95933d93
2023-11-17 16:11:48 +08:00
hoshi-hiyouga
0d2262ffd0
Merge #1544 from Outsider565/main, fix #1548
...
Fix: Change rouge-chinese package name to rouge_chinese
Former-commit-id: 7f9770b2c680f4f71faa28bd57ba4c9ef8873d0e
2023-11-17 16:09:42 +08:00
Shaowen Wang
4ea3144554
Fix: Change rouge-chinese package name to rouge_chinese
...
To reproduce:
python:
importlib.util.find_spec('rouge-chinese') -> None
importlib.util.find_spec('rouge_chinese') -> ModuleSpec(name='rouge_chinese'...)
from rouge_chinese import Rouge
print(Rouge.__module__) -> rouge_chinese
Former-commit-id: 397e9489849d80517b0c467852a7092a0a9626f2
2023-11-16 20:12:35 -06:00
hiyouga
5de45bf989
fix chatglm template
...
Former-commit-id: ed9f7705efbed0accf4dc5c9dfa9e3e7e15e1174
2023-11-16 22:54:15 +08:00
hiyouga
4a6cb33f0c
Update bug-report.yml
...
Former-commit-id: 438c37456707e6d3b0fc74799507d00197948977
2023-11-16 19:37:35 +08:00
hiyouga
1fd8f1eb72
add issue template
...
Former-commit-id: 9e0bfcfc14c8652428742dde66a1c6a1bf625cdf
2023-11-16 19:35:30 +08:00
hoshi-hiyouga
39735b5750
Update issue templates
...
Former-commit-id: dea176f88ee60866b9a5f91a0c4755b74bc010c0
2023-11-16 18:56:30 +08:00
hiyouga
8454e02313
fix web ui demo
...
Former-commit-id: 10ce87e088ae5934c4c3e61e9d0556cd5378308c
2023-11-16 18:41:55 +08:00
hiyouga
be0fb659d2
fix web ui demo
...
Former-commit-id: 1c80e9a09ed9fce0809e2b893d946306df0f9f7c
2023-11-16 17:12:23 +08:00
hiyouga
11af6c1e39
release v0.3.0
...
Former-commit-id: c4facc03af20d15d5b09ec77dc3742138db68f9d
2023-11-16 16:00:11 +08:00
hiyouga
763a9305d0
update readme
...
Former-commit-id: 72e6699547d4fd0a20f61225f7a4b2c054ec035b
2023-11-16 15:58:37 +08:00
hoshi-hiyouga
550293badc
Merge #1525 from hiyouga/dev, fix #224 #336 #931 #936 #1011
...
Refactor llmtuner, support full-parameter RLHF
Former-commit-id: f04bc2a42815d02c22935fec8bf7b81438c8ba79
2023-11-16 15:47:13 +08:00
hiyouga
11de514cc6
fix css
...
Former-commit-id: 08f3c114292676699a1921d4395f268a54763428
2023-11-16 15:45:38 +08:00
hiyouga
3f53155a90
fix bug in web ui
...
Former-commit-id: 6efa38be46ed536f80fc67002f23862edcb9df8d
2023-11-16 15:21:24 +08:00
hiyouga
e4f97615f0
update ppo and demo in webui
...
Former-commit-id: 7537dd434f4c0f0bde06bd8c2ac69bf622772316
2023-11-16 14:55:26 +08:00
hiyouga
0ed0b8f9c5
fix bug in freeze tuning
...
Former-commit-id: ff52b1779c909819d0aef83d3f7ea663199cbe54
2023-11-16 14:25:11 +08:00
