hiyouga
|
d88c72f326
|
fix flashattn warning
Former-commit-id: 6eb095d39bd82fdbdb729a0ea57fc7246e3a60d6
|
2023-11-10 18:34:54 +08:00 |
|
hiyouga
|
6a80ba8de4
|
refactor constants
Former-commit-id: a4d4c3fd35276f20e3b354e9d13ea971029c8775
|
2023-11-10 14:16:10 +08:00 |
|
hiyouga
|
f697474e67
|
add template, modify datasets
Former-commit-id: 81e54beb4d0f792f4fd7f450643caaf10f2f0b7d
|
2023-11-09 15:53:23 +08:00 |
|
hiyouga
|
0e360ed9c8
|
delete file
Former-commit-id: 7d6355db0fd5809b99f3fa42753cf4dffd251fd1
|
2023-11-07 16:20:12 +08:00 |
|
hiyouga
|
08df3dca98
|
upgrade peft, fix #1088 #1411
Former-commit-id: aa7d104f8e050d12cb8f585bc8a52c850995500f
|
2023-11-07 16:13:36 +08:00 |
|
hiyouga
|
72adf2c18c
|
update templates
Former-commit-id: 85be2e242b062283f192c4c4d0715dc1e8a68589
|
2023-11-06 12:25:47 +08:00 |
|
hiyouga
|
3e51949b1c
|
fix deepseek template
Former-commit-id: 1fdbcdad9a1cdb20299350efd87a8e5cb8c625a3
|
2023-11-05 13:08:46 +08:00 |
|
hiyouga
|
69127733d2
|
support deepseek coder #1378
Former-commit-id: ae0c829917b9de10e71199c85c77a52cdcd2b7b3
|
2023-11-05 12:51:03 +08:00 |
|
hiyouga
|
22abc44236
|
fix #1316
Former-commit-id: 88a753fe80e277007bac2264aee24024e18f2314
|
2023-10-31 11:32:08 +08:00 |
|
hiyouga
|
2d500fa485
|
update constants
Former-commit-id: ebacbb1072045924a7e335cc9dda488d6f0be8b3
|
2023-10-29 13:30:20 +08:00 |
|
hiyouga
|
d72933d105
|
fix vicuna template
Former-commit-id: a98eda0803e4b73a24f12d848e14161451921e98
|
2023-10-27 22:15:25 +08:00 |
|
hiyouga
|
35548fd6c3
|
fix chatglm3 template
Former-commit-id: 69bcbc9f6c98e4f4ad97ec0306b33ab21923d311
|
2023-10-27 21:12:06 +08:00 |
|
hiyouga
|
b97d454ac1
|
support chatglm3
Former-commit-id: ba82e13bbeed3b262d301196b1860d73f319401d
|
2023-10-27 19:16:28 +08:00 |
|
hiyouga
|
797c3073b3
|
fix openchat template
Former-commit-id: 88b9b657bc50495ac4c42f64195fc652fe4ca3df
|
2023-10-21 01:25:42 +08:00 |
|
hiyouga
|
e79f0755a6
|
fix #1232
Former-commit-id: 49975755d47344e362145c52548fdda8783f2c0c
|
2023-10-20 23:28:52 +08:00 |
|
hiyouga
|
a317943e54
|
fix eval resuming in webui
Former-commit-id: b28b53cd06777f213ef7b925a914ff5fd357ade1
|
2023-10-15 15:45:38 +08:00 |
|
hiyouga
|
caf8b3d3b8
|
tiny fix
Former-commit-id: 47b7b34357708a5354d542ddc239146c6417d718
|
2023-10-15 05:02:48 +08:00 |
|
hiyouga
|
a0dad14cd2
|
fix callback
Former-commit-id: 51208655a8c1d66551b7b644247321a3583debdc
|
2023-10-15 04:59:44 +08:00 |
|
hiyouga
|
6c835ecb5e
|
implement webui resuming training
Former-commit-id: 2d41672ef52414c56c50c8b4fdc442797ba682e9
|
2023-10-15 04:52:19 +08:00 |
|
hiyouga
|
f1a8fcf917
|
refactor model_dtype, fix PPO trainer
Former-commit-id: 3e17ee5afbcb823a7c9a2f91864b3750cd79edb4
|
2023-10-11 23:16:01 +08:00 |
|
hiyouga
|
c678dc262d
|
fix aquila template, repair sft packing mechanism
Former-commit-id: 8c82cfa5dd4bec957426b5bf176d242c77552ab0
|
2023-10-10 18:49:55 +08:00 |
|
hiyouga
|
7bdcd9d507
|
fix flash shift short attention
Former-commit-id: e44ad23eafa39b3ac0400b6f97cd440106a87f44
|
2023-10-09 17:54:48 +08:00 |
|
hiyouga
|
0c1e00574d
|
fix shift short attention
Former-commit-id: 9a49cce8e6f6b222f74a07bdab40efee6a77b0f1
|
2023-10-09 17:07:46 +08:00 |
|
hiyouga
|
025bc4bf5c
|
fix #1068 #1074
Former-commit-id: 26c6bfd21de06cc56be9a58e2ef69045ea70cc14
|
2023-09-28 14:39:16 +08:00 |
|
hiyouga
|
51c6c09f02
|
tiny fix
Former-commit-id: 35b355b76d2a8f8adf3750a905224e52d03d218f
|
2023-09-28 01:03:04 +08:00 |
|
hiyouga
|
d231f97335
|
tiny fix
Former-commit-id: 7451b2ae7e58d0f1857f01a037672a8c53b1bd0d
|
2023-09-28 01:02:11 +08:00 |
|
hiyouga
|
2bacc9789a
|
fix #1064
Former-commit-id: fd4660aa72d981d7efdad465f24a59358626c975
|
2023-09-28 00:53:29 +08:00 |
|
hiyouga
|
4617413bde
|
fix layer norm dtype
Former-commit-id: 67af21961b68d9b54d07b09e444c7140869f26da
|
2023-09-28 00:25:55 +08:00 |
|
hiyouga
|
d6f5a3cae9
|
support LongLoRA
Former-commit-id: 0832ed37e7947d699f17375648a52f80752c2b6b
|
2023-09-27 21:55:50 +08:00 |
|
hiyouga
|
e4542e1d45
|
add MMLU and C-Eval script
Former-commit-id: 3403f876127b4b99c5e3edb2834cc3b9a3a0063f
|
2023-09-23 00:34:17 +08:00 |
|
hiyouga
|
c19a5a4575
|
fix error info
Former-commit-id: b90ed220c5e94086d2b73045eff2440ff1b58c5c
|
2023-09-19 18:30:23 +08:00 |
|
hiyouga
|
df0b527c1e
|
fix #762 #814
Former-commit-id: 9a30ee5009040afbc524dbac0dad99904b2adf5f
|
2023-09-12 16:10:10 +08:00 |
|
hiyouga
|
5b55347952
|
tiny fix
Former-commit-id: d8ea0691f84c971e6860526714fc9873c350b064
|
2023-09-11 18:27:08 +08:00 |
|
hiyouga
|
8afbd30695
|
update flashattn, fix ppo save model
Former-commit-id: 0b08bc3dac246d4aa3f89afb7172529dcad9c39f
|
2023-09-11 17:25:36 +08:00 |
|
hiyouga
|
f5689c0e6e
|
remove PeftTrainer
Former-commit-id: cc0cff3e991f194732d278e627648e528118a719
|
2023-09-10 22:23:23 +08:00 |
|
hiyouga
|
f326178f89
|
support FlashAttention2
Former-commit-id: 23e56c5554b948d4f08ad87849b261eafd2c7890
|
2023-09-10 20:43:56 +08:00 |
|
hiyouga
|
9a3b4d9ee0
|
fix lora target
Former-commit-id: d822e41e7ac7e310ee49e347fc45754284ce30b8
|
2023-09-09 17:04:45 +08:00 |
|
hiyouga
|
34da72ffbb
|
support lora target auto find
Former-commit-id: bce9984733d88bf013847eed523d1c75fdf0995e
|
2023-09-09 15:38:37 +08:00 |
|
hiyouga
|
801d1fa7b9
|
change to right-padding, update reward score #803
Former-commit-id: baa90415bc8f5ebd423d001378b51c3a3a6c2ec7
|
2023-09-08 20:04:31 +08:00 |
|
hiyouga
|
82b0f43fc0
|
fix chatglm template
Former-commit-id: 69a824628b4d6a56a680a7e713b217877c6c15c5
|
2023-09-08 14:45:58 +08:00 |
|
hiyouga
|
47d9325873
|
fix baichuan templates
Former-commit-id: f48a49e835b32f3991cfad8874c7b9c78953809f
|
2023-09-07 18:54:14 +08:00 |
|
hiyouga
|
86c476cfca
|
update baichuan2 template
Former-commit-id: 16d9f8ba176443c5b397233da621600d6e1e1eec
|
2023-09-06 21:43:06 +08:00 |
|
hiyouga
|
79cf2ebfe4
|
add Baichuan2 models
Former-commit-id: 36960025e9274b574f57e7a7bf453cd96956e922
|
2023-09-06 18:36:04 +08:00 |
|
hiyouga
|
c5fcf5b3a5
|
refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: 0feec9a830b917b36686b61938a66e842eccf930
|
2023-09-01 19:00:45 +08:00 |
|
codemayq
|
6e90cce232
|
update llama2 template
Former-commit-id: 01de1d51d9fa5a22a338b6ed18ffad4d0ad5e3e8
|
2023-08-30 16:23:56 +08:00 |
|
codemayq
|
22cece8acb
|
add dataset stage and filter dataset when stage chosen in webui
Former-commit-id: 26e4136449a4df6028d834fd16a0f4a7c532759d
|
2023-08-23 18:54:23 +08:00 |
|
hiyouga
|
538c404cc0
|
update template
Former-commit-id: a95f3a4d62de1073a78125401cf4289ec0523156
|
2023-08-22 19:46:09 +08:00 |
|
hiyouga
|
8d8a1b46ac
|
fix #608
Former-commit-id: c02a6809124fcfd06628c49c95d419ec2d8cc8ef
|
2023-08-21 17:49:36 +08:00 |
|
hiyouga
|
31a4e38039
|
fix baichuan template for training #597 #616
Former-commit-id: 6530c1d972301eac9ef058b3235618bb09833f15
|
2023-08-21 17:41:51 +08:00 |
|
hiyouga
|
a089d2665a
|
fix ChatGLM2 ppo #527 #528
Former-commit-id: 60d6ad64d7c9f6445b0df8de0153c3a311974198
|
2023-08-18 00:34:59 +08:00 |
|