51 Commits

Author SHA1 Message Date
Shiyu Zhang
249adacc4d 仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2489055574fd3365425d26360d73897
2024-07-18 15:30:25 +08:00
hiyouga
14bc7b0551 fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
2024-07-15 01:04:56 +08:00
hiyouga
3baf1d1f7e fix #4792
Former-commit-id: 6b48308ef9be34d072f3e6bb2444e186a38c2779
2024-07-13 22:07:58 +08:00
hoshi-hiyouga
f85187b4dd Merge pull request #4700 from marko1616/patch-1
Fix Windows command preview

Former-commit-id: 555194e15026c444b2bd1c09f521950cbff86c21
2024-07-10 13:51:50 +08:00
hiyouga
a9ce54d143 fix #4731
Former-commit-id: 51942acee84cdb20002f8fdccf6be8c7fe9bd0d3
2024-07-10 11:32:36 +08:00
hiyouga
f3c105f088 fix #4705
Former-commit-id: a15782cb9f3ee64ba1f5fc2a3da20ac6c6ef0aa0
2024-07-07 13:10:06 +08:00
marko1616
c8205c5163 Update utils.py
In windows mutiline command should like
command --arg1 xxx `
--arg2 xxx `

Former-commit-id: e0562521bbd7cf6b3b90f8c87e52690931f736bd
2024-07-06 20:40:13 +08:00
hiyouga
b254df2d34 update ui
Former-commit-id: 7f770f6895f1e2e0b8e4f0b49088bfae096f6d3c
2024-07-03 23:13:49 +08:00
hoshi-hiyouga
2452f57cd7 Merge branch 'main' into main
Former-commit-id: e8e6af26514272e29a50649b38182beb4db4ebfa
2024-07-01 21:01:09 +08:00
hiyouga
87e60f8bac bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674


Former-commit-id: 4d35e218b1d60ff24b368ff5bc608be9c85411de
2024-06-28 06:00:26 +08:00
hiyouga
835f0578c2 refactor pissa, improve llamaboard
Former-commit-id: 8baf3b22b0fb9624807d809832f097301982d192
2024-06-28 01:04:24 +08:00
hiyouga
f2425cb4ed tiny fix
Former-commit-id: f17c9dfd848ff8ee33fb4db70e40bca15153e40f
2024-06-27 00:46:41 +08:00
hiyouga
da80d41c78 tiny fix
Former-commit-id: 29c710da3a8984c5f6522a79368344544319ebce
2024-06-27 00:36:04 +08:00
hiyouga
d2d9fa4abb support HQQ/EETQ #4113
Former-commit-id: ad144c2265cdee0d23014dbb3d017ea257cb26ed
2024-06-27 00:29:42 +08:00
hiyouga
d519c2fde5 tiny fix
Former-commit-id: 41086059b12ecb7827eb390294e315068ff9c2e6
2024-06-25 01:15:19 +08:00
hiyouga
47651a94a3 fix #4410
Former-commit-id: fca893d73c3d7bbb87a816522f2e1568d3e9c612
2024-06-24 22:34:31 +08:00
hiyouga
0844750bb9 tiny fix
Former-commit-id: 8d4f5093cfcccfe9df173b4c4f7ec0125aecf198
2024-06-20 22:56:05 +08:00
hiyouga
6ea4680334 improve llamaboard
Former-commit-id: f22d8f9ca49681e1ca52c9bdedfe3b5c5a3409b8
2024-06-19 23:46:03 +08:00
hiyouga
029c343537 fix llamaboard abort
Former-commit-id: 3f84411b5d904dbbc5cddeda44884417fe68f689
2024-06-19 23:22:28 +08:00
hiyouga
bccc852f76 fix tool formatter, allow parallel function #4362
Former-commit-id: cd75b1fe9d91fb52a9ae6de7435302ff06b4d933
2024-06-19 03:23:51 +08:00
hiyouga
f25b8626bf support pissa
Former-commit-id: 8c1046d78ac6c8f9429b73617e35e1eccb35138f
2024-06-16 01:08:12 +08:00
hiyouga
2946153cea add license
Former-commit-id: d87108daa68bd40174b262be1ca65fe6e1b7ab56
2024-06-15 17:54:33 +08:00
hiyouga
ba9aa7e2aa fix #4292
Former-commit-id: 9092f963dba6f2e0eeade53b5b35e6b770f8348e
2024-06-15 04:47:13 +08:00
hiyouga
27777c8e68 add quant check in webui export tab
Former-commit-id: c94e6c9411cc1165ea8180d377611a3ae47956e6
2024-06-13 03:19:18 +08:00
ancv
045eb155a2 implement efficient packing without cross-contamination attention
Former-commit-id: b2c367bc61c2778dc359613dca496d9e134c2743
2024-06-12 11:56:01 +07:00
hiyouga
a8318723a4 add resume args in webui
Former-commit-id: 06e5d136a4916413d1c116e341ba7d5136d7748a
2024-06-08 00:22:16 +08:00
hiyouga
d79222894c fix #4137
Former-commit-id: 8bf9da659cc789dbdd909930f79ac59539b51127
2024-06-07 19:16:06 +08:00
hiyouga
8da149ba40 rename files
Former-commit-id: 74f96efef9bcd63f65d0190c901ff9be54ccd350
2024-06-07 00:09:06 +08:00
hiyouga
cceff9f520 lora modules: all by default
Former-commit-id: cae47379079ff811aa385c297481a27020a8da6b
2024-06-06 03:53:28 +08:00
hiyouga
8f25af89b6 lint
Former-commit-id: 7daf8366db0e161d46993fd87cf983a27a0ce2a3
2024-06-06 03:33:44 +08:00
hoshi-hiyouga
229794a148 Merge pull request #4066 from injet-zhou/main
add throughput entry to training log

Former-commit-id: f2580ad403cd0ae91aa0954c0a15363c46452438
2024-06-06 03:32:04 +08:00
hoshi-hiyouga
d31c9c73c7 Merge pull request #4080 from MengqingCao/npu
Add npu option for model exporting

Former-commit-id: ca459f67eb319c262d5bab882e9cb3535a76eb69
2024-06-06 03:15:44 +08:00
hoshi-hiyouga
0b7cf306f7 Update export.py
Former-commit-id: feaee36c4642558c6c4e069b0fd42c20691e3ff4
2024-06-06 03:14:46 +08:00
hoshi-hiyouga
896a3b8311 Merge pull request #4053 from hzhaoy/feature/add_select_config_file
Support selecting saved configuration files

Former-commit-id: 0e740aa463bdd649eaf1cc2d5366216e0c709261
2024-06-06 03:06:03 +08:00
hiyouga
00b3fb4d14 update train hparams
Former-commit-id: dc4a00dd63769dc02d898c8bad2c158e4e5c0447
2024-06-06 01:49:20 +08:00
MengqingCao
71b9b87d88 modify export_device option
Former-commit-id: 2c0305266291fdb163c4445db227d4c77529f3b5
2024-06-05 09:37:36 +00:00
MengqingCao
15f6ab73a5 add npu for model export
Former-commit-id: 07045c876a4c6025ba56905b65cce6c9faedacb5
2024-06-05 07:06:40 +00:00
faddddeout
a2931b813b add throughput entry to log
Former-commit-id: b2f04595423b8e84b3763d169e402a0cd34f3175
2024-06-04 11:04:29 +00:00
hzhaoy
4721d0b8ff add: support selecting saved configuration files and loading training parameters
Former-commit-id: b27c4cfcb367f7ab0b56da3ba238c4d9c29ff4e7
2024-06-04 10:33:43 +08:00
hiyouga
b12d4beb8a fix abort in webui DDP mode
Former-commit-id: 2187518762844472a96b72fbad4da15d8bc97bbd
2024-06-04 00:10:24 +08:00
hoshi-hiyouga
326f180397 Merge pull request #3987 from injet-zhou/main
Fix cann't interrupt training when using multi GPUs in webui

Former-commit-id: ae18e1e2514d2829b5bc8b4abdb7fa3e8e906c22
2024-06-04 00:04:07 +08:00
hiyouga
e2920aa925 fix #4043
Former-commit-id: 79784ebeb6cc712b12edadcca8203b20afcf851e
2024-06-03 23:30:37 +08:00
faddddeout
64976e426c fix cann't interrupt training when using multi GPUs in webui
Former-commit-id: b13d03946ed7e39f848988f7b75485a9b69bae09
2024-05-30 08:39:21 +00:00
hiyouga
820404946e better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui


Former-commit-id: 80708717329b4552920dd4ce8cebc683e65d54c5
2024-05-29 23:55:38 +08:00
hiyouga
13e7b64641 add ds config to webui
Former-commit-id: e4b420c146235b2bce70d66a081efd137aef98af
2024-05-29 01:13:17 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa9208ec14f00a9bdb51f69aebb02af5
2024-05-28 19:24:22 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986c43f97994211ec34dc5928fc3bb9d7
2024-05-26 23:46:33 +08:00
hiyouga
5351e3945b add kto to webui
Former-commit-id: 9b0f4d7602f70031cc1a5fd66616cbe6bb4d78d3
2024-05-20 21:20:25 +08:00
hiyouga
02f716907e safe output path in webui
Former-commit-id: 3c2a992caa45c9121cd1ccac3de9bbcf1a9b058b
2024-05-18 22:42:28 +08:00
hiyouga
f4bf49e891 enable inbrowser in webui
Former-commit-id: 694a05fd044bbbad107ca8fed5494460c78e1981
2024-05-17 00:08:56 +08:00