Commit Graph

45 Commits

Author SHA1 Message Date
hiyouga
f3c105f088 fix #4705
Former-commit-id: a15782cb9f
2024-07-07 13:10:06 +08:00
hiyouga
b254df2d34 update ui
Former-commit-id: 7f770f6895
2024-07-03 23:13:49 +08:00
hoshi-hiyouga
2452f57cd7 Merge branch 'main' into main
Former-commit-id: e8e6af2651
2024-07-01 21:01:09 +08:00
hiyouga
87e60f8bac bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674


Former-commit-id: 4d35e218b1
2024-06-28 06:00:26 +08:00
hiyouga
835f0578c2 refactor pissa, improve llamaboard
Former-commit-id: 8baf3b22b0
2024-06-28 01:04:24 +08:00
hiyouga
f2425cb4ed tiny fix
Former-commit-id: f17c9dfd84
2024-06-27 00:46:41 +08:00
hiyouga
da80d41c78 tiny fix
Former-commit-id: 29c710da3a
2024-06-27 00:36:04 +08:00
hiyouga
d2d9fa4abb support HQQ/EETQ #4113
Former-commit-id: ad144c2265
2024-06-27 00:29:42 +08:00
hiyouga
d519c2fde5 tiny fix
Former-commit-id: 41086059b1
2024-06-25 01:15:19 +08:00
hiyouga
47651a94a3 fix #4410
Former-commit-id: fca893d73c
2024-06-24 22:34:31 +08:00
hiyouga
0844750bb9 tiny fix
Former-commit-id: 8d4f5093cf
2024-06-20 22:56:05 +08:00
hiyouga
6ea4680334 improve llamaboard
Former-commit-id: f22d8f9ca4
2024-06-19 23:46:03 +08:00
hiyouga
029c343537 fix llamaboard abort
Former-commit-id: 3f84411b5d
2024-06-19 23:22:28 +08:00
hiyouga
bccc852f76 fix tool formatter, allow parallel function #4362
Former-commit-id: cd75b1fe9d
2024-06-19 03:23:51 +08:00
hiyouga
f25b8626bf support pissa
Former-commit-id: 8c1046d78a
2024-06-16 01:08:12 +08:00
hiyouga
2946153cea add license
Former-commit-id: d87108daa6
2024-06-15 17:54:33 +08:00
hiyouga
ba9aa7e2aa fix #4292
Former-commit-id: 9092f963db
2024-06-15 04:47:13 +08:00
hiyouga
27777c8e68 add quant check in webui export tab
Former-commit-id: c94e6c9411
2024-06-13 03:19:18 +08:00
ancv
045eb155a2 implement efficient packing without cross-contamination attention
Former-commit-id: b2c367bc61
2024-06-12 11:56:01 +07:00
hiyouga
a8318723a4 add resume args in webui
Former-commit-id: 06e5d136a4
2024-06-08 00:22:16 +08:00
hiyouga
d79222894c fix #4137
Former-commit-id: 8bf9da659c
2024-06-07 19:16:06 +08:00
hiyouga
8da149ba40 rename files
Former-commit-id: 74f96efef9
2024-06-07 00:09:06 +08:00
hiyouga
cceff9f520 lora modules: all by default
Former-commit-id: cae4737907
2024-06-06 03:53:28 +08:00
hiyouga
8f25af89b6 lint
Former-commit-id: 7daf8366db
2024-06-06 03:33:44 +08:00
hoshi-hiyouga
229794a148 Merge pull request #4066 from injet-zhou/main
add throughput entry to training log

Former-commit-id: f2580ad403
2024-06-06 03:32:04 +08:00
hoshi-hiyouga
d31c9c73c7 Merge pull request #4080 from MengqingCao/npu
Add npu option for model exporting

Former-commit-id: ca459f67eb
2024-06-06 03:15:44 +08:00
hoshi-hiyouga
0b7cf306f7 Update export.py
Former-commit-id: feaee36c46
2024-06-06 03:14:46 +08:00
hoshi-hiyouga
896a3b8311 Merge pull request #4053 from hzhaoy/feature/add_select_config_file
Support selecting saved configuration files

Former-commit-id: 0e740aa463
2024-06-06 03:06:03 +08:00
hiyouga
00b3fb4d14 update train hparams
Former-commit-id: dc4a00dd63
2024-06-06 01:49:20 +08:00
MengqingCao
71b9b87d88 modify export_device option
Former-commit-id: 2c03052662
2024-06-05 09:37:36 +00:00
MengqingCao
15f6ab73a5 add npu for model export
Former-commit-id: 07045c876a
2024-06-05 07:06:40 +00:00
faddddeout
a2931b813b add throughput entry to log
Former-commit-id: b2f0459542
2024-06-04 11:04:29 +00:00
hzhaoy
4721d0b8ff add: support selecting saved configuration files and loading training parameters
Former-commit-id: b27c4cfcb3
2024-06-04 10:33:43 +08:00
hiyouga
b12d4beb8a fix abort in webui DDP mode
Former-commit-id: 2187518762
2024-06-04 00:10:24 +08:00
hoshi-hiyouga
326f180397 Merge pull request #3987 from injet-zhou/main
Fix cann't interrupt training when using multi GPUs in webui

Former-commit-id: ae18e1e251
2024-06-04 00:04:07 +08:00
hiyouga
e2920aa925 fix #4043
Former-commit-id: 79784ebeb6
2024-06-03 23:30:37 +08:00
faddddeout
64976e426c fix cann't interrupt training when using multi GPUs in webui
Former-commit-id: b13d03946e
2024-05-30 08:39:21 +00:00
hiyouga
820404946e better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui


Former-commit-id: 8070871732
2024-05-29 23:55:38 +08:00
hiyouga
13e7b64641 add ds config to webui
Former-commit-id: e4b420c146
2024-05-29 01:13:17 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa
2024-05-28 19:24:22 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986
2024-05-26 23:46:33 +08:00
hiyouga
5351e3945b add kto to webui
Former-commit-id: 9b0f4d7602
2024-05-20 21:20:25 +08:00
hiyouga
02f716907e safe output path in webui
Former-commit-id: 3c2a992caa
2024-05-18 22:42:28 +08:00
hiyouga
f4bf49e891 enable inbrowser in webui
Former-commit-id: 694a05fd04
2024-05-17 00:08:56 +08:00
hiyouga
cae823ddf0 rename package
Former-commit-id: 308edbc426
2024-05-16 18:39:08 +08:00