Commit Graph

37 Commits

Author SHA1 Message Date
hiyouga
c2766af6f4 fix dpo metrics
Former-commit-id: 4270f7dfb9
2024-11-02 20:59:01 +08:00
hiyouga
e83cb17f97 support rank0 logger
Former-commit-id: c38aa29336
2024-11-02 18:31:04 +08:00
hiyouga
aba4268607 support extra args in llamaboard
Former-commit-id: 86e5affc0d
2024-10-30 08:55:54 +00:00
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
hiyouga
f31e7e0dfc remove visual_inputs, fix qlora
Former-commit-id: a025c3df61
2024-08-31 00:24:51 +08:00
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32
2024-08-30 02:14:31 +08:00
hiyouga
c765292093 support liger kernel
Former-commit-id: 72bc8f0111
2024-08-27 11:20:14 +08:00
hiyouga
0aad78694a tiny fix
Former-commit-id: ace1d44857
2024-07-24 18:33:39 +08:00
hiyouga
34f16cc635 follow #4878 fix #4684
Former-commit-id: 779aae83d2
2024-07-18 22:06:12 +08:00
Shiyu Zhang
249adacc4d 仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2
2024-07-18 15:30:25 +08:00
hiyouga
14bc7b0551 fix up
Former-commit-id: 29ebcd75d5
2024-07-15 01:04:56 +08:00
hiyouga
f3c105f088 fix #4705
Former-commit-id: a15782cb9f
2024-07-07 13:10:06 +08:00
hiyouga
b254df2d34 update ui
Former-commit-id: 7f770f6895
2024-07-03 23:13:49 +08:00
hoshi-hiyouga
2452f57cd7 Merge branch 'main' into main
Former-commit-id: e8e6af2651
2024-07-01 21:01:09 +08:00
hiyouga
835f0578c2 refactor pissa, improve llamaboard
Former-commit-id: 8baf3b22b0
2024-06-28 01:04:24 +08:00
hiyouga
d2d9fa4abb support HQQ/EETQ #4113
Former-commit-id: ad144c2265
2024-06-27 00:29:42 +08:00
hiyouga
d519c2fde5 tiny fix
Former-commit-id: 41086059b1
2024-06-25 01:15:19 +08:00
hiyouga
029c343537 fix llamaboard abort
Former-commit-id: 3f84411b5d
2024-06-19 23:22:28 +08:00
hiyouga
f25b8626bf support pissa
Former-commit-id: 8c1046d78a
2024-06-16 01:08:12 +08:00
hiyouga
2946153cea add license
Former-commit-id: d87108daa6
2024-06-15 17:54:33 +08:00
ancv
045eb155a2 implement efficient packing without cross-contamination attention
Former-commit-id: b2c367bc61
2024-06-12 11:56:01 +07:00
hiyouga
a8318723a4 add resume args in webui
Former-commit-id: 06e5d136a4
2024-06-08 00:22:16 +08:00
hiyouga
d79222894c fix #4137
Former-commit-id: 8bf9da659c
2024-06-07 19:16:06 +08:00
hiyouga
cceff9f520 lora modules: all by default
Former-commit-id: cae4737907
2024-06-06 03:53:28 +08:00
hoshi-hiyouga
229794a148 Merge pull request #4066 from injet-zhou/main
add throughput entry to training log

Former-commit-id: f2580ad403
2024-06-06 03:32:04 +08:00
hiyouga
00b3fb4d14 update train hparams
Former-commit-id: dc4a00dd63
2024-06-06 01:49:20 +08:00
faddddeout
a2931b813b add throughput entry to log
Former-commit-id: b2f0459542
2024-06-04 11:04:29 +00:00
hiyouga
b12d4beb8a fix abort in webui DDP mode
Former-commit-id: 2187518762
2024-06-04 00:10:24 +08:00
hoshi-hiyouga
326f180397 Merge pull request #3987 from injet-zhou/main
Fix cann't interrupt training when using multi GPUs in webui

Former-commit-id: ae18e1e251
2024-06-04 00:04:07 +08:00
hiyouga
e2920aa925 fix #4043
Former-commit-id: 79784ebeb6
2024-06-03 23:30:37 +08:00
faddddeout
64976e426c fix cann't interrupt training when using multi GPUs in webui
Former-commit-id: b13d03946e
2024-05-30 08:39:21 +00:00
hiyouga
820404946e better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui


Former-commit-id: 8070871732
2024-05-29 23:55:38 +08:00
hiyouga
13e7b64641 add ds config to webui
Former-commit-id: e4b420c146
2024-05-29 01:13:17 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa
2024-05-28 19:24:22 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986
2024-05-26 23:46:33 +08:00
hiyouga
5351e3945b add kto to webui
Former-commit-id: 9b0f4d7602
2024-05-20 21:20:25 +08:00
hiyouga
cae823ddf0 rename package
Former-commit-id: 308edbc426
2024-05-16 18:39:08 +08:00