hiyouga
|
8c74851b70
|
fix dispatch
Former-commit-id: deda82638716506dc690902c51276bb1eb0ddd5e
|
2024-01-03 16:33:16 +08:00 |
|
hiyouga
|
7168392a51
|
fix valuehead patch
Former-commit-id: d9cb98362b58b28ae0ee207e7c07e75e5d810876
|
2024-01-03 16:19:23 +08:00 |
|
hiyouga
|
ccc5b324fe
|
fix rm server
Former-commit-id: 81bc1638682a9fd01518f9f25250a6b584d2a9e6
|
2024-01-03 15:30:46 +08:00 |
|
hiyouga
|
e85c205a81
|
fix #2014
Former-commit-id: 077f6bf64e50f01f62aa4a957438bedc4e7925b3
|
2023-12-29 15:17:22 +08:00 |
|
hiyouga
|
7e225be16e
|
add yuan model
Former-commit-id: 6a0377e2e51633bd5fb10fa8628e554565c5ee3e
|
2023-12-29 13:50:24 +08:00 |
|
hiyouga
|
ebb32e85f8
|
fix version
Former-commit-id: dd7500b65d0d548441eece101b60d51fa619cc0f
|
2023-12-29 04:53:36 +08:00 |
|
hiyouga
|
90d279f39f
|
fix args
Former-commit-id: ff18f327a3dc96d9677ef32841e8f29ab2eeb7ef
|
2023-12-28 18:47:19 +08:00 |
|
hiyouga
|
af3f5b6e16
|
fix export format
Former-commit-id: 7c82bd396b9e6ff395850ad544d95cbf1b7557cd
|
2023-12-28 18:40:46 +08:00 |
|
hiyouga
|
53d7c5109f
|
fix ppo trainer
Former-commit-id: ca5b5823b03822ef899405d233a82396be997f44
|
2023-12-28 18:09:28 +08:00 |
|
hiyouga
|
c33fbea469
|
fix bug
Former-commit-id: b06faa1be3f5aa5e0fa31aa31314c213c36c3442
|
2023-12-24 19:20:12 +08:00 |
|
hiyouga
|
921f593632
|
update loader
Former-commit-id: 080d8eab858217ca58bffe719d5ffde7579c5bda
|
2023-12-24 19:10:23 +08:00 |
|
hiyouga
|
940403720a
|
update patcher
Former-commit-id: d6d7b6670847ce4ea10353c5b126214542b45c2b
|
2023-12-23 15:24:27 +08:00 |
|
hiyouga
|
f869e44fe5
|
fix #1909
Former-commit-id: 3e93c33af9f80e28c9f30af9b7ba20757358afb4
|
2023-12-23 14:42:20 +08:00 |
|
hiyouga
|
306a70c7ba
|
fix unsloth dtype
Former-commit-id: fd22e6546ce5f38a6a075cf894aafc3d206b2fcd
|
2023-12-23 01:59:49 +08:00 |
|
hiyouga
|
d358d955e5
|
fix dpo trainer
Former-commit-id: c160dd7cd86e296e32775ace2e4258a473449c41
|
2023-12-23 01:51:55 +08:00 |
|
hiyouga
|
0fdd6074c3
|
llama board: add unsloth
Former-commit-id: 9477e6f28808ae9deadada1f6cf679a29542c271
|
2023-12-23 00:35:53 +08:00 |
|
hiyouga
|
6faf9c35a9
|
support unsloth
Former-commit-id: b857f00234b90b785d82ca7cdb29af3d948b1a7b
|
2023-12-23 00:14:33 +08:00 |
|
ShaneTian
|
d05febe5de
|
Fix slow model initialization in bfloat16 dtype.
Former-commit-id: cf2e2f6f9b7f09b1e2faf6fbc413e3f62e3846c7
|
2023-12-22 16:27:28 +08:00 |
|
hiyouga
|
67f7034a21
|
fix param type
Former-commit-id: 11b99f344416ade1cdac52e11ba7f36fcf689221
|
2023-12-21 17:33:01 +08:00 |
|
hiyouga
|
79f301a2c6
|
fix ds zero3 check
Former-commit-id: 7f50705b1d821d287bd854211319f697f57b25db
|
2023-12-21 01:19:22 +08:00 |
|
hiyouga
|
31cbc67986
|
match version
Former-commit-id: 16db52522584a8e084d4db2a7c253c8b88f27371
|
2023-12-20 22:17:35 +08:00 |
|
hiyouga
|
acf5241845
|
fix stop words
Former-commit-id: 6ce6cac9fa8f0af33697e824cf93a9a80cdbd064
|
2023-12-20 19:06:43 +08:00 |
|
hiyouga
|
2bce99b82f
|
fix yi template #1895
Former-commit-id: 05b4fa1e2b13a15ee261a151ac8cd0a2ebdf5edc
|
2023-12-20 18:58:16 +08:00 |
|
hiyouga
|
3c330869ef
|
improve quantization
Former-commit-id: 4dde60017ad8208dfea0b2bb61df6a14a35d03e0
|
2023-12-20 18:27:16 +08:00 |
|
hiyouga
|
dba1af4841
|
add max_memory for gptq #1923
Former-commit-id: 9afc42c8b999fbbc206d9a467ca5795b27a10096
|
2023-12-20 18:15:17 +08:00 |
|
hiyouga
|
2b1e52dcc9
|
fix #1073 #1462 #1735 #1908
Former-commit-id: cd8e2535aa66931b24b96e76c2b56ce703a579b1
|
2023-12-20 17:15:40 +08:00 |
|
hiyouga
|
b5238e945a
|
optimize data loading logic
Former-commit-id: 58f669b384582ac90e85de835f1f44f7003f9ec0
|
2023-12-20 16:15:41 +08:00 |
|
hiyouga
|
afc0f29704
|
fix #1909
Former-commit-id: f563e8d28dfa48a60cbe3d295b20f9cf58de296d
|
2023-12-20 16:11:07 +08:00 |
|
hiyouga
|
de0bb1d2da
|
fix mixtral inference #1821
Former-commit-id: 612f9fd19cbd29e8b1785a1576a9668e7dcd264c
|
2023-12-20 15:11:15 +08:00 |
|
hiyouga
|
cc16ece283
|
fix #1900
Former-commit-id: 4c35214396f873588562606b084740b6581188d9
|
2023-12-19 17:21:46 +08:00 |
|
hiyouga
|
4b27cf5460
|
add codegeex template
Former-commit-id: a8222722b8097158f1c92e3729f41d411eff3926
|
2023-12-18 19:52:35 +08:00 |
|
hiyouga
|
a53b2a643f
|
add xverse-65B-2 model
Former-commit-id: 3e563a0d9666934dfdab54d61654ec00079a93f1
|
2023-12-18 19:24:09 +08:00 |
|
hiyouga
|
d925ecae1b
|
add models
Former-commit-id: 3a4728557304996bcbe58d7d6380beead7c63c70
|
2023-12-18 19:09:31 +08:00 |
|
hiyouga
|
13fd751a78
|
fix tokenizer for Yi chat models #1617 #1875
Former-commit-id: 9485692c8d367a0b25d3e653db413aa01cb9ad7d
|
2023-12-18 17:18:11 +08:00 |
|
hiyouga
|
5e7bb5fe73
|
fix llama board
Former-commit-id: f43f61b2898dda56aba0066fcb3409b152260bdb
|
2023-12-16 22:17:37 +08:00 |
|
hiyouga
|
790a31404a
|
fix #1742
Former-commit-id: efbb32afdcf0d6aa4ca26f54c95f76dbb84f77dc
|
2023-12-16 20:50:45 +08:00 |
|
hiyouga
|
f927601702
|
add xverse-65b-chat model
Former-commit-id: fff6288db6b61ca27010ea47c918298f76922106
|
2023-12-16 20:21:29 +08:00 |
|
hiyouga
|
c4654d54d7
|
set version
Former-commit-id: 45a05e3a415eeaf875e2cf15bdba0235fbd7d527
|
2023-12-16 20:17:51 +08:00 |
|
hiyouga
|
df777c30d1
|
add noisy mean initialization #1815
Former-commit-id: 3253b1fca0123071913079277186c160046edf21
|
2023-12-16 19:47:51 +08:00 |
|
hiyouga
|
d81ad2d4bc
|
support dpo-ftx
Former-commit-id: 86dfa04f9821556019fa777106787f73eb70b452
|
2023-12-16 19:21:41 +08:00 |
|
hiyouga
|
9f77e8b025
|
support autogptq in llama board #246
Former-commit-id: fea01226703d1534b5cf511bcb6a49e73bc86ce1
|
2023-12-16 16:31:30 +08:00 |
|
yhyu13
|
7d1fe50977
|
Use llmtuner logger
Former-commit-id: ef5a560b4246e04e0ef2612e3520e05288e93707
|
2023-12-16 07:15:27 +00:00 |
|
yhyu13
|
c0e5e3c5d5
|
Improve logging for unknown args
Former-commit-id: 03e49d76ca91f7fcaf1c013740d5f6bfc11a2028
|
2023-12-16 05:16:29 +00:00 |
|
hiyouga
|
3a45cfb604
|
update tips
Former-commit-id: 4432cbda6b7535bcbb40ba77df069fca631b4be8
|
2023-12-15 23:52:50 +08:00 |
|
hiyouga
|
393e4b0f5a
|
fix #1770
Former-commit-id: 8266187cec70bb4bd1b4837d51b09409ec11f93e
|
2023-12-15 23:50:15 +08:00 |
|
hiyouga
|
296711d502
|
support quantization in export model
Former-commit-id: f32500ae6edccab7d14df4c92467e15986866def
|
2023-12-15 23:44:50 +08:00 |
|
hiyouga
|
9121722999
|
update dc link
Former-commit-id: f6789e50e17a377b6d9b434d8e12ad99d8eecfeb
|
2023-12-15 22:11:31 +08:00 |
|
hiyouga
|
33521fb45e
|
fix bug
Former-commit-id: 95ac272907a04a64785f928536de1fd099150f92
|
2023-12-15 21:54:02 +08:00 |
|
hiyouga
|
e5204e60ed
|
fix bug
Former-commit-id: 8b80baf02cfece53527c27712f0899fa3532c414
|
2023-12-15 21:49:26 +08:00 |
|
hiyouga
|
0409428d87
|
add configurer
Former-commit-id: c40c9889615ffb49c7ce24c69c0d3d20d841c800
|
2023-12-15 21:46:40 +08:00 |
|