hoshi-hiyouga
|
fe66bf3663
|
Merge pull request #1932 from ShaneTian/main
Update transformers to 4.36.2 to resolve multi-node saving bug.
Former-commit-id: 5c55907a57e8327134e2c982c838a53c9fa42f51
|
2023-12-20 22:13:28 +08:00 |
|
ShaneTian
|
4691d4b35d
|
Update transformers to 4.36.2 to resolve bug when saving a checkpoint in the multi-node setting.
Former-commit-id: 3173f8e51eec5e8f488e3dfc54ad371b640d6b87
|
2023-12-20 22:00:41 +08:00 |
|
hiyouga
|
acf5241845
|
fix stop words
Former-commit-id: 6ce6cac9fa8f0af33697e824cf93a9a80cdbd064
|
2023-12-20 19:06:43 +08:00 |
|
hiyouga
|
2bce99b82f
|
fix yi template #1895
Former-commit-id: 05b4fa1e2b13a15ee261a151ac8cd0a2ebdf5edc
|
2023-12-20 18:58:16 +08:00 |
|
hiyouga
|
3c330869ef
|
improve quantization
Former-commit-id: 4dde60017ad8208dfea0b2bb61df6a14a35d03e0
|
2023-12-20 18:27:16 +08:00 |
|
hiyouga
|
dba1af4841
|
add max_memory for gptq #1923
Former-commit-id: 9afc42c8b999fbbc206d9a467ca5795b27a10096
|
2023-12-20 18:15:17 +08:00 |
|
hiyouga
|
2b1e52dcc9
|
fix #1073 #1462 #1735 #1908
Former-commit-id: cd8e2535aa66931b24b96e76c2b56ce703a579b1
|
2023-12-20 17:15:40 +08:00 |
|
hiyouga
|
b5238e945a
|
optimize data loading logic
Former-commit-id: 58f669b384582ac90e85de835f1f44f7003f9ec0
|
2023-12-20 16:15:41 +08:00 |
|
hiyouga
|
afc0f29704
|
fix #1909
Former-commit-id: f563e8d28dfa48a60cbe3d295b20f9cf58de296d
|
2023-12-20 16:11:07 +08:00 |
|
hiyouga
|
de0bb1d2da
|
fix mixtral inference #1821
Former-commit-id: 612f9fd19cbd29e8b1785a1576a9668e7dcd264c
|
2023-12-20 15:11:15 +08:00 |
|
hiyouga
|
cc16ece283
|
fix #1900
Former-commit-id: 4c35214396f873588562606b084740b6581188d9
|
2023-12-19 17:21:46 +08:00 |
|
hiyouga
|
31ba802fc9
|
update readme
Former-commit-id: 36cd747e6a1a568e1a03e6c6611fec48e6ab9df7
|
2023-12-18 22:29:45 +08:00 |
|
hiyouga
|
4b27cf5460
|
add codegeex template
Former-commit-id: a8222722b8097158f1c92e3729f41d411eff3926
|
2023-12-18 19:52:35 +08:00 |
|
hiyouga
|
a53b2a643f
|
add xverse-65B-2 model
Former-commit-id: 3e563a0d9666934dfdab54d61654ec00079a93f1
|
2023-12-18 19:24:09 +08:00 |
|
hiyouga
|
d925ecae1b
|
add models
Former-commit-id: 3a4728557304996bcbe58d7d6380beead7c63c70
|
2023-12-18 19:09:31 +08:00 |
|
hiyouga
|
13fd751a78
|
fix tokenizer for Yi chat models #1617 #1875
Former-commit-id: 9485692c8d367a0b25d3e653db413aa01cb9ad7d
|
2023-12-18 17:18:11 +08:00 |
|
hiyouga
|
74575f8922
|
update readme
Former-commit-id: 01267eee0da0bffb3f0c0378e2e60d14e05585c4
|
2023-12-18 15:46:45 +08:00 |
|
hiyouga
|
5e7bb5fe73
|
fix llama board
Former-commit-id: f43f61b2898dda56aba0066fcb3409b152260bdb
|
2023-12-16 22:17:37 +08:00 |
|
hiyouga
|
790a31404a
|
fix #1742
Former-commit-id: efbb32afdcf0d6aa4ca26f54c95f76dbb84f77dc
v0.4.0
|
2023-12-16 20:50:45 +08:00 |
|
hiyouga
|
f927601702
|
add xverse-65b-chat model
Former-commit-id: fff6288db6b61ca27010ea47c918298f76922106
|
2023-12-16 20:21:29 +08:00 |
|
hiyouga
|
c4654d54d7
|
set version
Former-commit-id: 45a05e3a415eeaf875e2cf15bdba0235fbd7d527
|
2023-12-16 20:17:51 +08:00 |
|
hiyouga
|
df777c30d1
|
add noisy mean initialization #1815
Former-commit-id: 3253b1fca0123071913079277186c160046edf21
|
2023-12-16 19:47:51 +08:00 |
|
hiyouga
|
d81ad2d4bc
|
support dpo-ftx
Former-commit-id: 86dfa04f9821556019fa777106787f73eb70b452
|
2023-12-16 19:21:41 +08:00 |
|
hiyouga
|
9f77e8b025
|
support autogptq in llama board #246
Former-commit-id: fea01226703d1534b5cf511bcb6a49e73bc86ce1
|
2023-12-16 16:31:30 +08:00 |
|
hoshi-hiyouga
|
04dc3f4614
|
Merge pull request #1868 from yhyu13/improve_hfargparser
Improve logging for unknown args
Former-commit-id: 6455013a99ca5c63f5b99c1100e93f794a03c497
|
2023-12-16 16:06:09 +08:00 |
|
yhyu13
|
7d1fe50977
|
Use llmtuner logger
Former-commit-id: ef5a560b4246e04e0ef2612e3520e05288e93707
|
2023-12-16 07:15:27 +00:00 |
|
yhyu13
|
c0e5e3c5d5
|
Improve logging for unknown args
Former-commit-id: 03e49d76ca91f7fcaf1c013740d5f6bfc11a2028
|
2023-12-16 05:16:29 +00:00 |
|
hiyouga
|
3a45cfb604
|
update tips
Former-commit-id: 4432cbda6b7535bcbb40ba77df069fca631b4be8
|
2023-12-15 23:52:50 +08:00 |
|
hiyouga
|
393e4b0f5a
|
fix #1770
Former-commit-id: 8266187cec70bb4bd1b4837d51b09409ec11f93e
|
2023-12-15 23:50:15 +08:00 |
|
hiyouga
|
296711d502
|
support quantization in export model
Former-commit-id: f32500ae6edccab7d14df4c92467e15986866def
|
2023-12-15 23:44:50 +08:00 |
|
hiyouga
|
9121722999
|
update dc link
Former-commit-id: f6789e50e17a377b6d9b434d8e12ad99d8eecfeb
|
2023-12-15 22:11:31 +08:00 |
|
hoshi-hiyouga
|
d8d74091f6
|
Merge pull request #1864 from hiyouga/dev
Refactor hyper-parameters of adapters and model loader
Former-commit-id: d5ce2fb6858b9f2963f355e9f4d6f046eb6efdcd
|
2023-12-15 22:06:56 +08:00 |
|
hiyouga
|
33521fb45e
|
fix bug
Former-commit-id: 95ac272907a04a64785f928536de1fd099150f92
|
2023-12-15 21:54:02 +08:00 |
|
hiyouga
|
e5204e60ed
|
fix bug
Former-commit-id: 8b80baf02cfece53527c27712f0899fa3532c414
|
2023-12-15 21:49:26 +08:00 |
|
hiyouga
|
0409428d87
|
add configurer
Former-commit-id: c40c9889615ffb49c7ce24c69c0d3d20d841c800
|
2023-12-15 21:46:40 +08:00 |
|
hiyouga
|
f902b0d420
|
refactor adapter hparam
Former-commit-id: f82aece9ebd6df83a7a005cc7cbbcec07fa6e14d
|
2023-12-15 20:53:11 +08:00 |
|
hiyouga
|
27ef5b1aa7
|
add loftq
Former-commit-id: 0b900882ef19ac49604a24fbae8b3254f1bff7ad
|
2023-12-14 21:53:56 +08:00 |
|
hiyouga
|
c32303fc7e
|
fix valuehead model
Former-commit-id: 9f628debb6510f2d1c91b00f121a721ab5d648e9
|
2023-12-14 20:15:20 +08:00 |
|
hoshi-hiyouga
|
45abe361ba
|
tiny fix
Former-commit-id: 987df4c62f34026adfe2089910f4ff9ac6ebd9a6
|
2023-12-13 17:32:36 +08:00 |
|
hoshi-hiyouga
|
3ae479faae
|
revert peft version
Former-commit-id: 6440fa1a8c28fd2db58d0905a67d071837e0edd1
|
2023-12-13 10:49:45 +08:00 |
|
hoshi-hiyouga
|
5698038f49
|
update peft version
Former-commit-id: 31c01e1272bd2cd9588e5ee68c1924a3dd55c67e
|
2023-12-13 10:23:51 +08:00 |
|
hoshi-hiyouga
|
020233f725
|
tiny fix
Former-commit-id: 1478bc052417e0939188f55a0adcbf00956960f2
|
2023-12-13 10:21:29 +08:00 |
|
hoshi-hiyouga
|
6f9d55b8eb
|
fix #1819
Former-commit-id: f2e2b0354cbe9a7190ccab807f690cc8ab433a6e
|
2023-12-13 10:14:01 +08:00 |
|
hiyouga
|
2542b62d77
|
remove loftq
Former-commit-id: e175c0a1c631296117abda2403a4b87bbdd35a66
|
2023-12-13 01:53:46 +08:00 |
|
hiyouga
|
95678bb6b1
|
fix sharegpt loading
Former-commit-id: ad35c35f9328bff69e8b9ea7dba6a61a2dc9e28b
|
2023-12-13 00:56:16 +08:00 |
|
hiyouga
|
a78759e7ee
|
add model urls
Former-commit-id: 3139a9fafab246f5461697efd5ed7a6599d85481
|
2023-12-13 00:09:17 +08:00 |
|
hiyouga
|
cc5c523f58
|
update readme
Former-commit-id: e81037d766f89f7e2b6539596397983eba52b492
|
2023-12-12 23:30:29 +08:00 |
|
hiyouga
|
e39bbdd287
|
support loftq
Former-commit-id: e7ac2eb7f7daae17525a278ffbe2f82c0fbd8093
|
2023-12-12 22:47:06 +08:00 |
|
hiyouga
|
d9a50bf93f
|
fix #1795
Former-commit-id: 949ab45487155525789c08027d4f8e7da1b8bc0c
|
2023-12-12 19:58:34 +08:00 |
|
hiyouga
|
934d00ea1e
|
support system column #1765
Former-commit-id: f425584a511c5e42bae8b3ba090eaa898b28adad
|
2023-12-12 19:45:59 +08:00 |
|