hiyouga
|
36f118b66f
|
fix #3625
Former-commit-id: 8c0f5d1db29862277d84aa128b424b7d0f2b187f
|
2024-05-08 17:12:56 +08:00 |
|
hiyouga
|
9f2ea1c4cf
|
fix #3560
Former-commit-id: ea69cbe903a301df1bcc4b63cdc5bd4c6e3a8255
|
2024-05-07 19:03:35 +08:00 |
|
hiyouga
|
c52cab3e40
|
fix llava rlhf
Former-commit-id: f6863cbbcbf960d6481296c6cae3e40fd70e4e14
|
2024-04-28 03:01:49 +08:00 |
|
hiyouga
|
9d1a4b5158
|
fix llava qlora
Former-commit-id: 01c5a669f6fe598aac1758a700a7607da37db1bc
|
2024-04-26 18:00:23 +08:00 |
|
hoshi-hiyouga
|
651fdb819c
|
Update loader.py
Former-commit-id: 72d4817a15f6916706828ea2a61d808183c23773
|
2024-04-26 03:22:40 +08:00 |
|
BUAADreamer
|
62d9d20686
|
modify some style
Former-commit-id: b016e6a671a2f228f0bdd9b8d5995b4669609655
|
2024-04-25 21:58:18 +08:00 |
|
BUAADreamer
|
633e76a1bd
|
modify style
Former-commit-id: c1f1df99e4dc3d0aadf1207b4e9a16218187fd5a
|
2024-04-25 21:29:50 +08:00 |
|
BUAADreamer
|
bb46c64dd6
|
modify style
Former-commit-id: 54b713d0c4ffdfc6a7faeb14471b58bb1cd8acf5
|
2024-04-25 21:15:16 +08:00 |
|
BUAADreamer
|
c11c9711e7
|
add some
Former-commit-id: 8d035a849c4a441d457791aab073861adf69a09f
|
2024-04-25 21:08:32 +08:00 |
|
BUAADreamer
|
80e7813d78
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 131d0bcd554dedd794add7eb3d7b1201cac80e7c
|
2024-04-25 20:02:50 +08:00 |
|
BUAADreamer
|
69fb4351f5
|
merge data part to the text stream
Former-commit-id: 7ee20286d9bcc2d5378bfd6bb02cd3648396d873
|
2024-04-25 19:19:59 +08:00 |
|
hiyouga
|
0a08fbf392
|
add export_device in webui #3333
Former-commit-id: 30ebd3652809d73941e0a5e4a8be11d989faf98d
|
2024-04-25 19:02:32 +08:00 |
|
BUAADreamer
|
d6d109a282
|
merge model part to the text stream
Former-commit-id: b6fcb832ddaed4647d6f2b926f3dfccd47f3ea84
|
2024-04-25 08:20:41 +08:00 |
|
BUAADreamer
|
15c8b9ac37
|
remove error
Former-commit-id: 2bcd1c7dc3595f17ae4e2c4475196cc2d03d0e75
|
2024-04-25 01:01:59 +08:00 |
|
BUAADreamer
|
8dda627bd8
|
remove conflicts
Former-commit-id: f8b637eb76cba7ec229e2978068805ad1cca8adb
|
2024-04-25 00:34:22 +08:00 |
|
BUAADreamer
|
641c97ba74
|
add llava and instructblip
Former-commit-id: 142fb6f4541a1acfefe66ff2574dabde53b00c06
|
2024-04-25 00:22:43 +08:00 |
|
hiyouga
|
fd473aec3d
|
fix log level
Former-commit-id: 8d21302f6201b3f33c10f61f3559bd95be3363c2
|
2024-04-24 23:42:59 +08:00 |
|
hiyouga
|
3b83811b99
|
support new special token #3420
Former-commit-id: f5c6a47f5193ab3a6c137580992bdcce0b31fdd5
|
2024-04-24 23:39:31 +08:00 |
|
hiyouga
|
97cbbac619
|
fix bug
Former-commit-id: 38e164fe4aaea6f0baf121a720291ca42643ba8c
|
2024-04-24 05:21:18 +08:00 |
|
hiyouga
|
84a125bb42
|
fix bug
Former-commit-id: 271c24d2c82d645fa9072e6de94ca38f20411537
|
2024-04-24 05:10:07 +08:00 |
|
hiyouga
|
56d7473fea
|
remove redundant code
Former-commit-id: 4a7a7ad2bcdc493458084f5f3d384239228b7d5a
|
2024-04-24 05:02:18 +08:00 |
|
hiyouga
|
e66b8ade4d
|
support unsloth generate
Former-commit-id: 0ef1ad9f505dba71db9342f524cc3a7565e5e09e
|
2024-04-24 04:46:53 +08:00 |
|
hiyouga
|
460da206f6
|
refactor patcher
Former-commit-id: 263cfe1294f5c3188f5e8d65791f35ee0d87315a
|
2024-04-24 03:02:23 +08:00 |
|
hiyouga
|
33f525455e
|
reenable sdpa and fast tok by default
Former-commit-id: 9e00902dbedc71d55743d1bf237843506a557891
|
2024-04-24 02:18:44 +08:00 |
|
hiyouga
|
83b8bc8937
|
fix #3347 #3387
Former-commit-id: c253c18185a29b59190f3e0ed236c2bb4c788085
|
2024-04-24 01:30:16 +08:00 |
|
BUAADreamer
|
20e05970ab
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: a730f89a972f1a9d37c718c716f199cb8d4903b2
|
2024-04-23 18:45:43 +08:00 |
|
hiyouga
|
04da91e84e
|
fix #3365
Former-commit-id: 415ce41e8fa887e980e5bd575c8e95bd4076b90b
|
2024-04-21 19:20:18 +08:00 |
|
hiyouga
|
366c0eb1c5
|
fix mod stuff
Former-commit-id: cf3988226e6398c67bb2955578e436fc505aa5c5
|
2024-04-21 18:11:10 +08:00 |
|
hoshi-hiyouga
|
5c3922713a
|
Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth
Former-commit-id: 4da2ece53353b63e672ff529d6beba41ff710c14
|
2024-04-21 18:05:52 +08:00 |
|
hoshi-hiyouga
|
7279a7014c
|
fix #3348
Former-commit-id: aa5e921c00f60074eceb2f9d4d8837cc713edba6
|
2024-04-20 10:34:09 +08:00 |
|
Marco
|
68dbd5d220
|
Added Mixture of Depths
Former-commit-id: 75dd98b9abc847e22cb263c17ebcd2ca5dd98345
|
2024-04-18 20:31:24 +02:00 |
|
hiyouga
|
0d0c6612a5
|
fix #3324
Former-commit-id: 5e710c4ac331f3400534d33b2646c4108c898d98
|
2024-04-18 15:34:45 +08:00 |
|
hiyouga
|
dd992dcce9
|
fix #3316
Former-commit-id: 7395e9e90a209228ff563ab54319955608850fc3
|
2024-04-17 22:54:34 +08:00 |
|
hoshi-hiyouga
|
e8667f9c90
|
Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
Former-commit-id: 10a5e1e65b34b03e5ca2a41bf6ded09a3fb25f0c
|
2024-04-16 17:32:16 +08:00 |
|
hoshi-hiyouga
|
b5c3d23a22
|
Update utils.py
Former-commit-id: 7edf4dbed88b8034282f14fd6e0cb6f7f9e5f805
|
2024-04-16 17:29:30 +08:00 |
|
hoshi-hiyouga
|
88a080ced4
|
Update patcher.py
Former-commit-id: 494e6a1e05b38f5ff61d83327303614f53c92e64
|
2024-04-16 17:29:19 +08:00 |
|
hoshi-hiyouga
|
12f43694be
|
Update adapter.py
Former-commit-id: 8f7b75b26f020d8ae85baab7b082475c3bfeb512
|
2024-04-16 17:28:12 +08:00 |
|
Jonery
|
2ba03e6ef3
|
resolve gradient checkpointing issue.
Former-commit-id: 6df9135d063bb6102f0cbcdf0d702076f5febbae
|
2024-04-16 12:05:27 +08:00 |
|
hiyouga
|
ba4efe3ff6
|
support unsloth 2024.4
Former-commit-id: 14a83f8bc4fe44783252378fce59198194a96bb8
|
2024-04-16 00:25:03 +08:00 |
|
hiyouga
|
2aa1d1476e
|
add codegemma
Former-commit-id: 9324176525c2eda22962b0ca1895009b6237e6e3
|
2024-04-16 00:11:15 +08:00 |
|
hiyouga
|
19874e39ee
|
support cohere commandR #3184
Former-commit-id: e077c36872740f6b2ac255aee9da6c4c70f28977
|
2024-04-15 23:26:42 +08:00 |
|
Jonery
|
22188f1fa3
|
Feature BAdam
Former-commit-id: d8d2807fbcf587c37f7fd34a23e9397d2775ceed
|
2024-04-15 23:15:27 +08:00 |
|
hiyouga
|
be206df674
|
update examples
Former-commit-id: 369294b31c8a03a1cafcee83eb31a817007d3c49
|
2024-04-15 22:14:34 +08:00 |
|
hoshi-hiyouga
|
740d89e9df
|
Merge pull request #3276 from liu-zichen/fix_mixtral
fix: turn on output_router_logits of mixtral
Former-commit-id: 07bbaf5c67d00a152e5304e81b15fd9189e7bb99
|
2024-04-15 15:38:16 +08:00 |
|
hiyouga
|
506276c9cb
|
fix #3273
Former-commit-id: 3b20c89b342a068356ffc29c3724b645775c65db
|
2024-04-15 15:32:58 +08:00 |
|
liuzc
|
44c86150c9
|
fix: mixtral output_router_logits
Former-commit-id: ab3171ea97ec968b972287287ef9ee2502c6d37c
|
2024-04-15 12:11:49 +08:00 |
|
hiyouga
|
a97f8d1fa8
|
release v0.6.2
Former-commit-id: f92ad0a62d957b595f6a76a5403216b163eb3d17
|
2024-04-11 20:08:51 +08:00 |
|
hoshi-hiyouga
|
db51e05205
|
Update adapter.py
Former-commit-id: 720fde3683529ed7e08ac27c7c4598c6bdc30d44
|
2024-04-10 00:57:51 +08:00 |
|
hoshi-hiyouga
|
bfb090ed7a
|
Update adapter.py
Former-commit-id: a84b8d17dbf221259212e81931d80bcdd6284ad7
|
2024-04-10 00:57:30 +08:00 |
|
Erich Schubert
|
cc2ff3065f
|
Pass additional_target to unsloth
Fixes #3200
Former-commit-id: f8f87f5b0549cba6a011749c42064047f82ba577
|
2024-04-09 17:53:40 +02:00 |
|