hiyouga
|
5c9da798b5
|
update docs
Former-commit-id: a4a2e94241bea6f96590f6cb8ca8b5cddee1917e
|
2024-05-06 21:47:00 +08:00 |
|
Oscar
|
d0597897bf
|
Fix badam example outdated argument
Former-commit-id: 29aa188cc774cb72367f706f1cd4c07bc5a9f241
|
2024-05-05 23:35:19 +08:00 |
|
hiyouga
|
ce8200ad98
|
update webui and add CLIs
Former-commit-id: 1368dda22ab875914c9dd86ee5146a4f6a4736ad
|
2024-05-03 02:58:23 +08:00 |
|
hiyouga
|
2cedb59bee
|
Update prepare.sh
Former-commit-id: 5928b869251a984a085289ca6861a9731dc5b910
|
2024-05-02 17:16:02 +08:00 |
|
hiyouga
|
51f776ae2a
|
fix llava qlora
Former-commit-id: 01c5a669f6fe598aac1758a700a7607da37db1bc
|
2024-04-26 18:00:23 +08:00 |
|
hiyouga
|
697bc20941
|
add llava to llamaboard
Former-commit-id: deaaff0a9de0eef9691991c99cd797461b1165cc
|
2024-04-26 06:41:35 +08:00 |
|
hiyouga
|
23b881bff1
|
support mllm hf inference
Former-commit-id: 2c7c01282acd7ddabbb17ce3246b8dae4bc4b8cf
|
2024-04-26 05:34:58 +08:00 |
|
BUAADreamer
|
f74e640565
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 131d0bcd554dedd794add7eb3d7b1201cac80e7c
|
2024-04-25 20:02:50 +08:00 |
|
BUAADreamer
|
3c792174db
|
merge data part to the text stream
Former-commit-id: 7ee20286d9bcc2d5378bfd6bb02cd3648396d873
|
2024-04-25 19:19:59 +08:00 |
|
hiyouga
|
9aeb88c426
|
add export_device in webui #3333
Former-commit-id: 30ebd3652809d73941e0a5e4a8be11d989faf98d
|
2024-04-25 19:02:32 +08:00 |
|
BUAADreamer
|
12c51655ce
|
add llava and instructblip
Former-commit-id: 142fb6f4541a1acfefe66ff2574dabde53b00c06
|
2024-04-25 00:22:43 +08:00 |
|
BUAADreamer
|
1451297c78
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 67800c565b086f362b8cf131b0c9babaa7a7ebc7
|
2024-04-23 19:22:42 +08:00 |
|
BUAADreamer
|
0b99b13786
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: b78b5f290aa38a7454e101ee9703fb6fac5064ac
|
2024-04-23 18:47:03 +08:00 |
|
BUAADreamer
|
f5edbf2b49
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 6287d1b789c631205c1033adf036e28deaef4167
|
2024-04-23 18:46:12 +08:00 |
|
BUAADreamer
|
ab6dc0ea30
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: a730f89a972f1a9d37c718c716f199cb8d4903b2
|
2024-04-23 18:45:43 +08:00 |
|
hiyouga
|
79d34ce0f3
|
update examples
Former-commit-id: 8bf55682cdfbbdca0f01073eac0084c20a6a09d1
|
2024-04-23 18:29:46 +08:00 |
|
hiyouga
|
ba06eb65ca
|
update readme and examples
Former-commit-id: 27dd9bf201c24f7804811398bc2758966ec78432
|
2024-04-22 00:37:32 +08:00 |
|
hiyouga
|
be716972fe
|
remove extras
Former-commit-id: d67e972f8c3d5273e589c8c85c0a1620f59785c5
|
2024-04-22 00:35:41 +08:00 |
|
hiyouga
|
d16561e7a4
|
fix bug in galore optimizer
Former-commit-id: c05ac23261a5a8ba893c2918a43dc7777307407b
|
2024-04-21 18:53:22 +08:00 |
|
hiyouga
|
f8e219dc81
|
fix mod stuff
Former-commit-id: cf3988226e6398c67bb2955578e436fc505aa5c5
|
2024-04-21 18:11:10 +08:00 |
|
Marco
|
44cda2eece
|
Added Mixture of Depths
Former-commit-id: 75dd98b9abc847e22cb263c17ebcd2ca5dd98345
|
2024-04-18 20:31:24 +02:00 |
|
hiyouga
|
a4167fd925
|
support badam for all stages
Former-commit-id: 7a1380646119bfe6855f73dd90570defcea05281
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
de728d0371
|
Update sft.sh
Former-commit-id: 2b4b1562e91bbb02e345e71b7721da9333c0791b
|
2024-04-16 17:25:40 +08:00 |
|
Jonery
|
6dd6b3e396
|
resolve gradient checkpointing issue.
Former-commit-id: 6df9135d063bb6102f0cbcdf0d702076f5febbae
|
2024-04-16 12:05:27 +08:00 |
|
Jonery
|
d4d471450f
|
Feature BAdam
Former-commit-id: d8d2807fbcf587c37f7fd34a23e9397d2775ceed
|
2024-04-15 23:15:27 +08:00 |
|
hiyouga
|
276f2cb24e
|
update examples
Former-commit-id: 369294b31c8a03a1cafcee83eb31a817007d3c49
|
2024-04-15 22:14:34 +08:00 |
|
khazic
|
19adfb88a9
|
Upgrade README.md
Former-commit-id: 697f768d7185789ee054c94f4f161a65b8a505bc
|
2024-04-13 20:50:49 +08:00 |
|
khazic
|
daaafa900a
|
Added specimens for single-card full parameter prediction
Former-commit-id: d8d4fb9fa4b0e1950a453682e5e186f34f085dee
|
2024-04-13 20:45:19 +08:00 |
|
hiyouga
|
3ac333fc6a
|
update examples
Former-commit-id: de40ad62ba3d4c74c69de97b39cc79786ac28f0f
|
2024-04-04 14:48:21 +08:00 |
|
hiyouga
|
755b6511ff
|
update examples
Former-commit-id: 2715cfe20f6f4532bebaa47b80ccd5df43d6a490
|
2024-04-02 21:09:25 +08:00 |
|
hiyouga
|
35621c6089
|
add zh readme
Former-commit-id: 389a170a4d42c56c71c0e17bbe018c4cb1983b5a
|
2024-04-02 20:58:45 +08:00 |
|
hiyouga
|
38b59664e6
|
update examples
Former-commit-id: c078582a759f6bce6e760cd39a05883f7eb194fe
|
2024-04-02 20:51:21 +08:00 |
|
hiyouga
|
933a084999
|
update examples
Former-commit-id: bf36b16e48d6438de6d0b2f2bfe33f7895699b9d
|
2024-04-02 20:41:49 +08:00 |
|
hiyouga
|
c1510d19c7
|
update readme
Former-commit-id: 9b8e7ccdab167f53fb897e1940562682324e8ff0
|
2024-04-02 20:37:37 +08:00 |
|
hiyouga
|
b12176d818
|
simplify readme
Former-commit-id: 0da6ec2d516326fe9c7583ba71cd1778eb838178
|
2024-04-02 20:07:43 +08:00 |
|
hiyouga
|
61eb3a3d46
|
update webui
Former-commit-id: e96d260917a35ad2068f7b28b4f0b334b808ccc2
|
2024-04-01 16:23:28 +08:00 |
|
hiyouga
|
d764cd8736
|
support ORPO
Former-commit-id: f44a4c27e2461cdaa1b16865f597a31033c0e6d9
|
2024-03-31 18:29:50 +08:00 |
|
hiyouga
|
59e6ebf039
|
update trainers
Former-commit-id: d0dd6eefed0b86895ed00a7cafb331e5193db645
|
2024-03-28 18:16:27 +08:00 |
|
hiyouga
|
587e65e442
|
fix #2981
Former-commit-id: ede2a913856e52c0a96155705116528d3af15998
|
2024-03-26 17:53:04 +08:00 |
|
hiyouga
|
935ee0a023
|
support fsdp + qlora
Former-commit-id: b894bf8e84be689db258021f0638e9ac939abcbc
|
2024-03-21 00:36:06 +08:00 |
|
hiyouga
|
46f99ff277
|
improve lora+ impl.
Former-commit-id: 332bad25455a70ad9204e7dd384bb086d789aa39
|
2024-03-13 23:32:51 +08:00 |
|
齐保元
|
3c91e86268
|
[FEATURE]: ADD LORA+ ALGORITHM
Former-commit-id: c35b3c3b1e27171f8a703f88ede1dc8a84c80a56
|
2024-03-13 19:43:27 +08:00 |
|
hiyouga
|
7ff8a064f3
|
support layerwise galore
Former-commit-id: d43a4da0947897d0be3f62fad3107754d4c89f2b
|
2024-03-10 00:24:11 +08:00 |
|
hiyouga
|
8ed1463236
|
update examples
Former-commit-id: 38592faa258f7331afb95bc5db4b9bf37f08105d
|
2024-03-09 02:30:37 +08:00 |
|
hiyouga
|
9b97b23ce7
|
fix aqlm version
Former-commit-id: 05673f81f0295c76957f3247c62f95fda322a63e
|
2024-03-09 00:09:09 +08:00 |
|
hiyouga
|
53ab28533e
|
fix example params
Former-commit-id: 0280748528488d7bee6b9074025255453966124c
|
2024-03-08 20:41:43 +08:00 |
|
hiyouga
|
e416cecf62
|
fix galore
Former-commit-id: 62a3ceeef8f60caef43ccc7f971a0c9184e21296
|
2024-03-08 00:44:51 +08:00 |
|
hiyouga
|
bf812fbe40
|
add galore examples
Former-commit-id: aabf1b99f39aae535401b2f65f0d629def6e39f5
|
2024-03-07 22:53:45 +08:00 |
|
hiyouga
|
056d2d956a
|
support vllm
Former-commit-id: 889f6e910e654d8ec3922c2185042d737ffbf1c3
|
2024-03-07 20:26:31 +08:00 |
|
hiyouga
|
6b407092d9
|
update examples
Former-commit-id: 194e25606515bfa42c3be27d68f68d604191514b
|
2024-03-06 13:14:57 +08:00 |
|