BUAADreamer
|
20e05970ab
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: a730f89a972f1a9d37c718c716f199cb8d4903b2
|
2024-04-23 18:45:43 +08:00 |
|
hiyouga
|
63c85187e2
|
update readme and examples
Former-commit-id: 27dd9bf201c24f7804811398bc2758966ec78432
|
2024-04-22 00:37:32 +08:00 |
|
hiyouga
|
5df0c1e0a4
|
remove extras
Former-commit-id: d67e972f8c3d5273e589c8c85c0a1620f59785c5
|
2024-04-22 00:35:41 +08:00 |
|
hiyouga
|
b353a080cb
|
fix bug in galore optimizer
Former-commit-id: c05ac23261a5a8ba893c2918a43dc7777307407b
|
2024-04-21 18:53:22 +08:00 |
|
hiyouga
|
366c0eb1c5
|
fix mod stuff
Former-commit-id: cf3988226e6398c67bb2955578e436fc505aa5c5
|
2024-04-21 18:11:10 +08:00 |
|
Marco
|
68dbd5d220
|
Added Mixture of Depths
Former-commit-id: 75dd98b9abc847e22cb263c17ebcd2ca5dd98345
|
2024-04-18 20:31:24 +02:00 |
|
hiyouga
|
d41793228e
|
support badam for all stages
Former-commit-id: 7a1380646119bfe6855f73dd90570defcea05281
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
ac32264bfe
|
Update sft.sh
Former-commit-id: 2b4b1562e91bbb02e345e71b7721da9333c0791b
|
2024-04-16 17:25:40 +08:00 |
|
Jonery
|
2ba03e6ef3
|
resolve gradient checkpointing issue.
Former-commit-id: 6df9135d063bb6102f0cbcdf0d702076f5febbae
|
2024-04-16 12:05:27 +08:00 |
|
Jonery
|
22188f1fa3
|
Feature BAdam
Former-commit-id: d8d2807fbcf587c37f7fd34a23e9397d2775ceed
|
2024-04-15 23:15:27 +08:00 |
|
hiyouga
|
be206df674
|
update examples
Former-commit-id: 369294b31c8a03a1cafcee83eb31a817007d3c49
|
2024-04-15 22:14:34 +08:00 |
|
khazic
|
f8378037a8
|
Upgrade README.md
Former-commit-id: 697f768d7185789ee054c94f4f161a65b8a505bc
|
2024-04-13 20:50:49 +08:00 |
|
khazic
|
8404b94bf6
|
Added specimens for single-card full parameter prediction
Former-commit-id: d8d4fb9fa4b0e1950a453682e5e186f34f085dee
|
2024-04-13 20:45:19 +08:00 |
|
hiyouga
|
46a76afd44
|
update examples
Former-commit-id: de40ad62ba3d4c74c69de97b39cc79786ac28f0f
|
2024-04-04 14:48:21 +08:00 |
|
hiyouga
|
aef4b0d4a3
|
update examples
Former-commit-id: 2715cfe20f6f4532bebaa47b80ccd5df43d6a490
|
2024-04-02 21:09:25 +08:00 |
|
hiyouga
|
1317dd28a3
|
add zh readme
Former-commit-id: 389a170a4d42c56c71c0e17bbe018c4cb1983b5a
|
2024-04-02 20:58:45 +08:00 |
|
hiyouga
|
037e8518d5
|
update examples
Former-commit-id: c078582a759f6bce6e760cd39a05883f7eb194fe
|
2024-04-02 20:51:21 +08:00 |
|
hiyouga
|
b1401c70be
|
update examples
Former-commit-id: bf36b16e48d6438de6d0b2f2bfe33f7895699b9d
|
2024-04-02 20:41:49 +08:00 |
|
hiyouga
|
06af770c99
|
update readme
Former-commit-id: 9b8e7ccdab167f53fb897e1940562682324e8ff0
|
2024-04-02 20:37:37 +08:00 |
|
hiyouga
|
75819c1220
|
simplify readme
Former-commit-id: 0da6ec2d516326fe9c7583ba71cd1778eb838178
|
2024-04-02 20:07:43 +08:00 |
|
hiyouga
|
99294220db
|
update webui
Former-commit-id: e96d260917a35ad2068f7b28b4f0b334b808ccc2
|
2024-04-01 16:23:28 +08:00 |
|
hiyouga
|
e6c7e6e667
|
support ORPO
Former-commit-id: f44a4c27e2461cdaa1b16865f597a31033c0e6d9
|
2024-03-31 18:29:50 +08:00 |
|
hiyouga
|
27f5c967e4
|
update trainers
Former-commit-id: d0dd6eefed0b86895ed00a7cafb331e5193db645
|
2024-03-28 18:16:27 +08:00 |
|
hiyouga
|
bb5d0954dc
|
fix #2981
Former-commit-id: ede2a913856e52c0a96155705116528d3af15998
|
2024-03-26 17:53:04 +08:00 |
|
hiyouga
|
b590e82d41
|
support fsdp + qlora
Former-commit-id: b894bf8e84be689db258021f0638e9ac939abcbc
|
2024-03-21 00:36:06 +08:00 |
|
hiyouga
|
4ef67ed4dd
|
improve lora+ impl.
Former-commit-id: 332bad25455a70ad9204e7dd384bb086d789aa39
|
2024-03-13 23:32:51 +08:00 |
|
齐保元
|
3c15d4cbec
|
[FEATURE]: ADD LORA+ ALGORITHM
Former-commit-id: c35b3c3b1e27171f8a703f88ede1dc8a84c80a56
|
2024-03-13 19:43:27 +08:00 |
|
hiyouga
|
0aacc41252
|
support layerwise galore
Former-commit-id: d43a4da0947897d0be3f62fad3107754d4c89f2b
|
2024-03-10 00:24:11 +08:00 |
|
hiyouga
|
e233a207fc
|
update examples
Former-commit-id: 38592faa258f7331afb95bc5db4b9bf37f08105d
|
2024-03-09 02:30:37 +08:00 |
|
hiyouga
|
1dd3f17f79
|
fix aqlm version
Former-commit-id: 05673f81f0295c76957f3247c62f95fda322a63e
|
2024-03-09 00:09:09 +08:00 |
|
hiyouga
|
7338eab8c6
|
fix example params
Former-commit-id: 0280748528488d7bee6b9074025255453966124c
|
2024-03-08 20:41:43 +08:00 |
|
hiyouga
|
b5187e4104
|
fix galore
Former-commit-id: 62a3ceeef8f60caef43ccc7f971a0c9184e21296
|
2024-03-08 00:44:51 +08:00 |
|
hiyouga
|
2cba075e56
|
add galore examples
Former-commit-id: aabf1b99f39aae535401b2f65f0d629def6e39f5
|
2024-03-07 22:53:45 +08:00 |
|
hiyouga
|
ddabd699ca
|
support vllm
Former-commit-id: 889f6e910e654d8ec3922c2185042d737ffbf1c3
|
2024-03-07 20:26:31 +08:00 |
|
hiyouga
|
004294623f
|
update examples
Former-commit-id: 194e25606515bfa42c3be27d68f68d604191514b
|
2024-03-06 13:14:57 +08:00 |
|
hiyouga
|
4026fca9b8
|
add examples
Former-commit-id: 2744dc9d2f9df4150a496b38e24ea96040a85bef
|
2024-03-05 03:16:35 +08:00 |
|
hiyouga
|
8d21b54d8d
|
add examples
Former-commit-id: 8cdf64adc2c8e5f194a6df26cf749d7bc9bc039f
|
2024-02-28 23:19:25 +08:00 |
|