hiyouga
|
0b571f84b4
|
support pissa
Former-commit-id: ef8e45f2eaf466c54e9a671512a2974575677b08
|
2024-06-16 01:08:12 +08:00 |
|
hiyouga
|
6306f3e2ea
|
Update README.md
Former-commit-id: f8d701cd3ce2e56f95b4f5439b8b48d5b62e0d2b
|
2024-06-13 16:02:21 +08:00 |
|
hiyouga
|
db6e74884c
|
update examples
Former-commit-id: d6bf6231290d79eb3a63e711f18fa711ef18a4f6
|
2024-06-13 03:26:10 +08:00 |
|
hiyouga
|
e06568de98
|
Update llama3_full_sft_ds3.yaml
Former-commit-id: e715af62d521112d9c155cfa91fbb42fa0e77710
|
2024-06-13 03:16:20 +08:00 |
|
hiyouga
|
554c84f8d3
|
update examples
Former-commit-id: 19681f93db399d695aa8e35f8ec2a9e720875baa
|
2024-06-13 03:15:06 +08:00 |
|
hiyouga
|
990dd6d44c
|
lora modules: all by default
Former-commit-id: 52c4ae87c7f4312704c31ef26b079b2c5b95ea5f
|
2024-06-06 03:53:28 +08:00 |
|
hiyouga
|
0b671615d0
|
update train hparams
Former-commit-id: 1ca9fce55b55bf209f4b76152b586731932a3f39
|
2024-06-06 01:49:20 +08:00 |
|
hiyouga
|
1cc9508fb3
|
tiny fix
Former-commit-id: f9d50501aac1f60a3b445ca3fee9aa60995461ee
|
2024-06-04 00:31:10 +08:00 |
|
hiyouga
|
1ef396362b
|
fix #4005 #4013
Former-commit-id: 8608fa268cde5cddf8d0c6c2eb2cb5fa246c1831
|
2024-06-03 19:12:29 +08:00 |
|
hiyouga
|
0c722c879a
|
update readme
Former-commit-id: 440e9de66986ef7736361ce8ec3e23ce68655a56
|
2024-05-29 18:39:11 +08:00 |
|
hiyouga
|
edbc4bdac4
|
support DDP in webui
Former-commit-id: d059262ff8dc857f597d2657546ec625726a664a
|
2024-05-28 19:24:22 +08:00 |
|
hiyouga
|
c12d99ea4e
|
update dpo examples
Former-commit-id: 69e32a7cb6336ca9a953c379ec794818b3f169bd
|
2024-05-27 19:56:04 +08:00 |
|
hiyouga
|
ed2601a909
|
support SimPO #3900
Former-commit-id: 6b954ce60155cf8334150b795cfc4bb63ca74c8b
|
2024-05-26 23:46:33 +08:00 |
|
hiyouga
|
d24969bb7e
|
improve KTO impl., replace datasets
Former-commit-id: e56a57ddcf061de6e4acc8679f7dbf0b68364986
|
2024-05-18 03:44:56 +08:00 |
|
hiyouga
|
0d7d9f3ffe
|
update badam example #3764
Former-commit-id: a3730fd0a96bab869be6d695031182dabaea8137
|
2024-05-17 02:21:10 +08:00 |
|
hiyouga
|
e40ed5b474
|
update examples
Former-commit-id: 3b5f138155d96b346bda18e465cf60ec7d99e19c
|
2024-05-17 01:02:00 +08:00 |
|
hiyouga
|
bfb3a61461
|
fix examples #3769
Former-commit-id: 80c036beb8d9ddac8f844f1818c9488ded04e86e
|
2024-05-16 19:12:09 +08:00 |
|
hiyouga
|
9316996bdc
|
fix #3694
Former-commit-id: 3d1b818cb6a77b7603724fbeb756b468aa74e7ea
|
2024-05-16 00:35:28 +08:00 |
|
hiyouga
|
add54e3aaa
|
fix examples
Former-commit-id: 910ffaf46e3dde87d2dbb48b82a59a9898a90847
|
2024-05-15 00:26:10 +08:00 |
|
hiyouga
|
eeb8ac3ca0
|
update examples
Former-commit-id: 09269c59427e8a007c1c1b6f9d2014b4c0d0a328
|
2024-05-15 00:05:17 +08:00 |
|
hiyouga
|
a72c7c3721
|
add npu examples
Former-commit-id: 0f21e68e2dbd84c820d66d5c6d980004efc51d51
|
2024-05-14 23:32:53 +08:00 |
|
hiyouga
|
b4172aa25c
|
update examples
Former-commit-id: 779603055ae9216ff549f5285caac8c0c0a1e9fb
|
2024-05-13 20:39:36 +08:00 |
|
hiyouga
|
913f22bf09
|
fix #3602
Former-commit-id: 1518b45490606ea200482da4737113c46985e8c5
|
2024-05-07 17:50:27 +08:00 |
|
hiyouga
|
6b3a01b64c
|
update examples
Former-commit-id: cca50b627c85e0a777717d609377406cc7fd579f
|
2024-05-06 23:07:55 +08:00 |
|
hiyouga
|
6710e27429
|
update example docs
Former-commit-id: 102cd42768d9eb2cf1219309a25b41e26149067e
|
2024-05-06 22:51:02 +08:00 |
|
hiyouga
|
ce048fadfe
|
update docs
Former-commit-id: a4a2e94241bea6f96590f6cb8ca8b5cddee1917e
|
2024-05-06 21:47:00 +08:00 |
|
Oscar
|
75232784d5
|
Fix badam example outdated argument
Former-commit-id: 29aa188cc774cb72367f706f1cd4c07bc5a9f241
|
2024-05-05 23:35:19 +08:00 |
|
hiyouga
|
419a3849f2
|
update webui and add CLIs
Former-commit-id: 1368dda22ab875914c9dd86ee5146a4f6a4736ad
|
2024-05-03 02:58:23 +08:00 |
|
hiyouga
|
a9e80b6b20
|
Update prepare.sh
Former-commit-id: 5928b869251a984a085289ca6861a9731dc5b910
|
2024-05-02 17:16:02 +08:00 |
|
hiyouga
|
9d1a4b5158
|
fix llava qlora
Former-commit-id: 01c5a669f6fe598aac1758a700a7607da37db1bc
|
2024-04-26 18:00:23 +08:00 |
|
hiyouga
|
9c660479b8
|
add llava to llamaboard
Former-commit-id: deaaff0a9de0eef9691991c99cd797461b1165cc
|
2024-04-26 06:41:35 +08:00 |
|
hiyouga
|
a635030931
|
support mllm hf inference
Former-commit-id: 2c7c01282acd7ddabbb17ce3246b8dae4bc4b8cf
|
2024-04-26 05:34:58 +08:00 |
|
BUAADreamer
|
80e7813d78
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 131d0bcd554dedd794add7eb3d7b1201cac80e7c
|
2024-04-25 20:02:50 +08:00 |
|
BUAADreamer
|
69fb4351f5
|
merge data part to the text stream
Former-commit-id: 7ee20286d9bcc2d5378bfd6bb02cd3648396d873
|
2024-04-25 19:19:59 +08:00 |
|
hiyouga
|
0a08fbf392
|
add export_device in webui #3333
Former-commit-id: 30ebd3652809d73941e0a5e4a8be11d989faf98d
|
2024-04-25 19:02:32 +08:00 |
|
BUAADreamer
|
641c97ba74
|
add llava and instructblip
Former-commit-id: 142fb6f4541a1acfefe66ff2574dabde53b00c06
|
2024-04-25 00:22:43 +08:00 |
|
BUAADreamer
|
ce37008f6d
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 67800c565b086f362b8cf131b0c9babaa7a7ebc7
|
2024-04-23 19:22:42 +08:00 |
|
BUAADreamer
|
9742c5d2d2
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: b78b5f290aa38a7454e101ee9703fb6fac5064ac
|
2024-04-23 18:47:03 +08:00 |
|
BUAADreamer
|
594c7c3678
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 6287d1b789c631205c1033adf036e28deaef4167
|
2024-04-23 18:46:12 +08:00 |
|
BUAADreamer
|
20e05970ab
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: a730f89a972f1a9d37c718c716f199cb8d4903b2
|
2024-04-23 18:45:43 +08:00 |
|
hiyouga
|
8412cd3091
|
update examples
Former-commit-id: 8bf55682cdfbbdca0f01073eac0084c20a6a09d1
|
2024-04-23 18:29:46 +08:00 |
|
hiyouga
|
63c85187e2
|
update readme and examples
Former-commit-id: 27dd9bf201c24f7804811398bc2758966ec78432
|
2024-04-22 00:37:32 +08:00 |
|
hiyouga
|
5df0c1e0a4
|
remove extras
Former-commit-id: d67e972f8c3d5273e589c8c85c0a1620f59785c5
|
2024-04-22 00:35:41 +08:00 |
|
hiyouga
|
b353a080cb
|
fix bug in galore optimizer
Former-commit-id: c05ac23261a5a8ba893c2918a43dc7777307407b
|
2024-04-21 18:53:22 +08:00 |
|
hiyouga
|
366c0eb1c5
|
fix mod stuff
Former-commit-id: cf3988226e6398c67bb2955578e436fc505aa5c5
|
2024-04-21 18:11:10 +08:00 |
|
Marco
|
68dbd5d220
|
Added Mixture of Depths
Former-commit-id: 75dd98b9abc847e22cb263c17ebcd2ca5dd98345
|
2024-04-18 20:31:24 +02:00 |
|
hiyouga
|
d41793228e
|
support badam for all stages
Former-commit-id: 7a1380646119bfe6855f73dd90570defcea05281
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
ac32264bfe
|
Update sft.sh
Former-commit-id: 2b4b1562e91bbb02e345e71b7721da9333c0791b
|
2024-04-16 17:25:40 +08:00 |
|
Jonery
|
2ba03e6ef3
|
resolve gradient checkpointing issue.
Former-commit-id: 6df9135d063bb6102f0cbcdf0d702076f5febbae
|
2024-04-16 12:05:27 +08:00 |
|
Jonery
|
22188f1fa3
|
Feature BAdam
Former-commit-id: d8d2807fbcf587c37f7fd34a23e9397d2775ceed
|
2024-04-15 23:15:27 +08:00 |
|