hiyouga
|
f25b8626bf
|
support pissa
Former-commit-id: 8c1046d78ac6c8f9429b73617e35e1eccb35138f
|
2024-06-16 01:08:12 +08:00 |
|
hiyouga
|
d4ce280fbc
|
Update README.md
Former-commit-id: 2d43b8bb49057e14a9f79146acdcc0cfa94bcc5a
|
2024-06-13 16:02:21 +08:00 |
|
hiyouga
|
f81a839197
|
update examples
Former-commit-id: 892e561c28cbbab1ee38a8022ddd9b397c873563
|
2024-06-13 03:26:10 +08:00 |
|
hiyouga
|
4c40171c55
|
Update llama3_full_sft_ds3.yaml
Former-commit-id: a19cdd39feafa91fdacae4818393f82e9724c53f
|
2024-06-13 03:16:20 +08:00 |
|
hiyouga
|
0926d81053
|
update examples
Former-commit-id: b6e008c152421db668c971b0828cbee6a80b16bc
|
2024-06-13 03:15:06 +08:00 |
|
hiyouga
|
cceff9f520
|
lora modules: all by default
Former-commit-id: cae47379079ff811aa385c297481a27020a8da6b
|
2024-06-06 03:53:28 +08:00 |
|
hiyouga
|
00b3fb4d14
|
update train hparams
Former-commit-id: dc4a00dd63769dc02d898c8bad2c158e4e5c0447
|
2024-06-06 01:49:20 +08:00 |
|
hiyouga
|
0eff6a66d5
|
tiny fix
Former-commit-id: 5a13b3baa63225e7f79e024610722de0f87e0acc
|
2024-06-04 00:31:10 +08:00 |
|
hiyouga
|
e4ce59243b
|
fix #4005 #4013
Former-commit-id: eed33862bc733361f3c28b3c95dc0eb4ea00884c
|
2024-06-03 19:12:29 +08:00 |
|
hiyouga
|
a71a6a05c3
|
update readme
Former-commit-id: 89ca832740731dfb121175aa5c16b13bd4944011
|
2024-05-29 18:39:11 +08:00 |
|
hiyouga
|
3ea8f5e6b9
|
support DDP in webui
Former-commit-id: 7c016b22aa9208ec14f00a9bdb51f69aebb02af5
|
2024-05-28 19:24:22 +08:00 |
|
hiyouga
|
710642827a
|
update dpo examples
Former-commit-id: 30e1c8e7450a68ccabede245cbc09b416ef7a94d
|
2024-05-27 19:56:04 +08:00 |
|
hiyouga
|
4807c11db8
|
support SimPO #3900
Former-commit-id: cb63b32986c43f97994211ec34dc5928fc3bb9d7
|
2024-05-26 23:46:33 +08:00 |
|
hiyouga
|
13d7b48efe
|
improve KTO impl., replace datasets
Former-commit-id: c450ee87a35ff9235f9b695b0de2e042b2971178
|
2024-05-18 03:44:56 +08:00 |
|
hiyouga
|
947f0e9964
|
update badam example #3764
Former-commit-id: e5bba7cf1bd5317a2446b67ee5e0e245bb8b4ad4
|
2024-05-17 02:21:10 +08:00 |
|
hiyouga
|
dfff5119b4
|
update examples
Former-commit-id: ddec9e1b842d407790637e9b0b181f8b26926db9
|
2024-05-17 01:02:00 +08:00 |
|
hiyouga
|
5eb8107db2
|
fix examples #3769
Former-commit-id: 3df986c6793a51ec2cb5f31fd1808cd3a9883bc4
|
2024-05-16 19:12:09 +08:00 |
|
hiyouga
|
6e6267f17c
|
fix #3694
Former-commit-id: 2a67ab3925f0c17c4cb5e8c5a5e2cc6a9dc7d47e
|
2024-05-16 00:35:28 +08:00 |
|
hiyouga
|
213ba09b24
|
fix examples
Former-commit-id: 7e69e71a52c736d0e42afbf61a3b3c22db606bc2
|
2024-05-15 00:26:10 +08:00 |
|
hiyouga
|
c4743674ab
|
update examples
Former-commit-id: 5bdad463875100e402329d47cd4c14bf9bc3b84b
|
2024-05-15 00:05:17 +08:00 |
|
hiyouga
|
f5df1ceaf1
|
add npu examples
Former-commit-id: af343034dd31303be59678af9d1eae338864e884
|
2024-05-14 23:32:53 +08:00 |
|
hiyouga
|
3318b6e188
|
update examples
Former-commit-id: dae83f419919305cb23bb2b9da1277a1616179c5
|
2024-05-13 20:39:36 +08:00 |
|
hiyouga
|
52cc6bce38
|
fix #3602
Former-commit-id: b0888262e371280f2b69ab529040b3a99632fc12
|
2024-05-07 17:50:27 +08:00 |
|
hiyouga
|
fe494fe97e
|
update examples
Former-commit-id: 047313f48e0b2c050952592329509e8b3dfc6f81
|
2024-05-06 23:07:55 +08:00 |
|
hiyouga
|
92cafef325
|
update example docs
Former-commit-id: f02f87c6fbd20adae105c83526baa23dba2042fd
|
2024-05-06 22:51:02 +08:00 |
|
hiyouga
|
eb21a527a6
|
update docs
Former-commit-id: 34d33e22570338da709b8499830adb06b202095c
|
2024-05-06 21:47:00 +08:00 |
|
Oscar
|
c57a42164c
|
Fix badam example outdated argument
Former-commit-id: eeb415f6fa81ca9093ad0419d1343bd5f780a688
|
2024-05-05 23:35:19 +08:00 |
|
hiyouga
|
289d1f3679
|
update webui and add CLIs
Former-commit-id: 245fe47ece22a4b7822449b126715aaa8ec25aba
|
2024-05-03 02:58:23 +08:00 |
|
hiyouga
|
4cddd4be26
|
Update prepare.sh
Former-commit-id: 39e964a97a8d764fcb4620cc3ff03b4f40c73d7e
|
2024-05-02 17:16:02 +08:00 |
|
hiyouga
|
12790601c1
|
fix llava qlora
Former-commit-id: fc67b736ba3abd1a321c3498548d58de48921626
|
2024-04-26 18:00:23 +08:00 |
|
hiyouga
|
eb70328eec
|
add llava to llamaboard
Former-commit-id: cd3a960f81579b4173ae79aa14d075e94651e8ce
|
2024-04-26 06:41:35 +08:00 |
|
hiyouga
|
d2df4c22ab
|
support mllm hf inference
Former-commit-id: e057c8de486bfbc829240924f9238d6212c917f1
|
2024-04-26 05:34:58 +08:00 |
|
BUAADreamer
|
ad7d8a6525
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 68cdd9a020902e276efec6f431ecaf7cf3ded6da
|
2024-04-25 20:02:50 +08:00 |
|
BUAADreamer
|
b6d78b2a64
|
merge data part to the text stream
Former-commit-id: c6dd89918feb25fe8c07857162421ad1706f791f
|
2024-04-25 19:19:59 +08:00 |
|
hiyouga
|
84031c5bf9
|
add export_device in webui #3333
Former-commit-id: 3a7c1286ce7fdfe5db60b17720ce734408913b7f
|
2024-04-25 19:02:32 +08:00 |
|
BUAADreamer
|
31bce63a10
|
add llava and instructblip
Former-commit-id: cfb485eddff0130422416b50c50e171fccc8103e
|
2024-04-25 00:22:43 +08:00 |
|
BUAADreamer
|
37705bbfdc
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: e1afbea68f9885ab4caebc948067c713cf612cf0
|
2024-04-23 19:22:42 +08:00 |
|
BUAADreamer
|
5360b327ea
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 4f3d558f67f6de3bc1a05a2bba860c0eeeb02587
|
2024-04-23 18:47:03 +08:00 |
|
BUAADreamer
|
629a8f8147
|
Merge branch 'hiyouga:main' into main
Former-commit-id: cde4dfe5693da615b05bba62b91ad420dbae9308
|
2024-04-23 18:46:12 +08:00 |
|
BUAADreamer
|
175b56bced
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 4dcb11eab7bbeac866043d2a7c748b8d06fbd243
|
2024-04-23 18:45:43 +08:00 |
|
hiyouga
|
23f738fda5
|
update examples
Former-commit-id: 2efd9b6ba0e06f62d8dc48bc3c4100c829d6795b
|
2024-04-23 18:29:46 +08:00 |
|
hiyouga
|
d8deb0f99e
|
update readme and examples
Former-commit-id: a1f1fac33b2a727b38e8ba52d68a224814d4848b
|
2024-04-22 00:37:32 +08:00 |
|
hiyouga
|
92e24a73cb
|
remove extras
Former-commit-id: ddbd29d77702f7b82051d930e3eac1b47f5c6d35
|
2024-04-22 00:35:41 +08:00 |
|
hiyouga
|
9e45f82be7
|
fix bug in galore optimizer
Former-commit-id: 5c62881c5a59cfcc5a76d365263c8ad8c817ce49
|
2024-04-21 18:53:22 +08:00 |
|
hiyouga
|
ec81d45d27
|
fix mod stuff
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
|
2024-04-21 18:11:10 +08:00 |
|
Marco
|
639297a5ef
|
Added Mixture of Depths
Former-commit-id: 620add7b9f634de1a711f7b87b16050adf735e9b
|
2024-04-18 20:31:24 +02:00 |
|
hiyouga
|
0a94fab357
|
support badam for all stages
Former-commit-id: e3d8fc75eb2cfc54efd35bfd9ad6c4ac5acc458c
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
507ab397f5
|
Update sft.sh
Former-commit-id: 57dcd91e17833a0eeb8d99af92ac73c132a77648
|
2024-04-16 17:25:40 +08:00 |
|
Jonery
|
b3260c7456
|
resolve gradient checkpointing issue.
Former-commit-id: 7ecb61822b37f5d71060d696495830ff98edaa06
|
2024-04-16 12:05:27 +08:00 |
|
Jonery
|
025f329445
|
Feature BAdam
Former-commit-id: 06c8908d3fe48907ddb585c5fa15677fc5416f94
|
2024-04-15 23:15:27 +08:00 |
|