hiyouga
|
92cafef325
|
update example docs
Former-commit-id: f02f87c6fbd20adae105c83526baa23dba2042fd
|
2024-05-06 22:51:02 +08:00 |
|
hiyouga
|
eb21a527a6
|
update docs
Former-commit-id: 34d33e22570338da709b8499830adb06b202095c
|
2024-05-06 21:47:00 +08:00 |
|
Oscar
|
c57a42164c
|
Fix badam example outdated argument
Former-commit-id: eeb415f6fa81ca9093ad0419d1343bd5f780a688
|
2024-05-05 23:35:19 +08:00 |
|
hiyouga
|
289d1f3679
|
update webui and add CLIs
Former-commit-id: 245fe47ece22a4b7822449b126715aaa8ec25aba
|
2024-05-03 02:58:23 +08:00 |
|
hiyouga
|
4cddd4be26
|
Update prepare.sh
Former-commit-id: 39e964a97a8d764fcb4620cc3ff03b4f40c73d7e
|
2024-05-02 17:16:02 +08:00 |
|
hiyouga
|
12790601c1
|
fix llava qlora
Former-commit-id: fc67b736ba3abd1a321c3498548d58de48921626
|
2024-04-26 18:00:23 +08:00 |
|
hiyouga
|
eb70328eec
|
add llava to llamaboard
Former-commit-id: cd3a960f81579b4173ae79aa14d075e94651e8ce
|
2024-04-26 06:41:35 +08:00 |
|
hiyouga
|
d2df4c22ab
|
support mllm hf inference
Former-commit-id: e057c8de486bfbc829240924f9238d6212c917f1
|
2024-04-26 05:34:58 +08:00 |
|
BUAADreamer
|
ad7d8a6525
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 68cdd9a020902e276efec6f431ecaf7cf3ded6da
|
2024-04-25 20:02:50 +08:00 |
|
BUAADreamer
|
b6d78b2a64
|
merge data part to the text stream
Former-commit-id: c6dd89918feb25fe8c07857162421ad1706f791f
|
2024-04-25 19:19:59 +08:00 |
|
hiyouga
|
84031c5bf9
|
add export_device in webui #3333
Former-commit-id: 3a7c1286ce7fdfe5db60b17720ce734408913b7f
|
2024-04-25 19:02:32 +08:00 |
|
BUAADreamer
|
31bce63a10
|
add llava and instructblip
Former-commit-id: cfb485eddff0130422416b50c50e171fccc8103e
|
2024-04-25 00:22:43 +08:00 |
|
BUAADreamer
|
37705bbfdc
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: e1afbea68f9885ab4caebc948067c713cf612cf0
|
2024-04-23 19:22:42 +08:00 |
|
BUAADreamer
|
5360b327ea
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 4f3d558f67f6de3bc1a05a2bba860c0eeeb02587
|
2024-04-23 18:47:03 +08:00 |
|
BUAADreamer
|
629a8f8147
|
Merge branch 'hiyouga:main' into main
Former-commit-id: cde4dfe5693da615b05bba62b91ad420dbae9308
|
2024-04-23 18:46:12 +08:00 |
|
BUAADreamer
|
175b56bced
|
add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 4dcb11eab7bbeac866043d2a7c748b8d06fbd243
|
2024-04-23 18:45:43 +08:00 |
|
hiyouga
|
23f738fda5
|
update examples
Former-commit-id: 2efd9b6ba0e06f62d8dc48bc3c4100c829d6795b
|
2024-04-23 18:29:46 +08:00 |
|
hiyouga
|
d8deb0f99e
|
update readme and examples
Former-commit-id: a1f1fac33b2a727b38e8ba52d68a224814d4848b
|
2024-04-22 00:37:32 +08:00 |
|
hiyouga
|
92e24a73cb
|
remove extras
Former-commit-id: ddbd29d77702f7b82051d930e3eac1b47f5c6d35
|
2024-04-22 00:35:41 +08:00 |
|
hiyouga
|
9e45f82be7
|
fix bug in galore optimizer
Former-commit-id: 5c62881c5a59cfcc5a76d365263c8ad8c817ce49
|
2024-04-21 18:53:22 +08:00 |
|
hiyouga
|
ec81d45d27
|
fix mod stuff
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
|
2024-04-21 18:11:10 +08:00 |
|
Marco
|
639297a5ef
|
Added Mixture of Depths
Former-commit-id: 620add7b9f634de1a711f7b87b16050adf735e9b
|
2024-04-18 20:31:24 +02:00 |
|
hiyouga
|
0a94fab357
|
support badam for all stages
Former-commit-id: e3d8fc75eb2cfc54efd35bfd9ad6c4ac5acc458c
|
2024-04-16 17:44:48 +08:00 |
|
hoshi-hiyouga
|
507ab397f5
|
Update sft.sh
Former-commit-id: 57dcd91e17833a0eeb8d99af92ac73c132a77648
|
2024-04-16 17:25:40 +08:00 |
|
Jonery
|
b3260c7456
|
resolve gradient checkpointing issue.
Former-commit-id: 7ecb61822b37f5d71060d696495830ff98edaa06
|
2024-04-16 12:05:27 +08:00 |
|
Jonery
|
025f329445
|
Feature BAdam
Former-commit-id: 06c8908d3fe48907ddb585c5fa15677fc5416f94
|
2024-04-15 23:15:27 +08:00 |
|
hiyouga
|
fb385b8c26
|
update examples
Former-commit-id: cce52351b54f70904f33902d9c17411134f9f6eb
|
2024-04-15 22:14:34 +08:00 |
|
khazic
|
652caa3cbd
|
Upgrade README.md
Former-commit-id: fe5d3bb8f07902fbd3973a56dd73837a2c175a3d
|
2024-04-13 20:50:49 +08:00 |
|
khazic
|
21c4a43085
|
Added specimens for single-card full parameter prediction
Former-commit-id: 47111ce506d2769bfa14b37b729d22b57796b26e
|
2024-04-13 20:45:19 +08:00 |
|
hiyouga
|
5dd3c1ab79
|
update examples
Former-commit-id: b87f8f15194923392d1a1c3d3c617b463cdd8379
|
2024-04-04 14:48:21 +08:00 |
|
hiyouga
|
86513f28dc
|
update examples
Former-commit-id: fc7f1cc365ee481b76f9c7e6f1947b49cf131fbf
|
2024-04-02 21:09:25 +08:00 |
|
hiyouga
|
03c538ebb3
|
add zh readme
Former-commit-id: 7765f337c7f0d7b8866beecb990c346700146c67
|
2024-04-02 20:58:45 +08:00 |
|
hiyouga
|
e341fa59fe
|
update examples
Former-commit-id: f22eaeb5bc5329146feb0cc5455fae8ce10380f8
|
2024-04-02 20:51:21 +08:00 |
|
hiyouga
|
9df316931b
|
update examples
Former-commit-id: 31ffbde24dd2e30c3d06331ac4b47d966fc2a191
|
2024-04-02 20:41:49 +08:00 |
|
hiyouga
|
135c4e3512
|
update readme
Former-commit-id: 11a6c1bad65a86b0f3d9c5e5df84d246d7d368df
|
2024-04-02 20:37:37 +08:00 |
|
hiyouga
|
bf5ffeeae0
|
simplify readme
Former-commit-id: 92dab8a90bdd82a72a06559943467b56dde12c71
|
2024-04-02 20:07:43 +08:00 |
|
hiyouga
|
cefe7f7bcf
|
update webui
Former-commit-id: d0842f682897cb227cda9e9747f42a7281970463
|
2024-04-01 16:23:28 +08:00 |
|
hiyouga
|
2f878bde11
|
support ORPO
Former-commit-id: 17bf8a2c3a7bb5b83071c8659cfd8751e894e692
|
2024-03-31 18:29:50 +08:00 |
|
hiyouga
|
89c400633a
|
update trainers
Former-commit-id: 8c77b1091296e204dc3c8c1f157c288ca5b236bd
|
2024-03-28 18:16:27 +08:00 |
|
hiyouga
|
300437a5e9
|
fix #2981
Former-commit-id: b29d5560f1359a3868d917048aeba1a069ba12a9
|
2024-03-26 17:53:04 +08:00 |
|
hiyouga
|
7999836fb6
|
support fsdp + qlora
Former-commit-id: 84082251621e1470b3b5406a56d0a967780a1804
|
2024-03-21 00:36:06 +08:00 |
|
hiyouga
|
8b8671817f
|
improve lora+ impl.
Former-commit-id: 72367307dfadf936fb989ebe8bc9f0ff229fb933
|
2024-03-13 23:32:51 +08:00 |
|
齐保元
|
24c9277488
|
[FEATURE]: ADD LORA+ ALGORITHM
Former-commit-id: a0965cd62c85545aa2364e244295df2963308354
|
2024-03-13 19:43:27 +08:00 |
|
hiyouga
|
4a4e4b4354
|
support layerwise galore
Former-commit-id: 8664262cde3919e10eaecbd66e8c5d356856362e
|
2024-03-10 00:24:11 +08:00 |
|
hiyouga
|
eb363b04b9
|
update examples
Former-commit-id: 4c00bcdcaeb675c9fdb3e977c27c3604d7895ae2
|
2024-03-09 02:30:37 +08:00 |
|
hiyouga
|
398c261c7c
|
fix aqlm version
Former-commit-id: 10be2f0eccc3963a985afcd24e5b8b8fc638b1c3
|
2024-03-09 00:09:09 +08:00 |
|
hiyouga
|
ccec17f773
|
fix example params
Former-commit-id: 8a45213440ffc960947dd69ecf3b092aa724bef3
|
2024-03-08 20:41:43 +08:00 |
|
hiyouga
|
5b50458acf
|
fix galore
Former-commit-id: 33a4c24a8a3c153bc62edf74b9246699a0ae3233
|
2024-03-08 00:44:51 +08:00 |
|
hiyouga
|
cb2bf680c9
|
add galore examples
Former-commit-id: 7230e1177daf4d96a1205565ab9335085cc8f3a7
|
2024-03-07 22:53:45 +08:00 |
|
hiyouga
|
34533b2f35
|
support vllm
Former-commit-id: d07ad5cc1cdbc13879afd84f653afdfee03a6933
|
2024-03-07 20:26:31 +08:00 |
|