1284 Commits

Author SHA1 Message Date
hiyouga
d2df4c22ab support mllm hf inference
Former-commit-id: e057c8de486bfbc829240924f9238d6212c917f1
2024-04-26 05:34:58 +08:00
hoshi-hiyouga
208dfe9a87 Merge pull request #3450 from BUAADreamer/mllm
Add Multimodal LLM Finetuning

Former-commit-id: c20f750d11774a7c7647624c8a9f6bd5c4242937
2024-04-26 05:30:30 +08:00
hoshi-hiyouga
3257df2fdb Update preprocess.py
Former-commit-id: 7f3bd35c0ead92710036064bf306740e8ee901c7
2024-04-26 04:10:28 +08:00
hoshi-hiyouga
15b7182418 Update aligner.py
Former-commit-id: fcd09112d5929f5a4c502c5886050083e69122f9
2024-04-26 03:48:34 +08:00
hoshi-hiyouga
6ef2ec71ed Update parser.py
Former-commit-id: f62cadb258f85ddf6b595c8f6fe3385c2e0e3376
2024-04-26 03:35:39 +08:00
hoshi-hiyouga
4487a4a790 Update loader.py
Former-commit-id: 3408af236f0b4ef64c3bfa791ef757828a74da7f
2024-04-26 03:33:07 +08:00
hoshi-hiyouga
268c0efd67 Update workflow.py
Former-commit-id: e16f128dc397d71e74398fa38818e57e80cc32f4
2024-04-26 03:29:12 +08:00
hoshi-hiyouga
9c69cc1e16 Update loader.py
Former-commit-id: 7d812ed8419817a8724f8584996607e8685b5ea9
2024-04-26 03:22:40 +08:00
hoshi-hiyouga
3e832e53be Update dataset_info.json
Former-commit-id: f8c26e6a346ca0f18f3b05b6fc7413f3625fb220
2024-04-26 03:03:36 +08:00
hoshi-hiyouga
6275682325 Update mllm_demo.json
Former-commit-id: 5ef293387f8bded42364984f804fb8f665ef1f89
2024-04-26 02:58:45 +08:00
hoshi-hiyouga
82b61ccda6 Update and rename llava_instruct_example.json to mllm_demo.json
Former-commit-id: 7dcae3dba3dbda4953a0e3993e279cc8c21fc976
2024-04-26 02:57:54 +08:00
hoshi-hiyouga
6ef8ee5988 update hparam name
Former-commit-id: 860549b99b520ae9509559b18646f83fd95933b8
2024-04-26 02:49:39 +08:00
hoshi-hiyouga
e7725f2bbb delete llava template (use vicuna)
Former-commit-id: 646a7885e7c721342b7f546ed717f1d4a68bc012
2024-04-26 02:20:47 +08:00
BUAADreamer
4905b38c0b modify some bug
Former-commit-id: a7ead1440fefaced1a68be46b8bf7b19a5ea47c2
2024-04-25 22:59:46 +08:00
BUAADreamer
5ef2b8bdda modify some style
Former-commit-id: ece78a6d6af0673795824b2f95c266c042532eb3
2024-04-25 22:40:53 +08:00
BUAADreamer
26b760842b modify some style
Former-commit-id: d29f3798f654c40448bc91e3b97db1c6e4de0fbe
2024-04-25 22:40:25 +08:00
BUAADreamer
de1e5b3f40 merge some func
Former-commit-id: 31420f7b314d1bc0d7918196d4b23524323a01ae
2024-04-25 22:35:17 +08:00
BUAADreamer
a9b0da597b modify some style
Former-commit-id: c27f7fbf62b4a00b5794bb20621a4060a82490b7
2024-04-25 22:04:09 +08:00
BUAADreamer
a0be27fc9b modify some style
Former-commit-id: 2d4ded535faa44b460f88028d49e4b8c8b430db5
2024-04-25 21:58:18 +08:00
BUAADreamer
ba67d6dad5 make dataset script
Former-commit-id: 2cab2d42fb37454760bdc1b45ceae7844871e29b
2024-04-25 21:32:01 +08:00
BUAADreamer
40bfe767f7 modify style
Former-commit-id: 235b4113709fe788b4f1a1a3089ce8356940877b
2024-04-25 21:29:50 +08:00
BUAADreamer
549f35b1fd modify style
Former-commit-id: fc0fa9f048aa7ac2f74da15c0250bae5c46cf386
2024-04-25 21:27:48 +08:00
BUAADreamer
e6cf251fb8 modify style
Former-commit-id: 1dcabafe72fe21c7f9122a6bc1a1ccc4f5d08fdd
2024-04-25 21:15:16 +08:00
BUAADreamer
f42c0b26d1 Merge branch 'main' of https://github.com/BUAADreamer/LLaMA-Factory
Former-commit-id: 43d7ad5eccfc04fd7f31a481b278a7101c64a2fa
2024-04-25 21:08:40 +08:00
BUAADreamer
cefdbb8728 add some
Former-commit-id: 94ad744941b5d305892c38169a8478d0fb1a3019
2024-04-25 21:08:32 +08:00
hoshi-hiyouga
317252f2bf Merge pull request #3449 from hiyouga/mllm
add webui backend option

Former-commit-id: fcfbd8c3003989a5671f2a31a439ad2c336b55f1
2024-04-25 20:58:16 +08:00
hiyouga
ea117a374c add webui backend option
Former-commit-id: b45939e1393b7858f81f8a3d2a5af40f45e1e63c
2024-04-25 20:49:23 +08:00
hiyouga
7b4e1ca788 vllm + lora support
Former-commit-id: 28571da80a35a7cf302a2134a05592505128a0d6
2024-04-25 20:24:31 +08:00
BUAADreamer
32baed8302 rm some
Former-commit-id: eefcd105c12dd916a7b80825fdb1e979f87501d6
2024-04-25 20:09:43 +08:00
BUAADreamer
ad7d8a6525 Merge branch 'hiyouga:main' into main
Former-commit-id: 68cdd9a020902e276efec6f431ecaf7cf3ded6da
2024-04-25 20:02:50 +08:00
BUAADreamer
56028422e8 merge data part to the text stream
Former-commit-id: 42c90c8183a49cadb2c2abcc58f6ea27d325231d
2024-04-25 19:58:47 +08:00
hiyouga
6c71803b87 fix #3374
Former-commit-id: 8d66435664b53f3df8c4fd21ca097ad1dccd6ddd
2024-04-25 19:56:49 +08:00
BUAADreamer
c50474869f Merge branch 'main' of https://github.com/BUAADreamer/LLaMA-Factory
Former-commit-id: 2ee3046eb0bbee7c339ac5115131d4193c59a7f8
2024-04-25 19:20:08 +08:00
BUAADreamer
b6d78b2a64 merge data part to the text stream
Former-commit-id: c6dd89918feb25fe8c07857162421ad1706f791f
2024-04-25 19:19:59 +08:00
hiyouga
84031c5bf9 add export_device in webui #3333
Former-commit-id: 3a7c1286ce7fdfe5db60b17720ce734408913b7f
2024-04-25 19:02:32 +08:00
BUAADreamer
9642b6de8a Merge branch 'hiyouga:main' into main
Former-commit-id: 7e22ff5cf12d371fe515bcf3e3ccb9d7aac653b2
2024-04-25 15:30:56 +08:00
codingma
0158ab3c27 Merge pull request #3435 from codemayq/main
update wechat

Former-commit-id: a3aad4b4f0edac1933420c8dd7c888f7869fe043
2024-04-25 15:10:35 +08:00
codingma
e7290d0ac6 update wechat
Former-commit-id: f579901e4d6896aad69f6b09295df258eb60d503
2024-04-25 15:09:15 +08:00
BUAADreamer
4e032ff95e merge model part to the text stream
Former-commit-id: 838eb87a961894b072bf79a60bbda63516670d6f
2024-04-25 08:20:41 +08:00
BUAADreamer
cb1c66a810 remove error
Former-commit-id: 8239907f578dc4b185cfb1789944db23d112fa2c
2024-04-25 01:01:59 +08:00
BUAADreamer
906e7f0983 remove conflicts
Former-commit-id: f85f403d39e0af6dd57f9c94290e4fa63b344f0d
2024-04-25 00:56:06 +08:00
BUAADreamer
ff8d729b59 remove conflicts
Former-commit-id: 7ffee907995095220e93c282d8b57137c0e6c018
2024-04-25 00:34:22 +08:00
BUAADreamer
31bce63a10 add llava and instructblip
Former-commit-id: cfb485eddff0130422416b50c50e171fccc8103e
2024-04-25 00:22:43 +08:00
hiyouga
b9fd197a37 update tool template
Former-commit-id: aa16ff6205c48c00fe5792be1177c9aa88ed848b
2024-04-25 00:21:34 +08:00
hiyouga
9a21785396 fix log level
Former-commit-id: 7fbe8add8f449358c9815c5ba8a2052a2d874dab
2024-04-24 23:42:59 +08:00
hiyouga
ce490c65ae support new special token #3420
Former-commit-id: 297fb8ead3daf154152d9826b49bb4d769fbaaa9
2024-04-24 23:39:31 +08:00
hoshi-hiyouga
7592d981b2 fix phi template
Former-commit-id: e5d23c053a6d239097f87515b8cd5611b7cfa3cf
2024-04-24 13:55:14 +08:00
hoshi-hiyouga
ce36e316bc fix webchatmodel
Former-commit-id: 4c71c314fb23e0e1eb294abf0d6c4cccfb531716
2024-04-24 13:54:21 +08:00
hoshi-hiyouga
4a854dfe27 fix inference in llamaboard
Former-commit-id: f36057ea0300ab089ded568fa170682e9e19c4ee
2024-04-24 13:53:39 +08:00
hiyouga
fff1fb1232 add olmo 1.7
Former-commit-id: 44a43ee152ba746f79bf7ef38520b29cd6a5cc2b
2024-04-24 05:50:50 +08:00