Commit Graph

1602 Commits

Author SHA1 Message Date
hiyouga
ea117a374c add webui backend option
Former-commit-id: b45939e139
2024-04-25 20:49:23 +08:00
hiyouga
7b4e1ca788 vllm + lora support
Former-commit-id: 28571da80a
2024-04-25 20:24:31 +08:00
BUAADreamer
32baed8302 rm some
Former-commit-id: eefcd105c1
2024-04-25 20:09:43 +08:00
BUAADreamer
ad7d8a6525 Merge branch 'hiyouga:main' into main
Former-commit-id: 68cdd9a020
2024-04-25 20:02:50 +08:00
BUAADreamer
56028422e8 merge data part to the text stream
Former-commit-id: 42c90c8183
2024-04-25 19:58:47 +08:00
hiyouga
6c71803b87 fix #3374
Former-commit-id: 8d66435664
2024-04-25 19:56:49 +08:00
BUAADreamer
b6d78b2a64 merge data part to the text stream
Former-commit-id: c6dd89918f
2024-04-25 19:19:59 +08:00
hiyouga
84031c5bf9 add export_device in webui #3333
Former-commit-id: 3a7c1286ce
2024-04-25 19:02:32 +08:00
BUAADreamer
4e032ff95e merge model part to the text stream
Former-commit-id: 838eb87a96
2024-04-25 08:20:41 +08:00
BUAADreamer
cb1c66a810 remove error
Former-commit-id: 8239907f57
2024-04-25 01:01:59 +08:00
BUAADreamer
ff8d729b59 remove conflicts
Former-commit-id: 7ffee90799
2024-04-25 00:34:22 +08:00
BUAADreamer
31bce63a10 add llava and instructblip
Former-commit-id: cfb485eddf
2024-04-25 00:22:43 +08:00
hiyouga
b9fd197a37 update tool template
Former-commit-id: aa16ff6205
2024-04-25 00:21:34 +08:00
hiyouga
9a21785396 fix log level
Former-commit-id: 7fbe8add8f
2024-04-24 23:42:59 +08:00
hiyouga
ce490c65ae support new special token #3420
Former-commit-id: 297fb8ead3
2024-04-24 23:39:31 +08:00
hoshi-hiyouga
7592d981b2 fix phi template
Former-commit-id: e5d23c053a
2024-04-24 13:55:14 +08:00
hoshi-hiyouga
ce36e316bc fix webchatmodel
Former-commit-id: 4c71c314fb
2024-04-24 13:54:21 +08:00
hoshi-hiyouga
4a854dfe27 fix inference in llamaboard
Former-commit-id: f36057ea03
2024-04-24 13:53:39 +08:00
hiyouga
fff1fb1232 add olmo 1.7
Former-commit-id: 44a43ee152
2024-04-24 05:50:50 +08:00
hiyouga
80f0a63f73 add dbrx and jamba models
Former-commit-id: 69eb03a8fe
2024-04-24 05:39:52 +08:00
hiyouga
7d89abb1fd fix bug
Former-commit-id: 73ff9c834b
2024-04-24 05:21:18 +08:00
hiyouga
612ba26c4c fix bug
Former-commit-id: 8f44dce08a
2024-04-24 05:10:07 +08:00
hiyouga
1f99c367b3 remove redundant code
Former-commit-id: 667ce08b27
2024-04-24 05:02:18 +08:00
hiyouga
c0afc4074f support unsloth generate
Former-commit-id: b1deb0a0b9
2024-04-24 04:46:53 +08:00
hiyouga
8465e54d38 refactor patcher
Former-commit-id: aa2b79eb23
2024-04-24 03:02:23 +08:00
hiyouga
80c8586534 reenable sdpa and fast tok by default
Former-commit-id: 07737a3d2d
2024-04-24 02:18:44 +08:00
hiyouga
34ecad4af8 fix #3347 #3387
Former-commit-id: 707f0b1d5d
2024-04-24 01:30:16 +08:00
hiyouga
1bea1ed868 support phi-3
Former-commit-id: 1a13f05555
2024-04-24 00:28:53 +08:00
BUAADreamer
37705bbfdc add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: e1afbea68f
2024-04-23 19:22:42 +08:00
BUAADreamer
175b56bced add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 4dcb11eab7
2024-04-23 18:45:43 +08:00
hiyouga
d5d6fb3970 update readme
Former-commit-id: db7f3b9784
2024-04-22 17:09:17 +08:00
hiyouga
31f96ce22a set dev version
Former-commit-id: 3e1bf8325c
2024-04-21 23:14:30 +08:00
hiyouga
869777b990 release v0.6.3
Former-commit-id: e0d6b72d56
2024-04-21 23:13:23 +08:00
hiyouga
1ce9db5654 fix #3366
Former-commit-id: 4469a3237d
2024-04-21 21:34:25 +08:00
hiyouga
6a3ee1edd9 fix optimizers
Former-commit-id: fbbe0dba2f
2024-04-21 20:40:54 +08:00
hiyouga
79666c298d fix #3365
Former-commit-id: a1d31ffc8c
2024-04-21 19:20:18 +08:00
hiyouga
9e45f82be7 fix bug in galore optimizer
Former-commit-id: 5c62881c5a
2024-04-21 18:53:22 +08:00
hiyouga
ec81d45d27 fix mod stuff
Former-commit-id: f58425ab45
2024-04-21 18:11:10 +08:00
hoshi-hiyouga
7c63a9b5fd Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth

Former-commit-id: d0273787be
2024-04-21 18:05:52 +08:00
hoshi-hiyouga
e9b1aff447 fix #3348
Former-commit-id: 1fa287fd63
2024-04-20 10:34:09 +08:00
hiyouga
97c3f9e22c fix #3352
Former-commit-id: ba559a659a
2024-04-19 22:40:01 +08:00
hiyouga
ac7ec7ed10 fix llama3 template
Former-commit-id: 14a605a2da
2024-04-19 15:46:51 +08:00
Marco
b6a87e0a3f fix small typo
Former-commit-id: 4fb7e046b3
2024-04-18 20:33:29 +02:00
Marco
639297a5ef Added Mixture of Depths
Former-commit-id: 620add7b9f
2024-04-18 20:31:24 +02:00
hoshi-hiyouga
15d17a1e86 support llama3
Former-commit-id: 2aaaede247
2024-04-19 01:13:50 +08:00
hiyouga
9aa62ffb57 fix #3324
Former-commit-id: 942362d008
2024-04-18 15:34:45 +08:00
hiyouga
e2e0bbde12 tiny fix
Former-commit-id: 3b43a3b7c5
2024-04-18 00:22:17 +08:00
hiyouga
8a369cc084 add mixtral 8x22B models
Former-commit-id: cab0598fd0
2024-04-17 23:35:59 +08:00
hiyouga
3b491b4e1a add CodeQwen models
Former-commit-id: 5f86053d75
2024-04-17 23:27:22 +08:00
hiyouga
0170ef83a6 fix #3316
Former-commit-id: c9a477322d
2024-04-17 22:54:34 +08:00