Commit Graph

1727 Commits

Author SHA1 Message Date
hiyouga
1bea1ed868 support phi-3
Former-commit-id: 1a13f05555
2024-04-24 00:28:53 +08:00
BUAADreamer
37705bbfdc add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: e1afbea68f
2024-04-23 19:22:42 +08:00
BUAADreamer
5360b327ea add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 4f3d558f67
2024-04-23 18:47:03 +08:00
BUAADreamer
629a8f8147 Merge branch 'hiyouga:main' into main
Former-commit-id: cde4dfe569
2024-04-23 18:46:12 +08:00
BUAADreamer
175b56bced add multimodal LLM BLIP-2 and InstructBLIP
Former-commit-id: 4dcb11eab7
2024-04-23 18:45:43 +08:00
hiyouga
23f738fda5 update examples
Former-commit-id: 2efd9b6ba0
2024-04-23 18:29:46 +08:00
hiyouga
a7ec9d4be8 Update wechat.jpg
Former-commit-id: 5722ada12b
2024-04-23 17:12:33 +08:00
hiyouga
d5d6fb3970 update readme
Former-commit-id: db7f3b9784
2024-04-22 17:09:17 +08:00
hiyouga
381b461eb6 update readme
Former-commit-id: 836ca05586
2024-04-22 00:51:35 +08:00
hiyouga
e842328f05 update readme
Former-commit-id: 34d66a3a85
2024-04-22 00:42:25 +08:00
hiyouga
d8deb0f99e update readme and examples
Former-commit-id: a1f1fac33b
2024-04-22 00:37:32 +08:00
hiyouga
92e24a73cb remove extras
Former-commit-id: ddbd29d777
2024-04-22 00:35:41 +08:00
hiyouga
ecc62ff3be Update wechat.jpg
Former-commit-id: 1197513a16
2024-04-22 00:22:58 +08:00
hiyouga
c0d8d530dd update readme
Former-commit-id: a83e7587a0
2024-04-22 00:21:01 +08:00
hiyouga
31f96ce22a set dev version
Former-commit-id: 3e1bf8325c
2024-04-21 23:14:30 +08:00
hiyouga
869777b990 release v0.6.3
Former-commit-id: e0d6b72d56
2024-04-21 23:13:23 +08:00
hiyouga
1ce9db5654 fix #3366
Former-commit-id: 4469a3237d
2024-04-21 21:34:25 +08:00
hiyouga
6a3ee1edd9 fix optimizers
Former-commit-id: fbbe0dba2f
2024-04-21 20:40:54 +08:00
hiyouga
79666c298d fix #3365
Former-commit-id: a1d31ffc8c
2024-04-21 19:20:18 +08:00
hiyouga
9e45f82be7 fix bug in galore optimizer
Former-commit-id: 5c62881c5a
2024-04-21 18:53:22 +08:00
hiyouga
ec81d45d27 fix mod stuff
Former-commit-id: f58425ab45
2024-04-21 18:11:10 +08:00
hoshi-hiyouga
7c63a9b5fd Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth

Former-commit-id: d0273787be
2024-04-21 18:05:52 +08:00
hoshi-hiyouga
e9b1aff447 fix #3348
Former-commit-id: 1fa287fd63
2024-04-20 10:34:09 +08:00
hiyouga
12290955d8 add dpo mix dataset
Former-commit-id: 6339edefff
2024-04-20 01:31:38 +08:00
hiyouga
97c3f9e22c fix #3352
Former-commit-id: ba559a659a
2024-04-19 22:40:01 +08:00
hiyouga
ac7ec7ed10 fix llama3 template
Former-commit-id: 14a605a2da
2024-04-19 15:46:51 +08:00
Marco
b6a87e0a3f fix small typo
Former-commit-id: 4fb7e046b3
2024-04-18 20:33:29 +02:00
Marco
639297a5ef Added Mixture of Depths
Former-commit-id: 620add7b9f
2024-04-18 20:31:24 +02:00
hoshi-hiyouga
15d17a1e86 support llama3
Former-commit-id: 2aaaede247
2024-04-19 01:13:50 +08:00
hiyouga
9aa62ffb57 fix #3324
Former-commit-id: 942362d008
2024-04-18 15:34:45 +08:00
hiyouga
e2e0bbde12 tiny fix
Former-commit-id: 3b43a3b7c5
2024-04-18 00:22:17 +08:00
hiyouga
a49dd8b4f3 update readme
Former-commit-id: e2f1c6fc6a
2024-04-17 23:40:49 +08:00
hiyouga
8a369cc084 add mixtral 8x22B models
Former-commit-id: cab0598fd0
2024-04-17 23:35:59 +08:00
hiyouga
3b491b4e1a add CodeQwen models
Former-commit-id: 5f86053d75
2024-04-17 23:27:22 +08:00
hiyouga
0170ef83a6 fix #3316
Former-commit-id: c9a477322d
2024-04-17 22:54:34 +08:00
hiyouga
f9c859e97b fix #3317
Former-commit-id: 6d641af703
2024-04-17 22:17:19 +08:00
hiyouga
dac0c1a52b Update wechat.jpg
Former-commit-id: e3ca57602c
2024-04-17 21:14:37 +08:00
hiyouga
bdd253228e lint
Former-commit-id: 278c5e10c4
2024-04-16 18:21:09 +08:00
hoshi-hiyouga
7daaae2005 Merge pull request #3291 from codemayq/main
support for previewing custom dataset in directory format

Former-commit-id: aa3206ec26
2024-04-16 18:12:09 +08:00
hiyouga
038d524fcd Update parser.py
Former-commit-id: c00f0771a5
2024-04-16 18:09:31 +08:00
hiyouga
8beb7a9239 update readme and gradio version
Former-commit-id: 5d62a51c12
2024-04-16 18:09:16 +08:00
hiyouga
0a94fab357 support badam for all stages
Former-commit-id: e3d8fc75eb
2024-04-16 17:44:48 +08:00
hoshi-hiyouga
496396b3bc Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm

Former-commit-id: 4d660c5ade
2024-04-16 17:32:16 +08:00
hoshi-hiyouga
6d954b2733 Update utils.py
Former-commit-id: c9828f4c6e
2024-04-16 17:30:12 +08:00
hoshi-hiyouga
5226c4fa97 Update trainer.py
Former-commit-id: 6700a1b9fa
2024-04-16 17:29:52 +08:00
hoshi-hiyouga
b92f690190 Update utils.py
Former-commit-id: 38a56706e0
2024-04-16 17:29:30 +08:00
hoshi-hiyouga
48fb0be1b9 Update patcher.py
Former-commit-id: a950f3b81d
2024-04-16 17:29:19 +08:00
hoshi-hiyouga
ce56ff22af Update adapter.py
Former-commit-id: 750cdf2e74
2024-04-16 17:28:12 +08:00
hoshi-hiyouga
0f6d691aa6 Update parser.py
Former-commit-id: 4660703674
2024-04-16 17:27:25 +08:00
hoshi-hiyouga
d68212d016 Update parser.py
Former-commit-id: 5b59ff4212
2024-04-16 17:27:02 +08:00