hiyouga
|
af2cb33bb2
|
tiny fix
Former-commit-id: 2d8d47f6126d68db1701ed18fc31310c6f14dd49
|
2024-06-20 22:56:05 +08:00 |
|
Jonery
|
fa3150548e
|
Cleaner integration.
Former-commit-id: 26d4b05d424bd71f570195dd433258caf6465d92
|
2024-06-19 12:29:40 +08:00 |
|
hiyouga
|
4bc0bea0e9
|
fix #4357
Former-commit-id: a6741bba8cebd16a6a3f97a2dc81057d0e27eb39
|
2024-06-18 22:42:45 +08:00 |
|
Jonery
|
870a54ac84
|
fix typo
Former-commit-id: d4bee3716dbf8a84564d5bcc2059172604819f3e
|
2024-06-18 12:39:26 +08:00 |
|
Jonery
|
12fcfc2b72
|
Support distributed BAdam.
Former-commit-id: bdcb986e37975911c190a74d3e60bb77aa2033bd
|
2024-06-18 12:27:47 +08:00 |
|
hiyouga
|
875270b851
|
lint
Former-commit-id: a19a7ac99af62b6715c96274f6350b124a784331
|
2024-06-17 22:35:56 +08:00 |
|
Jonery
|
95ae30f678
|
Merge remote-tracking branch 'upstream/main'
Former-commit-id: 37834a7e79473ccf50ad7f67745b97c274c326d9
|
2024-06-17 18:44:51 +08:00 |
|
Jonery
|
ba303fd1aa
|
adapt for badam with ds zero3
Former-commit-id: fff2a020ec8713022bd8145f4a7168168ea07ca4
|
2024-06-17 18:18:10 +08:00 |
|
hoshi-hiyouga
|
ca67b7a568
|
Update parser.py
Former-commit-id: d10c97193d08bd368aca1a72f0d1d8a96c76765d
|
2024-06-16 02:57:00 +08:00 |
|
hiyouga
|
32f45c9e91
|
support pissa
Former-commit-id: ef8e45f2eaf466c54e9a671512a2974575677b08
|
2024-06-16 01:08:12 +08:00 |
|
hiyouga
|
05f3a3c944
|
tiny fix
Former-commit-id: f7f440986b0ae3b38ea9f2da80789629d4f79ea1
|
2024-06-16 01:06:41 +08:00 |
|
hiyouga
|
14f7bfc545
|
use fixture
Former-commit-id: 10761985691b9f934f7689c1f82aa6dd68febcca
|
2024-06-15 20:06:17 +08:00 |
|
hiyouga
|
bb88536166
|
add license
Former-commit-id: 69cfc98d7c81756a5ab6bf962240e393e449fef0
|
2024-06-15 17:54:33 +08:00 |
|
hiyouga
|
2af932d969
|
disable DP
Former-commit-id: c18fd609d268389f3e65274992045a6c9f8e6c1f
|
2024-06-15 04:57:19 +08:00 |
|
hiyouga
|
3ff9b87012
|
add test cases
Former-commit-id: 731176ff34cdf0cbf6b41c40c69f4ceb54c2daf6
|
2024-06-15 04:05:54 +08:00 |
|
hiyouga
|
5080f2314c
|
fix lint
Former-commit-id: b170165679317af2b3f03633afac27661b3deb06
|
2024-06-13 00:48:44 +08:00 |
|
ancv
|
c7ab302c69
|
implement efficient packing without cross-contamination attention
Former-commit-id: a64a5305c0da5ef092d4cc26faf829bb44de65d1
|
2024-06-12 11:56:01 +07:00 |
|
hiyouga
|
820b6e7b32
|
fix #4198
Former-commit-id: 945d2c6cc73542adf9272ebd9aa332ea2c1c7361
|
2024-06-11 15:38:38 +08:00 |
|
hiyouga
|
27aece94cf
|
tiny fix
Former-commit-id: c4b2e263d9cefbad0fbc5de72422e4ef8edbcb54
|
2024-06-11 12:48:53 +08:00 |
|
hiyouga
|
ff9ba70bb8
|
reorganize adapter code
Former-commit-id: b26c2df9d97f4efffccbf7d28de13619b43f10dd
|
2024-06-08 00:47:23 +08:00 |
|
hiyouga
|
937f49ec3d
|
lora modules: all by default
Former-commit-id: 52c4ae87c7f4312704c31ef26b079b2c5b95ea5f
|
2024-06-06 03:53:28 +08:00 |
|
hoshi-hiyouga
|
c709d5f7db
|
Merge pull request #4080 from MengqingCao/npu
Add npu option for model exporting
Former-commit-id: 07fc67193ef6bcb8e8a392aff0c57a2eb36832bf
|
2024-06-06 03:15:44 +08:00 |
|
hoshi-hiyouga
|
ee5853c565
|
Update model_args.py
Former-commit-id: 09c0afd94a8a5f5b45a61b32c983d50e1b9e2941
|
2024-06-06 03:14:23 +08:00 |
|
hiyouga
|
fc95800840
|
add vllm_dtype arg #3387 #3717
Former-commit-id: a0dd3a6351bb78541d40fec1d2fc457d803c86a4
|
2024-06-06 02:53:27 +08:00 |
|
hiyouga
|
765715af21
|
support train from scratch #4033 #4075
Former-commit-id: 1290b9d01077e62f8de7a23637daa2586cc82bfa
|
2024-06-06 02:43:19 +08:00 |
|
MengqingCao
|
9dd5f7d642
|
add npu for model export
Former-commit-id: ce020b6eb3f35c1db37ee4835e694eddcd0f59b0
|
2024-06-05 07:06:40 +00:00 |
|
hiyouga
|
82d744716a
|
fix #4005 #4013
Former-commit-id: 8608fa268cde5cddf8d0c6c2eb2cb5fa246c1831
|
2024-06-03 19:12:29 +08:00 |
|
hoshi-hiyouga
|
1a3764ab8f
|
Merge pull request #4007 from xu-song/patch-3
Update model_args.py
Former-commit-id: d88b3a0f2707bcc964f642d348295b99f7c796f8
|
2024-06-03 18:54:37 +08:00 |
|
hiyouga
|
d2ede9d393
|
fix #4022
Former-commit-id: 9541f2f1f1b7d7877eb734f051048e52003a3430
|
2024-06-03 18:38:36 +08:00 |
|
Xu Song
|
f2ae2cc04d
|
Update model_args.py
Former-commit-id: f1e018587e5722e41962abd60f74043a3e55f692
|
2024-05-31 14:35:48 +08:00 |
|
hiyouga
|
87aa332583
|
better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui
Former-commit-id: 84cfb2452cc86b037ccddee6e833f8eb7c129fa4
|
2024-05-29 23:55:38 +08:00 |
|
hiyouga
|
bceac4f554
|
bump vllm version to 0.4.1
Former-commit-id: a00fd39a4c2f270620711f2bfbad8d460fb4aa89
|
2024-05-28 21:27:27 +08:00 |
|
hiyouga
|
9138a7a5ba
|
support DDP in webui
Former-commit-id: d059262ff8dc857f597d2657546ec625726a664a
|
2024-05-28 19:24:22 +08:00 |
|
hiyouga
|
3b28c003dd
|
fix full/freeze tuning for mllm
Former-commit-id: df5860ddb593d5b82163a585d12160b41dbce0f3
|
2024-05-27 20:37:57 +08:00 |
|
BUAADreamer
|
11fcd055ec
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 113be744b3d044fbea3a8654158aa83ddb4599eb
|
2024-05-27 11:54:01 +08:00 |
|
hiyouga
|
b0d9966663
|
support SimPO #3900
Former-commit-id: 6b954ce60155cf8334150b795cfc4bb63ca74c8b
|
2024-05-26 23:46:33 +08:00 |
|
BUAADreamer
|
27d8706d6d
|
Merge branch 'hiyouga:main' into main
Former-commit-id: a4ce5ee381fd59f6b254ab634af51b6bb54edd97
|
2024-05-24 09:50:00 +08:00 |
|
hiyouga
|
554ca3d8dc
|
fix oom issues in export
Former-commit-id: b7ccc882a192aa1e25b1e5816f875ea304282412
|
2024-05-23 23:32:45 +08:00 |
|
BUAADreamer
|
1f093334d1
|
support pretraining of llava
Former-commit-id: 6a4c8cf0a6a1674c693b9337f018ff8df7477f8f
|
2024-05-21 08:57:14 +08:00 |
|
hoshi-hiyouga
|
3578abc7a4
|
Update generating_args.py
Former-commit-id: 861c146fa7d9cb5b99372464bd068c20fa36415d
|
2024-05-20 00:29:31 +08:00 |
|
ycjcl868
|
77a089c35c
|
feat: cli chat support system_message
Former-commit-id: e3982bff596d01992733687a580c4f41c558061c
|
2024-05-19 23:17:46 +08:00 |
|
hiyouga
|
2bff90719b
|
improve KTO impl., replace datasets
Former-commit-id: e56a57ddcf061de6e4acc8679f7dbf0b68364986
|
2024-05-18 03:44:56 +08:00 |
|
hoshi-hiyouga
|
e4570e28a8
|
Merge pull request #3785 from enji-zhou/feature/add_kto
add kto
Former-commit-id: f60faa23e23022fd855dac6b1ecbd21e095bccb5
|
2024-05-18 03:07:18 +08:00 |
|
hoshi-hiyouga
|
0fd1a05cec
|
Update model_args.py
Former-commit-id: f40a2fe5334865763e4d513292d359317b7a091b
|
2024-05-17 16:16:41 +08:00 |
|
juejuezi
|
6373d307ec
|
feat: pass the max_lora_rank parameter to vLLM backend
Former-commit-id: a8756d839405ecb5deabe885cf11d1a61564deee
|
2024-05-17 16:07:39 +08:00 |
|
enji.zhou
|
66b5634ebf
|
add kto
Former-commit-id: ec51986cf70b0bdd79b8141e45916670fb97a08e
|
2024-05-17 13:09:17 +08:00 |
|
hiyouga
|
dfa686b617
|
rename package
Former-commit-id: a07ff0c083558cfe6f474d13027642d3052fee08
|
2024-05-16 18:39:08 +08:00 |
|