177 Commits

Author SHA1 Message Date
hiyouga
cceff9f520 lora modules: all by default
Former-commit-id: cae47379079ff811aa385c297481a27020a8da6b
2024-06-06 03:53:28 +08:00
hoshi-hiyouga
d31c9c73c7 Merge pull request #4080 from MengqingCao/npu
Add npu option for model exporting

Former-commit-id: ca459f67eb319c262d5bab882e9cb3535a76eb69
2024-06-06 03:15:44 +08:00
hoshi-hiyouga
d9a372658a Update model_args.py
Former-commit-id: af2c3cbee4372724cf00379d8494f5000dc8a3df
2024-06-06 03:14:23 +08:00
hiyouga
c439c959f7 add vllm_dtype arg #3387 #3717
Former-commit-id: 8fcc79e1e66a4e952710ac8c98685437d924361a
2024-06-06 02:53:27 +08:00
hiyouga
3fcb678d00 support train from scratch #4033 #4075
Former-commit-id: a12a506c3d2ba85975a5990c46d2e055cdfe0f2e
2024-06-06 02:43:19 +08:00
MengqingCao
15f6ab73a5 add npu for model export
Former-commit-id: 07045c876a4c6025ba56905b65cce6c9faedacb5
2024-06-05 07:06:40 +00:00
hiyouga
e4ce59243b fix #4005 #4013
Former-commit-id: eed33862bc733361f3c28b3c95dc0eb4ea00884c
2024-06-03 19:12:29 +08:00
hoshi-hiyouga
eaab09fccb Merge pull request #4007 from xu-song/patch-3
Update model_args.py

Former-commit-id: 1539c72b9493907464f29ca0f0112c6df2f997b4
2024-06-03 18:54:37 +08:00
hiyouga
d0ceb1b091 fix #4022
Former-commit-id: 24e1c0e2ee365812357fb9cf82e2162915299a26
2024-06-03 18:38:36 +08:00
Xu Song
abe33220bf Update model_args.py
Former-commit-id: dade2f083d398f83581d935f44d20dc45244c924
2024-05-31 14:35:48 +08:00
hiyouga
820404946e better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui


Former-commit-id: 80708717329b4552920dd4ce8cebc683e65d54c5
2024-05-29 23:55:38 +08:00
hiyouga
87e71df597 bump vllm version to 0.4.1
Former-commit-id: 1e80a3a6385f615bf038806b9c6b1f73f4a3e24f
2024-05-28 21:27:27 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa9208ec14f00a9bdb51f69aebb02af5
2024-05-28 19:24:22 +08:00
hiyouga
b88ecd71fd fix full/freeze tuning for mllm
Former-commit-id: 08564838bd02651668845ed74e2e60561e5b6d8c
2024-05-27 20:37:57 +08:00
BUAADreamer
a6c2a2071d Merge branch 'hiyouga:main' into main
Former-commit-id: 4bc7c10c00e6e9b5af8538af907178a37e3595f8
2024-05-27 11:54:01 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986c43f97994211ec34dc5928fc3bb9d7
2024-05-26 23:46:33 +08:00
BUAADreamer
119af92620 Merge branch 'hiyouga:main' into main
Former-commit-id: 047a06a1e5336625acac14b3533ab3ef2b9905be
2024-05-24 09:50:00 +08:00
hiyouga
6d8ef03741 fix oom issues in export
Former-commit-id: 67ebc7b388c61b9d880c02d7fd217c29299fdf43
2024-05-23 23:32:45 +08:00
BUAADreamer
071d674065 support pretraining of llava
Former-commit-id: 29a6d5bdb8610be8f796eed65eede9ba7b503527
2024-05-21 08:57:14 +08:00
hoshi-hiyouga
a710d97748 Update generating_args.py
Former-commit-id: a1fa7aa63b9b3fade3de6bd27395c1b94068b6d2
2024-05-20 00:29:31 +08:00
ycjcl868
b28f9ecaa0 feat: cli chat support system_message
Former-commit-id: a08ba254c8b62bff49b77be3740022105ae9dbb5
2024-05-19 23:17:46 +08:00
hiyouga
13d7b48efe improve KTO impl., replace datasets
Former-commit-id: c450ee87a35ff9235f9b695b0de2e042b2971178
2024-05-18 03:44:56 +08:00
hoshi-hiyouga
97469892c3 Merge pull request #3785 from enji-zhou/feature/add_kto
add kto

Former-commit-id: 33a354548e78a7f7f51d63f80974920827d30252
2024-05-18 03:07:18 +08:00
hoshi-hiyouga
e4a2accf4a Update model_args.py
Former-commit-id: 964672745389e35580a7010b0f010bd5ee08d542
2024-05-17 16:16:41 +08:00
juejuezi
20326affde feat: pass the max_lora_rank parameter to vLLM backend
Former-commit-id: b20d62ba3ccc5c02529d19e22b7adcfe8b88c326
2024-05-17 16:07:39 +08:00
enji.zhou
03956053b8 add kto
Former-commit-id: db1d5a4f51faae61fe18666057353747b01f5b8d
2024-05-17 13:09:17 +08:00
hiyouga
cae823ddf0 rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
2024-05-16 18:39:08 +08:00