Commit Graph

1305 Commits

Author SHA1 Message Date
hiyouga
446c681b58 fix paligemma inference
Former-commit-id: 542229abb3
2024-05-20 23:36:43 +08:00
hiyouga
5351e3945b add kto to webui
Former-commit-id: 9b0f4d7602
2024-05-20 21:20:25 +08:00
zhangzc
4b90f04c1f fix conflict
Former-commit-id: d956041640
2024-05-20 17:10:01 +08:00
hiyouga
864da49139 fix chat engines
do not use pop(key, default) since api assigns None to dict values


Former-commit-id: d52fae2fa8
2024-05-20 00:36:43 +08:00
hoshi-hiyouga
6955042c10 Merge pull request #3812 from ycjcl868/feat/chat-support-system-prompt
feat: cli chat support system_message
Former-commit-id: aa0bca49e9
2024-05-20 00:31:32 +08:00
hoshi-hiyouga
02fdf903e8 Update vllm_engine.py
Former-commit-id: a0e8d3d159
2024-05-20 00:31:04 +08:00
hoshi-hiyouga
30b2ec7025 Update hf_engine.py
Former-commit-id: a943a1034b
2024-05-20 00:30:45 +08:00
hoshi-hiyouga
a710d97748 Update generating_args.py
Former-commit-id: a1fa7aa63b
2024-05-20 00:29:31 +08:00
hoshi-hiyouga
b293939c24 Update chat_model.py
Former-commit-id: 896c656185
2024-05-20 00:29:12 +08:00
hiyouga
0e57bb201c fix jinja template
Former-commit-id: 10573e1639
2024-05-19 23:38:30 +08:00
ycjcl868
b28f9ecaa0 feat: cli chat support system_message
Former-commit-id: a08ba254c8
2024-05-19 23:17:46 +08:00
hiyouga
8d4a5ebf6e fix zero2 high ram usage
Former-commit-id: 31a0564d4f
2024-05-19 21:53:54 +08:00
hiyouga
5f48c282d3 fix hf gen args
Former-commit-id: 70214b71b1
2024-05-19 19:39:32 +08:00
hiyouga
32a65e89e5 fix envs
Former-commit-id: 8ee8ac6eba
2024-05-19 18:27:18 +08:00
hiyouga
df4aec7e72 fix #3807
Former-commit-id: 1ebc890a5f
2024-05-19 17:07:57 +08:00
hiyouga
02f716907e safe output path in webui
Former-commit-id: 3c2a992caa
2024-05-18 22:42:28 +08:00
hiyouga
7130efff54 fix jetmoe z3 block
Former-commit-id: d43822fcc2
2024-05-18 22:28:45 +08:00
hiyouga
519d2511ae improve data process logger
Former-commit-id: a851056229
2024-05-18 22:02:42 +08:00
hiyouga
1e867c0fa0 fix #3803
Former-commit-id: 0edc16769f
2024-05-18 16:13:14 +08:00
hiyouga
13d7b48efe improve KTO impl., replace datasets
Former-commit-id: c450ee87a3
2024-05-18 03:44:56 +08:00
hoshi-hiyouga
97469892c3 Merge pull request #3785 from enji-zhou/feature/add_kto
add kto

Former-commit-id: 33a354548e
2024-05-18 03:07:18 +08:00
hoshi-hiyouga
e4a2accf4a Update model_args.py
Former-commit-id: 9646727453
2024-05-17 16:16:41 +08:00
juejuezi
20326affde feat: pass the max_lora_rank parameter to vLLM backend
Former-commit-id: b20d62ba3c
2024-05-17 16:07:39 +08:00
hiyouga
9af3dce3c8 add deepseek v2 lite model
Former-commit-id: 8af9817605
2024-05-17 13:25:36 +08:00
enji.zhou
03956053b8 add kto
Former-commit-id: db1d5a4f51
2024-05-17 13:09:17 +08:00
hiyouga
780a1f5a4e better dtype handle in loading
Former-commit-id: d9f190ff1e
2024-05-17 02:14:56 +08:00
hiyouga
f4bf49e891 enable inbrowser in webui
Former-commit-id: 694a05fd04
2024-05-17 00:08:56 +08:00
hiyouga
22f71c152a add falcon 11b
Former-commit-id: d77bed4091
2024-05-17 00:08:33 +08:00
hiyouga
cae823ddf0 rename package
Former-commit-id: 308edbc426
2024-05-16 18:39:08 +08:00
hiyouga
93a289107b set dev version
Former-commit-id: b2fc7aeb03
2024-05-16 02:17:31 +08:00
hiyouga
b5034f2b12 release v0.7.1
Former-commit-id: 1c910079d8
2024-05-16 00:57:16 +08:00
hiyouga
6e6267f17c fix #3694
Former-commit-id: 2a67ab3925
2024-05-16 00:35:28 +08:00
hiyouga
a84f155563 fix #3606
https://github.com/huggingface/peft/pull/1706

Former-commit-id: 44cfa9a1cd
2024-05-15 23:05:02 +08:00
hiyouga
757e172509 add Yi-VL-34B model
Former-commit-id: a388cadfc0
2024-05-15 22:58:19 +08:00
hiyouga
74727c03e8 add yi-vl 6b model
Former-commit-id: 73845fcc46
2024-05-15 20:02:41 +08:00
hiyouga
b4c5a08d06 fix yi vl vllm infer
Former-commit-id: 51d61fcc89
2024-05-15 19:25:48 +08:00
hoshi-hiyouga
82a10c569a Merge pull request #3748 from BUAADreamer/main
Add MLLM YI-VL and save processor config during training

Former-commit-id: 75f405ec30
2024-05-15 16:40:54 +08:00
hoshi-hiyouga
e80e50805c Update visual.py
Former-commit-id: cbeef2aaea
2024-05-15 16:39:57 +08:00
hiyouga
f2b4237db1 fix fsdp model loading
Former-commit-id: 008e3b3b10
2024-05-15 16:32:28 +08:00
hoshi-hiyouga
e09d68985f Update patcher.py
Former-commit-id: 5a0c8a8d34
2024-05-15 15:37:07 +08:00
hoshi-hiyouga
3d65c4ceab Update template.py
Former-commit-id: 780ca8306b
2024-05-15 14:20:39 +08:00
hoshi-hiyouga
cea8cea9dd Update trainer.py
Former-commit-id: aa4a8933dd
2024-05-15 14:13:26 +08:00
hoshi-hiyouga
7622300c4b Update workflow.py
Former-commit-id: c309605ff5
2024-05-15 14:13:01 +08:00
BUAADreamer
e1c2ff41a0 rm extra import
Former-commit-id: db1622f76b
2024-05-15 12:48:18 +08:00
BUAADreamer
3f38ef9f59 cast dtype in mm_proj
Former-commit-id: d2bf697400
2024-05-15 11:22:15 +08:00
BUAADreamer
dbc7b1c046 modify style
Former-commit-id: 771bed5bde
2024-05-15 10:18:10 +08:00
BUAADreamer
df3a974057 Merge branch 'main' of https://github.com/BUAADreamer/LLaMA-Factory
Former-commit-id: 3f4556454c
2024-05-15 09:54:21 +08:00
BUAADreamer
7d1d73b941 Merge branch 'hiyouga:main' into main
Former-commit-id: 7046144499
2024-05-15 09:54:14 +08:00
BUAADreamer
92b184101f add yivl and save processor to model_dir
Former-commit-id: afc6c7b9fd
2024-05-15 09:54:00 +08:00
hiyouga
967b9c0a49 fix bug in vllm engine
Former-commit-id: 11bf282dcc
2024-05-15 02:17:54 +08:00