hoshi-hiyouga
|
5f67fdaac9
|
Update loader.py
Former-commit-id: 19d8fd62c18ee3ba0e431fc241f7d315cb716fef
|
2024-05-30 00:12:12 +08:00 |
|
hoshi-hiyouga
|
05e6fe4287
|
Update parser.py
Former-commit-id: 310cc11e8c83f16fc5bccc349c38fea347ea9a97
|
2024-05-30 00:05:20 +08:00 |
|
seanzhang-zhichen
|
a3b52fd380
|
Merge branch 'main' into add_dataset_sample_num
Former-commit-id: 26300127c45f24e63b91f1b0cc73e46c3a936a91
|
2024-05-24 15:57:47 +08:00 |
|
hiyouga
|
bf59383783
|
refactor data preprocessing, fix mllm rlhf
Former-commit-id: 53ff2dd24f9121ea30c95063bb72e49a9b31e980
|
2024-05-24 04:08:25 +08:00 |
|
hiyouga
|
e6fc0ac8fe
|
fix paligemma sft
requires transformers>=4.41.1
Former-commit-id: 80b3030569cd606ac0de43e9a682478f5bd7b727
|
2024-05-24 00:23:40 +08:00 |
|
hiyouga
|
554ca3d8dc
|
fix oom issues in export
Former-commit-id: b7ccc882a192aa1e25b1e5816f875ea304282412
|
2024-05-23 23:32:45 +08:00 |
|
hiyouga
|
2b65f8bd5c
|
fix paligemma sft
Former-commit-id: 60682d04414be37e611d6470618a8d599703942b
|
2024-05-21 20:03:09 +08:00 |
|
hiyouga
|
4adec327de
|
fix #3847
Former-commit-id: d206b306ca4eadc8b3d4feaf490ad12f9452e562
|
2024-05-21 17:53:06 +08:00 |
|
hiyouga
|
e0e8507108
|
support paligemma
Former-commit-id: 11c27f9bf204d3d6a9ca5bd4f0a19a420160453f
|
2024-05-21 00:01:22 +08:00 |
|
hiyouga
|
f5962f8128
|
fix paligemma data preprocess
Former-commit-id: 71b85437301739d9d96d3881d4a34b37c0f69db8
|
2024-05-20 23:51:32 +08:00 |
|
hiyouga
|
b31d808655
|
fix paligemma inference
Former-commit-id: 46357b7a677e8ba2e0a7c9d4ec1974abd061569c
|
2024-05-20 23:36:43 +08:00 |
|
hiyouga
|
e30975e9a2
|
add kto to webui
Former-commit-id: 6c866f4dbd45e868860be8351d1a65c4e1a4e02b
|
2024-05-20 21:20:25 +08:00 |
|
zhangzc
|
de9f1583c2
|
fix conflict
Former-commit-id: 6922b23a748c2459147bf44b96d86daa89f2c96c
|
2024-05-20 17:10:01 +08:00 |
|
hiyouga
|
ab48653e63
|
fix chat engines
do not use pop(key, default) since api assigns None to dict values
Former-commit-id: 3ebbd0b55ea07de2897c27ca54eeab5c3b319419
|
2024-05-20 00:36:43 +08:00 |
|
hoshi-hiyouga
|
6d7a1e3f8f
|
Merge pull request #3812 from ycjcl868/feat/chat-support-system-prompt
feat: cli chat support system_message
Former-commit-id: 96596990527403e910c81e95e38bf2638541cf31
|
2024-05-20 00:31:32 +08:00 |
|
hoshi-hiyouga
|
e093dad7cb
|
Update vllm_engine.py
Former-commit-id: 0b8278bd21baf35d3f60c6ed24f110b391c92a47
|
2024-05-20 00:31:04 +08:00 |
|
hoshi-hiyouga
|
b103a121f0
|
Update hf_engine.py
Former-commit-id: ce8b902e538c69d89f207db8a43c85072cd70265
|
2024-05-20 00:30:45 +08:00 |
|
hoshi-hiyouga
|
3578abc7a4
|
Update generating_args.py
Former-commit-id: 861c146fa7d9cb5b99372464bd068c20fa36415d
|
2024-05-20 00:29:31 +08:00 |
|
hoshi-hiyouga
|
17d398f419
|
Update chat_model.py
Former-commit-id: 7736aafdc81d175e9fb484dbb7cae9263120a0fc
|
2024-05-20 00:29:12 +08:00 |
|
hiyouga
|
3453a8eebb
|
fix jinja template
Former-commit-id: 353561f0e3914de3f81499c4e4b831ae0a6383b6
|
2024-05-19 23:38:30 +08:00 |
|
ycjcl868
|
77a089c35c
|
feat: cli chat support system_message
Former-commit-id: e3982bff596d01992733687a580c4f41c558061c
|
2024-05-19 23:17:46 +08:00 |
|
hiyouga
|
516d83c946
|
fix zero2 high ram usage
Former-commit-id: 01797126eb173250250e31f8e76b69ae0047745d
|
2024-05-19 21:53:54 +08:00 |
|
hiyouga
|
fd02c9f973
|
fix hf gen args
Former-commit-id: 491a84976258cbb2a2647922420e2f84de1e38cd
|
2024-05-19 19:39:32 +08:00 |
|
hiyouga
|
351e80a656
|
fix envs
Former-commit-id: d5e150cfb98f8216713415564ab386b8320c88cb
|
2024-05-19 18:27:18 +08:00 |
|
hiyouga
|
4f04e2ed93
|
fix #3807
Former-commit-id: 08b695969049de8bf9bd3e90b9700736d90385ee
|
2024-05-19 17:07:57 +08:00 |
|
hiyouga
|
fbe963a96a
|
safe output path in webui
Former-commit-id: 23f14262e0d54631630c084ba71e0433ea1d4640
|
2024-05-18 22:42:28 +08:00 |
|
hiyouga
|
d13b8bee8a
|
fix jetmoe z3 block
Former-commit-id: cb00a14d905395c4b8fadb955f0424a4c56668de
|
2024-05-18 22:28:45 +08:00 |
|
hiyouga
|
0aa072a155
|
improve data process logger
Former-commit-id: 33d0b012b56dbafc9fff87b821c2d1bf1409dbb5
|
2024-05-18 22:02:42 +08:00 |
|
hiyouga
|
9c1c59e481
|
fix #3803
Former-commit-id: 1ef12c95059d14a1717c82ce04e529e7ad6435ed
|
2024-05-18 16:13:14 +08:00 |
|
hiyouga
|
2bff90719b
|
improve KTO impl., replace datasets
Former-commit-id: e56a57ddcf061de6e4acc8679f7dbf0b68364986
|
2024-05-18 03:44:56 +08:00 |
|
hoshi-hiyouga
|
e4570e28a8
|
Merge pull request #3785 from enji-zhou/feature/add_kto
add kto
Former-commit-id: f60faa23e23022fd855dac6b1ecbd21e095bccb5
|
2024-05-18 03:07:18 +08:00 |
|
hoshi-hiyouga
|
0fd1a05cec
|
Update model_args.py
Former-commit-id: f40a2fe5334865763e4d513292d359317b7a091b
|
2024-05-17 16:16:41 +08:00 |
|
juejuezi
|
6373d307ec
|
feat: pass the max_lora_rank parameter to vLLM backend
Former-commit-id: a8756d839405ecb5deabe885cf11d1a61564deee
|
2024-05-17 16:07:39 +08:00 |
|
hiyouga
|
a32c3a50fc
|
add deepseek v2 lite model
Former-commit-id: 5e864e6b721d8b891b1cc2ca2dcac41babb9eaaf
|
2024-05-17 13:25:36 +08:00 |
|
enji.zhou
|
66b5634ebf
|
add kto
Former-commit-id: ec51986cf70b0bdd79b8141e45916670fb97a08e
|
2024-05-17 13:09:17 +08:00 |
|
hiyouga
|
969e605c7e
|
better dtype handle in loading
Former-commit-id: 663f0577dd61a1a31191db2c6fbb0c7cea533b21
|
2024-05-17 02:14:56 +08:00 |
|
hiyouga
|
45329d9e3c
|
enable inbrowser in webui
Former-commit-id: 71fdeedb64b2339eb1c740d670b87e0c03dada68
|
2024-05-17 00:08:56 +08:00 |
|
hiyouga
|
6481321470
|
add falcon 11b
Former-commit-id: 897acc725edc204fad393cc9616828431b4fa768
|
2024-05-17 00:08:33 +08:00 |
|
hiyouga
|
dfa686b617
|
rename package
Former-commit-id: a07ff0c083558cfe6f474d13027642d3052fee08
|
2024-05-16 18:39:08 +08:00 |
|
hiyouga
|
fe638cf11f
|
set dev version
Former-commit-id: 5e9c72d07c3793cdccbdb8a9f95f1bb5d714e0a3
|
2024-05-16 02:17:31 +08:00 |
|
hiyouga
|
b2949b88e9
|
release v0.7.1
Former-commit-id: a4f8adb021b6218d624303b51cd5e93ffa3111a1
|
2024-05-16 00:57:16 +08:00 |
|
hiyouga
|
538c79fd8f
|
fix #3694
Former-commit-id: 3d1b818cb6a77b7603724fbeb756b468aa74e7ea
|
2024-05-16 00:35:28 +08:00 |
|
hiyouga
|
437cc20be6
|
fix #3606
https://github.com/huggingface/peft/pull/1706
Former-commit-id: bf2783e1b6bc207375974c48736d6f82dd293f02
|
2024-05-15 23:05:02 +08:00 |
|
hiyouga
|
2ac972d6e7
|
add Yi-VL-34B model
Former-commit-id: 8b3d8a7e3bd8dff27cc72edba1b8a042f6d1929c
|
2024-05-15 22:58:19 +08:00 |
|
hiyouga
|
4d7f0fbb7a
|
add yi-vl 6b model
Former-commit-id: 35f4041b13a593a6cf1ec6686fa18b38911ad6a4
|
2024-05-15 20:02:41 +08:00 |
|
hiyouga
|
40e3d3fbdd
|
fix yi vl vllm infer
Former-commit-id: de54e5d7ec06dd7c20ec82c9ff032fc16cd50244
|
2024-05-15 19:25:48 +08:00 |
|
hoshi-hiyouga
|
7940b968ae
|
Merge pull request #3748 from BUAADreamer/main
Add MLLM YI-VL and save processor config during training
Former-commit-id: 1d3cbd24ccea63d36c27725cdc5ecd02b460b0ed
|
2024-05-15 16:40:54 +08:00 |
|
hoshi-hiyouga
|
36a4224bf5
|
Update visual.py
Former-commit-id: f5f13a995c64fc374ad05e26cde8efa6651aefa1
|
2024-05-15 16:39:57 +08:00 |
|
hiyouga
|
d4d36e157c
|
fix fsdp model loading
Former-commit-id: fc6fe23cc9ae4a920a17e8268a85c1aa4ad16d3b
|
2024-05-15 16:32:28 +08:00 |
|
hoshi-hiyouga
|
c4f5e49d0d
|
Update patcher.py
Former-commit-id: 4c31a21f2106adcdad100119bad83ecaef0be3f3
|
2024-05-15 15:37:07 +08:00 |
|