hiyouga
|
26f293d587
|
fix #3853
Former-commit-id: 465a5500bae1f30744d4b9b3db40aaf9171da2cb
|
2024-05-24 23:29:45 +08:00 |
|
seanzhang-zhichen
|
a3b52fd380
|
Merge branch 'main' into add_dataset_sample_num
Former-commit-id: 26300127c45f24e63b91f1b0cc73e46c3a936a91
|
2024-05-24 15:57:47 +08:00 |
|
BUAADreamer
|
27d8706d6d
|
Merge branch 'hiyouga:main' into main
Former-commit-id: a4ce5ee381fd59f6b254ab634af51b6bb54edd97
|
2024-05-24 09:50:00 +08:00 |
|
hiyouga
|
bf59383783
|
refactor data preprocessing, fix mllm rlhf
Former-commit-id: 53ff2dd24f9121ea30c95063bb72e49a9b31e980
|
2024-05-24 04:08:25 +08:00 |
|
hoshi-hiyouga
|
1078611259
|
Merge pull request #3876 from dongdongqiang2018/main
added adapted to 910B image
Former-commit-id: 0708cc8a24589b9f22ad3df6685e57d1da0336f2
|
2024-05-24 01:54:30 +08:00 |
|
hiyouga
|
e6fc0ac8fe
|
fix paligemma sft
requires transformers>=4.41.1
Former-commit-id: 80b3030569cd606ac0de43e9a682478f5bd7b727
|
2024-05-24 00:23:40 +08:00 |
|
hiyouga
|
554ca3d8dc
|
fix oom issues in export
Former-commit-id: b7ccc882a192aa1e25b1e5816f875ea304282412
|
2024-05-23 23:32:45 +08:00 |
|
donggang
|
86dfdf956d
|
adapted to 910B image
Former-commit-id: e095254808aace63a1be878620f683902f51cfb3
|
2024-05-23 09:48:22 +00:00 |
|
BUAADreamer
|
c0e4475485
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 4076f52c8ba7da4624a1fb3fa52a7170d1c3171e
|
2024-05-21 22:18:20 +08:00 |
|
hiyouga
|
2b65f8bd5c
|
fix paligemma sft
Former-commit-id: 60682d04414be37e611d6470618a8d599703942b
|
2024-05-21 20:03:09 +08:00 |
|
hiyouga
|
09e78272c2
|
Update README_zh.md
Former-commit-id: 34c4ba6bf9bb89170446fb396aa06ae44d251de0
|
2024-05-21 18:30:59 +08:00 |
|
hiyouga
|
cccce564bd
|
update wechat
Former-commit-id: 6613349562194b48c5fc57aa68e620b8fa83fc0a
|
2024-05-21 18:22:32 +08:00 |
|
hiyouga
|
4adec327de
|
fix #3847
Former-commit-id: d206b306ca4eadc8b3d4feaf490ad12f9452e562
|
2024-05-21 17:53:06 +08:00 |
|
BUAADreamer
|
1f093334d1
|
support pretraining of llava
Former-commit-id: 6a4c8cf0a6a1674c693b9337f018ff8df7477f8f
|
2024-05-21 08:57:14 +08:00 |
|
hiyouga
|
e0e8507108
|
support paligemma
Former-commit-id: 11c27f9bf204d3d6a9ca5bd4f0a19a420160453f
|
2024-05-21 00:01:22 +08:00 |
|
hiyouga
|
f5962f8128
|
fix paligemma data preprocess
Former-commit-id: 71b85437301739d9d96d3881d4a34b37c0f69db8
|
2024-05-20 23:51:32 +08:00 |
|
hiyouga
|
b31d808655
|
fix paligemma inference
Former-commit-id: 46357b7a677e8ba2e0a7c9d4ec1974abd061569c
|
2024-05-20 23:36:43 +08:00 |
|
hiyouga
|
247cda4b68
|
fix #3818
Former-commit-id: 3f366e05a34be224f53c5bf8334e57ae5d316004
|
2024-05-20 21:43:19 +08:00 |
|
hiyouga
|
e30975e9a2
|
add kto to webui
Former-commit-id: 6c866f4dbd45e868860be8351d1a65c4e1a4e02b
|
2024-05-20 21:20:25 +08:00 |
|
zhangzc
|
de9f1583c2
|
fix conflict
Former-commit-id: 6922b23a748c2459147bf44b96d86daa89f2c96c
|
2024-05-20 17:10:01 +08:00 |
|
hiyouga
|
ab48653e63
|
fix chat engines
do not use pop(key, default) since api assigns None to dict values
Former-commit-id: 3ebbd0b55ea07de2897c27ca54eeab5c3b319419
|
2024-05-20 00:36:43 +08:00 |
|
hoshi-hiyouga
|
6d7a1e3f8f
|
Merge pull request #3812 from ycjcl868/feat/chat-support-system-prompt
feat: cli chat support system_message
Former-commit-id: 96596990527403e910c81e95e38bf2638541cf31
|
2024-05-20 00:31:32 +08:00 |
|
hoshi-hiyouga
|
e093dad7cb
|
Update vllm_engine.py
Former-commit-id: 0b8278bd21baf35d3f60c6ed24f110b391c92a47
|
2024-05-20 00:31:04 +08:00 |
|
hoshi-hiyouga
|
b103a121f0
|
Update hf_engine.py
Former-commit-id: ce8b902e538c69d89f207db8a43c85072cd70265
|
2024-05-20 00:30:45 +08:00 |
|
hoshi-hiyouga
|
3578abc7a4
|
Update generating_args.py
Former-commit-id: 861c146fa7d9cb5b99372464bd068c20fa36415d
|
2024-05-20 00:29:31 +08:00 |
|
hoshi-hiyouga
|
17d398f419
|
Update chat_model.py
Former-commit-id: 7736aafdc81d175e9fb484dbb7cae9263120a0fc
|
2024-05-20 00:29:12 +08:00 |
|
hiyouga
|
3453a8eebb
|
fix jinja template
Former-commit-id: 353561f0e3914de3f81499c4e4b831ae0a6383b6
|
2024-05-19 23:38:30 +08:00 |
|
ycjcl868
|
77a089c35c
|
feat: cli chat support system_message
Former-commit-id: e3982bff596d01992733687a580c4f41c558061c
|
2024-05-19 23:17:46 +08:00 |
|
hiyouga
|
516d83c946
|
fix zero2 high ram usage
Former-commit-id: 01797126eb173250250e31f8e76b69ae0047745d
|
2024-05-19 21:53:54 +08:00 |
|
hiyouga
|
fd02c9f973
|
fix hf gen args
Former-commit-id: 491a84976258cbb2a2647922420e2f84de1e38cd
|
2024-05-19 19:39:32 +08:00 |
|
hiyouga
|
351e80a656
|
fix envs
Former-commit-id: d5e150cfb98f8216713415564ab386b8320c88cb
|
2024-05-19 18:27:18 +08:00 |
|
hiyouga
|
4f04e2ed93
|
fix #3807
Former-commit-id: 08b695969049de8bf9bd3e90b9700736d90385ee
|
2024-05-19 17:07:57 +08:00 |
|
hiyouga
|
a810d1b98e
|
update readme
Former-commit-id: e0beb67a417b13c818a09bd419d4e20dd44ca842
|
2024-05-18 23:09:03 +08:00 |
|
hiyouga
|
fbe963a96a
|
safe output path in webui
Former-commit-id: 23f14262e0d54631630c084ba71e0433ea1d4640
|
2024-05-18 22:42:28 +08:00 |
|
hiyouga
|
d13b8bee8a
|
fix jetmoe z3 block
Former-commit-id: cb00a14d905395c4b8fadb955f0424a4c56668de
|
2024-05-18 22:28:45 +08:00 |
|
hiyouga
|
0aa072a155
|
improve data process logger
Former-commit-id: 33d0b012b56dbafc9fff87b821c2d1bf1409dbb5
|
2024-05-18 22:02:42 +08:00 |
|
hiyouga
|
57dde7c3bc
|
update data readme
Former-commit-id: 22c7335b496e4a673383d5a1e4e60bf2cb4e35b3
|
2024-05-18 21:37:38 +08:00 |
|
hiyouga
|
6b9003f781
|
update data readme
Former-commit-id: beb864a9367943d3274cb6057423d1eb9aaf85c4
|
2024-05-18 21:15:20 +08:00 |
|
hiyouga
|
9c1c59e481
|
fix #3803
Former-commit-id: 1ef12c95059d14a1717c82ce04e529e7ad6435ed
|
2024-05-18 16:13:14 +08:00 |
|
hoshi-hiyouga
|
31daec2749
|
Merge pull request #3799 from hiyouga/dev
improve KTO impl, replace datasets
Former-commit-id: b4cc207855aa1dbb120f7999165e176e649af338
|
2024-05-18 03:49:13 +08:00 |
|
hiyouga
|
2bff90719b
|
improve KTO impl., replace datasets
Former-commit-id: e56a57ddcf061de6e4acc8679f7dbf0b68364986
|
2024-05-18 03:44:56 +08:00 |
|
hoshi-hiyouga
|
e4570e28a8
|
Merge pull request #3785 from enji-zhou/feature/add_kto
add kto
Former-commit-id: f60faa23e23022fd855dac6b1ecbd21e095bccb5
|
2024-05-18 03:07:18 +08:00 |
|
hoshi-hiyouga
|
d84a730daa
|
Merge pull request #3794 from jue-jue-zi/main
feat: pass the `max_lora_rank` parameter to vLLM backend
Former-commit-id: be839961686a1845f00a56e398a7b3779df8b6e4
|
2024-05-17 16:17:30 +08:00 |
|
hoshi-hiyouga
|
0fd1a05cec
|
Update model_args.py
Former-commit-id: f40a2fe5334865763e4d513292d359317b7a091b
|
2024-05-17 16:16:41 +08:00 |
|
juejuezi
|
6373d307ec
|
feat: pass the max_lora_rank parameter to vLLM backend
Former-commit-id: a8756d839405ecb5deabe885cf11d1a61564deee
|
2024-05-17 16:07:39 +08:00 |
|
hiyouga
|
a32c3a50fc
|
add deepseek v2 lite model
Former-commit-id: 5e864e6b721d8b891b1cc2ca2dcac41babb9eaaf
|
2024-05-17 13:25:36 +08:00 |
|
enji.zhou
|
66b5634ebf
|
add kto
Former-commit-id: ec51986cf70b0bdd79b8141e45916670fb97a08e
|
2024-05-17 13:09:17 +08:00 |
|
hiyouga
|
92b3697e2c
|
update badam example #3764
Former-commit-id: a3730fd0a96bab869be6d695031182dabaea8137
|
2024-05-17 02:21:10 +08:00 |
|
hiyouga
|
969e605c7e
|
better dtype handle in loading
Former-commit-id: 663f0577dd61a1a31191db2c6fbb0c7cea533b21
|
2024-05-17 02:14:56 +08:00 |
|
hiyouga
|
a3320f26cf
|
update examples
Former-commit-id: 3b5f138155d96b346bda18e465cf60ec7d99e19c
|
2024-05-17 01:02:00 +08:00 |
|