hoshi-hiyouga
|
fc18db6290
|
Merge pull request #6364 from hiyouga/hiyouga/control_reenterent_gc
[model] support non-reenterent-gc
Former-commit-id: a665ad6178516faf8aaa628d3b2c672ad831d7b7
|
2024-12-17 19:58:36 +08:00 |
|
hiyouga
|
64bac4bc7e
|
support non-reenterent-gc & fix #6358
Former-commit-id: f319da6937964c5068864f7815efbf3847bd4ad8
|
2024-12-17 11:41:59 +00:00 |
|
hoshi-hiyouga
|
002c7d2867
|
Merge pull request #6363 from hiyouga/hiyouga/control_skip_eos
[infer] support control eos
Former-commit-id: 69738283071567eeecb492ac38ce1df3b994d975
|
2024-12-17 19:35:40 +08:00 |
|
hiyouga
|
a94a1eac67
|
support control eos, fix #6345
Former-commit-id: eda76de32bab103c650f246327d214539ae6f291
|
2024-12-17 10:42:05 +00:00 |
|
hiyouga
|
bff1b94583
|
generalized packing & fix #6343
Former-commit-id: 2d107d3aefd5af61163056634c8b91fe3cb3e77c
|
2024-12-17 10:26:19 +00:00 |
|
hiyouga
|
50ca43c3fb
|
fix #6348
Former-commit-id: 142191e4664cb1b920aff2f51d1bac6180f2c24b
|
2024-12-17 10:06:46 +00:00 |
|
hiyouga
|
6f1e450739
|
fix mrope
Former-commit-id: 2811814fc42fb214b3e8be1055f9f57ffd0ffb12
|
2024-12-12 15:08:17 +00:00 |
|
hiyouga
|
cf8cad8e7e
|
support qwen2vl train proj only
Former-commit-id: 99c62660c67fd2567c094bb49ec7d108e5670730
|
2024-12-05 10:37:42 +00:00 |
|
hiyouga
|
88b06a0c7f
|
support qwen2vl vllm infer
Former-commit-id: 207f8b069ca35a28de4588b4962e7254f451c52c
|
2024-12-05 10:17:26 +00:00 |
|
hiyouga
|
819f487c8f
|
fix scripts
Former-commit-id: eb3e147d198a3ecb02c65f7733cec7cd9d3814a3
|
2024-12-05 03:47:32 +00:00 |
|
hoshi-hiyouga
|
9bbeba6323
|
Merge pull request #6160 from village-way/pr_dataloader
fix:tokenized_path not None and load_from_disk return Dataset Trigger…
Former-commit-id: cf298468309cd923d830dcaf7a1aa837519faf1e
|
2024-12-04 22:18:19 +08:00 |
|
hoshi-hiyouga
|
92940817e7
|
lint
Former-commit-id: 6a5074e46695378b76d58aac8ad7768b6b034b9c
|
2024-12-04 22:08:27 +08:00 |
|
hiyouga
|
235cdcacee
|
support batch infer in vllm
Former-commit-id: 1324d158f954d777f1fbf09f46149c372704b388
|
2024-12-04 13:50:00 +00:00 |
|
hoshi-hiyouga
|
ed4c4bab49
|
Merge pull request #6170 from hykilpikonna/main
[+] Show the hostname in webui title
Former-commit-id: 263cb82bdb3dfb0c213018f25022686a3dab617e
|
2024-12-04 18:07:29 +08:00 |
|
hiyouga
|
0ef1dc4dd5
|
fix vlm zero3 training
Former-commit-id: dbb9e5b70efab37ed057b2d5822b9d0d23e99fb1
|
2024-12-04 09:40:39 +00:00 |
|
Azalea
|
0efa34c9ef
|
[U] Compute hostname differently
Former-commit-id: 6554cdeedb8ab669ce500be404dab8d42a90779b
|
2024-11-28 22:23:41 -05:00 |
|
hiyouga
|
1c3d86cd65
|
add qwq
Former-commit-id: 68a612115aebba51695d22be4397c16c86f3b40a
|
2024-11-28 08:50:57 +00:00 |
|
Azalea
|
f5e6e25a1b
|
[+] Show the hostname
Former-commit-id: dfb953b1adb79ed9f886ecac6851a559617aaa5a
|
2024-11-28 12:25:02 +08:00 |
|
wangdepeng
|
ae09c6c214
|
fix:tokenized_path not None and load_from_disk return Dataset Trigger stuck
Former-commit-id: 4424d4de8aca0e4d3b92672584978f3cc3fc33da
|
2024-11-27 16:44:42 +08:00 |
|
hiyouga
|
9822cb7bac
|
fix dataset
Former-commit-id: 046b6fb118e3ea75062c6a759720a1759639e93c
|
2024-11-27 06:27:44 +00:00 |
|
hiyouga
|
d51d96d594
|
add skywork o1
Former-commit-id: ec9ff8caa2637965d41937cce7de4e4d51d054eb
|
2024-11-27 05:51:59 +00:00 |
|
hiyouga
|
ab3782b0fa
|
add marco-o1 and openo1 dataset
Former-commit-id: 17afb7d4103499a9a090a6624896cfa123e9e1d6
|
2024-11-27 04:20:23 +00:00 |
|
hoshi-hiyouga
|
6cd90efb82
|
Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset
Former-commit-id: b26c490ac3a0a8a6342f940eb6ccb7b8b6d78f93
|
2024-11-27 00:16:15 +08:00 |
|
hiyouga
|
358708ee97
|
fix #6149
Former-commit-id: 362d579ce83e63007e6f89f264d06d2698671cc6
|
2024-11-26 16:03:02 +00:00 |
|
hiyouga
|
006022cadd
|
fix mllama cross_mask
Former-commit-id: 598c22e43f3f10a335933339cc612744c4835eb0
|
2024-11-26 15:56:58 +00:00 |
|
hoshi-hiyouga
|
118ffe50e3
|
lint
Former-commit-id: da9e4ddd26ebd6e7eb266aa0bef7505465a6b119
|
2024-11-25 22:55:56 +08:00 |
|
hoshi-hiyouga
|
c0ffe68745
|
fix #6139
Former-commit-id: d87e16cf5c46dadbfcda7b8ac8edfef6a012f97f
|
2024-11-25 22:22:06 +08:00 |
|
hoshi-hiyouga
|
a489f10986
|
fix visual patch
Former-commit-id: 75b586c31acf47d1bd28e04566ffd1d954e45596
|
2024-11-25 20:06:06 +08:00 |
|
hoshi-hiyouga
|
f48d07cd6c
|
fix #6136
Former-commit-id: 0516e556a71a22b8767b17734adb94eb127e7e6f
|
2024-11-25 19:43:42 +08:00 |
|
hiyouga
|
f8f3638bff
|
set dev version
Former-commit-id: b0ccc2ee86b74548c55e15da525bb9f22db8188a
|
2024-11-25 01:36:49 +08:00 |
|
hoshi-hiyouga
|
1176cd6779
|
Merge pull request #6124 from hiyouga/hiyouga/release
[release] release v0.9.1
Former-commit-id: 18daf10eda815e29ffd7bc0f2423f0c6d12b7b31
|
2024-11-25 00:20:02 +08:00 |
|
hoshi-hiyouga
|
4165c4414d
|
Merge pull request #6126 from hiyouga/hiyouga/fix_vllm
[inference] fix vllm
Former-commit-id: 07059a7ca4bc9d79465639b1c22d8ccde5e81244
|
2024-11-25 00:19:54 +08:00 |
|
hiyouga
|
65699c29d4
|
fix vllm
Former-commit-id: 13ee1f5cec815590c5d290f0aca264e6d16ddd5d
|
2024-11-25 00:07:24 +08:00 |
|
hiyouga
|
a04538e70b
|
fix cli
Former-commit-id: 8792d78c82e83f319c584079d7ebfa2dccbb346a
|
2024-11-24 23:56:21 +08:00 |
|
hiyouga
|
708116a5f3
|
release v0.9.1
Former-commit-id: d622f8fdec744ca98035913eac13e1340949a72a
|
2024-11-24 23:48:41 +08:00 |
|
hiyouga
|
dcc67ac1a5
|
fix qwen2vl vllm infer
Former-commit-id: fa50fc470e46010214f0e509ef75a6c167caac7f
|
2024-11-24 23:27:24 +08:00 |
|
hiyouga
|
253752ccca
|
add forbidden modules
Former-commit-id: df477370dc67315effac1a8f48068c4e9c4067a5
|
2024-11-23 18:34:15 +00:00 |
|
hiyouga
|
e99031daa4
|
fix inputs
Former-commit-id: 446441fdb020b5a102480251cb8536dd8b3f8f99
|
2024-11-23 18:26:02 +00:00 |
|
marko1616
|
23fc0c863e
|
Linter.
Former-commit-id: b1e43e56db4d898c0d6d27b703b82a1eb9af70c2
|
2024-11-23 16:09:04 +00:00 |
|
marko1616
|
3295519099
|
Tiny fix.
Former-commit-id: 8372c5e3771c42f225d7bd80a758af920f80e893
|
2024-11-23 16:09:01 +00:00 |
|
marko1616
|
20faaf3418
|
Support llama3.2vl.
Former-commit-id: 3f2c056253c651e8e614c787e2045f4232e82666
|
2024-11-23 16:07:35 +00:00 |
|
hoshi-hiyouga
|
1eaaa85980
|
do not split save_cmd ret value
Former-commit-id: d20b97e7e9514e68c33d0428512fd21b548c1131
|
2024-11-21 22:30:23 +08:00 |
|
superboy-zjc
|
e272f87849
|
[patch] Patch remote OS command injection vulnerability
Former-commit-id: aa6a174d6822340022433c5ba38182b4932adecb
|
2024-11-21 01:52:12 -05:00 |
|
hoshi-hiyouga
|
302e4e22bf
|
Merge pull request #6078 from wtmlon/support-efficient-tokens-calculation
support effective tokens calculation on sft/dpo
Former-commit-id: bd639a137e6f46e1a0005cc91572f5f1ec894f74
|
2024-11-20 13:43:15 +08:00 |
|
Ting
|
e27a0c3d53
|
code refactor
Former-commit-id: 40627c601efc9f144a227dded8c6b40babff4e8b
|
2024-11-19 20:33:18 +08:00 |
|
Ting
|
32656bc50d
|
update
Former-commit-id: f566ecc8d1f04615351acbe4f8480b75b2daed42
|
2024-11-19 19:12:10 +08:00 |
|
Ting
|
bf2b8df540
|
update
Former-commit-id: ef6e14550dd76810285cee9c268590d1d9423e54
|
2024-11-19 19:10:07 +08:00 |
|
Ting
|
7ad5b5c088
|
support efficient tokens calculation on sft/dpo
Former-commit-id: b9f00286d8a017ed9fd2876986da3b4d7034ef07
|
2024-11-19 17:15:47 +08:00 |
|
hoshi-hiyouga
|
9815d1712c
|
fix #6050
Former-commit-id: dc828218726704ff0453a2d13535663ac6ad7833
|
2024-11-16 16:11:16 +08:00 |
|
hiyouga
|
d4e0010027
|
add qwen-coder and opencoder
Former-commit-id: 431ac4892cdddba802a02b285031a797e278d0eb
|
2024-11-15 21:48:38 +08:00 |
|