Commit Graph

1618 Commits

Author SHA1 Message Date
hiyouga
046b6fb118 fix dataset 2024-11-27 06:27:44 +00:00
hiyouga
ec9ff8caa2 add skywork o1 2024-11-27 05:51:59 +00:00
hiyouga
17afb7d410 add marco-o1 and openo1 dataset 2024-11-27 04:20:23 +00:00
hoshi-hiyouga
b26c490ac3 Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset
2024-11-27 00:16:15 +08:00
hiyouga
362d579ce8 fix #6149 2024-11-26 16:03:02 +00:00
hiyouga
598c22e43f fix mllama cross_mask 2024-11-26 15:56:58 +00:00
hoshi-hiyouga
da9e4ddd26 lint 2024-11-25 22:55:56 +08:00
hoshi-hiyouga
d87e16cf5c fix #6139 2024-11-25 22:22:06 +08:00
hoshi-hiyouga
75b586c31a fix visual patch 2024-11-25 20:06:06 +08:00
hoshi-hiyouga
0516e556a7 fix #6136 2024-11-25 19:43:42 +08:00
hiyouga
b0ccc2ee86 set dev version 2024-11-25 01:36:49 +08:00
hoshi-hiyouga
18daf10eda Merge pull request #6124 from hiyouga/hiyouga/release
[release] release v0.9.1
2024-11-25 00:20:02 +08:00
hoshi-hiyouga
07059a7ca4 Merge pull request #6126 from hiyouga/hiyouga/fix_vllm
[inference] fix vllm
2024-11-25 00:19:54 +08:00
hiyouga
13ee1f5cec fix vllm 2024-11-25 00:07:24 +08:00
hiyouga
8792d78c82 fix cli 2024-11-24 23:56:21 +08:00
hiyouga
d622f8fdec release v0.9.1 2024-11-24 23:48:41 +08:00
hiyouga
fa50fc470e fix qwen2vl vllm infer 2024-11-24 23:27:24 +08:00
hiyouga
df477370dc add forbidden modules 2024-11-23 18:34:15 +00:00
hiyouga
446441fdb0 fix inputs 2024-11-23 18:26:02 +00:00
marko1616
b1e43e56db Linter. 2024-11-23 16:09:04 +00:00
marko1616
8372c5e377 Tiny fix. 2024-11-23 16:09:01 +00:00
marko1616
3f2c056253 Support llama3.2vl. 2024-11-23 16:07:35 +00:00
hoshi-hiyouga
d20b97e7e9 do not split save_cmd ret value 2024-11-21 22:30:23 +08:00
superboy-zjc
aa6a174d68 [patch] Patch remote OS command injection vulnerability 2024-11-21 01:52:12 -05:00
hoshi-hiyouga
bd639a137e Merge pull request #6078 from wtmlon/support-efficient-tokens-calculation
support effective tokens calculation on sft/dpo
2024-11-20 13:43:15 +08:00
Ting
40627c601e code refactor 2024-11-19 20:33:18 +08:00
Ting
f566ecc8d1 update 2024-11-19 19:12:10 +08:00
Ting
ef6e14550d update 2024-11-19 19:10:07 +08:00
Ting
b9f00286d8 support efficient tokens calculation on sft/dpo 2024-11-19 17:15:47 +08:00
hoshi-hiyouga
dc82821872 fix #6050 2024-11-16 16:11:16 +08:00
hiyouga
431ac4892c add qwen-coder and opencoder 2024-11-15 21:48:38 +08:00
hoshi-hiyouga
8d70edf39b fix #5988 2024-11-11 13:57:14 +08:00
hiyouga
58ab4579dc add vllm config 2024-11-10 21:28:18 +08:00
hoshi-hiyouga
adc5849ce7 Merge pull request #5971 from hiyouga/hiyouga/fix_webui
[webui] fix extra args
2024-11-09 00:25:24 +08:00
hiyouga
eb294fed13 fix extra args 2024-11-09 00:24:27 +08:00
hiyouga
8f3a32286e fix #5966 2024-11-08 23:49:16 +08:00
hiyouga
ffa39ba3db add image input type 2024-11-04 08:27:20 +00:00
hiyouga
8c88065c38 fix chat engines 2024-11-04 08:18:12 +00:00
hiyouga
c5fae465ec update datasets version 2024-11-04 07:52:26 +00:00
hoshi-hiyouga
04c10d2e80 Merge pull request #5914 from hiyouga/hiyouga/dev_read
[misc] update readme
2024-11-02 21:44:10 +08:00
hiyouga
2e843d989e fix phi3 template 2024-11-02 21:31:23 +08:00
hoshi-hiyouga
478cbb1aa7 update template 2024-11-02 21:21:22 +08:00
hoshi-hiyouga
5f14910910 Merge branch 'main' into main 2024-11-02 21:20:27 +08:00
hiyouga
ba10d54bf9 fix webchat 2024-11-02 21:04:18 +08:00
hiyouga
4270f7dfb9 fix dpo metrics 2024-11-02 20:59:01 +08:00
hoshi-hiyouga
c58cc22d06 Merge pull request #5910 from Cuiyn/index
Support Index series models.
2024-11-02 20:16:54 +08:00
Cuiyn
ecca9db66b fix: rename to Index-1.9B-Charater-Chat and Index-1.9B-Chat-32K 2024-11-02 20:04:14 +08:00
hiyouga
c38aa29336 support rank0 logger 2024-11-02 18:31:04 +08:00
Cuiyn
a15a69ab44 Add support for Index 2024-11-02 13:45:27 +08:00
hoshi-hiyouga
bd08b8c441 Merge pull request #5909 from hiyouga/hiyouga/dev2
[data] support auto convert for single image, add image_dir argument
2024-11-02 13:43:04 +08:00