Billy Cao 00409ff28a [data] shard the dataset to allow multiprocessing when streaming is enabled (#7530) ...

* Shard the dataset when streaming to allow multiprocessing

* Allow user to not set dataset_shards to ensure backward compatibility

2025-04-01 15:36:23 +08:00

..

__init__.py

[misc] update license year & fix llama pro (#6814)

2025-02-05 01:53:33 +08:00

data_args.py

[data] shard the dataset to allow multiprocessing when streaming is enabled (#7530)

2025-04-01 15:36:23 +08:00

evaluation_args.py

[misc] upgrade format to py39 (#7256)

2025-03-12 00:08:41 +08:00

finetuning_args.py

[3rdparty] support swanlab lark notification (#7481)

2025-03-27 01:52:01 +08:00

generating_args.py

[misc] upgrade format to py39 (#7256)

2025-03-12 00:08:41 +08:00

model_args.py

[model] add Qwen2.5-Omni model (#7537)

2025-03-31 20:39:35 +08:00

parser.py

[deps] upgrade vllm to 0.8 (#7436)

2025-03-23 14:32:22 +08:00

training_args.py

[misc] update format (#7277)

2025-03-13 02:53:08 +08:00