Kingsley
|
3461cc3c0a
|
[scripts] add video params for vllm infer (#7992)
|
2025-05-09 21:16:52 +08:00 |
|
hoshi-hiyouga
|
81d10321d0
|
Merge commit from fork
|
2025-04-23 16:38:27 +08:00 |
|
hoshi-hiyouga
|
a0818eae58
|
[breaking] bump transformers to 4.45.0 & improve ci (#7746)
* update ci
* fix
* fix
* fix
* fix
* fix
|
2025-04-17 02:36:48 +08:00 |
|
hoshi-hiyouga
|
fb46193364
|
[misc] fix packing and eval plot (#7623)
|
2025-04-07 18:20:57 +08:00 |
|
hoshi-hiyouga
|
40fb24916f
|
[model] add llama4 (#7611)
|
2025-04-06 13:42:31 +08:00 |
|
Kingsley
|
ac9ba80128
|
[data] fix qwen2.5 omni plugin (#7573)
* align key with qwen2vl
* nit && change scripts
|
2025-04-02 21:28:52 +08:00 |
|
hoshi-hiyouga
|
be0289292d
|
[infer] vllm video/audio inference (#7566)
|
2025-04-02 02:27:04 +08:00 |
|
hoshi-hiyouga
|
37d783149d
|
[model] fix kv cache (#7564)
|
2025-04-01 23:07:46 +08:00 |
|
Kingsley
|
1189aeb6c2
|
[model] add Qwen2.5-Omni model (#7537)
* preserve image_sizes
* preserve image_sizes
* init plugin
* support audio-text2text lora
* nit
* support image/video-text2text, audio-text2text
* remove args
* remove lines
* add docs && nit
* remove some comments
* fix && add merge part script
* add license
|
2025-03-31 20:39:35 +08:00 |
|
hoshi-hiyouga
|
4d2c16fd39
|
[misc] fix license (#7440)
|
2025-03-23 19:31:56 +08:00 |
|
SnowFox4004
|
1b5666b989
|
[scripts] support compute score on vllm's predictions (#7419)
* enable manual bleu&rouge eval by adding `scripts/eval_bleu_rouge.py`
* added libraries check
* update: 使用datasets库的多进程加速处理
* update:
- 使用 fire.Fire
- 修改代码格式
* Update eval_bleu_rouge.py: correctly uses fire
Deleted the code of using sys.argv
* Update eval_bleu_rouge.py
---------
Co-authored-by: SnowFox4004 <manba@out>
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
|
2025-03-23 19:21:01 +08:00 |
|
hoshi-hiyouga
|
1b1964714e
|
[misc] update format (#7277)
|
2025-03-13 02:53:08 +08:00 |
|
hoshi-hiyouga
|
efa86e730c
|
[misc] upgrade format to py39 (#7256)
|
2025-03-12 00:08:41 +08:00 |
|
hoshi-hiyouga
|
6c5927ba93
|
[infer] fix vllm args (#7235)
Former-commit-id: 999be5b4512890b8cf4f45874a77e35cf35626f5
|
2025-03-11 01:15:35 +08:00 |
|
hoshi-hiyouga
|
1c924ebeec
|
[script] fix vllm version (#7193)
Former-commit-id: ababdde597b2b9bf0ab3f30f036bc8d97de07f03
|
2025-03-06 17:14:17 +08:00 |
|
hoshi-hiyouga
|
4d737be5a2
|
[misc] fix project toml (#7067)
Former-commit-id: 28a668ff4e0beebfe5387362f5518c1d9343666f
|
2025-02-25 23:22:48 +08:00 |
|
JieShen
|
4f8c144f90
|
[script] add seed args (#7058)
* add seed args
* add seed args
* update seed
Former-commit-id: eb9770b2c01a840b6a0ac119210c22bdbb81e18b
|
2025-02-25 19:44:57 +08:00 |
|
hoshi-hiyouga
|
ccc656376f
|
[misc] fix script (#6977)
Former-commit-id: 775efa1d8cbdb1b7d122be2a986d47f85214e0a1
|
2025-02-18 17:00:46 +08:00 |
|
hoshi-hiyouga
|
8cbfa350fd
|
[misc] fix grad ckpt func (#6916)
Former-commit-id: 35e069a52b3d7cfd9b0107574b09265eb2290f0b
|
2025-02-13 00:17:18 +08:00 |
|
hoshi-hiyouga
|
ca5cd8276c
|
[misc] support export ollama modelfile (#6899)
* support export ollama modelfile
* update config
* add system and num ctx
Former-commit-id: 8c2af7466f4015f300b51841db11bcd2505ebf20
|
2025-02-11 19:52:25 +08:00 |
|
codingma
|
185319802f
|
support ollama modelfile export (#4686)
Former-commit-id: 15cca102a7fc0d08b5d049cf264acc6fa576b104
|
2025-02-11 17:52:24 +08:00 |
|
Zhangchi Feng
|
46a1786595
|
[model] support audio (#6701)
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 5eacb5629e4d7733cd992a63747a1335f2c6a929
|
2025-02-05 04:59:09 +08:00 |
|
hoshi-hiyouga
|
40b6e9045d
|
[misc] update license year & fix llama pro (#6814)
* fix llamapro script
* change year
Former-commit-id: d9ae594178796994d400a5f207d6499712816f89
|
2025-02-05 01:53:33 +08:00 |
|
hoshi-hiyouga
|
89b308bf30
|
pin vllm version to 0.6.5 (#6629)
Former-commit-id: 26097ca0adf25ebb7d9e8eec2d2cef673c6cfe88
|
2025-01-14 02:44:02 +08:00 |
|
hoshi-hiyouga
|
7ab274eb67
|
[inference] fix stop token for object detection (#6624)
* fix stop token
* update minicpm data pipeline
* fix npu qlora examples
Former-commit-id: 844919fadaa8a61dfae47020971ea80730b2346f
|
2025-01-13 21:34:20 +08:00 |
|
hiyouga
|
074c9db3a6
|
update scripts
Former-commit-id: 05aa52adde8905ca892f1ed5847d6f90b1992848
|
2025-01-03 10:50:32 +00:00 |
|
hiyouga
|
7f0bd679ac
|
support qwen2vl vllm infer
Former-commit-id: 03ddd2555fb97488cd4daab11e8b672d36150c5a
|
2024-12-05 10:17:26 +00:00 |
|
hiyouga
|
7695787258
|
fix scripts
Former-commit-id: f94f55d20283298cb7d90d0573992a62df414a8f
|
2024-12-05 03:47:32 +00:00 |
|
hiyouga
|
51b18e565d
|
support batch infer in vllm
Former-commit-id: 3ef5ed3b9a44eed2f7e3ff221dfc343d0a97c0b5
|
2024-12-04 13:50:00 +00:00 |
|
JieShen
|
8880c61217
|
add async call api
Former-commit-id: 0f728386d88cf8253250c6650555d41578114a0c
|
2024-12-01 22:18:05 +08:00 |
|
JieShen
|
3df16e4323
|
add vllm_infer script
Former-commit-id: 4daab843a3aa096b35e5d3832c01fac4271e4604
|
2024-11-29 14:22:20 +08:00 |
|
hiyouga
|
a6c7b5e736
|
add examples
Former-commit-id: 9eff9625adba643263bc6cba480f30edc6bb086a
|
2024-11-01 08:41:54 +00:00 |
|
hiyouga
|
dbbfb5f5dc
|
use pre-commit
Former-commit-id: 7cfede95df22a9ff236788f04159b6b16b8d04bb
|
2024-10-29 09:07:46 +00:00 |
|
hiyouga
|
be233f1102
|
release v0.9.0 (real)
Former-commit-id: 8ff781c8ae5654680f738f69a6db9d7b95d76baf
|
2024-09-09 01:00:25 +08:00 |
|
hiyouga
|
883b366078
|
tiny fix
Former-commit-id: 76177039c8f9ef5a63724a339dae6195d89fa215
|
2024-09-08 23:18:08 +08:00 |
|
hiyouga
|
b90cb28654
|
update scripts
Former-commit-id: 51d087cbc14bf3c7dfa06b8b66052cd80a6081be
|
2024-09-08 14:17:41 +08:00 |
|
hiyouga
|
8d96a81d6d
|
support activation offloading via unsloth gc
Former-commit-id: d3d0dd0feba3ca6f0ae970d5856bec989d26ef67
|
2024-09-08 01:22:19 +08:00 |
|
hiyouga
|
fb90faf19a
|
add docstrings, refactor logger
Former-commit-id: c34e489d71f8f539028543ccf8ee92cecedd6276
|
2024-09-08 00:56:56 +08:00 |
|
hoshi-hiyouga
|
90a5d11962
|
fix
Former-commit-id: 53a74cbc3afec58b36c2265e080061bcdf702f98
|
2024-09-08 00:41:45 +08:00 |
|
hoshi-hiyouga
|
acb4d25aaf
|
Update cal_mfu.py
Former-commit-id: 0c391b2e59943b0ca9dd4e8561398e7c856a4b29
|
2024-09-08 00:39:48 +08:00 |
|
-.-
|
492df6a1eb
|
update cal_mfu.py
Former-commit-id: 1cdbb4c774d463969c6be14fb08d92c7a0bdb565
|
2024-09-07 23:21:35 +08:00 |
|
hiyouga
|
3756553c25
|
update get template
Former-commit-id: 21ea0d0786f91c0bce79630963e66b815a6792a0
|
2024-09-04 22:36:20 +08:00 |
|
hiyouga
|
c10fd715cf
|
update scripts
Former-commit-id: dabf5a1dc661a6581474c6a5ec115322d168ed5f
|
2024-08-09 19:16:23 +08:00 |
|
hiyouga
|
99cb841a11
|
tiny fix
Former-commit-id: 28cac0e325bfd7a6c0c344ad2d46511613190cd7
|
2024-07-24 18:33:39 +08:00 |
|
hiyouga
|
5ee2a3dd19
|
fix #4925
Former-commit-id: 79c336e2339974471627487858d59e4ed2152370
|
2024-07-24 16:56:58 +08:00 |
|
hiyouga
|
8ce43766c6
|
fix up
Former-commit-id: 43a56cb331fae899ca35b0c312730d4ab79d0c42
|
2024-07-15 01:04:56 +08:00 |
|
codingma
|
82e941ff61
|
1. add custom eval dataset support
2. merge load dataset and split dataset function
Former-commit-id: 963d97ba07e7efa3a4544c4d077283d9e112b3ad
|
2024-07-05 15:52:10 +08:00 |
|
hiyouga
|
b71b7c6a63
|
update scripts
Former-commit-id: 6dd6bae598d4d0b7b7d80341e88e313e49a49c00
|
2024-07-03 20:07:44 +08:00 |
|
hiyouga
|
0265a98942
|
fix #4556
Former-commit-id: 81faa9a985c14e83e38f42aedd228edb676b0695
|
2024-06-26 19:43:16 +08:00 |
|
hiyouga
|
412c1b9522
|
lint
Former-commit-id: a19a7ac99af62b6715c96274f6350b124a784331
|
2024-06-17 22:35:56 +08:00 |
|