hoshi-hiyouga
|
5e22597ff1
|
[infer] vllm video/audio inference (#7566)
|
2025-04-02 02:27:04 +08:00 |
|
hoshi-hiyouga
|
2bfcad2394
|
[model] fix kv cache (#7564)
|
2025-04-01 23:07:46 +08:00 |
|
Kingsley
|
7eed496336
|
[model] add Qwen2.5-Omni model (#7537)
* preserve image_sizes
* preserve image_sizes
* init plugin
* support audio-text2text lora
* nit
* support image/video-text2text, audio-text2text
* remove args
* remove lines
* add docs && nit
* remove some comments
* fix && add merge part script
* add license
|
2025-03-31 20:39:35 +08:00 |
|
hoshi-hiyouga
|
304796b803
|
[misc] fix license (#7440)
|
2025-03-23 19:31:56 +08:00 |
|
SnowFox4004
|
7cfd6e4bb0
|
[scripts] support compute score on vllm's predictions (#7419)
* enable manual bleu&rouge eval by adding `scripts/eval_bleu_rouge.py`
* added libraries check
* update: 使用datasets库的多进程加速处理
* update:
- 使用 fire.Fire
- 修改代码格式
* Update eval_bleu_rouge.py: correctly uses fire
Deleted the code of using sys.argv
* Update eval_bleu_rouge.py
---------
Co-authored-by: SnowFox4004 <manba@out>
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
|
2025-03-23 19:21:01 +08:00 |
|
hoshi-hiyouga
|
650a9a9057
|
[misc] update format (#7277)
|
2025-03-13 02:53:08 +08:00 |
|
hoshi-hiyouga
|
264538cb26
|
[misc] upgrade format to py39 (#7256)
|
2025-03-12 00:08:41 +08:00 |
|
hoshi-hiyouga
|
522a3e8493
|
[infer] fix vllm args (#7235)
Former-commit-id: 999be5b4512890b8cf4f45874a77e35cf35626f5
|
2025-03-11 01:15:35 +08:00 |
|
hoshi-hiyouga
|
f4ec4fa6ad
|
[script] fix vllm version (#7193)
Former-commit-id: ababdde597b2b9bf0ab3f30f036bc8d97de07f03
|
2025-03-06 17:14:17 +08:00 |
|
hoshi-hiyouga
|
5f65558088
|
[misc] fix project toml (#7067)
Former-commit-id: 28a668ff4e0beebfe5387362f5518c1d9343666f
|
2025-02-25 23:22:48 +08:00 |
|
JieShen
|
0f54a78144
|
[script] add seed args (#7058)
* add seed args
* add seed args
* update seed
Former-commit-id: eb9770b2c01a840b6a0ac119210c22bdbb81e18b
|
2025-02-25 19:44:57 +08:00 |
|
hoshi-hiyouga
|
be33ef67fb
|
[misc] fix script (#6977)
Former-commit-id: 775efa1d8cbdb1b7d122be2a986d47f85214e0a1
|
2025-02-18 17:00:46 +08:00 |
|
hoshi-hiyouga
|
3a3f4072e5
|
[misc] fix grad ckpt func (#6916)
Former-commit-id: 35e069a52b3d7cfd9b0107574b09265eb2290f0b
|
2025-02-13 00:17:18 +08:00 |
|
hoshi-hiyouga
|
88eafd865b
|
[misc] support export ollama modelfile (#6899)
* support export ollama modelfile
* update config
* add system and num ctx
Former-commit-id: 8c2af7466f4015f300b51841db11bcd2505ebf20
|
2025-02-11 19:52:25 +08:00 |
|
codingma
|
b72c4bd118
|
support ollama modelfile export (#4686)
Former-commit-id: 15cca102a7fc0d08b5d049cf264acc6fa576b104
|
2025-02-11 17:52:24 +08:00 |
|
Zhangchi Feng
|
8f401e37f8
|
[model] support audio (#6701)
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 5eacb5629e4d7733cd992a63747a1335f2c6a929
|
2025-02-05 04:59:09 +08:00 |
|
hoshi-hiyouga
|
c2022431aa
|
[misc] update license year & fix llama pro (#6814)
* fix llamapro script
* change year
Former-commit-id: d9ae594178796994d400a5f207d6499712816f89
|
2025-02-05 01:53:33 +08:00 |
|
hoshi-hiyouga
|
28d145a066
|
pin vllm version to 0.6.5 (#6629)
Former-commit-id: 26097ca0adf25ebb7d9e8eec2d2cef673c6cfe88
|
2025-01-14 02:44:02 +08:00 |
|
hoshi-hiyouga
|
2a05941b14
|
[inference] fix stop token for object detection (#6624)
* fix stop token
* update minicpm data pipeline
* fix npu qlora examples
Former-commit-id: 844919fadaa8a61dfae47020971ea80730b2346f
|
2025-01-13 21:34:20 +08:00 |
|
hiyouga
|
8516054e4d
|
update scripts
Former-commit-id: 05aa52adde8905ca892f1ed5847d6f90b1992848
|
2025-01-03 10:50:32 +00:00 |
|
hiyouga
|
bbd432415d
|
support qwen2vl vllm infer
Former-commit-id: 03ddd2555fb97488cd4daab11e8b672d36150c5a
|
2024-12-05 10:17:26 +00:00 |
|
hiyouga
|
86e4fab0d5
|
fix scripts
Former-commit-id: f94f55d20283298cb7d90d0573992a62df414a8f
|
2024-12-05 03:47:32 +00:00 |
|
hiyouga
|
c1768cfb14
|
support batch infer in vllm
Former-commit-id: 3ef5ed3b9a44eed2f7e3ff221dfc343d0a97c0b5
|
2024-12-04 13:50:00 +00:00 |
|
JieShen
|
76dc69ce36
|
add async call api
Former-commit-id: 0f728386d88cf8253250c6650555d41578114a0c
|
2024-12-01 22:18:05 +08:00 |
|
JieShen
|
6c9d05539a
|
add vllm_infer script
Former-commit-id: 4daab843a3aa096b35e5d3832c01fac4271e4604
|
2024-11-29 14:22:20 +08:00 |
|
hiyouga
|
df8ac15ef0
|
add examples
Former-commit-id: 9eff9625adba643263bc6cba480f30edc6bb086a
|
2024-11-01 08:41:54 +00:00 |
|
hiyouga
|
248d5daaff
|
use pre-commit
Former-commit-id: 7cfede95df22a9ff236788f04159b6b16b8d04bb
|
2024-10-29 09:07:46 +00:00 |
|
hiyouga
|
dfff411e1a
|
release v0.9.0 (real)
Former-commit-id: 8ff781c8ae5654680f738f69a6db9d7b95d76baf
|
2024-09-09 01:00:25 +08:00 |
|
hiyouga
|
3cbc9109ea
|
tiny fix
Former-commit-id: 76177039c8f9ef5a63724a339dae6195d89fa215
|
2024-09-08 23:18:08 +08:00 |
|
hiyouga
|
3259397f89
|
update scripts
Former-commit-id: 51d087cbc14bf3c7dfa06b8b66052cd80a6081be
|
2024-09-08 14:17:41 +08:00 |
|
hiyouga
|
294a103ead
|
support activation offloading via unsloth gc
Former-commit-id: d3d0dd0feba3ca6f0ae970d5856bec989d26ef67
|
2024-09-08 01:22:19 +08:00 |
|
hiyouga
|
7f71276ad8
|
add docstrings, refactor logger
Former-commit-id: c34e489d71f8f539028543ccf8ee92cecedd6276
|
2024-09-08 00:56:56 +08:00 |
|
hoshi-hiyouga
|
527ba2eb2e
|
fix
Former-commit-id: 53a74cbc3afec58b36c2265e080061bcdf702f98
|
2024-09-08 00:41:45 +08:00 |
|
hoshi-hiyouga
|
3021b31cf3
|
Update cal_mfu.py
Former-commit-id: 0c391b2e59943b0ca9dd4e8561398e7c856a4b29
|
2024-09-08 00:39:48 +08:00 |
|
-.-
|
9f2427907e
|
update cal_mfu.py
Former-commit-id: 1cdbb4c774d463969c6be14fb08d92c7a0bdb565
|
2024-09-07 23:21:35 +08:00 |
|
hiyouga
|
af178cbcd1
|
update get template
Former-commit-id: 21ea0d0786f91c0bce79630963e66b815a6792a0
|
2024-09-04 22:36:20 +08:00 |
|
hiyouga
|
9d1e2c3c1f
|
update scripts
Former-commit-id: dabf5a1dc661a6581474c6a5ec115322d168ed5f
|
2024-08-09 19:16:23 +08:00 |
|
hiyouga
|
211038584a
|
tiny fix
Former-commit-id: 28cac0e325bfd7a6c0c344ad2d46511613190cd7
|
2024-07-24 18:33:39 +08:00 |
|
hiyouga
|
27f2c3cae1
|
fix #4925
Former-commit-id: 79c336e2339974471627487858d59e4ed2152370
|
2024-07-24 16:56:58 +08:00 |
|
hiyouga
|
e4d11a117b
|
fix up
Former-commit-id: 43a56cb331fae899ca35b0c312730d4ab79d0c42
|
2024-07-15 01:04:56 +08:00 |
|
codingma
|
5f2bd04799
|
1. add custom eval dataset support
2. merge load dataset and split dataset function
Former-commit-id: 963d97ba07e7efa3a4544c4d077283d9e112b3ad
|
2024-07-05 15:52:10 +08:00 |
|
hiyouga
|
1ac9389ddc
|
update scripts
Former-commit-id: 6dd6bae598d4d0b7b7d80341e88e313e49a49c00
|
2024-07-03 20:07:44 +08:00 |
|
hiyouga
|
cf2dc4c444
|
fix #4556
Former-commit-id: 81faa9a985c14e83e38f42aedd228edb676b0695
|
2024-06-26 19:43:16 +08:00 |
|
hiyouga
|
875270b851
|
lint
Former-commit-id: a19a7ac99af62b6715c96274f6350b124a784331
|
2024-06-17 22:35:56 +08:00 |
|
hiyouga
|
485a80d294
|
tiny fix
Former-commit-id: 2289436567a7860d25d9da0afb39e4a3e5e83839
|
2024-06-17 17:47:25 +08:00 |
|
hiyouga
|
32f45c9e91
|
support pissa
Former-commit-id: ef8e45f2eaf466c54e9a671512a2974575677b08
|
2024-06-16 01:08:12 +08:00 |
|
hiyouga
|
05f3a3c944
|
tiny fix
Former-commit-id: f7f440986b0ae3b38ea9f2da80789629d4f79ea1
|
2024-06-16 01:06:41 +08:00 |
|
hiyouga
|
bb88536166
|
add license
Former-commit-id: 69cfc98d7c81756a5ab6bf962240e393e449fef0
|
2024-06-15 17:54:33 +08:00 |
|
hiyouga
|
e0f2c0b5dc
|
init unittest
Former-commit-id: 1c6f21cb8878ced043fe0b27c72cad2ef6ee990e
|
2024-06-08 01:35:58 +08:00 |
|
hiyouga
|
2ac2cde03e
|
tiny fix
Former-commit-id: f9d50501aac1f60a3b445ca3fee9aa60995461ee
|
2024-06-04 00:31:10 +08:00 |
|