SnowFox4004
|
7d4dc25c23
|
[scripts] support compute score on vllm's predictions (#7419)
* enable manual bleu&rouge eval by adding `scripts/eval_bleu_rouge.py`
* added libraries check
* update: 使用datasets库的多进程加速处理
* update:
- 使用 fire.Fire
- 修改代码格式
* Update eval_bleu_rouge.py: correctly uses fire
Deleted the code of using sys.argv
* Update eval_bleu_rouge.py
---------
Co-authored-by: SnowFox4004 <manba@out>
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
|
2025-03-23 19:21:01 +08:00 |
|
hoshi-hiyouga
|
9ccfb97a2c
|
[misc] update format (#7277)
|
2025-03-13 02:53:08 +08:00 |
|
hoshi-hiyouga
|
7c1640ed5f
|
[misc] upgrade format to py39 (#7256)
|
2025-03-12 00:08:41 +08:00 |
|
hoshi-hiyouga
|
317d0855d2
|
[infer] fix vllm args (#7235)
Former-commit-id: ef7af457fc44b1e8cad0c78717848617f98364f0
|
2025-03-11 01:15:35 +08:00 |
|
hoshi-hiyouga
|
b6c0e8608e
|
[script] fix vllm version (#7193)
Former-commit-id: 313355759dc906d3612364dc6c8f6344afdedb97
|
2025-03-06 17:14:17 +08:00 |
|
hoshi-hiyouga
|
f4aa0a146c
|
[misc] fix project toml (#7067)
Former-commit-id: 96fd510e6a03eae7a1f41772e1d6b784df6d5d2e
|
2025-02-25 23:22:48 +08:00 |
|
JieShen
|
96636c3729
|
[script] add seed args (#7058)
* add seed args
* add seed args
* update seed
Former-commit-id: e8266fe5635470e84f9d39f43e53cc49f962c2e9
|
2025-02-25 19:44:57 +08:00 |
|
hoshi-hiyouga
|
184c5d0882
|
[misc] fix script (#6977)
Former-commit-id: cc8c7e762b9c873ef79529152465bbed9231053c
|
2025-02-18 17:00:46 +08:00 |
|
hoshi-hiyouga
|
036fb0d561
|
[misc] fix grad ckpt func (#6916)
Former-commit-id: e34c3c06da706f80c74c20800f19110e9ad6b82a
|
2025-02-13 00:17:18 +08:00 |
|
hoshi-hiyouga
|
c6be9e242c
|
[misc] support export ollama modelfile (#6899)
* support export ollama modelfile
* update config
* add system and num ctx
Former-commit-id: 9184a6e0ed7ff5f632c848f861bfa448c4cd06fc
|
2025-02-11 19:52:25 +08:00 |
|
codingma
|
fafa3add84
|
support ollama modelfile export (#4686)
Former-commit-id: 7f354b80bc9d1336e8bea5374925a7c2ec7a315c
|
2025-02-11 17:52:24 +08:00 |
|
Zhangchi Feng
|
01915eaf40
|
[model] support audio (#6701)
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 24c78429489809873a1269a735ea5421340b32a2
|
2025-02-05 04:59:09 +08:00 |
|
hoshi-hiyouga
|
1fee69f874
|
[misc] update license year & fix llama pro (#6814)
* fix llamapro script
* change year
Former-commit-id: e2dc5b952aa22835d5220ba624f44676138b65ac
|
2025-02-05 01:53:33 +08:00 |
|
hoshi-hiyouga
|
5e699458e5
|
pin vllm version to 0.6.5 (#6629)
Former-commit-id: 1c7663d3049e00a9148c3e3c58204deca7a08c8d
|
2025-01-14 02:44:02 +08:00 |
|
hoshi-hiyouga
|
d8cba9464f
|
[inference] fix stop token for object detection (#6624)
* fix stop token
* update minicpm data pipeline
* fix npu qlora examples
Former-commit-id: e3e2c8c689c54ebb2af264de808502e5a8ba0f2b
|
2025-01-13 21:34:20 +08:00 |
|
hiyouga
|
20a9565e36
|
update scripts
Former-commit-id: dd44c65d7f60cb6f5d0e0d8ee5f4e7643defb89b
|
2025-01-03 10:50:32 +00:00 |
|
hiyouga
|
88b06a0c7f
|
support qwen2vl vllm infer
Former-commit-id: 207f8b069ca35a28de4588b4962e7254f451c52c
|
2024-12-05 10:17:26 +00:00 |
|
hiyouga
|
819f487c8f
|
fix scripts
Former-commit-id: eb3e147d198a3ecb02c65f7733cec7cd9d3814a3
|
2024-12-05 03:47:32 +00:00 |
|
hiyouga
|
235cdcacee
|
support batch infer in vllm
Former-commit-id: 1324d158f954d777f1fbf09f46149c372704b388
|
2024-12-04 13:50:00 +00:00 |
|
JieShen
|
d4bf81b36a
|
add async call api
Former-commit-id: 4c61368600a6648ec20753a41536ad3c7986703b
|
2024-12-01 22:18:05 +08:00 |
|
JieShen
|
99265c7d2f
|
add vllm_infer script
Former-commit-id: 961e8c2d2e5505de14702cf8609d54b4f3a23b1e
|
2024-11-29 14:22:20 +08:00 |
|
hiyouga
|
2eba98e152
|
add examples
Former-commit-id: e824b715ad4bf885241b245b12d75563adab2e26
|
2024-11-01 08:41:54 +00:00 |
|
hiyouga
|
0d8aa6e6ef
|
use pre-commit
Former-commit-id: 21db8ed2f4a0eba203754a92ce0741538e8ee709
|
2024-10-29 09:07:46 +00:00 |
|
hiyouga
|
3aefdad4ec
|
release v0.9.0 (real)
Former-commit-id: 90d6df622252c6fad985f68b97771c979357e2fc
|
2024-09-09 01:00:25 +08:00 |
|
hiyouga
|
0229263fbe
|
tiny fix
Former-commit-id: c9b3870adb60a2aca8cfd82c1a8b8044319bacbc
|
2024-09-08 23:18:08 +08:00 |
|
hiyouga
|
dc64166d13
|
update scripts
Former-commit-id: f2aa02c070b1442bfb58a075f22af25386192bfa
|
2024-09-08 14:17:41 +08:00 |
|
hiyouga
|
0daee7cb39
|
support activation offloading via unsloth gc
Former-commit-id: fb72a3adb0916232cc9ac9f0c725c02d07b9354c
|
2024-09-08 01:22:19 +08:00 |
|
hiyouga
|
7ccb86b215
|
add docstrings, refactor logger
Former-commit-id: 54c69059379d77dc9046c144cbe2d0253de3a4da
|
2024-09-08 00:56:56 +08:00 |
|
hoshi-hiyouga
|
4d8b782268
|
fix
Former-commit-id: 842c5455b0e7c4b8d307af950304d4ed52bbb3e8
|
2024-09-08 00:41:45 +08:00 |
|
hoshi-hiyouga
|
4f28e0e5d2
|
Update cal_mfu.py
Former-commit-id: e71133cab14eed2c071cfd4ce044ae9905447427
|
2024-09-08 00:39:48 +08:00 |
|
-.-
|
ab1775cd95
|
update cal_mfu.py
Former-commit-id: 66ec36522c9bf8dfffc1065202362801875a104d
|
2024-09-07 23:21:35 +08:00 |
|
hiyouga
|
d5ea05cfff
|
update get template
Former-commit-id: dabad5570bf4a6b1044c963d8f27717030f373ef
|
2024-09-04 22:36:20 +08:00 |
|
hiyouga
|
25b9cfa163
|
update scripts
Former-commit-id: 86f7099fa3fadd9c5a2059361ab5a5e1dbf5b1a2
|
2024-08-09 19:16:23 +08:00 |
|
hiyouga
|
0aad78694a
|
tiny fix
Former-commit-id: ace1d44857368dbbc868e4bba2d7ff17329921f5
|
2024-07-24 18:33:39 +08:00 |
|
hiyouga
|
019c6dad84
|
fix #4925
Former-commit-id: 935b22d93ed461e829cd1e6201de1fea697f4d1e
|
2024-07-24 16:56:58 +08:00 |
|
hiyouga
|
14bc7b0551
|
fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
|
2024-07-15 01:04:56 +08:00 |
|
codingma
|
74f0d02eb8
|
1. add custom eval dataset support
2. merge load dataset and split dataset function
Former-commit-id: 76f3bbcfc0e11aa41f8f5cbebc60b77b987f7901
|
2024-07-05 15:52:10 +08:00 |
|
hiyouga
|
e5c89890b1
|
update scripts
Former-commit-id: 1e0c860c8c5ae8958d7105acafdac5d253a585f9
|
2024-07-03 20:07:44 +08:00 |
|
hiyouga
|
654116c0b1
|
fix #4556
Former-commit-id: 59e0b4f616736ede37cc37a13346b547f5a2d4e7
|
2024-06-26 19:43:16 +08:00 |
|
hiyouga
|
19bf21efba
|
lint
Former-commit-id: 24c160df3d575843e5ad5f1b47246d04430a79f0
|
2024-06-17 22:35:56 +08:00 |
|
hiyouga
|
004f289074
|
tiny fix
Former-commit-id: 2bf2863a58c93206f271de17d7dfcbcd6375cd73
|
2024-06-17 17:47:25 +08:00 |
|
hiyouga
|
f25b8626bf
|
support pissa
Former-commit-id: 8c1046d78ac6c8f9429b73617e35e1eccb35138f
|
2024-06-16 01:08:12 +08:00 |
|
hiyouga
|
c0c6b8075a
|
tiny fix
Former-commit-id: 38b6b0f52edeb8ba45aa03b415b3c0c1b0e0c1e4
|
2024-06-16 01:06:41 +08:00 |
|
hiyouga
|
2946153cea
|
add license
Former-commit-id: d87108daa68bd40174b262be1ca65fe6e1b7ab56
|
2024-06-15 17:54:33 +08:00 |
|
hiyouga
|
4f3e680b57
|
init unittest
Former-commit-id: 1c7f0ab51906b20190f8d4db932623cff76efc01
|
2024-06-08 01:35:58 +08:00 |
|
hiyouga
|
0eff6a66d5
|
tiny fix
Former-commit-id: 5a13b3baa63225e7f79e024610722de0f87e0acc
|
2024-06-04 00:31:10 +08:00 |
|
hiyouga
|
cae823ddf0
|
rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
|
2024-05-16 18:39:08 +08:00 |
|
hiyouga
|
6e6267f17c
|
fix #3694
Former-commit-id: 2a67ab3925f0c17c4cb5e8c5a5e2cc6a9dc7d47e
|
2024-05-16 00:35:28 +08:00 |
|
hiyouga
|
9bbb5c846d
|
update webui
Former-commit-id: af596988b1e8988fd3f1376a8e090ed8b80ee810
|
2024-05-05 00:17:54 +08:00 |
|
hiyouga
|
df43fbb029
|
update scripts
Former-commit-id: c1a53a0debf98be26f0f64d710a13c3b25140f75
|
2024-05-04 23:05:17 +08:00 |
|