Qiaolin Yu
30038d9ce7
[inference] support sglang backend ( #7278 )
...
* Mimic SGLang offline Engine
* Add more tests and args
* Pass all current tests
* Clean Code
* fix sample_params
* clean code
* Fix Stream Chat
* change sglang from engine mode to server mode
* fix
* Fix Review Issues
* Use SGLang Built-In Utilities
* Fix test SGLang
* Some Doc Issue
* fix sglang engine
* add readme
---------
Co-authored-by: Jin Pan <jpan236@wisc.edu >
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn >
2025-03-15 04:37:58 +08:00
hoshi-hiyouga
ef5f1c1def
[data] gemma3 plugin pan and scan ( #7294 )
...
* gemma3 pan and scan
* add test case
* fix test
2025-03-13 23:29:23 +08:00
hoshi-hiyouga
9ccfb97a2c
[misc] update format ( #7277 )
2025-03-13 02:53:08 +08:00
hoshi-hiyouga
7c1640ed5f
[misc] upgrade format to py39 ( #7256 )
2025-03-12 00:08:41 +08:00
hoshi-hiyouga
5a29f49fb1
[config] update args ( #7231 )
...
Former-commit-id: ed8b12e3cb
2025-03-10 23:04:43 +08:00
hoshi-hiyouga
df63f05b47
[data] fix loader ( #7207 )
...
* fix dataloader
* add test case
* fix type
* fix ci
* fix ci
* fix ci
* disable overwrite cache in ci
Former-commit-id: 8c3f9f6747
2025-03-07 17:20:46 +08:00
hoshi-hiyouga
dca5fe14c2
[data] fix mllama ( #7053 )
...
* fix mllama
* fix test
Former-commit-id: 76314e6ad1
2025-02-24 22:05:38 +08:00
hoshi-hiyouga
1679930e00
[breaking change] refactor data pipeline ( #6901 )
...
* refactor data
* rename file
Former-commit-id: 617c8ab467
2025-02-13 00:39:20 +08:00
hoshi-hiyouga
2e2f6bea07
[data] feat: auto template ( #6905 )
...
* support auto template
* add unittest
Former-commit-id: 2f8b6847f5
2025-02-12 00:22:53 +08:00
hoshi-hiyouga
197aa3baf4
[data] fix ollama template ( #6902 )
...
* fix ollama template
* add meta info
* use half precision
Former-commit-id: e1a7c1242c
2025-02-11 22:43:09 +08:00
hoshi-hiyouga
c6be9e242c
[misc] support export ollama modelfile ( #6899 )
...
* support export ollama modelfile
* update config
* add system and num ctx
Former-commit-id: 9184a6e0ed
2025-02-11 19:52:25 +08:00
hoshi-hiyouga
2e954d8fd2
[data] refactor template ( #6896 )
...
Former-commit-id: d1b8aa3835
2025-02-11 17:59:25 +08:00
hoshi-hiyouga
b93333685b
[test] align test cases ( #6865 )
...
* align test cases
* fix function formatter
Former-commit-id: f6f3f8d0fc
2025-02-09 01:03:49 +08:00
Zhangchi Feng
01915eaf40
[model] support audio ( #6701 )
...
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn >
Former-commit-id: 24c7842948
2025-02-05 04:59:09 +08:00
hoshi-hiyouga
1fee69f874
[misc] update license year & fix llama pro ( #6814 )
...
* fix llamapro script
* change year
Former-commit-id: e2dc5b952a
2025-02-05 01:53:33 +08:00
Yueqi Song
8504bde893
[data] fix qwen tool template ( #6796 )
...
* Update tool_utils.py
* fix unittest
---------
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn >
Former-commit-id: dd6b7d203e
2025-02-05 00:02:00 +08:00
Zhangchi Feng
85f22d01bf
[data] fix minicpmv plugin ( #6801 )
...
* fix template name
* tiny fix
* support minicpm-o-2.6
* support inference of minicpmv
* update readme
* support dpo of minicpmv
* update init audio
* update init audio
* [model]fix image process in minicpmo
Former-commit-id: ab9bd068ef
2025-02-04 21:20:15 +08:00
hoshi-hiyouga
f6779b0e0c
[breaking] support transformers 4.48 ( #6628 )
...
Former-commit-id: 15357cdad9
2025-01-31 01:36:33 +08:00
hoshi-hiyouga
d8cba9464f
[inference] fix stop token for object detection ( #6624 )
...
* fix stop token
* update minicpm data pipeline
* fix npu qlora examples
Former-commit-id: e3e2c8c689
2025-01-13 21:34:20 +08:00
hiyouga
c89d17ab63
refactor mllm param logic
...
Former-commit-id: f6f630a1c9
2025-01-10 15:45:48 +00:00
hiyouga
b471def13d
improve template, add phi4 model
...
Former-commit-id: ae16ea755d
2025-01-09 18:27:54 +00:00
hiyouga
8524dcaa4a
fix #6391
...
Former-commit-id: d4c1fda1ad
2024-12-19 12:16:38 +00:00
hiyouga
95d3c2620b
support disable shuffling
...
Former-commit-id: c7cedc7569
2024-12-19 08:53:21 +00:00
hiyouga
a421113466
support qwen tool format
...
Former-commit-id: 98795854e3
2024-12-17 20:12:06 +00:00
ylfeng
857d23b324
Support Mistral format tools
...
Former-commit-id: 115924af47
2024-12-17 19:13:26 +00:00
hiyouga
f6a2bfc0e8
fix llama3 tool template
...
Former-commit-id: df5655f61c
2024-12-17 17:05:10 +00:00
hiyouga
a935933bed
support llama3 tool prompt
...
Former-commit-id: b24ae55ebf
2024-12-17 15:52:37 +00:00
hiyouga
0ef1dc4dd5
fix vlm zero3 training
...
Former-commit-id: dbb9e5b70e
2024-12-04 09:40:39 +00:00
hiyouga
4bba121f43
fix ci
...
Former-commit-id: b52c38350d
2024-11-23 19:13:32 +00:00
hiyouga
3f7c874594
update tests
...
Former-commit-id: 93d3b8f43f
2024-11-02 12:41:44 +08:00
Kingsley
3053a806e9
Merge branch 'hiyouga:main' into pixtral-patch
...
Former-commit-id: 67f59579d7
2024-10-29 21:01:25 +08:00
hiyouga
d183966a5d
fix pissa
...
Former-commit-id: 51e5f96247
2024-10-29 12:18:45 +00:00
hiyouga
825ea1c72d
fix #5747
...
Former-commit-id: ae045c884f
2024-10-29 10:47:04 +00:00
hiyouga
0d8aa6e6ef
use pre-commit
...
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
KUANGDD
62cbcb646a
modify style & little change
...
Former-commit-id: 9d6143e36a
2024-10-23 15:24:07 +08:00
KUANGDD
a24f94a36c
remove useless codes
...
Former-commit-id: 9b2642a2b5
2024-10-16 01:14:51 +08:00
KUANGDD
9c4941a1ea
fix bug for webui infer
...
Former-commit-id: 7ea29bbfe0
2024-10-16 01:09:33 +08:00
Kingsley
ae869639dd
add extra test for pixtral mm_input
...
Former-commit-id: 0fc949783d
2024-10-15 17:09:24 +08:00
BUAADreamer
a3f37777c1
fix some
...
Former-commit-id: 25641af04c
2024-10-15 13:30:41 +08:00
KUANGDD
5e440a467d
plugin test & check
...
Former-commit-id: 2df2be1c47
2024-10-15 12:12:46 +08:00
hiyouga
b664bcf307
lint
...
Former-commit-id: cee3dc484b
2024-09-30 17:00:33 +08:00
hoshi-hiyouga
81cf3bff08
Update test_mm_plugin.py
...
Former-commit-id: 8b50ce516a
2024-09-29 22:59:47 +08:00
BUAADreamer
96d51325ad
fix tests
...
Former-commit-id: 97d1536ee1
2024-09-29 18:00:45 +08:00
BUAADreamer
7ab42cb582
modify some style
...
Former-commit-id: 1b21793543
2024-09-28 01:07:38 +08:00
BUAADreamer
3501257780
add tests
...
Former-commit-id: f3be3d21e7
2024-09-28 00:59:14 +08:00
Zhangchi Feng
c576b7ca32
Merge branch 'hiyouga:main' into main
...
Former-commit-id: 900631755b
2024-09-27 18:14:39 +08:00
hiyouga
33fc7bec85
fix ci
...
Former-commit-id: b8e616183c
2024-09-25 23:14:17 +08:00
BUAADreamer
75585d01f0
try to past test
...
Former-commit-id: 0042a144d5
2024-09-10 13:29:09 +08:00
BUAADreamer
677d57b7c7
try to past test
...
Former-commit-id: b0cff7d909
2024-09-10 12:56:12 +08:00
BUAADreamer
f00f4ae9b6
support llava-next(video)
...
Former-commit-id: 31259e7e0c
2024-09-10 12:31:53 +08:00
