Commit Graph

142 Commits

Author SHA1 Message Date
hoshi-hiyouga
dca5fe14c2 [data] fix mllama (#7053)
* fix mllama

* fix test

Former-commit-id: 76314e6ad1
2025-02-24 22:05:38 +08:00
hoshi-hiyouga
1679930e00 [breaking change] refactor data pipeline (#6901)
* refactor data

* rename file

Former-commit-id: 617c8ab467
2025-02-13 00:39:20 +08:00
hoshi-hiyouga
2e2f6bea07 [data] feat: auto template (#6905)
* support auto template

* add unittest

Former-commit-id: 2f8b6847f5
2025-02-12 00:22:53 +08:00
hoshi-hiyouga
197aa3baf4 [data] fix ollama template (#6902)
* fix ollama template

* add meta info

* use half precision

Former-commit-id: e1a7c1242c
2025-02-11 22:43:09 +08:00
hoshi-hiyouga
c6be9e242c [misc] support export ollama modelfile (#6899)
* support export ollama modelfile

* update config

* add system and num ctx

Former-commit-id: 9184a6e0ed
2025-02-11 19:52:25 +08:00
hoshi-hiyouga
2e954d8fd2 [data] refactor template (#6896)
Former-commit-id: d1b8aa3835
2025-02-11 17:59:25 +08:00
hoshi-hiyouga
b93333685b [test] align test cases (#6865)
* align test cases

* fix function formatter

Former-commit-id: f6f3f8d0fc
2025-02-09 01:03:49 +08:00
Zhangchi Feng
01915eaf40 [model] support audio (#6701)
* support qwen2_audio

* improve code

* lint

* fix

* fix

* fix

---------

Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 24c7842948
2025-02-05 04:59:09 +08:00
hoshi-hiyouga
1fee69f874 [misc] update license year & fix llama pro (#6814)
* fix llamapro script

* change year

Former-commit-id: e2dc5b952a
2025-02-05 01:53:33 +08:00
Yueqi Song
8504bde893 [data] fix qwen tool template (#6796)
* Update tool_utils.py

* fix unittest

---------

Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: dd6b7d203e
2025-02-05 00:02:00 +08:00
Zhangchi Feng
85f22d01bf [data] fix minicpmv plugin (#6801)
* fix template name

* tiny fix

* support minicpm-o-2.6

* support inference of minicpmv

* update readme

* support dpo of minicpmv

* update init audio

* update init audio

* [model]fix image process in minicpmo

Former-commit-id: ab9bd068ef
2025-02-04 21:20:15 +08:00
hoshi-hiyouga
f6779b0e0c [breaking] support transformers 4.48 (#6628)
Former-commit-id: 15357cdad9
2025-01-31 01:36:33 +08:00
hoshi-hiyouga
d8cba9464f [inference] fix stop token for object detection (#6624)
* fix stop token

* update minicpm data pipeline

* fix npu qlora examples

Former-commit-id: e3e2c8c689
2025-01-13 21:34:20 +08:00
hiyouga
c89d17ab63 refactor mllm param logic
Former-commit-id: f6f630a1c9
2025-01-10 15:45:48 +00:00
hiyouga
b471def13d improve template, add phi4 model
Former-commit-id: ae16ea755d
2025-01-09 18:27:54 +00:00
hiyouga
8524dcaa4a fix #6391
Former-commit-id: d4c1fda1ad
2024-12-19 12:16:38 +00:00
hiyouga
95d3c2620b support disable shuffling
Former-commit-id: c7cedc7569
2024-12-19 08:53:21 +00:00
hiyouga
a421113466 support qwen tool format
Former-commit-id: 98795854e3
2024-12-17 20:12:06 +00:00
ylfeng
857d23b324 Support Mistral format tools
Former-commit-id: 115924af47
2024-12-17 19:13:26 +00:00
hiyouga
f6a2bfc0e8 fix llama3 tool template
Former-commit-id: df5655f61c
2024-12-17 17:05:10 +00:00
hiyouga
a935933bed support llama3 tool prompt
Former-commit-id: b24ae55ebf
2024-12-17 15:52:37 +00:00
hiyouga
0ef1dc4dd5 fix vlm zero3 training
Former-commit-id: dbb9e5b70e
2024-12-04 09:40:39 +00:00
hiyouga
4bba121f43 fix ci
Former-commit-id: b52c38350d
2024-11-23 19:13:32 +00:00
hiyouga
3f7c874594 update tests
Former-commit-id: 93d3b8f43f
2024-11-02 12:41:44 +08:00
Kingsley
3053a806e9 Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: 67f59579d7
2024-10-29 21:01:25 +08:00
hiyouga
d183966a5d fix pissa
Former-commit-id: 51e5f96247
2024-10-29 12:18:45 +00:00
hiyouga
825ea1c72d fix #5747
Former-commit-id: ae045c884f
2024-10-29 10:47:04 +00:00
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
KUANGDD
62cbcb646a modify style & little change
Former-commit-id: 9d6143e36a
2024-10-23 15:24:07 +08:00
KUANGDD
a24f94a36c remove useless codes
Former-commit-id: 9b2642a2b5
2024-10-16 01:14:51 +08:00
KUANGDD
9c4941a1ea fix bug for webui infer
Former-commit-id: 7ea29bbfe0
2024-10-16 01:09:33 +08:00
Kingsley
ae869639dd add extra test for pixtral mm_input
Former-commit-id: 0fc949783d
2024-10-15 17:09:24 +08:00
BUAADreamer
a3f37777c1 fix some
Former-commit-id: 25641af04c
2024-10-15 13:30:41 +08:00
KUANGDD
5e440a467d plugin test & check
Former-commit-id: 2df2be1c47
2024-10-15 12:12:46 +08:00
hiyouga
b664bcf307 lint
Former-commit-id: cee3dc484b
2024-09-30 17:00:33 +08:00
hoshi-hiyouga
81cf3bff08 Update test_mm_plugin.py
Former-commit-id: 8b50ce516a
2024-09-29 22:59:47 +08:00
BUAADreamer
96d51325ad fix tests
Former-commit-id: 97d1536ee1
2024-09-29 18:00:45 +08:00
BUAADreamer
7ab42cb582 modify some style
Former-commit-id: 1b21793543
2024-09-28 01:07:38 +08:00
BUAADreamer
3501257780 add tests
Former-commit-id: f3be3d21e7
2024-09-28 00:59:14 +08:00
Zhangchi Feng
c576b7ca32 Merge branch 'hiyouga:main' into main
Former-commit-id: 900631755b
2024-09-27 18:14:39 +08:00
hiyouga
33fc7bec85 fix ci
Former-commit-id: b8e616183c
2024-09-25 23:14:17 +08:00
BUAADreamer
75585d01f0 try to past test
Former-commit-id: 0042a144d5
2024-09-10 13:29:09 +08:00
BUAADreamer
677d57b7c7 try to past test
Former-commit-id: b0cff7d909
2024-09-10 12:56:12 +08:00
BUAADreamer
f00f4ae9b6 support llava-next(video)
Former-commit-id: 31259e7e0c
2024-09-10 12:31:53 +08:00
hiyouga
f6f58ebef0 fix test case
Former-commit-id: b332908ab4
2024-09-08 01:50:51 +08:00
hiyouga
945841503e add test case
Former-commit-id: 52a06efaf8
2024-09-08 01:40:49 +08:00
hiyouga
52d3c42265 fix ci
Former-commit-id: eb5aa9adce
2024-09-05 22:39:47 +08:00
hiyouga
5585713182 fix ci
Former-commit-id: 2f939b708f
2024-09-05 22:27:48 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f
2024-09-05 21:52:28 +08:00
hiyouga
666013d09d fix ci
Former-commit-id: 1173f7fc1d
2024-09-05 03:02:59 +08:00