hoshi-hiyouga
5817cda37e
[misc] fix packing and eval plot ( #7623 )
2025-04-07 18:20:57 +08:00
Kingsley
b00cb2ed42
[data] fix pixtral plugin ( #7505 )
...
* preserve `image_sizes`
* add comments
2025-03-27 17:06:40 +08:00
hoshi-hiyouga
ef5f1c1def
[data] gemma3 plugin pan and scan ( #7294 )
...
* gemma3 pan and scan
* add test case
* fix test
2025-03-13 23:29:23 +08:00
hoshi-hiyouga
9ccfb97a2c
[misc] update format ( #7277 )
2025-03-13 02:53:08 +08:00
hoshi-hiyouga
7c1640ed5f
[misc] upgrade format to py39 ( #7256 )
2025-03-12 00:08:41 +08:00
hoshi-hiyouga
df63f05b47
[data] fix loader ( #7207 )
...
* fix dataloader
* add test case
* fix type
* fix ci
* fix ci
* fix ci
* disable overwrite cache in ci
Former-commit-id: 8c3f9f6747110107cbbb3695637482e45084dbc1
2025-03-07 17:20:46 +08:00
hoshi-hiyouga
dca5fe14c2
[data] fix mllama ( #7053 )
...
* fix mllama
* fix test
Former-commit-id: 76314e6ad1ecaa44fcae4375dd0abf4ebaf1f924
2025-02-24 22:05:38 +08:00
hoshi-hiyouga
1679930e00
[breaking change] refactor data pipeline ( #6901 )
...
* refactor data
* rename file
Former-commit-id: 617c8ab467d32be5f7d5c94fa89c0e3d7d1963bc
2025-02-13 00:39:20 +08:00
hoshi-hiyouga
2e2f6bea07
[data] feat: auto template ( #6905 )
...
* support auto template
* add unittest
Former-commit-id: 2f8b6847f5e199d770e91346dfe205c4b9f1fbb7
2025-02-12 00:22:53 +08:00
hoshi-hiyouga
197aa3baf4
[data] fix ollama template ( #6902 )
...
* fix ollama template
* add meta info
* use half precision
Former-commit-id: e1a7c1242cd1e0a1ca9ee7d04377a53872488126
2025-02-11 22:43:09 +08:00
hoshi-hiyouga
c6be9e242c
[misc] support export ollama modelfile ( #6899 )
...
* support export ollama modelfile
* update config
* add system and num ctx
Former-commit-id: 9184a6e0ed7ff5f632c848f861bfa448c4cd06fc
2025-02-11 19:52:25 +08:00
hoshi-hiyouga
2e954d8fd2
[data] refactor template ( #6896 )
...
Former-commit-id: d1b8aa3835f6e3b2e63cf06e6cadbe760d46f9aa
2025-02-11 17:59:25 +08:00
hoshi-hiyouga
b93333685b
[test] align test cases ( #6865 )
...
* align test cases
* fix function formatter
Former-commit-id: f6f3f8d0fc79de6bbad0bf892fc2f6c98c27eb8e
2025-02-09 01:03:49 +08:00
Zhangchi Feng
01915eaf40
[model] support audio ( #6701 )
...
* support qwen2_audio
* improve code
* lint
* fix
* fix
* fix
---------
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 24c78429489809873a1269a735ea5421340b32a2
2025-02-05 04:59:09 +08:00
hoshi-hiyouga
1fee69f874
[misc] update license year & fix llama pro ( #6814 )
...
* fix llamapro script
* change year
Former-commit-id: e2dc5b952aa22835d5220ba624f44676138b65ac
2025-02-05 01:53:33 +08:00
Yueqi Song
8504bde893
[data] fix qwen tool template ( #6796 )
...
* Update tool_utils.py
* fix unittest
---------
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: dd6b7d203eedbf09458c64654e8d97fec85f08d7
2025-02-05 00:02:00 +08:00
Zhangchi Feng
85f22d01bf
[data] fix minicpmv plugin ( #6801 )
...
* fix template name
* tiny fix
* support minicpm-o-2.6
* support inference of minicpmv
* update readme
* support dpo of minicpmv
* update init audio
* update init audio
* [model]fix image process in minicpmo
Former-commit-id: ab9bd068efee861452407cdda08ef014d5ce23d5
2025-02-04 21:20:15 +08:00
hoshi-hiyouga
d8cba9464f
[inference] fix stop token for object detection ( #6624 )
...
* fix stop token
* update minicpm data pipeline
* fix npu qlora examples
Former-commit-id: e3e2c8c689c54ebb2af264de808502e5a8ba0f2b
2025-01-13 21:34:20 +08:00
hiyouga
c89d17ab63
refactor mllm param logic
...
Former-commit-id: f6f630a1c96514053176abb12e35a06242e62abd
2025-01-10 15:45:48 +00:00
hiyouga
b471def13d
improve template, add phi4 model
...
Former-commit-id: ae16ea755d581a5a288fb55f12481215f369b255
2025-01-09 18:27:54 +00:00
hiyouga
a421113466
support qwen tool format
...
Former-commit-id: 98795854e3fda7b0c0bc209b3e2496b0036e154e
2024-12-17 20:12:06 +00:00
ylfeng
857d23b324
Support Mistral format tools
...
Former-commit-id: 115924af47496daa747a018952b6a32ccbd9cecb
2024-12-17 19:13:26 +00:00
hiyouga
f6a2bfc0e8
fix llama3 tool template
...
Former-commit-id: df5655f61cb847dc2d9eb7b34266b20343ff90d6
2024-12-17 17:05:10 +00:00
hiyouga
a935933bed
support llama3 tool prompt
...
Former-commit-id: b24ae55ebf548db904a9fe1876192024d8a96108
2024-12-17 15:52:37 +00:00
hiyouga
0ef1dc4dd5
fix vlm zero3 training
...
Former-commit-id: dbb9e5b70efab37ed057b2d5822b9d0d23e99fb1
2024-12-04 09:40:39 +00:00
hiyouga
4bba121f43
fix ci
...
Former-commit-id: b52c38350d6092e8158484ca01da19ed016236fc
2024-11-23 19:13:32 +00:00
hiyouga
3f7c874594
update tests
...
Former-commit-id: 93d3b8f43faf4a81b809d2f7d897e39bdb5475c3
2024-11-02 12:41:44 +08:00
KUANGDD
62cbcb646a
modify style & little change
...
Former-commit-id: 9d6143e36a12e0f295139d057aeb1843535435cf
2024-10-23 15:24:07 +08:00
KUANGDD
a24f94a36c
remove useless codes
...
Former-commit-id: 9b2642a2b53d3392e95061ed0f2c8dc10580c9e8
2024-10-16 01:14:51 +08:00
KUANGDD
9c4941a1ea
fix bug for webui infer
...
Former-commit-id: 7ea29bbfe03550ac59ff9cb01a4bc41c95ac3adf
2024-10-16 01:09:33 +08:00
Kingsley
ae869639dd
add extra test for pixtral mm_input
...
Former-commit-id: 0fc949783dec2d038dc3d1bf52051c256b69ac20
2024-10-15 17:09:24 +08:00
BUAADreamer
a3f37777c1
fix some
...
Former-commit-id: 25641af04c98e902ff024c8fa7b4c2c36ed797de
2024-10-15 13:30:41 +08:00
KUANGDD
5e440a467d
plugin test & check
...
Former-commit-id: 2df2be1c47aded0132b5cc86acd3926dca585bc1
2024-10-15 12:12:46 +08:00
hiyouga
b664bcf307
lint
...
Former-commit-id: cee3dc484be4bdf31ffe1d8b9c60604b84ed6a00
2024-09-30 17:00:33 +08:00
hoshi-hiyouga
81cf3bff08
Update test_mm_plugin.py
...
Former-commit-id: 8b50ce516af715a16c53568fb3420d6441aca1ae
2024-09-29 22:59:47 +08:00
BUAADreamer
96d51325ad
fix tests
...
Former-commit-id: 97d1536ee1f85b0a7a84fc6cb390fc502287a74c
2024-09-29 18:00:45 +08:00
BUAADreamer
7ab42cb582
modify some style
...
Former-commit-id: 1b21793543f4a03252e81a86e06ec91fd2a51fa5
2024-09-28 01:07:38 +08:00
BUAADreamer
3501257780
add tests
...
Former-commit-id: f3be3d21e7efcb2f596ee96f5a97bb53438f2d89
2024-09-28 00:59:14 +08:00
Zhangchi Feng
c576b7ca32
Merge branch 'hiyouga:main' into main
...
Former-commit-id: 900631755b28692bb150a8cf39354af4e2e986c9
2024-09-27 18:14:39 +08:00
hiyouga
33fc7bec85
fix ci
...
Former-commit-id: b8e616183cb0252da6efbeac3372b78098b2d6bd
2024-09-25 23:14:17 +08:00
BUAADreamer
75585d01f0
try to past test
...
Former-commit-id: 0042a144d532aecd0159956d6a275eb9fbfa305d
2024-09-10 13:29:09 +08:00
BUAADreamer
677d57b7c7
try to past test
...
Former-commit-id: b0cff7d9096b4b54927ce665fde58b7f34b11439
2024-09-10 12:56:12 +08:00
BUAADreamer
f00f4ae9b6
support llava-next(video)
...
Former-commit-id: 31259e7e0caa9ff6449b4abcee0554e211167178
2024-09-10 12:31:53 +08:00
hiyouga
5585713182
fix ci
...
Former-commit-id: 2f939b708f7f183f87aca67aa076db33a3c8a610
2024-09-05 22:27:48 +08:00
hiyouga
ac33d2f4da
tiny fix
...
Former-commit-id: c122b9f8657d1ca3032b1b6a6cf9cc61f11aaa82
2024-09-05 02:16:49 +08:00
hiyouga
9df7a26e6b
video datasets
...
Former-commit-id: 8cafc7b055a854f483ad1c67f3d487ffd34b5f89
2024-09-05 02:04:17 +08:00
hiyouga
60d770e4b1
fix test
...
Former-commit-id: c5e1736470c4c54de5a89ea1c58154b7fed2405d
2024-09-04 22:38:26 +08:00
hiyouga
d5ea05cfff
update get template
...
Former-commit-id: dabad5570bf4a6b1044c963d8f27717030f373ef
2024-09-04 22:36:20 +08:00
hiyouga
22deca0e9e
lazy image load
...
Former-commit-id: 47ea97fb1ba77de2e8a561904aa8fdc27c3f5025
2024-09-04 02:27:08 +08:00
hiyouga
cb776752f6
fix mixed mm inputs and rlhf-v
...
Former-commit-id: 9967ccb3aef3ca557ad6eafb78c6c99866857008
2024-09-01 20:52:47 +08:00
