132 Commits

Author SHA1 Message Date
Zhangchi Feng
85f22d01bf [data] fix minicpmv plugin (#6801)
* fix template name

* tiny fix

* support minicpm-o-2.6

* support inference of minicpmv

* update readme

* support dpo of minicpmv

* update init audio

* update init audio

* [model]fix image process in minicpmo

Former-commit-id: ab9bd068efee861452407cdda08ef014d5ce23d5
2025-02-04 21:20:15 +08:00
hoshi-hiyouga
f6779b0e0c [breaking] support transformers 4.48 (#6628)
Former-commit-id: 15357cdad953bba1f2d294819f56b9746ed1b891
2025-01-31 01:36:33 +08:00
hoshi-hiyouga
d8cba9464f [inference] fix stop token for object detection (#6624)
* fix stop token

* update minicpm data pipeline

* fix npu qlora examples

Former-commit-id: e3e2c8c689c54ebb2af264de808502e5a8ba0f2b
2025-01-13 21:34:20 +08:00
hiyouga
c89d17ab63 refactor mllm param logic
Former-commit-id: f6f630a1c96514053176abb12e35a06242e62abd
2025-01-10 15:45:48 +00:00
hiyouga
b471def13d improve template, add phi4 model
Former-commit-id: ae16ea755d581a5a288fb55f12481215f369b255
2025-01-09 18:27:54 +00:00
hiyouga
8524dcaa4a fix #6391
Former-commit-id: d4c1fda1ad19e73484d8d51d81e490cdb8781955
2024-12-19 12:16:38 +00:00
hiyouga
95d3c2620b support disable shuffling
Former-commit-id: c7cedc7569973a2879c689637b2923e8b26f1a81
2024-12-19 08:53:21 +00:00
hiyouga
a421113466 support qwen tool format
Former-commit-id: 98795854e3fda7b0c0bc209b3e2496b0036e154e
2024-12-17 20:12:06 +00:00
ylfeng
857d23b324 Support Mistral format tools
Former-commit-id: 115924af47496daa747a018952b6a32ccbd9cecb
2024-12-17 19:13:26 +00:00
hiyouga
f6a2bfc0e8 fix llama3 tool template
Former-commit-id: df5655f61cb847dc2d9eb7b34266b20343ff90d6
2024-12-17 17:05:10 +00:00
hiyouga
a935933bed support llama3 tool prompt
Former-commit-id: b24ae55ebf548db904a9fe1876192024d8a96108
2024-12-17 15:52:37 +00:00
hiyouga
0ef1dc4dd5 fix vlm zero3 training
Former-commit-id: dbb9e5b70efab37ed057b2d5822b9d0d23e99fb1
2024-12-04 09:40:39 +00:00
hiyouga
4bba121f43 fix ci
Former-commit-id: b52c38350d6092e8158484ca01da19ed016236fc
2024-11-23 19:13:32 +00:00
hiyouga
3f7c874594 update tests
Former-commit-id: 93d3b8f43faf4a81b809d2f7d897e39bdb5475c3
2024-11-02 12:41:44 +08:00
Kingsley
3053a806e9 Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: 67f59579d79e97689a4b3cba7101a423c30dab2b
2024-10-29 21:01:25 +08:00
hiyouga
d183966a5d fix pissa
Former-commit-id: 51e5f962474739bbf396782afdaa68743636fe90
2024-10-29 12:18:45 +00:00
hiyouga
825ea1c72d fix #5747
Former-commit-id: ae045c884f8ac2aa0ea27592e0757b7bca2dba13
2024-10-29 10:47:04 +00:00
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4a0eba203754a92ce0741538e8ee709
2024-10-29 09:07:46 +00:00
KUANGDD
62cbcb646a modify style & little change
Former-commit-id: 9d6143e36a12e0f295139d057aeb1843535435cf
2024-10-23 15:24:07 +08:00
KUANGDD
a24f94a36c remove useless codes
Former-commit-id: 9b2642a2b53d3392e95061ed0f2c8dc10580c9e8
2024-10-16 01:14:51 +08:00
KUANGDD
9c4941a1ea fix bug for webui infer
Former-commit-id: 7ea29bbfe03550ac59ff9cb01a4bc41c95ac3adf
2024-10-16 01:09:33 +08:00
Kingsley
ae869639dd add extra test for pixtral mm_input
Former-commit-id: 0fc949783dec2d038dc3d1bf52051c256b69ac20
2024-10-15 17:09:24 +08:00
BUAADreamer
a3f37777c1 fix some
Former-commit-id: 25641af04c98e902ff024c8fa7b4c2c36ed797de
2024-10-15 13:30:41 +08:00
KUANGDD
5e440a467d plugin test & check
Former-commit-id: 2df2be1c47aded0132b5cc86acd3926dca585bc1
2024-10-15 12:12:46 +08:00
hiyouga
b664bcf307 lint
Former-commit-id: cee3dc484be4bdf31ffe1d8b9c60604b84ed6a00
2024-09-30 17:00:33 +08:00
hoshi-hiyouga
81cf3bff08 Update test_mm_plugin.py
Former-commit-id: 8b50ce516af715a16c53568fb3420d6441aca1ae
2024-09-29 22:59:47 +08:00
BUAADreamer
96d51325ad fix tests
Former-commit-id: 97d1536ee1f85b0a7a84fc6cb390fc502287a74c
2024-09-29 18:00:45 +08:00
BUAADreamer
7ab42cb582 modify some style
Former-commit-id: 1b21793543f4a03252e81a86e06ec91fd2a51fa5
2024-09-28 01:07:38 +08:00
BUAADreamer
3501257780 add tests
Former-commit-id: f3be3d21e7efcb2f596ee96f5a97bb53438f2d89
2024-09-28 00:59:14 +08:00
Zhangchi Feng
c576b7ca32 Merge branch 'hiyouga:main' into main
Former-commit-id: 900631755b28692bb150a8cf39354af4e2e986c9
2024-09-27 18:14:39 +08:00
hiyouga
33fc7bec85 fix ci
Former-commit-id: b8e616183cb0252da6efbeac3372b78098b2d6bd
2024-09-25 23:14:17 +08:00
BUAADreamer
75585d01f0 try to past test
Former-commit-id: 0042a144d532aecd0159956d6a275eb9fbfa305d
2024-09-10 13:29:09 +08:00
BUAADreamer
677d57b7c7 try to past test
Former-commit-id: b0cff7d9096b4b54927ce665fde58b7f34b11439
2024-09-10 12:56:12 +08:00
BUAADreamer
f00f4ae9b6 support llava-next(video)
Former-commit-id: 31259e7e0caa9ff6449b4abcee0554e211167178
2024-09-10 12:31:53 +08:00
hiyouga
f6f58ebef0 fix test case
Former-commit-id: b332908ab4aad392e39f0b8661d100f096d8a6ec
2024-09-08 01:50:51 +08:00
hiyouga
945841503e add test case
Former-commit-id: 52a06efaf8af26d16137ba9095f1fd81e8f61983
2024-09-08 01:40:49 +08:00
hiyouga
52d3c42265 fix ci
Former-commit-id: eb5aa9adce7c01d453d45d2c901e530584e46eb6
2024-09-05 22:39:47 +08:00
hiyouga
5585713182 fix ci
Former-commit-id: 2f939b708f7f183f87aca67aa076db33a3c8a610
2024-09-05 22:27:48 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f49dabeb9e3c53d634cfb3c06b0241d
2024-09-05 21:52:28 +08:00
hiyouga
666013d09d fix ci
Former-commit-id: 1173f7fc1dbdcf814650bfdf854ade5212fc4738
2024-09-05 03:02:59 +08:00
hiyouga
9f36534b49 fix ci
Former-commit-id: b6a3fdd056d77dbe692053bc22a8923e24ed2256
2024-09-05 02:49:22 +08:00
hiyouga
ac33d2f4da tiny fix
Former-commit-id: c122b9f8657d1ca3032b1b6a6cf9cc61f11aaa82
2024-09-05 02:16:49 +08:00
hiyouga
9df7a26e6b video datasets
Former-commit-id: 8cafc7b055a854f483ad1c67f3d487ffd34b5f89
2024-09-05 02:04:17 +08:00
hiyouga
60d770e4b1 fix test
Former-commit-id: c5e1736470c4c54de5a89ea1c58154b7fed2405d
2024-09-04 22:38:26 +08:00
hiyouga
d5ea05cfff update get template
Former-commit-id: dabad5570bf4a6b1044c963d8f27717030f373ef
2024-09-04 22:36:20 +08:00
hiyouga
22deca0e9e lazy image load
Former-commit-id: 47ea97fb1ba77de2e8a561904aa8fdc27c3f5025
2024-09-04 02:27:08 +08:00
hiyouga
cb776752f6 fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3aef3ca557ad6eafb78c6c99866857008
2024-09-01 20:52:47 +08:00
hiyouga
09a2ecebc4 add test mm plugin
Former-commit-id: a2a8c0b92c49fb1ee65de271aec651e011dcabc4
2024-08-31 01:53:38 +08:00
hiyouga
488f392c81 fix test
Former-commit-id: cdb0f34f10f5407e83766a8c5c9c5aff6af2a84e
2024-07-19 01:17:37 +08:00
hiyouga
d0891f05fa fix unittest
Former-commit-id: e80006795fe6344ea98b61f9a8db16356498c7cb
2024-07-19 01:10:30 +08:00