39 Commits

Author SHA1 Message Date
hoshi-hiyouga
7c1640ed5f
[misc] upgrade format to py39 (#7256) 2025-03-12 00:08:41 +08:00
Zhangchi Feng
01915eaf40 [model] support audio (#6701)
* support qwen2_audio

* improve code

* lint

* fix

* fix

* fix

---------

Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
Former-commit-id: 24c78429489809873a1269a735ea5421340b32a2
2025-02-05 04:59:09 +08:00
hoshi-hiyouga
1fee69f874 [misc] update license year & fix llama pro (#6814)
* fix llamapro script

* change year

Former-commit-id: e2dc5b952aa22835d5220ba624f44676138b65ac
2025-02-05 01:53:33 +08:00
hoshi-hiyouga
1efe525df7 [model] support yarn (#6693)
Former-commit-id: 1f47b6186c267de86cbdbd47ba2adbf1f9db7f39
2025-01-18 13:56:09 +08:00
hoshi-hiyouga
91433d639c lint (#6641)
Former-commit-id: 1278c3e92eeb297e883aab89e2384c1df1d0e910
2025-01-14 18:40:07 +08:00
Xiaosu Zhu
a52496cc09 Fix tokenizer max length (#6632)
Former-commit-id: 58d029f3212dba1808e63cc8875022f6d741bd63
2025-01-14 17:35:54 +08:00
hiyouga
c89d17ab63 refactor mllm param logic
Former-commit-id: f6f630a1c96514053176abb12e35a06242e62abd
2025-01-10 15:45:48 +00:00
Yaser Afshar
fe4546a7bb Add trust_remote_code parameter and remove True
- Introduced a new model parameter `trust_remote_code`
- Set the default value of `trust_remote_code` to `False`
  to enhance security


Former-commit-id: 09437763267bc7081159a6878cee9652a2b1ddac
2024-12-17 12:25:12 +00:00
hiyouga
e83cb17f97 support rank0 logger
Former-commit-id: c38aa29336f286266553da4909a7267d7ef21f37
2024-11-02 18:31:04 +08:00
hiyouga
ac677205c9 fix #5904
Former-commit-id: bfe1abd7afe4595135b568783753d064cb6e0b28
2024-11-02 13:08:15 +08:00
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4a0eba203754a92ce0741538e8ee709
2024-10-29 09:07:46 +00:00
hoshi-hiyouga
f03b20b267 fix #5797
Former-commit-id: b4c7dd3ac5615ccb52d7627db635d33336e51951
2024-10-23 20:49:44 +08:00
huniu20
26e897e861 1. add modelers hub support
Former-commit-id: 24ebe187e360753666b768685a0dcc78054bb702
2024-10-09 17:21:37 +08:00
hiyouga
4464a6ff5b tiny fix
Former-commit-id: 451d271718a8026056d0f7d7b8ab333391d24ad4
2024-10-08 17:48:56 +08:00
hoshi-hiyouga
c639e52c6b Merge branch 'main' into cpei/refactor
Former-commit-id: 2c6262c3cd57906806e53aecd4e5a4423399c1e0
2024-10-08 17:31:17 +08:00
hiyouga
4df090ff48 fix #5542
Former-commit-id: fe7ffccdb9a45b31e20ab7e88282a75b45504a97
2024-09-30 23:28:55 +08:00
hiyouga
3720618c63 add patch processor func
Former-commit-id: 45841bb646afa9d0bc2ea4b6b7b107daa67d90f0
2024-09-30 17:07:43 +08:00
BUAADreamer
1e2ea34419 fix some
Former-commit-id: d5c69400cd27cdf0667290f3863a3aab47143eb3
2024-09-29 17:55:40 +08:00
BUAADreamer
5aa1e847d9 add llava-next/llava-next-video/video-llava
Former-commit-id: 6642cd501d55a1657678428ef2aa0c9b99b7e83f
2024-09-28 00:57:03 +08:00
Chengcheng Pei
bc7197dcfc address comments
Former-commit-id: 6bfd8442671eec4c0fb63fd34667a44760fd84e2
2024-09-25 21:07:51 -07:00
Chengcheng Pei
e80c98367e 1, log exceptions in details; 2, check processor is None before calling it.
Former-commit-id: 573e3183e644e8da61a409d96b9adcfacbfc3a7a
2024-09-25 12:59:48 -07:00
BUAADreamer
16c7326bc5 try to past test
Former-commit-id: 7b4ba0efb658422fd29dca63bac1e9cee8e82af8
2024-09-10 13:12:51 +08:00
BUAADreamer
5c53cf3244 resolve confilct
Former-commit-id: 96decf82b872a4ec06450b4440336d38475d1d02
2024-09-10 12:39:17 +08:00
BUAADreamer
f00f4ae9b6 support llava-next(video)
Former-commit-id: 31259e7e0caa9ff6449b4abcee0554e211167178
2024-09-10 12:31:53 +08:00
hiyouga
c52eeb70e7 fix qwen2vl preprocess
Former-commit-id: c93795ae14b1d5a0a3440d18f8197fd53cd013da
2024-09-09 22:33:33 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f49dabeb9e3c53d634cfb3c06b0241d
2024-09-05 21:52:28 +08:00
hiyouga
9df7a26e6b video datasets
Former-commit-id: 8cafc7b055a854f483ad1c67f3d487ffd34b5f89
2024-09-05 02:04:17 +08:00
hiyouga
bfdcc6bacf add rlhf-v dataset
Former-commit-id: 8e49940746c1a6ff910f07dbefbec14af9d0f3c6
2024-09-01 22:57:41 +08:00
hiyouga
cb776752f6 fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3aef3ca557ad6eafb78c6c99866857008
2024-09-01 20:52:47 +08:00
hiyouga
09a2ecebc4 add test mm plugin
Former-commit-id: a2a8c0b92c49fb1ee65de271aec651e011dcabc4
2024-08-31 01:53:38 +08:00
hiyouga
f31e7e0dfc remove visual_inputs, fix qlora
Former-commit-id: a025c3df61db154bef13033518903bbf846f4fc8
2024-08-31 00:24:51 +08:00
hiyouga
bbc37b2880 fix #4398 #4592
Former-commit-id: d74244d56858d837044e5c9cea57a1b3c2ca0214
2024-06-30 21:28:51 +08:00
hiyouga
d2d9fa4abb support HQQ/EETQ #4113
Former-commit-id: ad144c2265cdee0d23014dbb3d017ea257cb26ed
2024-06-27 00:29:42 +08:00
hiyouga
0ae1302e41 fix #4432
Former-commit-id: 1e9d0aa1e45fac52614e79a9fe87e8f1d3757333
2024-06-25 02:34:04 +08:00
hiyouga
2946153cea add license
Former-commit-id: d87108daa68bd40174b262be1ca65fe6e1b7ab56
2024-06-15 17:54:33 +08:00
hiyouga
8da149ba40 rename files
Former-commit-id: 74f96efef9bcd63f65d0190c901ff9be54ccd350
2024-06-07 00:09:06 +08:00
hiyouga
3fcb678d00 support train from scratch #4033 #4075
Former-commit-id: a12a506c3d2ba85975a5990c46d2e055cdfe0f2e
2024-06-06 02:43:19 +08:00
hiyouga
780a1f5a4e better dtype handle in loading
Former-commit-id: d9f190ff1ea1cc4dd061e8b03d429caea037bca4
2024-05-17 02:14:56 +08:00
hiyouga
cae823ddf0 rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
2024-05-16 18:39:08 +08:00