112 Commits

Author SHA1 Message Date
Kingsley
8ea1c5c69e Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: 95330893c5cd290430a0a2a4e4afa87afab2eb88
2024-10-13 17:42:02 +08:00
huniu20
26e897e861 1. add modelers hub support
Former-commit-id: 24ebe187e360753666b768685a0dcc78054bb702
2024-10-09 17:21:37 +08:00
Kingsley
5523a6fd2c Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: 93a441a6b746e9a933dad8c45553fb5b68bf2b34
2024-10-08 21:04:08 +08:00
hiyouga
4464a6ff5b tiny fix
Former-commit-id: 451d271718a8026056d0f7d7b8ab333391d24ad4
2024-10-08 17:48:56 +08:00
hoshi-hiyouga
c639e52c6b Merge branch 'main' into cpei/refactor
Former-commit-id: 2c6262c3cd57906806e53aecd4e5a4423399c1e0
2024-10-08 17:31:17 +08:00
hiyouga
2b3173e5d2 fix #5611
Former-commit-id: eb2db2af8ec061205d7370baa8f15bdaf34ed31c
2024-10-06 10:33:11 +08:00
Kingsley
f3ac97a749 Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: e53f47c0b3de491d4d9b31c995f9cea100f98896
2024-10-01 00:52:31 +08:00
hiyouga
4df090ff48 fix #5542
Former-commit-id: fe7ffccdb9a45b31e20ab7e88282a75b45504a97
2024-09-30 23:28:55 +08:00
Kingsley
6729ed2c7e sync with former
Former-commit-id: 9ddb84052e3cc72e21a92b8103caa179a35859c4
2024-09-30 20:27:05 +08:00
Kingsley
94ce8f561f fix some errors due to inconsistency of model cards
Former-commit-id: 2166b9bc6ba35760ff85b63620af9fa0213a4c78
2024-09-30 19:58:34 +08:00
Kingsley
4f85098088 Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: 9ac0fde3f29cfd98e08c53a0e52bf472240ae2e7
2024-09-30 19:33:29 +08:00
hiyouga
3720618c63 add patch processor func
Former-commit-id: 45841bb646afa9d0bc2ea4b6b7b107daa67d90f0
2024-09-30 17:07:43 +08:00
Zhangchi Feng
69e801d456 Merge branch 'main' into pixtral-patch
Former-commit-id: 26f45829b453ff1a0c76f6c1ddaba893d48f821e
2024-09-30 12:37:03 +08:00
BUAADreamer
87ab7fc01c fix constants
Former-commit-id: 485fc047169afd027ee65d05e3c5c08b371b6c4d
2024-09-29 22:00:01 +08:00
BUAADreamer
ddec40ac16 fix style
Former-commit-id: 23916d57c1d22653739dbf913d3e427fcb978a15
2024-09-29 21:39:37 +08:00
Zhangchi Feng
8e164f3594 Merge branch 'main' into main
Former-commit-id: 83abf86657ea38968e953e1dc4a2e8c34471b06a
2024-09-29 21:32:54 +08:00
BUAADreamer
1b71afb277 add more llava-next series template
Former-commit-id: 65a8923f5a7d20d34fabf4f81746fe9b7bc8c84a
2024-09-29 21:29:29 +08:00
BUAADreamer
534dc58363 fix readme
Former-commit-id: bf0bcbc5ec4ca0182ade283ea9f37012f224f519
2024-09-29 20:45:02 +08:00
BUAADreamer
1e2ea34419 fix some
Former-commit-id: d5c69400cd27cdf0667290f3863a3aab47143eb3
2024-09-29 17:55:40 +08:00
hoshi-hiyouga
5df765e376 Update attention.py
Former-commit-id: fe7057a8a3eb111cdaf8349b6ac077d898bf4935
2024-09-29 10:47:41 +08:00
Kingsley
a2452d0b1c Tiny fix
Former-commit-id: 8f13a3627d06a6f0a9b4e35443a415958d9ad1c9
2024-09-29 00:00:23 +08:00
Amirreza A
6ae0e27c8b made a small change to a warning about fa2 for gemma2 models.
Former-commit-id: 94ee105526d817e59bfd91f7bd4161d7cb2fd216
2024-09-28 19:03:36 +03:30
Kingsley
fd79cf8551 tiny fix
Former-commit-id: 3d3cc6705d4575f7f20bf4da2b7dab60b337006b
2024-09-28 22:50:53 +08:00
BUAADreamer
0e33902f61 fix some
Former-commit-id: 7f3f81009e3728fe25b9c063491ee71acc498c35
2024-09-28 01:15:33 +08:00
BUAADreamer
5aa1e847d9 add llava-next/llava-next-video/video-llava
Former-commit-id: 6642cd501d55a1657678428ef2aa0c9b99b7e83f
2024-09-28 00:57:03 +08:00
Zhangchi Feng
c576b7ca32 Merge branch 'hiyouga:main' into main
Former-commit-id: 900631755b28692bb150a8cf39354af4e2e986c9
2024-09-27 18:14:39 +08:00
Kingsley
b76116bb6c add pixtral template
Former-commit-id: 7b3336dd97e06a11ec52433ef36980aefdbb45ba
2024-09-26 17:14:51 +08:00
Kingsley
c436d6ea0b add pixtral template
Former-commit-id: 86f5a9be548ef02ce334bba35a529c70e8b3ad7f
2024-09-26 12:11:58 +08:00
Chengcheng Pei
bc7197dcfc address comments
Former-commit-id: 6bfd8442671eec4c0fb63fd34667a44760fd84e2
2024-09-25 21:07:51 -07:00
Chengcheng Pei
e80c98367e 1, log exceptions in details; 2, check processor is None before calling it.
Former-commit-id: 573e3183e644e8da61a409d96b9adcfacbfc3a7a
2024-09-25 12:59:48 -07:00
Billy Cao
38e955d4a9 Add qwen_vl to liger kernel supported list
Former-commit-id: 7a2958a44f3b99cddb91f7b67fa0dd1c26c1a991
2024-09-14 19:28:20 +08:00
BUAADreamer
16c7326bc5 try to past test
Former-commit-id: 7b4ba0efb658422fd29dca63bac1e9cee8e82af8
2024-09-10 13:12:51 +08:00
BUAADreamer
5c53cf3244 resolve confilct
Former-commit-id: 96decf82b872a4ec06450b4440336d38475d1d02
2024-09-10 12:39:17 +08:00
BUAADreamer
f00f4ae9b6 support llava-next(video)
Former-commit-id: 31259e7e0caa9ff6449b4abcee0554e211167178
2024-09-10 12:31:53 +08:00
hiyouga
c52eeb70e7 fix qwen2vl preprocess
Former-commit-id: c93795ae14b1d5a0a3440d18f8197fd53cd013da
2024-09-09 22:33:33 +08:00
hiyouga
0229263fbe tiny fix
Former-commit-id: c9b3870adb60a2aca8cfd82c1a8b8044319bacbc
2024-09-08 23:18:08 +08:00
hiyouga
f6f58ebef0 fix test case
Former-commit-id: b332908ab4aad392e39f0b8661d100f096d8a6ec
2024-09-08 01:50:51 +08:00
hiyouga
945841503e add test case
Former-commit-id: 52a06efaf8af26d16137ba9095f1fd81e8f61983
2024-09-08 01:40:49 +08:00
hiyouga
0daee7cb39 support activation offloading via unsloth gc
Former-commit-id: fb72a3adb0916232cc9ac9f0c725c02d07b9354c
2024-09-08 01:22:19 +08:00
hiyouga
995491594d tiny fix
Former-commit-id: 76f2e5950483c669a15a961f0554442b6eb5c4a6
2024-09-05 23:41:16 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f49dabeb9e3c53d634cfb3c06b0241d
2024-09-05 21:52:28 +08:00
hiyouga
9df7a26e6b video datasets
Former-commit-id: 8cafc7b055a854f483ad1c67f3d487ffd34b5f89
2024-09-05 02:04:17 +08:00
hiyouga
6e98872622 fix #5324
Former-commit-id: a61c8c4890962f3847b19eff31b170cd7f54316c
2024-09-02 23:56:21 +08:00
hiyouga
bfdcc6bacf add rlhf-v dataset
Former-commit-id: 8e49940746c1a6ff910f07dbefbec14af9d0f3c6
2024-09-01 22:57:41 +08:00
hiyouga
cb776752f6 fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3aef3ca557ad6eafb78c6c99866857008
2024-09-01 20:52:47 +08:00
hiyouga
09a2ecebc4 add test mm plugin
Former-commit-id: a2a8c0b92c49fb1ee65de271aec651e011dcabc4
2024-08-31 01:53:38 +08:00
hiyouga
f31e7e0dfc remove visual_inputs, fix qlora
Former-commit-id: a025c3df61db154bef13033518903bbf846f4fc8
2024-08-31 00:24:51 +08:00
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32f88ed377d3e7759bdeaf0f2559d22a
2024-08-30 02:14:31 +08:00
hoshi-hiyouga
98b0c7530c Merge pull request #5290 from simonJJJ/qwen2_vl
support qwen2-vl

Former-commit-id: 727e1848401d306274fb60ba78f66fed577b7b55
2024-08-30 02:10:36 +08:00
hiyouga
0e4ee9d9a3 update liger kernel
Former-commit-id: a7dd7d325e68c92c7470c1e9ef83a7c8abcbc616
2024-08-29 20:46:08 +08:00