364 Commits

Author SHA1 Message Date
hoshi-hiyouga
ce0c73c032 Update mm_plugin.py
Former-commit-id: 0257a67cb266dcaee8bfb358d88ef2be2403a2f7
2024-09-29 20:53:34 +08:00
BUAADreamer
66213043ac tiny fix
Former-commit-id: 7397827aec55eecad1e70878453387fda0db62b5
2024-09-29 20:38:46 +08:00
BUAADreamer
8ee588248e fix style
Former-commit-id: 6ddea0f3d3ef568378470ce967a0e8d02eeac5dd
2024-09-29 20:30:57 +08:00
BUAADreamer
1e2ea34419 fix some
Former-commit-id: d5c69400cd27cdf0667290f3863a3aab47143eb3
2024-09-29 17:55:40 +08:00
BUAADreamer
615edf937e fix some params of visual regularize
Former-commit-id: 1d09d592d3beacca6a17bb3e5a9728150741e551
2024-09-29 12:38:25 +08:00
Kingsley
a2452d0b1c Tiny fix
Former-commit-id: 8f13a3627d06a6f0a9b4e35443a415958d9ad1c9
2024-09-29 00:00:23 +08:00
Kingsley
fd79cf8551 tiny fix
Former-commit-id: 3d3cc6705d4575f7f20bf4da2b7dab60b337006b
2024-09-28 22:50:53 +08:00
Kingsley
66e473d519 remove some unnecessary if conditions
Former-commit-id: de06e2678e2168586614242f65939c5772e78774
2024-09-28 02:14:06 +08:00
BUAADreamer
7ab42cb582 modify some style
Former-commit-id: 1b21793543f4a03252e81a86e06ec91fd2a51fa5
2024-09-28 01:07:38 +08:00
BUAADreamer
5aa1e847d9 add llava-next/llava-next-video/video-llava
Former-commit-id: 6642cd501d55a1657678428ef2aa0c9b99b7e83f
2024-09-28 00:57:03 +08:00
Zhangchi Feng
c576b7ca32 Merge branch 'hiyouga:main' into main
Former-commit-id: 900631755b28692bb150a8cf39354af4e2e986c9
2024-09-27 18:14:39 +08:00
Kingsley
b76116bb6c add pixtral template
Former-commit-id: 7b3336dd97e06a11ec52433ef36980aefdbb45ba
2024-09-26 17:14:51 +08:00
Kingsley
35e44143fd Merge branches 'pixtral-patch' and 'pixtral-patch' of https://github.com/Kuangdd01/LLaMA-Factory-X into pixtral-patch
Former-commit-id: 5e64b0c37165a50296036a6e09e09193fb2ad644
2024-09-26 12:18:25 +08:00
Kingsley
c436d6ea0b add pixtral template
Former-commit-id: 86f5a9be548ef02ce334bba35a529c70e8b3ad7f
2024-09-26 12:11:58 +08:00
hiyouga
f30e0a75c4 optionally replace jinja template
Former-commit-id: ba52103ba7f8f0c856691c4a9a706a6e19e73c1e
2024-09-25 23:02:02 +08:00
huangpan.foo
fefe2aa0e4 Add deepseek-v2.5 template
Former-commit-id: ee059c393baecc4a4dfd44171d24cab45c73c962
2024-09-21 19:33:30 +08:00
hoshi-hiyouga
1ccc2d198e flat string
Former-commit-id: f2301305637aebc026895a7d4837e5def2c23159
2024-09-19 16:43:42 +08:00
hoshi-hiyouga
e4d26efea9 lint
Former-commit-id: af7f547ecbcae11761aa934f8b25dd5ea8c35516
2024-09-19 16:21:43 +08:00
hoshi-hiyouga
89138b8ab8 fix bug
Former-commit-id: 98b464d2dd4ca303d24ae2bb31989f4458b18146
2024-09-19 16:21:21 +08:00
hoshi-hiyouga
545ca7db99 improve error message
Former-commit-id: 36611d5c098d444454f0e41a15664f14c2975547
2024-09-19 16:06:00 +08:00
ybyang
daa1309466 fix: 修复function call数据集如果 function_call 值的为不合法json,异常提示且中断训练。
Former-commit-id: 953e1a0fb226e63b797cab0007c53d3ebc6456bb
2024-09-19 15:00:10 +08:00
menibrief
4ed2b629a5 fix phi-small template
Former-commit-id: 9c1bbfac2173450c56ded2cf343e3a37ba369b7b
2024-09-18 23:52:30 +03:00
BUAADreamer
0be477292b try to past test
Former-commit-id: e387216d49cf261c82d77df22424e6360dbcfc2a
2024-09-10 13:25:30 +08:00
Zhangchi Feng
4b6606832c Merge branch 'hiyouga:main' into main
Former-commit-id: 4643089a7dc6a88c391663131333f35b5da5015b
2024-09-10 13:20:24 +08:00
BUAADreamer
16c7326bc5 try to past test
Former-commit-id: 7b4ba0efb658422fd29dca63bac1e9cee8e82af8
2024-09-10 13:12:51 +08:00
BUAADreamer
f00f4ae9b6 support llava-next(video)
Former-commit-id: 31259e7e0caa9ff6449b4abcee0554e211167178
2024-09-10 12:31:53 +08:00
hiyouga
38505ae9e1 update accelerate ver for schedule_free optimizers
Former-commit-id: bdde35fd2e4a919c1d63ebfc9a0ea8ba0c97e14c
2024-09-09 22:51:08 +08:00
hiyouga
2bb1ee3292 fix mm plugin
Former-commit-id: 6dc2b00fa2bcbdbad71cb0d96e14d75a7db932e2
2024-09-09 22:41:28 +08:00
hiyouga
c52eeb70e7 fix qwen2vl preprocess
Former-commit-id: c93795ae14b1d5a0a3440d18f8197fd53cd013da
2024-09-09 22:33:33 +08:00
hiyouga
7ccb86b215 add docstrings, refactor logger
Former-commit-id: 54c69059379d77dc9046c144cbe2d0253de3a4da
2024-09-08 00:56:56 +08:00
hiyouga
995491594d tiny fix
Former-commit-id: 76f2e5950483c669a15a961f0554442b6eb5c4a6
2024-09-05 23:41:16 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f49dabeb9e3c53d634cfb3c06b0241d
2024-09-05 21:52:28 +08:00
hoshi-hiyouga
de277a8ab8 Merge pull request #5372 from LDLINGLINGLING/main
增加了对minicpm3.0的适配'

Former-commit-id: 12743562639ccc6eb0caf170e7123d9844e2b4a6
2024-09-05 21:35:42 +08:00
liudan
1797fe50a4 根据代码规范修改了代码
Former-commit-id: 3d3fbaaff98da327e10bdebb4aedbdf1ec9565e8
2024-09-05 20:17:55 +08:00
hiyouga
4fccc65579 support Yi-Coder models
Former-commit-id: 359ef8bb0ebb8ccf9651ac2b737c5a705dab6bad
2024-09-05 03:12:24 +08:00
hiyouga
9df7a26e6b video datasets
Former-commit-id: 8cafc7b055a854f483ad1c67f3d487ffd34b5f89
2024-09-05 02:04:17 +08:00
liudan
09cff03026 增加了对minicpm3.0的适配'
Former-commit-id: d7ba97be484bf781d6fe80252ea29eb505b261bb
2024-09-04 23:10:05 +08:00
hiyouga
d5ea05cfff update get template
Former-commit-id: dabad5570bf4a6b1044c963d8f27717030f373ef
2024-09-04 22:36:20 +08:00
hoshi-hiyouga
1dfd1aaf82 Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset

Former-commit-id: 8f441c2b3a5bb84dec2c037a541084c0201726c6
2024-09-04 22:09:36 +08:00
hoshi-hiyouga
8ac74c8ccb fix #5228
Former-commit-id: 44d6947e554cd61cff23c297248fff32a5f554da
2024-09-04 19:10:30 +08:00
hiyouga
a3d47818b7 fix #5344
Former-commit-id: d41d43a7c37cd10e34c9f399d1a346ffaee641c3
2024-09-04 03:06:06 +08:00
hiyouga
22deca0e9e lazy image load
Former-commit-id: 47ea97fb1ba77de2e8a561904aa8fdc27c3f5025
2024-09-04 02:27:08 +08:00
hiyouga
f837ae8cb5 fix #5338
Former-commit-id: 69d0acacc38dc90a97ce18447f865f525fff086a
2024-09-03 17:45:17 +08:00
naem1023
46695e42cc feat: add batch size of map function in the preprocessed dataset
Former-commit-id: 209313eeeab8d1a7c320bd9aa90a5f4656082b7c
2024-09-02 13:52:47 +09:00
hiyouga
f13e974930 tiny fix
Former-commit-id: 3a6f19f017539a2be31e348845a8ed8712275dcb
2024-09-02 01:33:22 +08:00
hiyouga
859823eb23 add image num check
Former-commit-id: ce8c5a264742161101da2094d0fc31c7fa7fb641
2024-09-02 01:31:36 +08:00
hiyouga
bfdcc6bacf add rlhf-v dataset
Former-commit-id: 8e49940746c1a6ff910f07dbefbec14af9d0f3c6
2024-09-01 22:57:41 +08:00
hiyouga
413a206652 fix bug
Former-commit-id: 64cb947c60398dfdfc2877f898147b0240089ea3
2024-09-01 21:07:49 +08:00
hiyouga
cb776752f6 fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3aef3ca557ad6eafb78c6c99866857008
2024-09-01 20:52:47 +08:00
hiyouga
09a2ecebc4 add test mm plugin
Former-commit-id: a2a8c0b92c49fb1ee65de271aec651e011dcabc4
2024-08-31 01:53:38 +08:00