Commit Graph

1620 Commits

Author SHA1 Message Date
Kingsley
c436d6ea0b add pixtral template
Former-commit-id: 86f5a9be54
2024-09-26 12:11:58 +08:00
Chengcheng Pei
bc7197dcfc address comments
Former-commit-id: 6bfd844267
2024-09-25 21:07:51 -07:00
hoshi-hiyouga
a73988141b add modelscope models
Former-commit-id: 8e5d12c2c4
2024-09-26 11:22:48 +08:00
marko1616
b70da07977 Chore: Support llama3.2.
Former-commit-id: 885a0b77ab
2024-09-25 16:08:44 -04:00
Chengcheng Pei
e80c98367e 1, log exceptions in details; 2, check processor is None before calling it.
Former-commit-id: 573e3183e6
2024-09-25 12:59:48 -07:00
hiyouga
f30e0a75c4 optionally replace jinja template
Former-commit-id: ba52103ba7
2024-09-25 23:02:02 +08:00
hoshi-hiyouga
1ccc2d198e flat string
Former-commit-id: f230130563
2024-09-19 16:43:42 +08:00
hoshi-hiyouga
e4d26efea9 lint
Former-commit-id: af7f547ecb
2024-09-19 16:21:43 +08:00
hoshi-hiyouga
89138b8ab8 fix bug
Former-commit-id: 98b464d2dd
2024-09-19 16:21:21 +08:00
hoshi-hiyouga
545ca7db99 improve error message
Former-commit-id: 36611d5c09
2024-09-19 16:06:00 +08:00
ybyang
daa1309466 fix: 修复function call数据集如果 function_call 值的为不合法json,异常提示且中断训练。
Former-commit-id: 953e1a0fb2
2024-09-19 15:00:10 +08:00
menibrief
4ed2b629a5 fix phi-small template
Former-commit-id: 9c1bbfac21
2024-09-18 23:52:30 +03:00
hoshi-hiyouga
2d19ba04e3 fix webui
Former-commit-id: f0b930d94a
2024-09-19 02:13:39 +08:00
hoshi-hiyouga
56058e2e84 add qwen2.5 models
Former-commit-id: 92ef62f502
2024-09-19 02:07:54 +08:00
Billy Cao
38e955d4a9 Add qwen_vl to liger kernel supported list
Former-commit-id: 7a2958a44f
2024-09-14 19:28:20 +08:00
hiyouga
d2f8bcb890 set dev version
Former-commit-id: 0ded765784
2024-09-11 18:56:37 +08:00
hiyouga
009500bc6d fix #5411
Former-commit-id: c7e51ff187
2024-09-11 17:36:42 +08:00
BUAADreamer
0be477292b try to past test
Former-commit-id: e387216d49
2024-09-10 13:25:30 +08:00
Zhangchi Feng
4b6606832c Merge branch 'hiyouga:main' into main
Former-commit-id: 4643089a7d
2024-09-10 13:20:24 +08:00
BUAADreamer
16c7326bc5 try to past test
Former-commit-id: 7b4ba0efb6
2024-09-10 13:12:51 +08:00
BUAADreamer
5c53cf3244 resolve confilct
Former-commit-id: 96decf82b8
2024-09-10 12:39:17 +08:00
BUAADreamer
f00f4ae9b6 support llava-next(video)
Former-commit-id: 31259e7e0c
2024-09-10 12:31:53 +08:00
hiyouga
38505ae9e1 update accelerate ver for schedule_free optimizers
Former-commit-id: bdde35fd2e
2024-09-09 22:51:08 +08:00
hiyouga
2bb1ee3292 fix mm plugin
Former-commit-id: 6dc2b00fa2
2024-09-09 22:41:28 +08:00
hiyouga
c52eeb70e7 fix qwen2vl preprocess
Former-commit-id: c93795ae14
2024-09-09 22:33:33 +08:00
hiyouga
3aefdad4ec release v0.9.0 (real)
Former-commit-id: 90d6df6222
2024-09-09 01:00:25 +08:00
hiyouga
561ae4d1af fix constants
Former-commit-id: 653fe70acb
2024-09-08 23:52:30 +08:00
hiyouga
fb9280a0a7 release v0.9.0
Former-commit-id: 54b5c4b819
2024-09-08 23:43:35 +08:00
hiyouga
0229263fbe tiny fix
Former-commit-id: c9b3870adb
2024-09-08 23:18:08 +08:00
hiyouga
dc64166d13 update scripts
Former-commit-id: f2aa02c070
2024-09-08 14:17:41 +08:00
hiyouga
78cf256067 support vllm 0.6.0
Former-commit-id: b6681d7198
2024-09-08 02:26:20 +08:00
hiyouga
f6f58ebef0 fix test case
Former-commit-id: b332908ab4
2024-09-08 01:50:51 +08:00
hiyouga
945841503e add test case
Former-commit-id: 52a06efaf8
2024-09-08 01:40:49 +08:00
hiyouga
0daee7cb39 support activation offloading via unsloth gc
Former-commit-id: fb72a3adb0
2024-09-08 01:22:19 +08:00
hiyouga
7ccb86b215 add docstrings, refactor logger
Former-commit-id: 54c6905937
2024-09-08 00:56:56 +08:00
hoshi-hiyouga
4ee9efbd98 fix #5384
Former-commit-id: 36665f3001
2024-09-07 01:21:14 +08:00
hiyouga
995491594d tiny fix
Former-commit-id: 76f2e59504
2024-09-05 23:41:16 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f
2024-09-05 21:52:28 +08:00
hoshi-hiyouga
de277a8ab8 Merge pull request #5372 from LDLINGLINGLING/main
增加了对minicpm3.0的适配'

Former-commit-id: 1274356263
2024-09-05 21:35:42 +08:00
liudan
1797fe50a4 根据代码规范修改了代码
Former-commit-id: 3d3fbaaff9
2024-09-05 20:17:55 +08:00
hoshi-hiyouga
f6014742fa fix #5366
Former-commit-id: e9bda48c6d
2024-09-05 18:08:09 +08:00
hiyouga
4fccc65579 support Yi-Coder models
Former-commit-id: 359ef8bb0e
2024-09-05 03:12:24 +08:00
hiyouga
666013d09d fix ci
Former-commit-id: 1173f7fc1d
2024-09-05 03:02:59 +08:00
hiyouga
9df7a26e6b video datasets
Former-commit-id: 8cafc7b055
2024-09-05 02:04:17 +08:00
liudan
09cff03026 增加了对minicpm3.0的适配'
Former-commit-id: d7ba97be48
2024-09-04 23:10:05 +08:00
hiyouga
d5ea05cfff update get template
Former-commit-id: dabad5570b
2024-09-04 22:36:20 +08:00
hoshi-hiyouga
1dfd1aaf82 Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset

Former-commit-id: 8f441c2b3a
2024-09-04 22:09:36 +08:00
hoshi-hiyouga
8ac74c8ccb fix #5228
Former-commit-id: 44d6947e55
2024-09-04 19:10:30 +08:00
hiyouga
a3d47818b7 fix #5344
Former-commit-id: d41d43a7c3
2024-09-04 03:06:06 +08:00
hiyouga
22deca0e9e lazy image load
Former-commit-id: 47ea97fb1b
2024-09-04 02:27:08 +08:00