Commit Graph

171 Commits

Author SHA1 Message Date
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
hiyouga
e90a1199da tiny fix
Former-commit-id: 3af57795dd
2024-10-11 23:51:54 +08:00
huniu20
5a3280ebee bugs fixed
Former-commit-id: 843b5d85e9
2024-10-11 19:56:13 +08:00
huniu20
e8e98bb125 add om_hub_token argument
Former-commit-id: 7b91be33c9
2024-10-10 17:16:46 +08:00
huniu20
132c1f1b0f 1. add model and dataset info to support webui
Former-commit-id: 0f669f221a
2024-10-10 16:46:34 +08:00
huniu20
26e897e861 1. add modelers hub support
Former-commit-id: 24ebe187e3
2024-10-09 17:21:37 +08:00
hiyouga
4464a6ff5b tiny fix
Former-commit-id: 451d271718
2024-10-08 17:48:56 +08:00
hoshi-hiyouga
54e749d1cf Update template.py
Former-commit-id: 02957fc9c3
2024-09-30 16:39:48 +08:00
shing100
b596102bd5 fix chat template Exaone3.0
Former-commit-id: 2964b20eb5
2024-09-30 09:44:21 +09:00
shing100
0a633f8098 add Exaone3.0 template
Former-commit-id: 3a9569647f
2024-09-30 09:18:25 +09:00
BUAADreamer
f1b16236a4 fix template
Former-commit-id: 01ca056965
2024-09-29 22:56:36 +08:00
BUAADreamer
1c69eea995 fix template
Former-commit-id: 96bec6817a
2024-09-29 22:55:45 +08:00
BUAADreamer
b37bb592ec fix constants
Former-commit-id: bec1cb8d55
2024-09-29 22:40:43 +08:00
BUAADreamer
1b71afb277 add more llava-next series template
Former-commit-id: 65a8923f5a
2024-09-29 21:29:29 +08:00
hoshi-hiyouga
ec793d16de Update mm_plugin.py
Former-commit-id: ffaea305fc
2024-09-29 20:54:04 +08:00
hoshi-hiyouga
ce0c73c032 Update mm_plugin.py
Former-commit-id: 0257a67cb2
2024-09-29 20:53:34 +08:00
BUAADreamer
66213043ac tiny fix
Former-commit-id: 7397827aec
2024-09-29 20:38:46 +08:00
BUAADreamer
8ee588248e fix style
Former-commit-id: 6ddea0f3d3
2024-09-29 20:30:57 +08:00
BUAADreamer
1e2ea34419 fix some
Former-commit-id: d5c69400cd
2024-09-29 17:55:40 +08:00
BUAADreamer
615edf937e fix some params of visual regularize
Former-commit-id: 1d09d592d3
2024-09-29 12:38:25 +08:00
BUAADreamer
7ab42cb582 modify some style
Former-commit-id: 1b21793543
2024-09-28 01:07:38 +08:00
BUAADreamer
5aa1e847d9 add llava-next/llava-next-video/video-llava
Former-commit-id: 6642cd501d
2024-09-28 00:57:03 +08:00
Zhangchi Feng
c576b7ca32 Merge branch 'hiyouga:main' into main
Former-commit-id: 900631755b
2024-09-27 18:14:39 +08:00
hiyouga
f30e0a75c4 optionally replace jinja template
Former-commit-id: ba52103ba7
2024-09-25 23:02:02 +08:00
hoshi-hiyouga
1ccc2d198e flat string
Former-commit-id: f230130563
2024-09-19 16:43:42 +08:00
hoshi-hiyouga
e4d26efea9 lint
Former-commit-id: af7f547ecb
2024-09-19 16:21:43 +08:00
hoshi-hiyouga
89138b8ab8 fix bug
Former-commit-id: 98b464d2dd
2024-09-19 16:21:21 +08:00
hoshi-hiyouga
545ca7db99 improve error message
Former-commit-id: 36611d5c09
2024-09-19 16:06:00 +08:00
ybyang
daa1309466 fix: 修复function call数据集如果 function_call 值的为不合法json,异常提示且中断训练。
Former-commit-id: 953e1a0fb2
2024-09-19 15:00:10 +08:00
BUAADreamer
0be477292b try to past test
Former-commit-id: e387216d49
2024-09-10 13:25:30 +08:00
Zhangchi Feng
4b6606832c Merge branch 'hiyouga:main' into main
Former-commit-id: 4643089a7d
2024-09-10 13:20:24 +08:00
BUAADreamer
16c7326bc5 try to past test
Former-commit-id: 7b4ba0efb6
2024-09-10 13:12:51 +08:00
BUAADreamer
f00f4ae9b6 support llava-next(video)
Former-commit-id: 31259e7e0c
2024-09-10 12:31:53 +08:00
hiyouga
38505ae9e1 update accelerate ver for schedule_free optimizers
Former-commit-id: bdde35fd2e
2024-09-09 22:51:08 +08:00
hiyouga
2bb1ee3292 fix mm plugin
Former-commit-id: 6dc2b00fa2
2024-09-09 22:41:28 +08:00
hiyouga
c52eeb70e7 fix qwen2vl preprocess
Former-commit-id: c93795ae14
2024-09-09 22:33:33 +08:00
hiyouga
7ccb86b215 add docstrings, refactor logger
Former-commit-id: 54c6905937
2024-09-08 00:56:56 +08:00
hiyouga
995491594d tiny fix
Former-commit-id: 76f2e59504
2024-09-05 23:41:16 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f
2024-09-05 21:52:28 +08:00
hoshi-hiyouga
de277a8ab8 Merge pull request #5372 from LDLINGLINGLING/main
增加了对minicpm3.0的适配'

Former-commit-id: 1274356263
2024-09-05 21:35:42 +08:00
liudan
1797fe50a4 根据代码规范修改了代码
Former-commit-id: 3d3fbaaff9
2024-09-05 20:17:55 +08:00
hiyouga
4fccc65579 support Yi-Coder models
Former-commit-id: 359ef8bb0e
2024-09-05 03:12:24 +08:00
hiyouga
9df7a26e6b video datasets
Former-commit-id: 8cafc7b055
2024-09-05 02:04:17 +08:00
liudan
09cff03026 增加了对minicpm3.0的适配'
Former-commit-id: d7ba97be48
2024-09-04 23:10:05 +08:00
hiyouga
d5ea05cfff update get template
Former-commit-id: dabad5570b
2024-09-04 22:36:20 +08:00
hoshi-hiyouga
1dfd1aaf82 Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset

Former-commit-id: 8f441c2b3a
2024-09-04 22:09:36 +08:00
hoshi-hiyouga
8ac74c8ccb fix #5228
Former-commit-id: 44d6947e55
2024-09-04 19:10:30 +08:00
hiyouga
a3d47818b7 fix #5344
Former-commit-id: d41d43a7c3
2024-09-04 03:06:06 +08:00
hiyouga
22deca0e9e lazy image load
Former-commit-id: 47ea97fb1b
2024-09-04 02:27:08 +08:00
hiyouga
f837ae8cb5 fix #5338
Former-commit-id: 69d0acacc3
2024-09-03 17:45:17 +08:00