hoshi-hiyouga
|
a01668bbe8
|
fix bug
Former-commit-id: b6d0ee1fd8b555bc6aac8b8686c9a3eea784c3a8
|
2024-09-19 16:21:21 +08:00 |
|
hoshi-hiyouga
|
3385616a37
|
improve error message
Former-commit-id: e7735dd487ae4e31c34dcd8e2ea9af0a39d1cf9e
|
2024-09-19 16:06:00 +08:00 |
|
ybyang
|
1f0d89328d
|
fix: 修复function call数据集如果 function_call 值的为不合法json，异常提示且中断训练。
Former-commit-id: 625a0cd7cb5725a0f76c8c19cd23d6c0275bd146
|
2024-09-19 15:00:10 +08:00 |
|
hoshi-hiyouga
|
ae6ad55758
|
fix webui
Former-commit-id: aa6e65b24451fe9f65d58e5eca5a56eb9aba71e8
|
2024-09-19 02:13:39 +08:00 |
|
hoshi-hiyouga
|
0118a2fc04
|
add qwen2.5 models
Former-commit-id: 408a7d7b2e1a2316cbeefade872b732c88191b75
|
2024-09-19 02:07:54 +08:00 |
|
Billy Cao
|
2b4da8baf6
|
Add qwen_vl to liger kernel supported list
Former-commit-id: 053b2d832450cb6cd6af673b9fc51404f1fb1e41
|
2024-09-14 19:28:20 +08:00 |
|
hiyouga
|
f7e85cd7de
|
set dev version
Former-commit-id: 39edf597f050bcb2099a10d6f6018f96e29b7e65
|
2024-09-11 18:56:37 +08:00 |
|
hiyouga
|
7fd0d2fc2f
|
fix #5411
Former-commit-id: 392bdaf1ea9e5baf6289f2d4415a175dd55a479d
|
2024-09-11 17:36:42 +08:00 |
|
hiyouga
|
588ea95732
|
update accelerate ver for schedule_free optimizers
Former-commit-id: 2de74e79049ce8e50f605f649275b1dbfb899c8c
|
2024-09-09 22:51:08 +08:00 |
|
hiyouga
|
800567cde7
|
fix mm plugin
Former-commit-id: 6a3549c6c1a8c40de61e748f0b280bfc9e1279a2
|
2024-09-09 22:41:28 +08:00 |
|
hiyouga
|
7a3ba5a25d
|
fix qwen2vl preprocess
Former-commit-id: 52ddd42b7d2ae9e1aa08c15fd5c13ddad96f1b74
|
2024-09-09 22:33:33 +08:00 |
|
hiyouga
|
dfff411e1a
|
release v0.9.0 (real)
Former-commit-id: 8ff781c8ae5654680f738f69a6db9d7b95d76baf
|
2024-09-09 01:00:25 +08:00 |
|
hiyouga
|
e20baa4218
|
fix constants
Former-commit-id: fce6671d2764d7a2b77c44401fc5582c7cbb77aa
|
2024-09-08 23:52:30 +08:00 |
|
hiyouga
|
d1ab9b501a
|
release v0.9.0
Former-commit-id: 594c450f648ad326ef39c0f4d70d67cda5f36159
|
2024-09-08 23:43:35 +08:00 |
|
hiyouga
|
3cbc9109ea
|
tiny fix
Former-commit-id: 76177039c8f9ef5a63724a339dae6195d89fa215
|
2024-09-08 23:18:08 +08:00 |
|
hiyouga
|
3259397f89
|
update scripts
Former-commit-id: 51d087cbc14bf3c7dfa06b8b66052cd80a6081be
|
2024-09-08 14:17:41 +08:00 |
|
hiyouga
|
eb5af3d90b
|
support vllm 0.6.0
Former-commit-id: e39470ec51a9c74ad901871eb816df10e851f351
|
2024-09-08 02:26:20 +08:00 |
|
hiyouga
|
b6810b209a
|
fix test case
Former-commit-id: b075b2971c6acb2c6039b36420a296f1f4e1b91b
|
2024-09-08 01:50:51 +08:00 |
|
hiyouga
|
158e0e1f63
|
add test case
Former-commit-id: c452d65e1551074dddd1d87517c0d44dc014c6aa
|
2024-09-08 01:40:49 +08:00 |
|
hiyouga
|
294a103ead
|
support activation offloading via unsloth gc
Former-commit-id: d3d0dd0feba3ca6f0ae970d5856bec989d26ef67
|
2024-09-08 01:22:19 +08:00 |
|
hiyouga
|
7f71276ad8
|
add docstrings, refactor logger
Former-commit-id: c34e489d71f8f539028543ccf8ee92cecedd6276
|
2024-09-08 00:56:56 +08:00 |
|
hoshi-hiyouga
|
570ce100c1
|
fix #5384
Former-commit-id: 2e86c54f381f7403c30ba78d2acf5003aab6e049
|
2024-09-07 01:21:14 +08:00 |
|
hiyouga
|
27547355e6
|
tiny fix
Former-commit-id: c0e9c0484dae6db93cef5048bad827ff22b1986a
|
2024-09-05 23:41:16 +08:00 |
|
hiyouga
|
9bdba2f6a8
|
add e2e tests
Former-commit-id: 0156a37450604641c4f5f9756ad84324698fc88c
|
2024-09-05 21:52:28 +08:00 |
|
hoshi-hiyouga
|
d6ce902d80
|
Merge pull request #5372 from LDLINGLINGLING/main
增加了对minicpm3.0的适配'
Former-commit-id: 2e3c221d9c87bd59f48648be8878b7b50347280f
|
2024-09-05 21:35:42 +08:00 |
|
liudan
|
ce6dcf3600
|
根据代码规范修改了代码
Former-commit-id: fe5351980b42e0e38175b0da2401a61b3807fa7c
|
2024-09-05 20:17:55 +08:00 |
|
hoshi-hiyouga
|
e7f92d16d8
|
fix #5366
Former-commit-id: b0a4964846dd5be7aa2c54d43f28ba62985587f1
|
2024-09-05 18:08:09 +08:00 |
|
hiyouga
|
72222d1598
|
support Yi-Coder models
Former-commit-id: ea3f1659e70541c4fa8b7079a0a8c94fce9a41c8
|
2024-09-05 03:12:24 +08:00 |
|
hiyouga
|
26d914b8fc
|
fix ci
Former-commit-id: 280c0f3f2cea4dfced797cc0e15f72b8b3a93542
|
2024-09-05 03:02:59 +08:00 |
|
hiyouga
|
1874d579c5
|
video datasets
Former-commit-id: 33f28ce82d9e44d2615909250dc56d6a4a03cd99
|
2024-09-05 02:04:17 +08:00 |
|
liudan
|
c692339020
|
增加了对minicpm3.0的适配'
Former-commit-id: 4ad3a761af2452ef3f6c61190b7e47c9ea5227b9
|
2024-09-04 23:10:05 +08:00 |
|
hiyouga
|
af178cbcd1
|
update get template
Former-commit-id: 21ea0d0786f91c0bce79630963e66b815a6792a0
|
2024-09-04 22:36:20 +08:00 |
|
hoshi-hiyouga
|
5d85be31ca
|
Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset
Former-commit-id: c3428c5807500d087cdee4386798e10e39c9cf30
|
2024-09-04 22:09:36 +08:00 |
|
hoshi-hiyouga
|
372b71c847
|
fix #5228
Former-commit-id: 0d332ca8d0987c0331361934ab110fafa6402a7e
|
2024-09-04 19:10:30 +08:00 |
|
hiyouga
|
f4dd429cbf
|
fix #5344
Former-commit-id: 9d445c0b5be5ccc0e6d1979e76a869ddf92d9534
|
2024-09-04 03:06:06 +08:00 |
|
hiyouga
|
7056087e92
|
lazy image load
Former-commit-id: cdd733b575411e003bc5ffd6560dd8eff8aa09cf
|
2024-09-04 02:27:08 +08:00 |
|
hiyouga
|
fed7ae5661
|
fix #5334
Former-commit-id: a5ea0f83f00c81d128a1f50ce244866ce38ee15f
|
2024-09-03 19:09:42 +08:00 |
|
hiyouga
|
5019c6148b
|
fix #5338
Former-commit-id: a66ddfea218feefde50fa097d20b4bcbe89ab791
|
2024-09-03 17:45:17 +08:00 |
|
hiyouga
|
2e1396cd6b
|
lint
Former-commit-id: d821d933e6cb982d648a69f85f6ad01d0560ed70
|
2024-09-03 00:46:25 +08:00 |
|
hiyouga
|
b5e9df5df8
|
fix #5324
Former-commit-id: f7aa06c9c0b18c28419ea5792410915d3f322cbf
|
2024-09-02 23:56:21 +08:00 |
|
naem1023
|
3622856994
|
feat: add batch size of map function in the preprocessed dataset
Former-commit-id: 94b6cf06c2f84d0619b1a2dccaf8abb51de9951c
|
2024-09-02 13:52:47 +09:00 |
|
hoshi-hiyouga
|
7367c6ec21
|
fix trainer predict
Former-commit-id: 2790790cd26c6743105555a60523b89f367ebce3
|
2024-09-02 10:15:29 +08:00 |
|
hoshi-hiyouga
|
6579ec8c4c
|
remove .cpu()
Former-commit-id: 35c57cc9dcba305d40282a9757ddc23968c210ac
|
2024-09-02 10:10:53 +08:00 |
|
hiyouga
|
a7fbae47d5
|
fix mm inference
Former-commit-id: fa782c15a07ed40f8a6381acdf2da395377efd04
|
2024-09-02 01:47:40 +08:00 |
|
hiyouga
|
f203a9d78e
|
tiny fix
Former-commit-id: 8b4f408da110d74285bae20bbd969013a979964b
|
2024-09-02 01:33:22 +08:00 |
|
hiyouga
|
bae73e676c
|
add image num check
Former-commit-id: 15201113bf16b748c0a758c7a5b363da8272e0e6
|
2024-09-02 01:31:36 +08:00 |
|
hiyouga
|
60cf12727b
|
add rlhf-v dataset
Former-commit-id: 3fd18fc34a0c994a738504746abfd5548e002437
|
2024-09-01 22:57:41 +08:00 |
|
hiyouga
|
7621526d22
|
tiny fix
Former-commit-id: 8ccaae3871d8d1fe3ea4633d427aecb2ab3addec
|
2024-09-01 21:15:44 +08:00 |
|
hiyouga
|
559b84dceb
|
fix bug
Former-commit-id: 6e19e56000dd18d5faf84ceabce8d7708ff21e4d
|
2024-09-01 21:07:49 +08:00 |
|
hiyouga
|
7e4c5d4bb3
|
fix mixed mm inputs and rlhf-v
Former-commit-id: 7c248fac20bf85d57a91132ce7a793c7f84e9218
|
2024-09-01 20:52:47 +08:00 |
|