hiyouga
|
3cbc9109ea
|
tiny fix
Former-commit-id: 76177039c8f9ef5a63724a339dae6195d89fa215
|
2024-09-08 23:18:08 +08:00 |
|
hiyouga
|
3259397f89
|
update scripts
Former-commit-id: 51d087cbc14bf3c7dfa06b8b66052cd80a6081be
|
2024-09-08 14:17:41 +08:00 |
|
hiyouga
|
eb5af3d90b
|
support vllm 0.6.0
Former-commit-id: e39470ec51a9c74ad901871eb816df10e851f351
|
2024-09-08 02:26:20 +08:00 |
|
hiyouga
|
b6810b209a
|
fix test case
Former-commit-id: b075b2971c6acb2c6039b36420a296f1f4e1b91b
|
2024-09-08 01:50:51 +08:00 |
|
hiyouga
|
158e0e1f63
|
add test case
Former-commit-id: c452d65e1551074dddd1d87517c0d44dc014c6aa
|
2024-09-08 01:40:49 +08:00 |
|
hiyouga
|
294a103ead
|
support activation offloading via unsloth gc
Former-commit-id: d3d0dd0feba3ca6f0ae970d5856bec989d26ef67
|
2024-09-08 01:22:19 +08:00 |
|
hiyouga
|
7f71276ad8
|
add docstrings, refactor logger
Former-commit-id: c34e489d71f8f539028543ccf8ee92cecedd6276
|
2024-09-08 00:56:56 +08:00 |
|
hoshi-hiyouga
|
93d4570a59
|
Merge pull request #5388 from yzoaim/cal_mfu_update
update cal_mfu.py
Former-commit-id: fe5eac2cb6a4646b653232d7c68d535105b60f3a
|
2024-09-08 00:49:28 +08:00 |
|
hoshi-hiyouga
|
527ba2eb2e
|
fix
Former-commit-id: 53a74cbc3afec58b36c2265e080061bcdf702f98
|
2024-09-08 00:41:45 +08:00 |
|
hoshi-hiyouga
|
3021b31cf3
|
Update cal_mfu.py
Former-commit-id: 0c391b2e59943b0ca9dd4e8561398e7c856a4b29
|
2024-09-08 00:39:48 +08:00 |
|
-.-
|
9f2427907e
|
update cal_mfu.py
Former-commit-id: 1cdbb4c774d463969c6be14fb08d92c7a0bdb565
|
2024-09-07 23:21:35 +08:00 |
|
hoshi-hiyouga
|
570ce100c1
|
fix #5384
Former-commit-id: 2e86c54f381f7403c30ba78d2acf5003aab6e049
|
2024-09-07 01:21:14 +08:00 |
|
hiyouga
|
27547355e6
|
tiny fix
Former-commit-id: c0e9c0484dae6db93cef5048bad827ff22b1986a
|
2024-09-05 23:41:16 +08:00 |
|
hiyouga
|
c5ef52a67a
|
fix ci
Former-commit-id: b5ffca5a190f3aed8ba8c49bd8cf3239fb787bf5
|
2024-09-05 22:39:47 +08:00 |
|
hiyouga
|
b48b47d519
|
fix ci
Former-commit-id: cf0758b03e9b8b4931ba790a9726b8256ee4286c
|
2024-09-05 22:27:48 +08:00 |
|
hiyouga
|
9bdba2f6a8
|
add e2e tests
Former-commit-id: 0156a37450604641c4f5f9756ad84324698fc88c
|
2024-09-05 21:52:28 +08:00 |
|
hoshi-hiyouga
|
d6ce902d80
|
Merge pull request #5372 from LDLINGLINGLING/main
增加了对minicpm3.0的适配'
Former-commit-id: 2e3c221d9c87bd59f48648be8878b7b50347280f
|
2024-09-05 21:35:42 +08:00 |
|
liudan
|
ce6dcf3600
|
根据代码规范修改了代码
Former-commit-id: fe5351980b42e0e38175b0da2401a61b3807fa7c
|
2024-09-05 20:17:55 +08:00 |
|
hoshi-hiyouga
|
e7f92d16d8
|
fix #5366
Former-commit-id: b0a4964846dd5be7aa2c54d43f28ba62985587f1
|
2024-09-05 18:08:09 +08:00 |
|
hiyouga
|
abd26f5f67
|
update data readme
Former-commit-id: 0af5f054b7b8da8b39eb44b1dfa76050f0c45667
|
2024-09-05 04:44:49 +08:00 |
|
hiyouga
|
4d35ace75e
|
update data readme
Former-commit-id: 81adb153b7d0b30e6cd50c9bf4ca1ccf17458611
|
2024-09-05 04:25:27 +08:00 |
|
hiyouga
|
72222d1598
|
support Yi-Coder models
Former-commit-id: ea3f1659e70541c4fa8b7079a0a8c94fce9a41c8
|
2024-09-05 03:12:24 +08:00 |
|
hiyouga
|
26d914b8fc
|
fix ci
Former-commit-id: 280c0f3f2cea4dfced797cc0e15f72b8b3a93542
|
2024-09-05 03:02:59 +08:00 |
|
hiyouga
|
7b01c0676c
|
fix ci
Former-commit-id: 7899b44b19c3d0a70706d987bb7d2e0e3536014b
|
2024-09-05 02:49:22 +08:00 |
|
hiyouga
|
571a9b8669
|
update ci
Former-commit-id: e24bf7345442701ca874d439f0ca3da49fa59a84
|
2024-09-05 02:26:10 +08:00 |
|
hoshi-hiyouga
|
ed35eb1e9e
|
Merge pull request #5365 from hiyouga/video_finetuning
Support Qwen2-VL Fine-Tuning on Video Datasets
Former-commit-id: 178cc3fbc48bf2c68723b487681db04e660b12fa
|
2024-09-05 02:24:58 +08:00 |
|
hiyouga
|
d291e0d60d
|
tiny fix
Former-commit-id: 9da6e084e1e5daf7403e7fabeaaec686167fb11f
|
2024-09-05 02:16:49 +08:00 |
|
hiyouga
|
1874d579c5
|
video datasets
Former-commit-id: 33f28ce82d9e44d2615909250dc56d6a4a03cd99
|
2024-09-05 02:04:17 +08:00 |
|
liudan
|
c692339020
|
增加了对minicpm3.0的适配'
Former-commit-id: 4ad3a761af2452ef3f6c61190b7e47c9ea5227b9
|
2024-09-04 23:10:05 +08:00 |
|
hiyouga
|
2c1eef34cb
|
fix test
Former-commit-id: 553a83aff9f9da35c9a0eca81f7d2b0bf2adf6ff
|
2024-09-04 22:38:26 +08:00 |
|
hiyouga
|
af178cbcd1
|
update get template
Former-commit-id: 21ea0d0786f91c0bce79630963e66b815a6792a0
|
2024-09-04 22:36:20 +08:00 |
|
hoshi-hiyouga
|
5d85be31ca
|
Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset
Former-commit-id: c3428c5807500d087cdee4386798e10e39c9cf30
|
2024-09-04 22:09:36 +08:00 |
|
hoshi-hiyouga
|
372b71c847
|
fix #5228
Former-commit-id: 0d332ca8d0987c0331361934ab110fafa6402a7e
|
2024-09-04 19:10:30 +08:00 |
|
hiyouga
|
41a9c415e1
|
fix #5252
Former-commit-id: 73f30b4dfffb260e24f9e2332617b8ca2c249ed5
|
2024-09-04 03:17:54 +08:00 |
|
hiyouga
|
915e32a5f8
|
add vl_feedback dataset
Former-commit-id: 6ff34ad2db383b5fbd51008bcc5eec880658811e
|
2024-09-04 03:13:03 +08:00 |
|
hiyouga
|
f4dd429cbf
|
fix #5344
Former-commit-id: 9d445c0b5be5ccc0e6d1979e76a869ddf92d9534
|
2024-09-04 03:06:06 +08:00 |
|
hoshi-hiyouga
|
7435cde2ef
|
Merge pull request #5346 from hiyouga/lazy_image
[exp] Lazyload for multimodal inputs
Former-commit-id: 4bbd721361a8c5888b28f5fcdcbb2a4ad2305445
|
2024-09-04 03:00:53 +08:00 |
|
hiyouga
|
7056087e92
|
lazy image load
Former-commit-id: cdd733b575411e003bc5ffd6560dd8eff8aa09cf
|
2024-09-04 02:27:08 +08:00 |
|
hiyouga
|
fed7ae5661
|
fix #5334
Former-commit-id: a5ea0f83f00c81d128a1f50ce244866ce38ee15f
|
2024-09-03 19:09:42 +08:00 |
|
hiyouga
|
5019c6148b
|
fix #5338
Former-commit-id: a66ddfea218feefde50fa097d20b4bcbe89ab791
|
2024-09-03 17:45:17 +08:00 |
|
hiyouga
|
2e1396cd6b
|
lint
Former-commit-id: d821d933e6cb982d648a69f85f6ad01d0560ed70
|
2024-09-03 00:46:25 +08:00 |
|
hiyouga
|
b5e9df5df8
|
fix #5324
Former-commit-id: f7aa06c9c0b18c28419ea5792410915d3f322cbf
|
2024-09-02 23:56:21 +08:00 |
|
naem1023
|
3622856994
|
feat: add batch size of map function in the preprocessed dataset
Former-commit-id: 94b6cf06c2f84d0619b1a2dccaf8abb51de9951c
|
2024-09-02 13:52:47 +09:00 |
|
hoshi-hiyouga
|
7367c6ec21
|
fix trainer predict
Former-commit-id: 2790790cd26c6743105555a60523b89f367ebce3
|
2024-09-02 10:15:29 +08:00 |
|
hoshi-hiyouga
|
6579ec8c4c
|
remove .cpu()
Former-commit-id: 35c57cc9dcba305d40282a9757ddc23968c210ac
|
2024-09-02 10:10:53 +08:00 |
|
hiyouga
|
a7fbae47d5
|
fix mm inference
Former-commit-id: fa782c15a07ed40f8a6381acdf2da395377efd04
|
2024-09-02 01:47:40 +08:00 |
|
hiyouga
|
f203a9d78e
|
tiny fix
Former-commit-id: 8b4f408da110d74285bae20bbd969013a979964b
|
2024-09-02 01:33:22 +08:00 |
|
hiyouga
|
bae73e676c
|
add image num check
Former-commit-id: 15201113bf16b748c0a758c7a5b363da8272e0e6
|
2024-09-02 01:31:36 +08:00 |
|
hiyouga
|
806e1061d4
|
add pokemon dataset
Former-commit-id: 06680158a0f0a1e3c542e77af92ac877fbe357c5
|
2024-09-02 01:02:25 +08:00 |
|
hiyouga
|
f920091667
|
update readme
Former-commit-id: 25a05d9f96718e06ce83f5bb1f41d2c001790295
|
2024-09-01 23:32:39 +08:00 |
|