hiyouga
|
0a949bf8aa
|
update data readme
Former-commit-id: 81adb153b7d0b30e6cd50c9bf4ca1ccf17458611
|
2024-09-05 04:25:27 +08:00 |
|
hiyouga
|
bcbec1dec8
|
support Yi-Coder models
Former-commit-id: ea3f1659e70541c4fa8b7079a0a8c94fce9a41c8
|
2024-09-05 03:12:24 +08:00 |
|
hiyouga
|
caae76adcb
|
fix ci
Former-commit-id: 280c0f3f2cea4dfced797cc0e15f72b8b3a93542
|
2024-09-05 03:02:59 +08:00 |
|
hiyouga
|
eb986571db
|
fix ci
Former-commit-id: 7899b44b19c3d0a70706d987bb7d2e0e3536014b
|
2024-09-05 02:49:22 +08:00 |
|
hiyouga
|
35ebeb0b72
|
update ci
Former-commit-id: e24bf7345442701ca874d439f0ca3da49fa59a84
|
2024-09-05 02:26:10 +08:00 |
|
hoshi-hiyouga
|
355daaab5b
|
Merge pull request #5365 from hiyouga/video_finetuning
Support Qwen2-VL Fine-Tuning on Video Datasets
Former-commit-id: 178cc3fbc48bf2c68723b487681db04e660b12fa
|
2024-09-05 02:24:58 +08:00 |
|
hiyouga
|
96635fa2a0
|
tiny fix
Former-commit-id: 9da6e084e1e5daf7403e7fabeaaec686167fb11f
|
2024-09-05 02:16:49 +08:00 |
|
hiyouga
|
d408d5cf32
|
video datasets
Former-commit-id: 33f28ce82d9e44d2615909250dc56d6a4a03cd99
|
2024-09-05 02:04:17 +08:00 |
|
hiyouga
|
0746d75198
|
fix test
Former-commit-id: 553a83aff9f9da35c9a0eca81f7d2b0bf2adf6ff
|
2024-09-04 22:38:26 +08:00 |
|
hiyouga
|
3756553c25
|
update get template
Former-commit-id: 21ea0d0786f91c0bce79630963e66b815a6792a0
|
2024-09-04 22:36:20 +08:00 |
|
hoshi-hiyouga
|
1a76d3e09c
|
Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset
Former-commit-id: c3428c5807500d087cdee4386798e10e39c9cf30
|
2024-09-04 22:09:36 +08:00 |
|
hoshi-hiyouga
|
7f94451034
|
fix #5228
Former-commit-id: 0d332ca8d0987c0331361934ab110fafa6402a7e
|
2024-09-04 19:10:30 +08:00 |
|
hiyouga
|
3abacf1145
|
fix #5252
Former-commit-id: 73f30b4dfffb260e24f9e2332617b8ca2c249ed5
|
2024-09-04 03:17:54 +08:00 |
|
hiyouga
|
13d59aecfb
|
add vl_feedback dataset
Former-commit-id: 6ff34ad2db383b5fbd51008bcc5eec880658811e
|
2024-09-04 03:13:03 +08:00 |
|
hiyouga
|
5cb08a30c2
|
fix #5344
Former-commit-id: 9d445c0b5be5ccc0e6d1979e76a869ddf92d9534
|
2024-09-04 03:06:06 +08:00 |
|
hoshi-hiyouga
|
79dc670256
|
Merge pull request #5346 from hiyouga/lazy_image
[exp] Lazyload for multimodal inputs
Former-commit-id: 4bbd721361a8c5888b28f5fcdcbb2a4ad2305445
|
2024-09-04 03:00:53 +08:00 |
|
hiyouga
|
54d4c3fca7
|
lazy image load
Former-commit-id: cdd733b575411e003bc5ffd6560dd8eff8aa09cf
|
2024-09-04 02:27:08 +08:00 |
|
hiyouga
|
3e0edf29dd
|
fix #5334
Former-commit-id: a5ea0f83f00c81d128a1f50ce244866ce38ee15f
|
2024-09-03 19:09:42 +08:00 |
|
hiyouga
|
bc038bc917
|
fix #5338
Former-commit-id: a66ddfea218feefde50fa097d20b4bcbe89ab791
|
2024-09-03 17:45:17 +08:00 |
|
hiyouga
|
214058ed8a
|
lint
Former-commit-id: d821d933e6cb982d648a69f85f6ad01d0560ed70
|
2024-09-03 00:46:25 +08:00 |
|
hiyouga
|
a1ab66416a
|
fix #5324
Former-commit-id: f7aa06c9c0b18c28419ea5792410915d3f322cbf
|
2024-09-02 23:56:21 +08:00 |
|
naem1023
|
961a1d5ae1
|
feat: add batch size of map function in the preprocessed dataset
Former-commit-id: 94b6cf06c2f84d0619b1a2dccaf8abb51de9951c
|
2024-09-02 13:52:47 +09:00 |
|
hoshi-hiyouga
|
880ba0b062
|
fix trainer predict
Former-commit-id: 2790790cd26c6743105555a60523b89f367ebce3
|
2024-09-02 10:15:29 +08:00 |
|
hoshi-hiyouga
|
def94f7a80
|
remove .cpu()
Former-commit-id: 35c57cc9dcba305d40282a9757ddc23968c210ac
|
2024-09-02 10:10:53 +08:00 |
|
hiyouga
|
c8e51d3cdd
|
fix mm inference
Former-commit-id: fa782c15a07ed40f8a6381acdf2da395377efd04
|
2024-09-02 01:47:40 +08:00 |
|
hiyouga
|
e35f7e3070
|
tiny fix
Former-commit-id: 8b4f408da110d74285bae20bbd969013a979964b
|
2024-09-02 01:33:22 +08:00 |
|
hiyouga
|
4be4033474
|
add image num check
Former-commit-id: 15201113bf16b748c0a758c7a5b363da8272e0e6
|
2024-09-02 01:31:36 +08:00 |
|
hiyouga
|
217d8f7199
|
add pokemon dataset
Former-commit-id: 06680158a0f0a1e3c542e77af92ac877fbe357c5
|
2024-09-02 01:02:25 +08:00 |
|
hiyouga
|
b7041c0a11
|
update readme
Former-commit-id: 25a05d9f96718e06ce83f5bb1f41d2c001790295
|
2024-09-01 23:32:39 +08:00 |
|
hiyouga
|
45daa1418d
|
update wechat
Former-commit-id: 7f88dfe080db10ff12d1fb80b43099a356c899ea
|
2024-09-01 23:30:57 +08:00 |
|
hoshi-hiyouga
|
36c535190e
|
Merge pull request #5317 from ByronHsu/patch-1
Add liger kernel link
Former-commit-id: a319b3cf9119fd49cbcfb17b963e111a2f86bb51
|
2024-09-01 23:30:12 +08:00 |
|
hiyouga
|
04db03bdfd
|
add rlhf-v dataset
Former-commit-id: 3fd18fc34a0c994a738504746abfd5548e002437
|
2024-09-01 22:57:41 +08:00 |
|
hiyouga
|
baf60f10c9
|
tiny fix
Former-commit-id: 8ccaae3871d8d1fe3ea4633d427aecb2ab3addec
|
2024-09-01 21:15:44 +08:00 |
|
hiyouga
|
25c0ce0f88
|
fix bug
Former-commit-id: 6e19e56000dd18d5faf84ceabce8d7708ff21e4d
|
2024-09-01 21:07:49 +08:00 |
|
hiyouga
|
ad6c42ff0a
|
fix mixed mm inputs and rlhf-v
Former-commit-id: 7c248fac20bf85d57a91132ce7a793c7f84e9218
|
2024-09-01 20:52:47 +08:00 |
|
Byron Hsu
|
fe4eaf1961
|
Add liger kernel link
Former-commit-id: 4f313044cf8efd9c6ebcbd4741f6f38d56804b7f
|
2024-08-30 17:16:16 -07:00 |
|
hiyouga
|
1d8e21c285
|
fix ci (temp)
Former-commit-id: 9ebaafd2e5c16ecef0243e4df77344ed7c823e57
|
2024-08-31 02:03:56 +08:00 |
|
hiyouga
|
a73e7e022d
|
add test mm plugin
Former-commit-id: ddea5cca5a3174de1dcc7fdee8ec69e77700b6bf
|
2024-08-31 01:53:38 +08:00 |
|
hiyouga
|
ec2da8b06a
|
remove visual_inputs, fix qlora
Former-commit-id: be30c01c4f1482520ece770bd54c6a4837c26f0a
|
2024-08-31 00:24:51 +08:00 |
|
hiyouga
|
818e0b2cd0
|
optimize predict vram
Former-commit-id: a577e44eee351b3ed8011a33ae01cd713354ff97
|
2024-08-30 23:08:45 +08:00 |
|
hiyouga
|
d16e689db2
|
add examples
Former-commit-id: 169c68921b1b8ac279834b060d9e7d38a56fe1aa
|
2024-08-30 21:43:19 +08:00 |
|
hiyouga
|
f389b6a676
|
tiny fix
Former-commit-id: 830511a6d0216da99520aee8b3a753d347a71fa9
|
2024-08-30 03:21:50 +08:00 |
|
hiyouga
|
b90a5db557
|
fix #5307
Former-commit-id: 63c19ddfe483a16c1c9afc2f1441e8070bb0f7e4
|
2024-08-30 02:45:40 +08:00 |
|
hiyouga
|
228f745235
|
refactor mm training
Former-commit-id: 179c0558699e287cbf38a2d73bff47e86d589c5a
|
2024-08-30 02:14:31 +08:00 |
|
hoshi-hiyouga
|
618e357740
|
Merge pull request #5290 from simonJJJ/qwen2_vl
support qwen2-vl
Former-commit-id: 7156f832af8505b26371559d340c0e69eb962bbc
|
2024-08-30 02:10:36 +08:00 |
|
hoshi-hiyouga
|
0601cd69a9
|
fix bug
Former-commit-id: 365e6df71509569f59c40743c115f1a4b945ef0f
|
2024-08-30 02:05:26 +08:00 |
|
hiyouga
|
4096d52752
|
update liger kernel
Former-commit-id: d6bf6ca2161c99dd5d644e31d2b1df451017b68c
|
2024-08-29 20:46:08 +08:00 |
|
hiyouga
|
8695af8766
|
fix #5292
Former-commit-id: dd81ce8ce5fdf450027c5f9634abb6ac2cd52128
|
2024-08-29 20:37:47 +08:00 |
|
hiyouga
|
6c373064c5
|
fix #5295
Former-commit-id: c76873b0eb8225f6e6bfc7223c6012387dceb8ed
|
2024-08-29 20:30:18 +08:00 |
|
hiyouga
|
a662843458
|
fix #5305
Former-commit-id: a710ebaf97c258c802f24e508d83f1f3f10edc6d
|
2024-08-29 20:16:01 +08:00 |
|