hoshi-hiyouga
|
de277a8ab8
|
Merge pull request #5372 from LDLINGLINGLING/main
增加了对minicpm3.0的适配'
Former-commit-id: 1274356263
|
2024-09-05 21:35:42 +08:00 |
|
liudan
|
1797fe50a4
|
根据代码规范修改了代码
Former-commit-id: 3d3fbaaff9
|
2024-09-05 20:17:55 +08:00 |
|
hiyouga
|
4fccc65579
|
support Yi-Coder models
Former-commit-id: 359ef8bb0e
|
2024-09-05 03:12:24 +08:00 |
|
hiyouga
|
9df7a26e6b
|
video datasets
Former-commit-id: 8cafc7b055
|
2024-09-05 02:04:17 +08:00 |
|
liudan
|
09cff03026
|
增加了对minicpm3.0的适配'
Former-commit-id: d7ba97be48
|
2024-09-04 23:10:05 +08:00 |
|
hiyouga
|
d5ea05cfff
|
update get template
Former-commit-id: dabad5570b
|
2024-09-04 22:36:20 +08:00 |
|
hoshi-hiyouga
|
1dfd1aaf82
|
Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset
Former-commit-id: 8f441c2b3a
|
2024-09-04 22:09:36 +08:00 |
|
hoshi-hiyouga
|
8ac74c8ccb
|
fix #5228
Former-commit-id: 44d6947e55
|
2024-09-04 19:10:30 +08:00 |
|
hiyouga
|
a3d47818b7
|
fix #5344
Former-commit-id: d41d43a7c3
|
2024-09-04 03:06:06 +08:00 |
|
hiyouga
|
22deca0e9e
|
lazy image load
Former-commit-id: 47ea97fb1b
|
2024-09-04 02:27:08 +08:00 |
|
hiyouga
|
f837ae8cb5
|
fix #5338
Former-commit-id: 69d0acacc3
|
2024-09-03 17:45:17 +08:00 |
|
naem1023
|
46695e42cc
|
feat: add batch size of map function in the preprocessed dataset
Former-commit-id: 209313eeea
|
2024-09-02 13:52:47 +09:00 |
|
hiyouga
|
f13e974930
|
tiny fix
Former-commit-id: 3a6f19f017
|
2024-09-02 01:33:22 +08:00 |
|
hiyouga
|
859823eb23
|
add image num check
Former-commit-id: ce8c5a2647
|
2024-09-02 01:31:36 +08:00 |
|
hiyouga
|
bfdcc6bacf
|
add rlhf-v dataset
Former-commit-id: 8e49940746
|
2024-09-01 22:57:41 +08:00 |
|
hiyouga
|
413a206652
|
fix bug
Former-commit-id: 64cb947c60
|
2024-09-01 21:07:49 +08:00 |
|
hiyouga
|
cb776752f6
|
fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3ae
|
2024-09-01 20:52:47 +08:00 |
|
hiyouga
|
09a2ecebc4
|
add test mm plugin
Former-commit-id: a2a8c0b92c
|
2024-08-31 01:53:38 +08:00 |
|
hiyouga
|
92c398166d
|
tiny fix
Former-commit-id: bee1bd43b9
|
2024-08-30 03:21:50 +08:00 |
|
hiyouga
|
a83756b5e9
|
refactor mm training
Former-commit-id: 3382317e32
|
2024-08-30 02:14:31 +08:00 |
|
hoshi-hiyouga
|
5730243179
|
fix bug
Former-commit-id: a8f22d8895
|
2024-08-30 02:05:26 +08:00 |
|
simonJJJ
|
d9fd8f26cc
|
update
Former-commit-id: 734e019cc1
|
2024-08-28 20:22:46 +08:00 |
|
simonJJJ
|
8a09b1e732
|
initial-commit
Former-commit-id: aeb85f200b
|
2024-08-28 16:51:35 +08:00 |
|
hoshi-hiyouga
|
a7604a95c1
|
Merge pull request #5156 from YeQiuO/main
fix Llama-template's system prompt bug
Former-commit-id: 15be296347
|
2024-08-20 00:09:03 +08:00 |
|
hoshi-hiyouga
|
103132aa99
|
Update template.py
Former-commit-id: ec72eeca52
|
2024-08-20 00:03:33 +08:00 |
|
hoshi-hiyouga
|
a921505f59
|
Update template.py
Former-commit-id: 5f3300ec5d
|
2024-08-19 23:40:16 +08:00 |
|
Huiyu Chen
|
66a7f4f128
|
Add SailorLLM template
Former-commit-id: 2502833a77
|
2024-08-15 15:10:14 +08:00 |
|
“Wzw”
|
3e159a0a83
|
fix Llama-template's system prompt bug
Former-commit-id: bcbbf45063
|
2024-08-12 19:22:12 +08:00 |
|
hiyouga
|
b5146facff
|
follow #5115
Former-commit-id: c87023d539
|
2024-08-09 18:03:00 +08:00 |
|
hoshi-hiyouga
|
397e4daa5d
|
Merge pull request #5115 from YeQiuO/main
fix: `Train on the last turn only` truncate bug
Former-commit-id: 51542cb15f
|
2024-08-09 17:58:27 +08:00 |
|
hoshi-hiyouga
|
54f57fb354
|
Update template.py
Former-commit-id: 4f62e1cb24
|
2024-08-09 16:27:42 +08:00 |
|
“Wzw”
|
13e5fff97a
|
mask_history args verify valid
Former-commit-id: 2fa1e0b2ad
|
2024-08-08 10:12:01 +08:00 |
|
“Wzw”
|
0bd25c3a6b
|
fix mask_history tiny bug
Former-commit-id: b5ca86cc07
|
2024-08-08 10:09:33 +08:00 |
|
moontidef
|
733cb9087b
|
fix: fix the deepseekcoder template to avoid repeat problem
Former-commit-id: b82ecbedd0
|
2024-08-05 23:55:45 +08:00 |
|
hoshi-hiyouga
|
0ac7824822
|
Merge pull request #4892 from piamo/main
update deepseek template
Former-commit-id: 8a2846cfe1
|
2024-07-26 11:49:34 +08:00 |
|
hiyouga
|
d63beb7a24
|
fix #4928
Former-commit-id: 091010492b
|
2024-07-24 17:00:29 +08:00 |
|
hiyouga
|
8d06679a3f
|
fix flashattn + packing
Former-commit-id: 4135e69406
|
2024-07-21 17:07:45 +08:00 |
|
huangpan.foo
|
ee4c3f32d1
|
update deepseek template
Former-commit-id: 44e48e2b82
|
2024-07-19 15:02:54 +08:00 |
|
hiyouga
|
34f16cc635
|
follow #4878 fix #4684
Former-commit-id: 779aae83d2
|
2024-07-18 22:06:12 +08:00 |
|
Shiyu Zhang
|
249adacc4d
|
仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2
|
2024-07-18 15:30:25 +08:00 |
|
hoshi-hiyouga
|
2b22a7da48
|
Merge pull request #4691 from codemayq/feature-suppot-eval-dataset
add eval dataset support
Former-commit-id: 15b399a82f
|
2024-07-15 01:00:34 +08:00 |
|
hoshi-hiyouga
|
30a3c6e886
|
Update preprocess.py
Former-commit-id: df52fb05b1
|
2024-07-15 00:55:36 +08:00 |
|
hoshi-hiyouga
|
eed7cbb453
|
Update parser.py
Former-commit-id: 84e4047f8a
|
2024-07-15 00:55:21 +08:00 |
|
hoshi-hiyouga
|
5633c0ab1e
|
Update data_utils.py
Former-commit-id: 97a0e291c7
|
2024-07-15 00:54:34 +08:00 |
|
hoshi-hiyouga
|
2e9c9471da
|
Update loader.py
Former-commit-id: a5b809516e
|
2024-07-15 00:50:06 +08:00 |
|
hoshi-hiyouga
|
140b512426
|
Update parser.py
Former-commit-id: 3d39d74003
|
2024-07-14 23:04:34 +08:00 |
|
hiyouga
|
0b26011181
|
fix gemma2 attention
Former-commit-id: 2f6af73da2
|
2024-07-13 23:33:45 +08:00 |
|
hiyouga
|
3baf1d1f7e
|
fix #4792
Former-commit-id: 6b48308ef9
|
2024-07-13 22:07:58 +08:00 |
|
hiyouga
|
7fcffb860d
|
add codegeex4, internlm2.5
Former-commit-id: 53b1002fb7
|
2024-07-06 16:16:47 +08:00 |
|
codingma
|
74f0d02eb8
|
1. add custom eval dataset support
2. merge load dataset and split dataset function
Former-commit-id: 76f3bbcfc0
|
2024-07-05 15:52:10 +08:00 |
|