Commit Graph

118 Commits

Author SHA1 Message Date
hiyouga
bfdcc6bacf add rlhf-v dataset
Former-commit-id: 8e49940746
2024-09-01 22:57:41 +08:00
hiyouga
413a206652 fix bug
Former-commit-id: 64cb947c60
2024-09-01 21:07:49 +08:00
hiyouga
cb776752f6 fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3ae
2024-09-01 20:52:47 +08:00
hiyouga
09a2ecebc4 add test mm plugin
Former-commit-id: a2a8c0b92c
2024-08-31 01:53:38 +08:00
hiyouga
92c398166d tiny fix
Former-commit-id: bee1bd43b9
2024-08-30 03:21:50 +08:00
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32
2024-08-30 02:14:31 +08:00
hoshi-hiyouga
5730243179 fix bug
Former-commit-id: a8f22d8895
2024-08-30 02:05:26 +08:00
simonJJJ
d9fd8f26cc update
Former-commit-id: 734e019cc1
2024-08-28 20:22:46 +08:00
simonJJJ
8a09b1e732 initial-commit
Former-commit-id: aeb85f200b
2024-08-28 16:51:35 +08:00
hoshi-hiyouga
a7604a95c1 Merge pull request #5156 from YeQiuO/main
fix Llama-template's system prompt bug

Former-commit-id: 15be296347
2024-08-20 00:09:03 +08:00
hoshi-hiyouga
103132aa99 Update template.py
Former-commit-id: ec72eeca52
2024-08-20 00:03:33 +08:00
hoshi-hiyouga
a921505f59 Update template.py
Former-commit-id: 5f3300ec5d
2024-08-19 23:40:16 +08:00
Huiyu Chen
66a7f4f128 Add SailorLLM template
Former-commit-id: 2502833a77
2024-08-15 15:10:14 +08:00
“Wzw”
3e159a0a83 fix Llama-template's system prompt bug
Former-commit-id: bcbbf45063
2024-08-12 19:22:12 +08:00
hiyouga
b5146facff follow #5115
Former-commit-id: c87023d539
2024-08-09 18:03:00 +08:00
hoshi-hiyouga
397e4daa5d Merge pull request #5115 from YeQiuO/main
fix: `Train on the last turn only` truncate bug
Former-commit-id: 51542cb15f
2024-08-09 17:58:27 +08:00
hoshi-hiyouga
54f57fb354 Update template.py
Former-commit-id: 4f62e1cb24
2024-08-09 16:27:42 +08:00
“Wzw”
13e5fff97a mask_history args verify valid
Former-commit-id: 2fa1e0b2ad
2024-08-08 10:12:01 +08:00
“Wzw”
0bd25c3a6b fix mask_history tiny bug
Former-commit-id: b5ca86cc07
2024-08-08 10:09:33 +08:00
moontidef
733cb9087b fix: fix the deepseekcoder template to avoid repeat problem
Former-commit-id: b82ecbedd0
2024-08-05 23:55:45 +08:00
hoshi-hiyouga
0ac7824822 Merge pull request #4892 from piamo/main
update deepseek template

Former-commit-id: 8a2846cfe1
2024-07-26 11:49:34 +08:00
hiyouga
d63beb7a24 fix #4928
Former-commit-id: 091010492b
2024-07-24 17:00:29 +08:00
hiyouga
8d06679a3f fix flashattn + packing
Former-commit-id: 4135e69406
2024-07-21 17:07:45 +08:00
huangpan.foo
ee4c3f32d1 update deepseek template
Former-commit-id: 44e48e2b82
2024-07-19 15:02:54 +08:00
hiyouga
34f16cc635 follow #4878 fix #4684
Former-commit-id: 779aae83d2
2024-07-18 22:06:12 +08:00
Shiyu Zhang
249adacc4d 仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2
2024-07-18 15:30:25 +08:00
hoshi-hiyouga
2b22a7da48 Merge pull request #4691 from codemayq/feature-suppot-eval-dataset
add eval dataset support

Former-commit-id: 15b399a82f
2024-07-15 01:00:34 +08:00
hoshi-hiyouga
30a3c6e886 Update preprocess.py
Former-commit-id: df52fb05b1
2024-07-15 00:55:36 +08:00
hoshi-hiyouga
eed7cbb453 Update parser.py
Former-commit-id: 84e4047f8a
2024-07-15 00:55:21 +08:00
hoshi-hiyouga
5633c0ab1e Update data_utils.py
Former-commit-id: 97a0e291c7
2024-07-15 00:54:34 +08:00
hoshi-hiyouga
2e9c9471da Update loader.py
Former-commit-id: a5b809516e
2024-07-15 00:50:06 +08:00
hoshi-hiyouga
140b512426 Update parser.py
Former-commit-id: 3d39d74003
2024-07-14 23:04:34 +08:00
hiyouga
0b26011181 fix gemma2 attention
Former-commit-id: 2f6af73da2
2024-07-13 23:33:45 +08:00
hiyouga
3baf1d1f7e fix #4792
Former-commit-id: 6b48308ef9
2024-07-13 22:07:58 +08:00
hiyouga
7fcffb860d add codegeex4, internlm2.5
Former-commit-id: 53b1002fb7
2024-07-06 16:16:47 +08:00
codingma
74f0d02eb8 1. add custom eval dataset support
2. merge load dataset and split dataset function


Former-commit-id: 76f3bbcfc0
2024-07-05 15:52:10 +08:00
hiyouga
8379a39776 fix processors
Former-commit-id: 9f33f1edf5
2024-07-05 08:33:22 +08:00
hiyouga
9aa3403687 fix #4683
Former-commit-id: e43809bced
2024-07-05 00:58:05 +08:00
hzhaoy
6d892dbc23 tiny fix
Former-commit-id: 738df47748
2024-07-04 10:20:28 +08:00
hiyouga
cbb93a2b47 tiny fix
Former-commit-id: 44747cebd2
2024-07-04 03:02:23 +08:00
hiyouga
4987aa32ba fix data map for packing
Former-commit-id: b5d101e1bf
2024-07-04 03:01:31 +08:00
hiyouga
7b3c1f29ff fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530
2024-07-04 01:52:43 +08:00
hoshi-hiyouga
a38ff842d0 Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention

Former-commit-id: 87d9b2d005
2024-07-04 01:18:54 +08:00
hiyouga
bfdaadcc40 update packing
Former-commit-id: cce7083024
2024-07-04 01:10:55 +08:00
hiyouga
ff6fc666c1 update hparams
Former-commit-id: 575a02a23d
2024-07-03 23:18:58 +08:00
hiyouga
cc31014002 improve rlhf
Former-commit-id: c47ab6c072
2024-07-02 22:23:08 +08:00
ancv
7f42932957 move efficient_packing from data_args to model_args
Former-commit-id: e8e13b0942
2024-07-02 18:37:55 +07:00
hoshi-hiyouga
2452f57cd7 Merge branch 'main' into main
Former-commit-id: e8e6af2651
2024-07-01 21:01:09 +08:00
hiyouga
ca7b65439d fix #4402 #4617
Deprecate reserved_label_len arg


Former-commit-id: 1771251ce3
2024-07-01 01:19:27 +08:00
hiyouga
654116c0b1 fix #4556
Former-commit-id: 59e0b4f616
2024-06-26 19:43:16 +08:00