Commit Graph

12 Commits

Author SHA1 Message Date
ancv
b2c367bc61 implement efficient packing without cross-contamination attention 2024-06-12 11:56:01 +07:00
hiyouga
ccc8b64cc2 update data processors 2024-06-07 04:15:40 +08:00
hoshi-hiyouga
181dbb0d05 Merge pull request #4009 from AlongWY/main
supervised packing with greedy knapsack algorithm
2024-06-07 03:48:46 +08:00
hoshi-hiyouga
c09ad8bab3 Update supervised.py 2024-06-07 03:42:08 +08:00
hoshi-hiyouga
788e8232fc Update supervised.py 2024-06-07 03:38:23 +08:00
hoshi-hiyouga
8cecade708 Update supervised.py 2024-06-07 03:38:04 +08:00
hiyouga
74f96efef9 rename files 2024-06-07 00:09:06 +08:00
ylfeng
b47e317447 remove empty line 2024-05-31 21:43:08 +08:00
ylfeng
84aee57901 fix eos 2024-05-31 21:40:41 +08:00
ylfeng
f9db439cb7 supervised packing with greedy knapsack algorithm 2024-05-31 15:33:54 +08:00
hiyouga
5581cb2e4e update readme 2024-05-27 18:14:02 +08:00
hiyouga
3a023bca2a refactor data preprocessing, fix mllm rlhf 2024-05-24 04:08:25 +08:00