hiyouga
|
7ccb86b215
|
add docstrings, refactor logger
Former-commit-id: 54c69059379d77dc9046c144cbe2d0253de3a4da
|
2024-09-08 00:56:56 +08:00 |
|
hiyouga
|
d5ea05cfff
|
update get template
Former-commit-id: dabad5570bf4a6b1044c963d8f27717030f373ef
|
2024-09-04 22:36:20 +08:00 |
|
hoshi-hiyouga
|
1dfd1aaf82
|
Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset
Former-commit-id: 8f441c2b3a5bb84dec2c037a541084c0201726c6
|
2024-09-04 22:09:36 +08:00 |
|
hoshi-hiyouga
|
8ac74c8ccb
|
fix #5228
Former-commit-id: 44d6947e554cd61cff23c297248fff32a5f554da
|
2024-09-04 19:10:30 +08:00 |
|
hiyouga
|
22deca0e9e
|
lazy image load
Former-commit-id: 47ea97fb1ba77de2e8a561904aa8fdc27c3f5025
|
2024-09-04 02:27:08 +08:00 |
|
naem1023
|
46695e42cc
|
feat: add batch size of map function in the preprocessed dataset
Former-commit-id: 209313eeeab8d1a7c320bd9aa90a5f4656082b7c
|
2024-09-02 13:52:47 +09:00 |
|
hiyouga
|
b5146facff
|
follow #5115
Former-commit-id: c87023d539875cd8e622d40212a5627c9c182fb8
|
2024-08-09 18:03:00 +08:00 |
|
“Wzw”
|
13e5fff97a
|
mask_history args verify valid
Former-commit-id: 2fa1e0b2add60142c178e5e21ebaad7132fa5b00
|
2024-08-08 10:12:01 +08:00 |
|
hoshi-hiyouga
|
2e9c9471da
|
Update loader.py
Former-commit-id: a5b809516e7de1d6d5f4583089fee3028d0db01d
|
2024-07-15 00:50:06 +08:00 |
|
codingma
|
74f0d02eb8
|
1. add custom eval dataset support
2. merge load dataset and split dataset function
Former-commit-id: 76f3bbcfc0e11aa41f8f5cbebc60b77b987f7901
|
2024-07-05 15:52:10 +08:00 |
|
hoshi-hiyouga
|
673f27a59e
|
Update loader.py
Former-commit-id: dddfd516ee66e9937e21f05300832aab45034b12
|
2024-06-24 23:06:18 +08:00 |
|
hiyouga
|
2946153cea
|
add license
Former-commit-id: d87108daa68bd40174b262be1ca65fe6e1b7ab56
|
2024-06-15 17:54:33 +08:00 |
|
hiyouga
|
8fccaf20c5
|
fix #4221
Former-commit-id: 6baafd4eb3147ad9f7d2952b8eb27c5486940f36
|
2024-06-13 02:48:21 +08:00 |
|
hiyouga
|
8da149ba40
|
rename files
Former-commit-id: 74f96efef9bcd63f65d0190c901ff9be54ccd350
|
2024-06-07 00:09:06 +08:00 |
|
hiyouga
|
e0aadd4b34
|
fix ppo dataset bug #4012
Former-commit-id: 149610c636bbb974e546d13fa302884ea65a6d38
|
2024-06-06 19:03:20 +08:00 |
|
hiyouga
|
0eff6a66d5
|
tiny fix
Former-commit-id: 5a13b3baa63225e7f79e024610722de0f87e0acc
|
2024-06-04 00:31:10 +08:00 |
|
hiyouga
|
8ecf606230
|
fix #3992
Former-commit-id: a18acf2abe28e37233bf8c8ed2600618ea3b62e9
|
2024-06-04 00:17:36 +08:00 |
|
hiyouga
|
64d24842fe
|
fix data loader hint
Former-commit-id: 49b1e88e3da3be0fb78f53e5f924a9be67568a02
|
2024-06-03 18:28:27 +08:00 |
|
hoshi-hiyouga
|
7b83c550ab
|
Update loader.py
Former-commit-id: ca5dd7c6c115a359e4b50e93f4ffcc9f2955ec2f
|
2024-05-30 00:20:20 +08:00 |
|
hoshi-hiyouga
|
9fc713da89
|
Update loader.py
Former-commit-id: f9a88b89ca8b8f9a0c5def03b154f9d67f558edf
|
2024-05-30 00:17:21 +08:00 |
|
hoshi-hiyouga
|
c0f11a280e
|
Update loader.py
Former-commit-id: b55fb611c57be03fb38218c7da1d96f6848496ba
|
2024-05-30 00:12:12 +08:00 |
|
seanzhang-zhichen
|
9c8d79fbe3
|
Merge branch 'main' into add_dataset_sample_num
Former-commit-id: 27cb51f7f86f97ae231abfdcb0114ff245d7af9c
|
2024-05-24 15:57:47 +08:00 |
|
hiyouga
|
3e729798df
|
refactor data preprocessing, fix mllm rlhf
Former-commit-id: 3a023bca2a502810a436cfba7708df164754ea62
|
2024-05-24 04:08:25 +08:00 |
|
zhangzc
|
4b90f04c1f
|
fix conflict
Former-commit-id: d956041640d9abc5e59919a227d27270fb513a7e
|
2024-05-20 17:10:01 +08:00 |
|
hiyouga
|
13d7b48efe
|
improve KTO impl., replace datasets
Former-commit-id: c450ee87a35ff9235f9b695b0de2e042b2971178
|
2024-05-18 03:44:56 +08:00 |
|
enji.zhou
|
03956053b8
|
add kto
Former-commit-id: db1d5a4f51faae61fe18666057353747b01f5b8d
|
2024-05-17 13:09:17 +08:00 |
|
hiyouga
|
cae823ddf0
|
rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
|
2024-05-16 18:39:08 +08:00 |
|