8 Commits

Author SHA1 Message Date
hiyouga
14bc7b0551 fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
2024-07-15 01:04:56 +08:00
codingma
74f0d02eb8 1. add custom eval dataset support
2. merge load dataset and split dataset function


Former-commit-id: 76f3bbcfc0e11aa41f8f5cbebc60b77b987f7901
2024-07-05 15:52:10 +08:00
hiyouga
2946153cea add license
Former-commit-id: d87108daa68bd40174b262be1ca65fe6e1b7ab56
2024-06-15 17:54:33 +08:00
hiyouga
cae823ddf0 rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
2024-05-16 18:39:08 +08:00
hiyouga
23f9efdf7d add cal_ppl script
Former-commit-id: 3a666832c119606a8d5baf4694b96569bee18659
2024-05-04 22:02:25 +08:00
hiyouga
70bf2a2247 update readme
Former-commit-id: 27ba1b63ce22d6fc2198c517141051705b2e77f6
2024-04-26 05:44:30 +08:00
hiyouga
2ecf2bcbf0 fix resize vocab at inference #3022
Former-commit-id: 148bda353f0b53af022c51da9a9e59a56f341510
2024-04-03 18:14:24 +08:00
hiyouga
e887aface7 fix version checking
Former-commit-id: 3016e6565708637c1d760f2cd5a67cbd8a5a6c26
2024-03-06 14:51:51 +08:00