hoshi-hiyouga 302e4e22bf Merge pull request #6078 from wtmlon/support-efficient-tokens-calculation
support effective tokens calculation on sft/dpo

Former-commit-id: bd639a137e6f46e1a0005cc91572f5f1ec894f74
2024-11-20 13:43:15 +08:00
..
2024-06-15 17:54:33 +08:00
2024-11-16 16:11:16 +08:00
2024-11-19 20:33:18 +08:00