11 Commits

Author	SHA1	Message	Date
simonJJJ	8a09b1e732	initial-commit ... Former-commit-id: aeb85f200bd824748008dae6047c2607dfcdf174	2024-08-28 16:51:35 +08:00
hiyouga	0b26011181	fix gemma2 attention ... Former-commit-id: 2f6af73da28c4f8321b625fd09ddec8bd4977b08	2024-07-13 23:33:45 +08:00
hzhaoy	6d892dbc23	tiny fix ... Former-commit-id: 738df477485de3633049651a9f1d498adf95a3d5	2024-07-04 10:20:28 +08:00
hiyouga	7b3c1f29ff	fix packing for eager/sdpa attn ... Former-commit-id: 6fd6aa4530f81a2ed306eeb2a5167607288b62c6	2024-07-04 01:52:43 +08:00
hiyouga	bfdaadcc40	update packing ... Former-commit-id: cce7083024bed4c7429ddc8288d1c9190fde29f5	2024-07-04 01:10:55 +08:00
hiyouga	ff6fc666c1	update hparams ... Former-commit-id: 575a02a23d9b41d00ca6291d8a40b5bdb3cbeeec	2024-07-03 23:18:58 +08:00
hiyouga	2946153cea	add license ... Former-commit-id: d87108daa68bd40174b262be1ca65fe6e1b7ab56	2024-06-15 17:54:33 +08:00
hiyouga	3e729798df	refactor data preprocessing, fix mllm rlhf ... Former-commit-id: 3a023bca2a502810a436cfba7708df164754ea62	2024-05-24 04:08:25 +08:00
hiyouga	13d7b48efe	improve KTO impl., replace datasets ... Former-commit-id: c450ee87a35ff9235f9b695b0de2e042b2971178	2024-05-18 03:44:56 +08:00
enji.zhou	03956053b8	add kto ... Former-commit-id: db1d5a4f51faae61fe18666057353747b01f5b8d	2024-05-17 13:09:17 +08:00
hiyouga	cae823ddf0	rename package ... Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb	2024-05-16 18:39:08 +08:00