159 Commits

Author	SHA1	Message	Date
hiyouga	640372cb66	tiny fix ... Former-commit-id: f7f440986b0ae3b38ea9f2da80789629d4f79ea1	2024-06-16 01:06:41 +08:00
ancv	c5e1dfb3a0	remove some unused params ... Former-commit-id: fef8132c50505a5fb6a246bd024491bd31798a3c	2024-06-15 23:00:55 +07:00
hiyouga	acfae2e677	add license ... Former-commit-id: 69cfc98d7c81756a5ab6bf962240e393e449fef0	2024-06-15 17:54:33 +08:00
hiyouga	344d1192ac	clean code ... Former-commit-id: f54cafd5c7f0383370d1a2f357834a61a97397ce	2024-06-13 01:58:16 +08:00
ancv	4463a5227a	implement efficient packing without cross-contamination attention ... Former-commit-id: a64a5305c0da5ef092d4cc26faf829bb44de65d1	2024-06-12 11:56:01 +07:00
hiyouga	a7233181f2	fix deepspeed version ... Former-commit-id: 938a69bb07d4de7d82928ff01c582032162c1480	2024-06-11 16:52:36 +08:00
hiyouga	8c7943c4de	tiny fix ... Former-commit-id: b5e9711ef375cc323fc083e742cccfc974550416	2024-06-11 01:04:16 +08:00
hiyouga	68df064c1f	fix #4160 ... The split heads should be concatenated in dim=2 Former-commit-id: 4b3f247f270d44df9fe226cfe0dabfb7fcd2deda	2024-06-11 00:37:17 +08:00
hiyouga	0b1f4a34f8	rename files ... Former-commit-id: e1a8431770fc36c0c9ee7fed4abbc3d7fdcc5efd	2024-06-07 00:09:06 +08:00