13 Commits

Author	SHA1	Message	Date
hiyouga	6fd6aa4530	fix packing for eager/sdpa attn	2024-07-04 01:52:43 +08:00
hiyouga	64f4337dac	increase pissa_iter for stability	2024-06-28 03:18:54 +08:00
hiyouga	8baf3b22b0	refactor pissa, improve llamaboard	2024-06-28 01:04:24 +08:00
hiyouga	24c160df3d	lint	2024-06-17 22:35:56 +08:00
hiyouga	8c1046d78a	support pissa	2024-06-16 01:08:12 +08:00
hiyouga	d87108daa6	add license	2024-06-15 17:54:33 +08:00
hiyouga	713fde4259	fix lint	2024-06-13 00:48:44 +08:00
hiyouga	cae4737907	lora modules: all by default	2024-06-06 03:53:28 +08:00
hiyouga	08564838bd	fix full/freeze tuning for mllm	2024-05-27 20:37:57 +08:00
hiyouga	cb63b32986	support SimPO #3900	2024-05-26 23:46:33 +08:00
hiyouga	c450ee87a3	improve KTO impl., replace datasets	2024-05-18 03:44:56 +08:00
enji.zhou	db1d5a4f51	add kto	2024-05-17 13:09:17 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00