23 Commits

Author	SHA1	Message	Date
hiyouga	ce43386080	tiny fix	2023-06-07 12:08:39 +08:00
hiyouga	909af8f496	add prompt template class	2023-06-07 11:55:25 +08:00
hiyouga	5d021d4ad5	fix inference, add prompt template	2023-06-07 10:52:35 +08:00
hiyouga	13d1f0709c	recover logging	2023-06-06 21:36:37 +08:00
hiyouga	4eb17bcf6c	support distributed quantized training	2023-06-06 17:39:41 +08:00
hiyouga	44298c1235	tiny fix	2023-06-05 15:25:22 +08:00
hiyouga	38b83533a4	tiny fix	2023-06-04 16:35:50 +08:00
hiyouga	eac9921e5c	tiny fix	2023-06-04 12:55:40 +08:00
hiyouga	3b9eee8cd2	support QLoRA	2023-06-04 00:08:56 +08:00
hiyouga	1bd13d7ca1	fix int8 inference	2023-06-03 23:22:05 +08:00
hiyouga	0f69a0c19e	fix int8 inference	2023-06-03 21:17:47 +08:00
hiyouga	de09ee1315	add ziya prompt template	2023-06-03 19:05:51 +08:00
hiyouga	771f454ff1	use low_cpu_mem_usage to speed up loading	2023-06-03 18:19:01 +08:00
hiyouga	dca27b4412	add logits processor	2023-06-03 16:34:54 +08:00
hiyouga	50d9a20f81	alter rewards data type	2023-06-02 14:19:51 +08:00
hiyouga	e6126244c1	fix possibly OOM error	2023-06-01 23:54:44 +08:00
hiyouga	740a5daf56	support BLOOM models	2023-05-31 16:54:06 +08:00
hiyouga	a72492e649	remove dummy code	2023-05-30 16:28:00 +08:00
hiyouga	8ff96509fa	add pre-training script	2023-05-29 21:37:22 +08:00
hiyouga	c0e5df92d6	fix checkpoint loading	2023-05-29 17:43:16 +08:00
hiyouga	ce71cc8b6d	tiny fix	2023-05-29 09:42:29 +08:00
hiyouga	0c9fda01e3	use fp16 model, add logcallback	2023-05-28 21:30:28 +08:00
hiyouga	769c6ab56b	Initial commit	2023-05-28 18:09:04 +08:00