16 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
hiyouga	e3aaef7d4a	fix layer norm name in PPO	2023-06-02 17:30:01 +08:00
hiyouga	bd565af370	fix #1	2023-06-02 14:25:00 +08:00
hiyouga	50d9a20f81	alter rewards data type	2023-06-02 14:19:51 +08:00
hiyouga	e6126244c1	fix possibly OOM error	2023-06-01 23:54:44 +08:00
hiyouga	fd709eacff	fix bug at inference	2023-05-31 18:11:53 +08:00
hiyouga	38ca429228	update readme	2023-05-31 16:57:43 +08:00
hiyouga	740a5daf56	support BLOOM models	2023-05-31 16:54:06 +08:00
hiyouga	a72492e649	remove dummy code	2023-05-30 16:28:00 +08:00
hiyouga	6ccdfb4001	update readme	2023-05-29 21:54:01 +08:00
hiyouga	7698f9aa9a	update readme	2023-05-29 21:53:02 +08:00
hiyouga	8ff96509fa	add pre-training script	2023-05-29 21:37:22 +08:00
hiyouga	c0e5df92d6	fix checkpoint loading	2023-05-29 17:43:16 +08:00
hiyouga	ce71cc8b6d	tiny fix	2023-05-29 09:42:29 +08:00
hiyouga	166c837b95	tiny fix	2023-05-28 21:48:33 +08:00
hiyouga	0c9fda01e3	use fp16 model, add logcallback	2023-05-28 21:30:28 +08:00
hiyouga	769c6ab56b	Initial commit	2023-05-28 18:09:04 +08:00