20 Commits

Author	SHA1	Message	Date
hiyouga	c13ae2df19	upcast logits	2024-07-02 22:32:05 +08:00
hiyouga	c47ab6c072	improve rlhf	2024-07-02 22:23:08 +08:00
hiyouga	4c296001c4	fix ppo callbacks	2024-07-02 17:34:56 +08:00
hiyouga	8baf3b22b0	refactor pissa, improve llamaboard	2024-06-28 01:04:24 +08:00
hiyouga	8d6cd69ac4	fix #4458	2024-06-26 19:52:35 +08:00
hiyouga	095fab58d3	tiny fix about badam	2024-06-25 01:54:53 +08:00
hoshi-hiyouga	d0f953bf5b	Merge pull request #4352 from Ledzy/main ... [Enhancement] Support ZeRO-3 when using BAdam	2024-06-25 01:49:13 +08:00
hiyouga	e507e60638	update readme	2024-06-24 18:22:12 +08:00
Jonery	5c2ff1b749	Cleaner integration.	2024-06-19 12:29:40 +08:00
Jonery	0f72aac8c9	Support distributed BAdam.	2024-06-18 12:27:47 +08:00
hiyouga	38b6b0f52e	tiny fix	2024-06-16 01:06:41 +08:00
hiyouga	d87108daa6	add license	2024-06-15 17:54:33 +08:00
hiyouga	b27269bd2b	add test cases	2024-06-15 04:05:54 +08:00
hiyouga	cf9f2d6c42	fix #4209 ... DeepSpeed ZeRO3 has inflight param error when calling model.eval()	2024-06-13 02:25:50 +08:00
hiyouga	4489d73ac7	fix ppo trainer save zero3 model ... accelerator.get_state_dict(ds_model) should be called at all ranks	2024-06-07 05:14:19 +08:00
hiyouga	2702d7e952	fix ppo in trl 0.8.6	2024-06-07 04:48:29 +08:00
hiyouga	74f96efef9	rename files	2024-06-07 00:09:06 +08:00
hiyouga	76c61905b2	fix ppo+zero3 #3108	2024-06-06 23:30:07 +08:00
hiyouga	65cd8bdbdb	10x generate in ppo w/ zero3 ... https://github.com/huggingface/trl/pull/1483	2024-05-29 00:23:23 +08:00
hiyouga	308edbc426	rename package	2024-05-16 18:39:08 +08:00