1273 Commits

Author	SHA1	Message	Date
hiyouga	71327ba85a	release v0.8.2	2024-06-19 20:42:09 +08:00
hiyouga	2b596fb55f	fix jinja template	2024-06-19 20:03:50 +08:00
hiyouga	4cff6a4ad5	fix templates	2024-06-19 17:44:05 +08:00
Jonery	5c2ff1b749	Cleaner integration.	2024-06-19 12:29:40 +08:00
hiyouga	6d2bf216ac	fix bug	2024-06-19 03:49:23 +08:00
hiyouga	4f22eae8f4	use prefix to replace force system	2024-06-19 03:39:52 +08:00
hiyouga	cd75b1fe9d	fix tool formatter, allow parallel function #4362	2024-06-19 03:23:51 +08:00
hoshi-hiyouga	c0ca42566c	Merge pull request #4173 from mMrBun/main ... Implemented the tool_formatter and tool_extractor for glm4 and Qwen2 tool_format	2024-06-19 03:18:55 +08:00
hiyouga	a233fbc258	add deepseek coder v2 #4346	2024-06-18 22:53:54 +08:00
hiyouga	4bd77d8563	fix #4357	2024-06-18 22:42:45 +08:00
hiyouga	c96264bc47	fix #4335	2024-06-18 22:08:56 +08:00
Jonery	8f7c78b641	fix typo	2024-06-18 12:39:26 +08:00
Jonery	0f72aac8c9	Support distributed BAdam.	2024-06-18 12:27:47 +08:00
hiyouga	24c160df3d	lint	2024-06-17 22:35:56 +08:00
hiyouga	7857c0990b	update chat engine #4335	2024-06-17 19:07:17 +08:00
Jonery	ea1f3ba5e0	Merge remote-tracking branch 'upstream/main'	2024-06-17 18:44:51 +08:00
Jonery	33b4372778	adapt for badam with ds zero3	2024-06-17 18:18:10 +08:00
hiyouga	e2665e71c7	fix #4326	2024-06-17 18:17:48 +08:00
hoshi-hiyouga	29c1f31baa	Update parser.py	2024-06-16 02:57:00 +08:00
hiyouga	46093b5786	fix tol	2024-06-16 01:38:44 +08:00
hiyouga	8c1046d78a	support pissa	2024-06-16 01:08:12 +08:00
hiyouga	38b6b0f52e	tiny fix	2024-06-16 01:06:41 +08:00
hiyouga	80a9e6bf94	use fixture	2024-06-15 20:06:17 +08:00
hiyouga	1b834f50be	add tests	2024-06-15 19:51:20 +08:00
hiyouga	572d8bbfdd	add minicpm #4227	2024-06-15 17:58:52 +08:00
hiyouga	d87108daa6	add license	2024-06-15 17:54:33 +08:00
hiyouga	d519b4d76d	disable DP	2024-06-15 04:57:19 +08:00
hiyouga	9092f963db	fix #4292	2024-06-15 04:47:13 +08:00
hiyouga	78589cf90c	fix #4295	2024-06-15 04:34:55 +08:00
hiyouga	b27269bd2b	add test cases	2024-06-15 04:05:54 +08:00
hiyouga	c94e6c9411	add quant check in webui export tab	2024-06-13 03:19:18 +08:00
hiyouga	6baafd4eb3	fix #4221	2024-06-13 02:48:21 +08:00
hiyouga	cf9f2d6c42	fix #4209 ... DeepSpeed ZeRO3 has inflight param error when calling model.eval()	2024-06-13 02:25:50 +08:00
hiyouga	2ed8270112	clean code	2024-06-13 01:58:16 +08:00
hoshi-hiyouga	1f23f25226	Merge pull request #4246 from hzhaoy/adapt-vllm-v0.5.0 ... adapt vllm==0.5.0	2024-06-13 01:54:02 +08:00
hiyouga	713fde4259	fix lint	2024-06-13 00:48:44 +08:00
hzhaoy	8fb6366ebe	adapt vllm==0.5.0	2024-06-12 18:29:03 +08:00
hiyouga	577de2fa07	fix #4242	2024-06-12 16:50:11 +08:00
Arthur Kim	d65a3f7cb6	Support vllm==0.5.0	2024-06-12 16:49:12 +09:00
hoshi-hiyouga	9049aab911	Merge pull request #4204 from dignfei/main ... fixbug：llama3在增量预训练时应该使用<|end_of_text|>标识文本的结束	2024-06-11 17:06:10 +08:00
hoshi-hiyouga	0c29233237	Update pretrain.py	2024-06-11 17:02:14 +08:00
hiyouga	cca6f35108	fix deepspeed version	2024-06-11 16:52:36 +08:00
d	6979f3f848	经过大量的增量预训练，进行对比试验，发现这个bug：llama3在预训练时使用的tokenizer.eos_toke是'<|end_of_text|>' ，这里在每条数据后面也得用这个，而不是'<|eot_id|>'，否则很容易导致严重的性能下降	2024-06-11 16:23:40 +08:00
hiyouga	89f2bd8c8c	fix #4198	2024-06-11 15:38:38 +08:00
hiyouga	90e14a960d	tiny fix	2024-06-11 12:48:53 +08:00
hiyouga	3f24337a8a	tiny fix	2024-06-11 01:04:16 +08:00
hiyouga	91e62a098f	set dev version	2024-06-11 00:50:53 +08:00
hiyouga	2b6ebd6b51	release v0.8.1	2024-06-11 00:44:26 +08:00
hiyouga	a793e8456b	fix #4160 ... The split heads should be concatenated in dim=2	2024-06-11 00:37:17 +08:00
hiyouga	0012762b04	update evaluator	2024-06-10 23:56:00 +08:00