488 Commits

Author	SHA1	Message	Date
hiyouga	93f2e35035	tiny fix ... Former-commit-id: ce43386080	2023-06-07 12:08:39 +08:00
hiyouga	ce08b4a7ec	add prompt template class ... Former-commit-id: 909af8f496	2023-06-07 11:55:25 +08:00
hiyouga	4cd43f018b	fix inference, add prompt template ... Former-commit-id: 5d021d4ad5	2023-06-07 10:52:35 +08:00
hiyouga	8849bee763	recover logging ... Former-commit-id: 13d1f0709c	2023-06-06 21:36:37 +08:00
hiyouga	794c2fd506	support distributed quantized training ... Former-commit-id: 4eb17bcf6c	2023-06-06 17:39:41 +08:00
hiyouga	1a49937351	add API demo from #1 ... Former-commit-id: 3d8d5ee5d5	2023-06-05 21:32:18 +08:00
hoshi-hiyouga	2c34b7f858	Merge pull request #11 from hiyouga/api ... Api Former-commit-id: 06e1b120e1	2023-06-05 20:58:02 +08:00
hiyouga	dc4d9e514e	fix bug in web demo ... Former-commit-id: a38d57ddd7	2023-06-05 17:58:29 +08:00
hiyouga	666fe30708	increase max length in cli demo ... Former-commit-id: 56eb99106a	2023-06-05 16:49:14 +08:00
hiyouga	e92ac44cd2	implement stream generating ... Former-commit-id: fe1d930816	2023-06-05 16:43:44 +08:00
hiyouga	e94cf814ff	tiny fix ... Former-commit-id: 44298c1235	2023-06-05 15:25:22 +08:00
hiyouga	b982a9df83	tiny fix ... Former-commit-id: 38b83533a4	2023-06-04 16:35:50 +08:00
hiyouga	95a6f1759b	tiny fix ... Former-commit-id: eac9921e5c	2023-06-04 12:55:40 +08:00
hiyouga	4d4636c48e	support QLoRA ... Former-commit-id: 3b9eee8cd2	2023-06-04 00:08:56 +08:00
hiyouga	08d6079140	fix int8 inference ... Former-commit-id: 1bd13d7ca1	2023-06-03 23:22:05 +08:00
hiyouga	3bf4b20d0b	reduce repetition penalty ... Former-commit-id: 926291940d	2023-06-03 21:57:39 +08:00
hiyouga	4200d5d558	fix int8 inference ... Former-commit-id: 0f69a0c19e	2023-06-03 21:17:47 +08:00
hiyouga	342ee89d28	add ziya prompt template ... Former-commit-id: de09ee1315	2023-06-03 19:05:51 +08:00
hiyouga	c7d71dd8af	use low_cpu_mem_usage to speed up loading ... Former-commit-id: 771f454ff1	2023-06-03 18:19:01 +08:00
hiyouga	42c9c8de39	add logits processor ... Former-commit-id: dca27b4412	2023-06-03 16:34:54 +08:00
hiyouga	1392242958	remove unused code ... Former-commit-id: ed6161fa6a	2023-06-03 00:10:54 +08:00
hiyouga	36790c4e32	tiny fix ... Former-commit-id: b8a034807e	2023-06-02 19:02:25 +08:00
hiyouga	6ab22a0181	fix layer norm name in PPO ... Former-commit-id: e3aaef7d4a	2023-06-02 17:30:01 +08:00
hiyouga	b0e9a673be	fix #1 ... Former-commit-id: bd565af370	2023-06-02 14:25:00 +08:00
hiyouga	4003ddcc3b	alter rewards data type ... Former-commit-id: 50d9a20f81	2023-06-02 14:19:51 +08:00
hiyouga	7e1be4c21a	fix possibly OOM error ... Former-commit-id: e6126244c1	2023-06-01 23:54:44 +08:00
hiyouga	3f3b475412	fix bug at inference ... Former-commit-id: fd709eacff	2023-05-31 18:11:53 +08:00
hiyouga	3bfb086399	support BLOOM models ... Former-commit-id: 740a5daf56	2023-05-31 16:54:06 +08:00
hoshi-hiyouga	1a5eacc98a	Merge pull request #1 from mMrBun/main ... Support conversation via API. Former-commit-id: c36620ece4	2023-05-30 16:34:00 +08:00
hiyouga	ddb456bbcb	remove dummy code ... Former-commit-id: a72492e649	2023-05-30 16:28:00 +08:00
mMrBun	bc2e530e16	Support conversation via API. ... Former-commit-id: 748b804bac	2023-05-30 15:00:28 +08:00
mMrBun	21ef968922	Support conversation via API. ... Former-commit-id: e821682430	2023-05-30 14:46:22 +08:00
hiyouga	4c7c96e656	add pre-training script ... Former-commit-id: 8ff96509fa	2023-05-29 21:37:22 +08:00
hiyouga	0ab4419b86	fix checkpoint loading ... Former-commit-id: c0e5df92d6	2023-05-29 17:43:16 +08:00
hiyouga	03338163c2	tiny fix ... Former-commit-id: ce71cc8b6d	2023-05-29 09:42:29 +08:00
hiyouga	b1517e7a0e	tiny fix ... Former-commit-id: 166c837b95	2023-05-28 21:48:33 +08:00
hiyouga	87ba09e035	use fp16 model, add logcallback ... Former-commit-id: 0c9fda01e3	2023-05-28 21:30:28 +08:00
hiyouga	54b8ce7b63	Initial commit ... Former-commit-id: 769c6ab56b	2023-05-28 18:09:04 +08:00