1305 Commits

Author	SHA1	Message	Date
codemayq	4a4623cf2d	auto match template when change model_name ... Former-commit-id: 0bf892ff1a	2023-08-14 20:56:05 +08:00
codemayq	ee7da14f81	add template match and stage in webui ... Former-commit-id: 79c68e5527	2023-08-14 20:42:59 +08:00
hiyouga	2aa2c363ad	fix ChatGLM lm_head #494 ... Former-commit-id: d019956808	2023-08-14 14:14:48 +08:00
hiyouga	2f70f96463	fix bug in webui ... Former-commit-id: 20a29297b1	2023-08-14 11:38:42 +08:00
hiyouga	307c814f38	fix webui cache ... Former-commit-id: ca08e5efd3	2023-08-14 11:37:01 +08:00
hiyouga	6c9b035c0e	web UI integrating RLHF ... Former-commit-id: ec94274ca1	2023-08-14 10:48:47 +08:00
hiyouga	e75024fde3	fix #480 ... Former-commit-id: 2f2fd55d81	2023-08-14 00:23:56 +08:00
hiyouga	7984ae8b62	fix webui ... Former-commit-id: d69b1388e6	2023-08-12 23:52:07 +08:00
hiyouga	e1b43dfc7f	tiny fix ... Former-commit-id: 9dc6a296e3	2023-08-12 22:02:43 +08:00
hiyouga	bd611e0090	fix rope scaling ... Former-commit-id: 8545c11c45	2023-08-12 22:00:01 +08:00
hiyouga	ba65dcb15e	update readme ... Former-commit-id: 1836c020c5	2023-08-12 21:00:11 +08:00
hiyouga	3f0a2d6adc	support rope scaling, fix #475 #476 #478 ... Former-commit-id: fa940c17b8	2023-08-12 20:46:27 +08:00
codemayq	3ba1b81105	add sft script preview in webui ... Former-commit-id: 6bc8e9866d	2023-08-12 13:53:55 +08:00
hiyouga	7bd4c59b7e	fix unusual output of 8bit models #278 #391 ... Former-commit-id: dd51c24203	2023-08-12 00:25:29 +08:00
hiyouga	79f4ba0d26	Release v0.1.6 ... Former-commit-id: a48cb0d474	2023-08-11 23:25:57 +08:00
hiyouga	21bf79e72b	add defaults ... Former-commit-id: d3844e97e3	2023-08-11 13:56:26 +08:00
hiyouga	eb26bfc2ba	fix stop word in baichuan template ... Former-commit-id: d59f938959	2023-08-11 13:51:46 +08:00
hiyouga	f1485ab927	fix baichuan template ... Former-commit-id: 9c6dd10514	2023-08-11 13:45:47 +08:00
hiyouga	abdfa26d06	support DPO training (2305.18290) ... Former-commit-id: 3ec4351cfd	2023-08-11 03:02:53 +08:00
hoshi-hiyouga	6c32b6922b	Merge pull request #451 from jovialchen/main ... huggingface login for projects must login while running Former-commit-id: 685dae4eff	2023-08-10 17:25:38 +08:00
hiyouga	58e95776e1	fix webui val size ... Former-commit-id: ad6e7c76c7	2023-08-10 15:20:44 +08:00
jiongxuc	7ffd961b8b	huggingface login for projects must login while running ... Former-commit-id: 3e000c2b60	2023-08-10 14:57:12 +08:00
hiyouga	0dc9b41b16	fix template ... Former-commit-id: eb6e571cb7	2023-08-09 23:14:27 +08:00
hiyouga	ce9ffca0d9	fix template ... Former-commit-id: ac29f4d5f0	2023-08-09 23:10:20 +08:00
hiyouga	6404167ab7	support val set in streaming mode ... Former-commit-id: d86ea314a1	2023-08-09 23:00:26 +08:00
hiyouga	d01c1231ed	fix tokenizer ... Former-commit-id: 572ea3bafb	2023-08-09 17:52:15 +08:00
niuba	53a89f53aa	add last_checkpoint support ... Former-commit-id: 2ec68d3398	2023-08-09 16:39:27 +08:00
hiyouga	b43f37ca19	fix sft trainer ... Former-commit-id: df946e6949	2023-08-09 16:35:03 +08:00
hiyouga	28a807472b	fix rm #420, fix template #426, fix #423 ... Former-commit-id: 39cd8b6989	2023-08-09 16:23:31 +08:00
hoshi-hiyouga	c3eb40b971	fix llama2 template ... Former-commit-id: 2d90685358	2023-08-09 00:58:27 +08:00
hoshi-hiyouga	a37e1c11c9	fix tokenizer ... Former-commit-id: 32fa5e8d70	2023-08-09 00:54:54 +08:00
hiyouga	4f714ba314	update webui ... Former-commit-id: 3a720aac66	2023-08-09 00:26:11 +08:00
hiyouga	77aa9853fb	fix tokenizer #417 ... Former-commit-id: eecc4b2131	2023-08-08 23:59:41 +08:00
hiyouga	9e49438c41	fix bug ... Former-commit-id: caa0eda27d	2023-08-08 21:28:28 +08:00
hiyouga	70b53d9503	fix bug ... Former-commit-id: 4b841a6b35	2023-08-08 17:55:55 +08:00
hiyouga	c796c542c8	fix chatml template #408 ... Former-commit-id: a9980617f5	2023-08-08 17:44:39 +08:00
hiyouga	921778a7cf	update args spec ... Former-commit-id: 5453b93db0	2023-08-07 15:23:35 +08:00
hiyouga	733b395822	update readme ... Former-commit-id: 20cf27976f	2023-08-07 15:02:02 +08:00
hiyouga	871f7de3d0	fix #376 ... Former-commit-id: 081345baca	2023-08-07 13:58:59 +08:00
hiyouga	77f6647e8f	update trainer ... Former-commit-id: 220175ab24	2023-08-07 13:34:35 +08:00
hiyouga	2faa1af4eb	fix qwen eos token ... Former-commit-id: e21ae01356	2023-08-06 13:31:17 +08:00
hiyouga	39955c28ff	fix qwen tokenizer #361 ... Former-commit-id: 7f18d2a335	2023-08-05 17:06:05 +08:00
hiyouga	45af1a951f	fix template for tiktoken ... Former-commit-id: 1afa51c2fa	2023-08-05 13:42:42 +08:00
hiyouga	1a1caf2116	remove redundant code ... Former-commit-id: 53d95725c5	2023-08-05 00:27:27 +08:00
hiyouga	ab95f569a4	fix template ... Former-commit-id: c183b3551d	2023-08-05 00:25:00 +08:00
hiyouga	7a89fce4c7	fix llama2 template ... Former-commit-id: e4a15f863c	2023-08-05 00:07:54 +08:00
hiyouga	65369ecf48	fix bos and eos token ... Former-commit-id: d87c8fd8ab	2023-08-04 23:55:57 +08:00
hiyouga	dbb284b5a2	fix encode ... Former-commit-id: 8172ad1b5e	2023-08-04 23:27:55 +08:00
hiyouga	ea045b0e5b	support chatml safe encoding ... Former-commit-id: b4852f9406	2023-08-04 23:14:28 +08:00
hiyouga	b32ed1d7be	support interleave probs ... Former-commit-id: 69744c17e8	2023-08-04 21:27:35 +08:00