46 Commits

Author	SHA1	Message	Date
hiyouga	a9fe47a848	fix function formatter ... Former-commit-id: 35aef8b287	2024-01-18 16:01:07 +08:00
hiyouga	f7fcfeaa47	fix templates ... Former-commit-id: a73a979afd	2024-01-18 14:49:52 +08:00
hiyouga	f266d473b8	fix pretrain data loader ... Former-commit-id: 5ff10fac4f	2024-01-18 14:42:52 +08:00
hiyouga	e95c0242a8	fix dataset ... Former-commit-id: 487dee066f	2024-01-18 12:59:30 +08:00
hiyouga	7f12aedc08	enable cutoff len ... Former-commit-id: f1067d2b58	2024-01-18 12:25:42 +08:00
hiyouga	1323b8f102	add tool test ... Former-commit-id: 83dbfce8c3	2024-01-18 10:26:26 +08:00
hiyouga	4e3bfb799d	support function calling ... Former-commit-id: d9f1cae351	2024-01-18 09:54:23 +08:00
hiyouga	21020e51ca	support solar 10.7B #1907 ... Former-commit-id: bf73224f33	2024-01-14 00:30:30 +08:00
hiyouga	4dc16df570	fix #2147 ... Former-commit-id: 9aa1a2fc17	2024-01-12 03:30:56 +08:00
hiyouga	a78cd5c5ad	fix qwen template ... Former-commit-id: ed216bbc46	2024-01-05 16:14:56 +08:00
hiyouga	c14bf033a3	fix #2014 ... Former-commit-id: ce2156eaa8	2023-12-29 15:17:22 +08:00
hiyouga	16688b773a	fix export format ... Former-commit-id: e165354fac	2023-12-28 18:40:46 +08:00
hiyouga	11a6c8a9a0	fix #1909 ... Former-commit-id: 0bbf7118df	2023-12-23 14:42:20 +08:00
hiyouga	9337568e23	fix stop words ... Former-commit-id: dec360d5ae	2023-12-20 19:06:43 +08:00
hiyouga	622d31e398	fix yi template #1895 ... Former-commit-id: 5af8841c4f	2023-12-20 18:58:16 +08:00
hiyouga	c1233ab65f	add max_memory for gptq #1923 ... Former-commit-id: c4a3977ad7	2023-12-20 18:15:17 +08:00
hiyouga	f64be8ee84	optimize data loading logic ... Former-commit-id: ec1fe1daa9	2023-12-20 16:15:41 +08:00
hiyouga	633624dc3c	fix #1909 ... Former-commit-id: c6abbbfe90	2023-12-20 16:11:07 +08:00
hiyouga	3981927d6b	add codegeex template ... Former-commit-id: a67a440644	2023-12-18 19:52:35 +08:00
hiyouga	7dbc670902	support quantization in export model ... Former-commit-id: 3524aa1e58	2023-12-15 23:44:50 +08:00
hiyouga	bd03307bbd	refactor adapter hparam ... Former-commit-id: 0716f5e470	2023-12-15 20:53:11 +08:00
hiyouga	c9a2a7a3b3	fix sharegpt loading ... Former-commit-id: 2c8e88f9c1	2023-12-13 00:56:16 +08:00
hiyouga	1a0bdd305c	support system column #1765 ... Former-commit-id: 0a9c6e0146	2023-12-12 19:45:59 +08:00
hiyouga	cefc0b2f03	fix modelscope data hub ... Former-commit-id: d5b2c57a35	2023-12-12 18:33:06 +08:00
hoshi-hiyouga	b67085e13a	Merge branch 'main' into feat/support_ms ... Former-commit-id: 6382efec52	2023-12-12 17:55:32 +08:00
xingjun.wang	6cb2c99e7d	add use_streaming ... Former-commit-id: adc98c86da	2023-12-12 14:23:05 +08:00
xingjun.wang	1bd75afae8	fix cache dir ... Former-commit-id: 1909f0d117	2023-12-12 14:21:33 +08:00
xingjun.wang	c1974c91e5	add print info for test ... Former-commit-id: 168321a4da	2023-12-12 14:14:40 +08:00
xingjun.wang	e17f2a3f7f	update cache dir ... Former-commit-id: edc82b923a	2023-12-12 13:08:18 +08:00
xingjun.wang	879209829e	update args for MsDataset.load ... Former-commit-id: 09533e95ed	2023-12-12 13:02:54 +08:00
xingjun.wang	6520aecef1	update ... Former-commit-id: cfba1009d0	2023-12-12 12:03:23 +08:00
xingjun.wang	1d65d24071	for test ... Former-commit-id: 5b979147f0	2023-12-12 11:52:59 +08:00
xingjun.wang	2918743520	for test ... Former-commit-id: 8a908a8c64	2023-12-12 11:47:59 +08:00
hiyouga	b7d99ad5f4	support mixtral ... Former-commit-id: 96380f5e18	2023-12-12 11:39:04 +08:00
hiyouga	b641e9e97e	fix #1784 ... Former-commit-id: 28d5de7e78	2023-12-09 20:53:18 +08:00
yuze.zyz	c523613f0a	support ms dataset ... Former-commit-id: 9c2247d700	2023-12-08 18:00:57 +08:00
hiyouga	9b84a706af	add models ... Former-commit-id: e25f7bae16	2023-12-06 13:33:18 +08:00
hiyouga	f8376b228a	add xuanyuan models ... Former-commit-id: 6e7af11b98	2023-12-02 00:35:29 +08:00
hiyouga	1c43fb6a41	add models ... Former-commit-id: 509abe8864	2023-11-30 19:16:13 +08:00
hiyouga	5f2943dc84	support Yi-34B-Chat models ... Former-commit-id: ff1c289229	2023-11-23 19:31:49 +08:00
hiyouga	4966bd7911	support GPTQ tuning #729 #1481 #1545 , fix chatglm template #1453 #1480 #1569 ... Former-commit-id: 9ea9380145	2023-11-20 22:52:11 +08:00
hiyouga	32545bd6d9	better data streaming ... Former-commit-id: 00baaa990e	2023-11-19 23:32:47 +08:00
hiyouga	8d82d7e994	fix Mistral template ... https://github.com/lm-sys/FastChat/pull/2547 Former-commit-id: bfb9433165	2023-11-19 16:29:30 +08:00
hiyouga	5de45bf989	fix chatglm template ... Former-commit-id: ed9f7705ef	2023-11-16 22:54:15 +08:00
hiyouga	3e0b76650a	update readme and constants ... Former-commit-id: 1e19cf242a	2023-11-15 18:04:37 +08:00
hiyouga	06a4820836	disentangle model from tuner and rename modules ... Former-commit-id: 4736344eb1	2023-11-15 16:29:09 +08:00