162 Commits

Author	SHA1	Message	Date
hiyouga	901faa16cc	support minicpm #2404	2024-02-03 22:36:46 +08:00
Johann-Peter Hartmann	b0ffde6e98	add simple german chatml template chatml_de	2024-02-03 09:01:15 +01:00
Fallen Angel	3399c0d645	fix eos_token_id=0 bug ... when eos_token_id=0, will never add eos_token	2024-02-02 17:34:48 +08:00
hiyouga	b2fb0eca56	fix #2282 and update tool prompt	2024-01-22 22:27:30 +08:00
hiyouga	6fc2d5cc03	add orion models	2024-01-22 21:26:53 +08:00
hiyouga	486cc8d360	add array param format	2024-01-21 22:17:48 +08:00
hiyouga	3bc301be02	tiny fix	2024-01-21 13:26:12 +08:00
hiyouga	3e982cc714	finish agent	2024-01-21 01:47:33 +08:00
hiyouga	55f707196e	fix api	2024-01-21 00:03:09 +08:00
hiyouga	a9c18255aa	fix internlm2 template	2024-01-20 23:33:50 +08:00
hiyouga	c550987a72	fix cli_demo	2024-01-20 23:27:10 +08:00
hiyouga	cf818a2598	fix #2260	2024-01-20 23:22:09 +08:00
hiyouga	71cfdc2658	release v0.5.0	2024-01-20 20:21:39 +08:00
hiyouga	638234ceee	format style	2024-01-20 20:15:56 +08:00
hiyouga	f6d6e00337	fix tests	2024-01-20 19:58:04 +08:00
hiyouga	12043aab9c	fix #2249	2024-01-19 21:44:32 +08:00
hiyouga	35aef8b287	fix function formatter	2024-01-18 16:01:07 +08:00
hiyouga	a73a979afd	fix templates	2024-01-18 14:49:52 +08:00
hiyouga	5ff10fac4f	fix pretrain data loader	2024-01-18 14:42:52 +08:00
hiyouga	487dee066f	fix dataset	2024-01-18 12:59:30 +08:00
hiyouga	f1067d2b58	enable cutoff len	2024-01-18 12:25:42 +08:00
hiyouga	83dbfce8c3	add tool test	2024-01-18 10:26:26 +08:00
hiyouga	d9f1cae351	support function calling	2024-01-18 09:54:23 +08:00
hiyouga	bf73224f33	support solar 10.7B #1907	2024-01-14 00:30:30 +08:00
hiyouga	9aa1a2fc17	fix #2147	2024-01-12 03:30:56 +08:00
hiyouga	ed216bbc46	fix qwen template	2024-01-05 16:14:56 +08:00
hiyouga	ce2156eaa8	fix #2014	2023-12-29 15:17:22 +08:00
hiyouga	e165354fac	fix export format	2023-12-28 18:40:46 +08:00
hiyouga	0bbf7118df	fix #1909	2023-12-23 14:42:20 +08:00
hiyouga	dec360d5ae	fix stop words	2023-12-20 19:06:43 +08:00
hiyouga	5af8841c4f	fix yi template #1895	2023-12-20 18:58:16 +08:00
hiyouga	c4a3977ad7	add max_memory for gptq #1923	2023-12-20 18:15:17 +08:00
hiyouga	ec1fe1daa9	optimize data loading logic	2023-12-20 16:15:41 +08:00
hiyouga	c6abbbfe90	fix #1909	2023-12-20 16:11:07 +08:00
hiyouga	a67a440644	add codegeex template	2023-12-18 19:52:35 +08:00
hiyouga	3524aa1e58	support quantization in export model	2023-12-15 23:44:50 +08:00
hiyouga	0716f5e470	refactor adapter hparam	2023-12-15 20:53:11 +08:00
hiyouga	2c8e88f9c1	fix sharegpt loading	2023-12-13 00:56:16 +08:00
hiyouga	0a9c6e0146	support system column #1765	2023-12-12 19:45:59 +08:00
hiyouga	d5b2c57a35	fix modelscope data hub	2023-12-12 18:33:06 +08:00
hoshi-hiyouga	6382efec52	Merge branch 'main' into feat/support_ms	2023-12-12 17:55:32 +08:00
xingjun.wang	adc98c86da	add use_streaming	2023-12-12 14:23:05 +08:00
xingjun.wang	1909f0d117	fix cache dir	2023-12-12 14:21:33 +08:00
xingjun.wang	168321a4da	add print info for test	2023-12-12 14:14:40 +08:00
xingjun.wang	edc82b923a	update cache dir	2023-12-12 13:08:18 +08:00
xingjun.wang	09533e95ed	update args for MsDataset.load	2023-12-12 13:02:54 +08:00
xingjun.wang	cfba1009d0	update	2023-12-12 12:03:23 +08:00
xingjun.wang	5b979147f0	for test	2023-12-12 11:52:59 +08:00
xingjun.wang	8a908a8c64	for test	2023-12-12 11:47:59 +08:00
hiyouga	96380f5e18	support mixtral	2023-12-12 11:39:04 +08:00