49 Commits

Author	SHA1	Message	Date
hiyouga	8408225162	support fsdp + qlora	2024-03-21 00:36:06 +08:00
hiyouga	06c97083e1	fix #2803	2024-03-12 16:57:39 +08:00
hiyouga	28f7862188	support galore	2024-03-07 22:41:36 +08:00
hiyouga	cfefacaa37	support DoRA, AWQ, AQLM #2512	2024-02-28 19:53:28 +08:00
Katehuuh	7dc352a4c2	bump accelerate	2024-02-27 08:56:45 +01:00
hiyouga	7924ffc55d	support llama pro #2338 , add rslora	2024-02-15 02:27:36 +08:00
hiyouga	38e63bfd28	bump up transformers version	2024-02-04 00:01:16 +08:00
hiyouga	d9f1cae351	support function calling	2024-01-18 09:54:23 +08:00
hiyouga	3ae735ffe8	fix #2125	2024-01-08 21:42:25 +08:00
Dristanta Das	e4cde81851	Update requirements.txt With einops dependency	2024-01-07 21:03:30 +05:30
hiyouga	7aad0b889d	support unsloth	2023-12-23 00:14:33 +08:00
ShaneTian	390f0caf7f	Update transformers to 4.36.2 to resolve bug when saving a checkpoint in the multi-node setting.	2023-12-20 22:00:41 +08:00
hiyouga	b87c74289d	support dpo-ftx	2023-12-16 19:21:41 +08:00
hiyouga	0716f5e470	refactor adapter hparam	2023-12-15 20:53:11 +08:00
hoshi-hiyouga	9b0630f84f	revert peft version	2023-12-13 10:49:45 +08:00
hoshi-hiyouga	573a12c86b	update peft version	2023-12-13 10:23:51 +08:00
hiyouga	96380f5e18	support mixtral	2023-12-12 11:39:04 +08:00
hiyouga	9ce1b0e2f2	use peft 0.7.0, fix #1561 #1764	2023-12-11 17:13:40 +08:00
hiyouga	d42c0b1d34	fix #1771 and temporarily fix #1764	2023-12-08 16:26:20 +08:00
hiyouga	442aefb925	refactor evaluation, upgrade trl to 074	2023-11-13 22:20:35 +08:00
hiyouga	33422e1fef	fix #1438 #1439	2023-11-09 13:45:10 +08:00
hiyouga	7ebd63a609	fix #1418	2023-11-07 16:17:22 +08:00
hiyouga	b2a60905f3	upgrade peft, fix #1088 #1411	2023-11-07 16:13:36 +08:00
hiyouga	66a91e1fe3	update requirements	2023-11-06 19:01:21 +08:00
hiyouga	84af10cec9	update gradio, support multiple resp in api	2023-11-01 23:02:16 +08:00
hiyouga	838ed9aa87	fix #1287	2023-10-26 17:49:41 +08:00
hiyouga	a6a04be2e6	fix config, #1191	2023-10-15 18:28:45 +08:00
hiyouga	8e2ed6b8ce	update readme	2023-10-09 20:02:50 +08:00
hiyouga	b8dbec086e	update webui #1086	2023-10-09 14:50:14 +08:00
hiyouga	d4be857e23	fix #762 #814	2023-09-12 16:10:10 +08:00
hiyouga	ccb3553576	Release v0.1.8	2023-09-11 17:31:34 +08:00
hiyouga	b218c271ed	remove PeftTrainer	2023-09-10 22:23:23 +08:00
hiyouga	f5351c18e1	update requirements	2023-09-07 19:26:25 +08:00
hiyouga	a9d1fb72f7	refactor dataset_attr, add eos in pt, fix #757	2023-09-01 19:00:45 +08:00
hiyouga	3ec4351cfd	support DPO training (2305.18290)	2023-08-11 03:02:53 +08:00
jiongxuc	3e000c2b60	huggingface login for projects must login while running	2023-08-10 14:57:12 +08:00
hiyouga	3a720aac66	update webui	2023-08-09 00:26:11 +08:00
hiyouga	87f8f830e2	support Qwen-7B, fix InternLM-7B inference	2023-08-03 15:53:32 +08:00
hiyouga	0b6150bc31	release v0.1.3	2023-07-21 16:48:34 +08:00
hiyouga	29af67b015	fix API	2023-07-19 00:01:14 +08:00
hiyouga	f8193e8009	release v0.1.0	2023-07-18 00:18:25 +08:00
hiyouga	85c2210452	fix #175	2023-07-17 18:07:17 +08:00
hiyouga	f751376613	modity code structure	2023-07-15 16:54:28 +08:00
hiyouga	89c623e4bf	update readme	2023-07-05 23:03:58 +08:00
hiyouga	4abd2485e1	fix streaming response in API	2023-07-05 22:42:31 +08:00
蓝鲸123	e2a16d549e	Update requirements.txt ... LlamaTokenizer requires the SentencePiece library but it was not found in your environment.	2023-06-26 15:36:19 +08:00
hiyouga	0697643358	update readme	2023-06-23 00:17:05 +08:00
hiyouga	cec6524d6b	support RM metrics, add generating Args	2023-06-12 15:48:48 +08:00
hiyouga	7698f9aa9a	update readme	2023-05-29 21:53:02 +08:00