930 Commits

Author	SHA1	Message	Date
hiyouga	8f44dce08a	fix bug	2024-04-24 05:10:07 +08:00
hiyouga	667ce08b27	remove redundant code	2024-04-24 05:02:18 +08:00
hiyouga	b1deb0a0b9	support unsloth generate	2024-04-24 04:46:53 +08:00
hiyouga	aa2b79eb23	refactor patcher	2024-04-24 03:02:23 +08:00
hiyouga	07737a3d2d	reenable sdpa and fast tok by default	2024-04-24 02:18:44 +08:00
hiyouga	707f0b1d5d	fix #3347 #3387	2024-04-24 01:30:16 +08:00
hiyouga	1a13f05555	support phi-3	2024-04-24 00:28:53 +08:00
BUAADreamer	e1afbea68f	add multimodal LLM BLIP-2 and InstructBLIP	2024-04-23 19:22:42 +08:00
BUAADreamer	4dcb11eab7	add multimodal LLM BLIP-2 and InstructBLIP	2024-04-23 18:45:43 +08:00
hiyouga	db7f3b9784	update readme	2024-04-22 17:09:17 +08:00
hiyouga	3e1bf8325c	set dev version	2024-04-21 23:14:30 +08:00
hiyouga	e0d6b72d56	release v0.6.3	2024-04-21 23:13:23 +08:00
hiyouga	4469a3237d	fix #3366	2024-04-21 21:34:25 +08:00
hiyouga	fbbe0dba2f	fix optimizers	2024-04-21 20:40:54 +08:00
hiyouga	a1d31ffc8c	fix #3365	2024-04-21 19:20:18 +08:00
hiyouga	5c62881c5a	fix bug in galore optimizer	2024-04-21 18:53:22 +08:00
hiyouga	f58425ab45	fix mod stuff	2024-04-21 18:11:10 +08:00
hoshi-hiyouga	d0273787be	Merge pull request #3338 from astramind-ai/main ... Adding Mixture of Depth	2024-04-21 18:05:52 +08:00
hoshi-hiyouga	1fa287fd63	fix #3348	2024-04-20 10:34:09 +08:00
hiyouga	ba559a659a	fix #3352	2024-04-19 22:40:01 +08:00
hiyouga	14a605a2da	fix llama3 template	2024-04-19 15:46:51 +08:00
Marco	4fb7e046b3	fix small typo	2024-04-18 20:33:29 +02:00
Marco	620add7b9f	Added Mixture of Depths	2024-04-18 20:31:24 +02:00
hoshi-hiyouga	2aaaede247	support llama3	2024-04-19 01:13:50 +08:00
hiyouga	942362d008	fix #3324	2024-04-18 15:34:45 +08:00
hiyouga	3b43a3b7c5	tiny fix	2024-04-18 00:22:17 +08:00
hiyouga	cab0598fd0	add mixtral 8x22B models	2024-04-17 23:35:59 +08:00
hiyouga	5f86053d75	add CodeQwen models	2024-04-17 23:27:22 +08:00
hiyouga	c9a477322d	fix #3316	2024-04-17 22:54:34 +08:00
hiyouga	6d641af703	fix #3317	2024-04-17 22:17:19 +08:00
hiyouga	278c5e10c4	lint	2024-04-16 18:21:09 +08:00
hoshi-hiyouga	aa3206ec26	Merge pull request #3291 from codemayq/main ... support for previewing custom dataset in directory format	2024-04-16 18:12:09 +08:00
hiyouga	c00f0771a5	Update parser.py	2024-04-16 18:09:31 +08:00
hiyouga	5d62a51c12	update readme and gradio version	2024-04-16 18:09:16 +08:00
hiyouga	e3d8fc75eb	support badam for all stages	2024-04-16 17:44:48 +08:00
hoshi-hiyouga	4d660c5ade	Merge pull request #3287 from Ledzy/badam ... [Feature] Add BAdam algorithm	2024-04-16 17:32:16 +08:00
hoshi-hiyouga	c9828f4c6e	Update utils.py	2024-04-16 17:30:12 +08:00
hoshi-hiyouga	6700a1b9fa	Update trainer.py	2024-04-16 17:29:52 +08:00
hoshi-hiyouga	38a56706e0	Update utils.py	2024-04-16 17:29:30 +08:00
hoshi-hiyouga	a950f3b81d	Update patcher.py	2024-04-16 17:29:19 +08:00
hoshi-hiyouga	750cdf2e74	Update adapter.py	2024-04-16 17:28:12 +08:00
hoshi-hiyouga	4660703674	Update parser.py	2024-04-16 17:27:25 +08:00
hoshi-hiyouga	5b59ff4212	Update parser.py	2024-04-16 17:27:02 +08:00
hoshi-hiyouga	ec899cccf3	Update finetuning_args.py	2024-04-16 17:26:30 +08:00
Jonery	7ecb61822b	resolve gradient checkpointing issue.	2024-04-16 12:05:27 +08:00
codingma	62294289dc	add check	2024-04-16 10:56:39 +08:00
codingma	75aa6392e8	support for previewing custom dataset in directory format	2024-04-16 10:43:14 +08:00
hiyouga	b3ac14ffc4	add empty template	2024-04-16 03:10:02 +08:00
hiyouga	7dc72fb58c	support unsloth 2024.4	2024-04-16 00:25:03 +08:00
hiyouga	6543f3d449	add codegemma	2024-04-16 00:11:15 +08:00