1711 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
hiyouga	1ce9db5654	fix #3366 ... Former-commit-id: 4469a3237d	2024-04-21 21:34:25 +08:00
hiyouga	6a3ee1edd9	fix optimizers ... Former-commit-id: fbbe0dba2f	2024-04-21 20:40:54 +08:00
hiyouga	79666c298d	fix #3365 ... Former-commit-id: a1d31ffc8c	2024-04-21 19:20:18 +08:00
hiyouga	9e45f82be7	fix bug in galore optimizer ... Former-commit-id: 5c62881c5a	2024-04-21 18:53:22 +08:00
hiyouga	ec81d45d27	fix mod stuff ... Former-commit-id: f58425ab45	2024-04-21 18:11:10 +08:00
hoshi-hiyouga	7c63a9b5fd	Merge pull request #3338 from astramind-ai/main ... Adding Mixture of Depth Former-commit-id: d0273787be	2024-04-21 18:05:52 +08:00
hoshi-hiyouga	e9b1aff447	fix #3348 ... Former-commit-id: 1fa287fd63	2024-04-20 10:34:09 +08:00
hiyouga	12290955d8	add dpo mix dataset ... Former-commit-id: 6339edefff	2024-04-20 01:31:38 +08:00
hiyouga	97c3f9e22c	fix #3352 ... Former-commit-id: ba559a659a	2024-04-19 22:40:01 +08:00
hiyouga	ac7ec7ed10	fix llama3 template ... Former-commit-id: 14a605a2da	2024-04-19 15:46:51 +08:00
Marco	b6a87e0a3f	fix small typo ... Former-commit-id: 4fb7e046b3	2024-04-18 20:33:29 +02:00
Marco	639297a5ef	Added Mixture of Depths ... Former-commit-id: 620add7b9f	2024-04-18 20:31:24 +02:00
hoshi-hiyouga	15d17a1e86	support llama3 ... Former-commit-id: 2aaaede247	2024-04-19 01:13:50 +08:00
hiyouga	9aa62ffb57	fix #3324 ... Former-commit-id: 942362d008	2024-04-18 15:34:45 +08:00
hiyouga	e2e0bbde12	tiny fix ... Former-commit-id: 3b43a3b7c5	2024-04-18 00:22:17 +08:00
hiyouga	a49dd8b4f3	update readme ... Former-commit-id: e2f1c6fc6a	2024-04-17 23:40:49 +08:00
hiyouga	8a369cc084	add mixtral 8x22B models ... Former-commit-id: cab0598fd0	2024-04-17 23:35:59 +08:00
hiyouga	3b491b4e1a	add CodeQwen models ... Former-commit-id: 5f86053d75	2024-04-17 23:27:22 +08:00
hiyouga	0170ef83a6	fix #3316 ... Former-commit-id: c9a477322d	2024-04-17 22:54:34 +08:00
hiyouga	f9c859e97b	fix #3317 ... Former-commit-id: 6d641af703	2024-04-17 22:17:19 +08:00
hiyouga	dac0c1a52b	Update wechat.jpg ... Former-commit-id: e3ca57602c	2024-04-17 21:14:37 +08:00
hiyouga	bdd253228e	lint ... Former-commit-id: 278c5e10c4	2024-04-16 18:21:09 +08:00
hoshi-hiyouga	7daaae2005	Merge pull request #3291 from codemayq/main ... support for previewing custom dataset in directory format Former-commit-id: aa3206ec26	2024-04-16 18:12:09 +08:00
hiyouga	038d524fcd	Update parser.py ... Former-commit-id: c00f0771a5	2024-04-16 18:09:31 +08:00
hiyouga	8beb7a9239	update readme and gradio version ... Former-commit-id: 5d62a51c12	2024-04-16 18:09:16 +08:00
hiyouga	0a94fab357	support badam for all stages ... Former-commit-id: e3d8fc75eb	2024-04-16 17:44:48 +08:00
hoshi-hiyouga	496396b3bc	Merge pull request #3287 from Ledzy/badam ... [Feature] Add BAdam algorithm Former-commit-id: 4d660c5ade	2024-04-16 17:32:16 +08:00
hoshi-hiyouga	6d954b2733	Update utils.py ... Former-commit-id: c9828f4c6e	2024-04-16 17:30:12 +08:00
hoshi-hiyouga	5226c4fa97	Update trainer.py ... Former-commit-id: 6700a1b9fa	2024-04-16 17:29:52 +08:00
hoshi-hiyouga	b92f690190	Update utils.py ... Former-commit-id: 38a56706e0	2024-04-16 17:29:30 +08:00
hoshi-hiyouga	48fb0be1b9	Update patcher.py ... Former-commit-id: a950f3b81d	2024-04-16 17:29:19 +08:00
hoshi-hiyouga	ce56ff22af	Update adapter.py ... Former-commit-id: 750cdf2e74	2024-04-16 17:28:12 +08:00
hoshi-hiyouga	0f6d691aa6	Update parser.py ... Former-commit-id: 4660703674	2024-04-16 17:27:25 +08:00
hoshi-hiyouga	d68212d016	Update parser.py ... Former-commit-id: 5b59ff4212	2024-04-16 17:27:02 +08:00
hoshi-hiyouga	5f48dd545e	Update finetuning_args.py ... Former-commit-id: ec899cccf3	2024-04-16 17:26:30 +08:00
hoshi-hiyouga	507ab397f5	Update sft.sh ... Former-commit-id: 57dcd91e17	2024-04-16 17:25:40 +08:00
hoshi-hiyouga	4133811434	Update requirements.txt ... Former-commit-id: 50ced257e0	2024-04-16 17:10:17 +08:00
hoshi-hiyouga	4aa17105e2	Update setup.py ... Former-commit-id: f4b4a26c64	2024-04-16 17:10:02 +08:00
Jonery	0853312593	remove badam from core requirements ... Former-commit-id: 86900210d3	2024-04-16 12:25:50 +08:00
Jonery	b3260c7456	resolve gradient checkpointing issue. ... Former-commit-id: 7ecb61822b	2024-04-16 12:05:27 +08:00
codingma	64f96cfd6d	add check ... Former-commit-id: 62294289dc	2024-04-16 10:56:39 +08:00
codingma	43d1730aa5	support for previewing custom dataset in directory format ... Former-commit-id: 75aa6392e8	2024-04-16 10:43:14 +08:00
hiyouga	627f281e5b	add empty template ... Former-commit-id: b3ac14ffc4	2024-04-16 03:10:02 +08:00
hiyouga	01b0913f08	update readme ... Former-commit-id: cf52911fed	2024-04-16 02:36:54 +08:00
hiyouga	76b41acc10	update readme ... Former-commit-id: 6084eb7cf1	2024-04-16 02:35:36 +08:00
hiyouga	b40f266617	support unsloth 2024.4 ... Former-commit-id: 7dc72fb58c	2024-04-16 00:25:03 +08:00
hiyouga	bd2b758b48	add codegemma ... Former-commit-id: 6543f3d449	2024-04-16 00:11:15 +08:00
hiyouga	2dc3343b1c	support cohere commandR #3184 ... Former-commit-id: e0dbac2845	2024-04-15 23:26:42 +08:00
Jonery	025f329445	Feature BAdam ... Former-commit-id: 06c8908d3f	2024-04-15 23:15:27 +08:00
hoshi-hiyouga	57ddf739c2	Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus ... Add template&support for c4ai-command-r/plus (tested) Former-commit-id: 7a8ae3f4ac	2024-04-15 22:59:35 +08:00