1821 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
hiyouga	a7ec9d4be8	Update wechat.jpg ... Former-commit-id: 5722ada12b	2024-04-23 17:12:33 +08:00
hiyouga	d5d6fb3970	update readme ... Former-commit-id: db7f3b9784	2024-04-22 17:09:17 +08:00
hiyouga	381b461eb6	update readme ... Former-commit-id: 836ca05586	2024-04-22 00:51:35 +08:00
hiyouga	e842328f05	update readme ... Former-commit-id: 34d66a3a85	2024-04-22 00:42:25 +08:00
hiyouga	d8deb0f99e	update readme and examples ... Former-commit-id: a1f1fac33b	2024-04-22 00:37:32 +08:00
hiyouga	92e24a73cb	remove extras ... Former-commit-id: ddbd29d777	2024-04-22 00:35:41 +08:00
hiyouga	ecc62ff3be	Update wechat.jpg ... Former-commit-id: 1197513a16	2024-04-22 00:22:58 +08:00
hiyouga	c0d8d530dd	update readme ... Former-commit-id: a83e7587a0	2024-04-22 00:21:01 +08:00
hiyouga	31f96ce22a	set dev version ... Former-commit-id: 3e1bf8325c	2024-04-21 23:14:30 +08:00
hiyouga	869777b990	release v0.6.3 ... Former-commit-id: e0d6b72d56	2024-04-21 23:13:23 +08:00
hiyouga	1ce9db5654	fix #3366 ... Former-commit-id: 4469a3237d	2024-04-21 21:34:25 +08:00
hiyouga	6a3ee1edd9	fix optimizers ... Former-commit-id: fbbe0dba2f	2024-04-21 20:40:54 +08:00
hiyouga	79666c298d	fix #3365 ... Former-commit-id: a1d31ffc8c	2024-04-21 19:20:18 +08:00
hiyouga	9e45f82be7	fix bug in galore optimizer ... Former-commit-id: 5c62881c5a	2024-04-21 18:53:22 +08:00
hiyouga	ec81d45d27	fix mod stuff ... Former-commit-id: f58425ab45	2024-04-21 18:11:10 +08:00
hoshi-hiyouga	7c63a9b5fd	Merge pull request #3338 from astramind-ai/main ... Adding Mixture of Depth Former-commit-id: d0273787be	2024-04-21 18:05:52 +08:00
hoshi-hiyouga	e9b1aff447	fix #3348 ... Former-commit-id: 1fa287fd63	2024-04-20 10:34:09 +08:00
hiyouga	12290955d8	add dpo mix dataset ... Former-commit-id: 6339edefff	2024-04-20 01:31:38 +08:00
hiyouga	97c3f9e22c	fix #3352 ... Former-commit-id: ba559a659a	2024-04-19 22:40:01 +08:00
hiyouga	ac7ec7ed10	fix llama3 template ... Former-commit-id: 14a605a2da	2024-04-19 15:46:51 +08:00
Marco	b6a87e0a3f	fix small typo ... Former-commit-id: 4fb7e046b3	2024-04-18 20:33:29 +02:00
Marco	639297a5ef	Added Mixture of Depths ... Former-commit-id: 620add7b9f	2024-04-18 20:31:24 +02:00
hoshi-hiyouga	15d17a1e86	support llama3 ... Former-commit-id: 2aaaede247	2024-04-19 01:13:50 +08:00
hiyouga	9aa62ffb57	fix #3324 ... Former-commit-id: 942362d008	2024-04-18 15:34:45 +08:00
hiyouga	e2e0bbde12	tiny fix ... Former-commit-id: 3b43a3b7c5	2024-04-18 00:22:17 +08:00
hiyouga	a49dd8b4f3	update readme ... Former-commit-id: e2f1c6fc6a	2024-04-17 23:40:49 +08:00
hiyouga	8a369cc084	add mixtral 8x22B models ... Former-commit-id: cab0598fd0	2024-04-17 23:35:59 +08:00
hiyouga	3b491b4e1a	add CodeQwen models ... Former-commit-id: 5f86053d75	2024-04-17 23:27:22 +08:00
hiyouga	0170ef83a6	fix #3316 ... Former-commit-id: c9a477322d	2024-04-17 22:54:34 +08:00
hiyouga	f9c859e97b	fix #3317 ... Former-commit-id: 6d641af703	2024-04-17 22:17:19 +08:00
hiyouga	dac0c1a52b	Update wechat.jpg ... Former-commit-id: e3ca57602c	2024-04-17 21:14:37 +08:00
hiyouga	bdd253228e	lint ... Former-commit-id: 278c5e10c4	2024-04-16 18:21:09 +08:00
hoshi-hiyouga	7daaae2005	Merge pull request #3291 from codemayq/main ... support for previewing custom dataset in directory format Former-commit-id: aa3206ec26	2024-04-16 18:12:09 +08:00
hiyouga	038d524fcd	Update parser.py ... Former-commit-id: c00f0771a5	2024-04-16 18:09:31 +08:00
hiyouga	8beb7a9239	update readme and gradio version ... Former-commit-id: 5d62a51c12	2024-04-16 18:09:16 +08:00
hiyouga	0a94fab357	support badam for all stages ... Former-commit-id: e3d8fc75eb	2024-04-16 17:44:48 +08:00
hoshi-hiyouga	496396b3bc	Merge pull request #3287 from Ledzy/badam ... [Feature] Add BAdam algorithm Former-commit-id: 4d660c5ade	2024-04-16 17:32:16 +08:00
hoshi-hiyouga	6d954b2733	Update utils.py ... Former-commit-id: c9828f4c6e	2024-04-16 17:30:12 +08:00
hoshi-hiyouga	5226c4fa97	Update trainer.py ... Former-commit-id: 6700a1b9fa	2024-04-16 17:29:52 +08:00
hoshi-hiyouga	b92f690190	Update utils.py ... Former-commit-id: 38a56706e0	2024-04-16 17:29:30 +08:00
hoshi-hiyouga	48fb0be1b9	Update patcher.py ... Former-commit-id: a950f3b81d	2024-04-16 17:29:19 +08:00
hoshi-hiyouga	ce56ff22af	Update adapter.py ... Former-commit-id: 750cdf2e74	2024-04-16 17:28:12 +08:00
hoshi-hiyouga	0f6d691aa6	Update parser.py ... Former-commit-id: 4660703674	2024-04-16 17:27:25 +08:00
hoshi-hiyouga	d68212d016	Update parser.py ... Former-commit-id: 5b59ff4212	2024-04-16 17:27:02 +08:00
hoshi-hiyouga	5f48dd545e	Update finetuning_args.py ... Former-commit-id: ec899cccf3	2024-04-16 17:26:30 +08:00
hoshi-hiyouga	507ab397f5	Update sft.sh ... Former-commit-id: 57dcd91e17	2024-04-16 17:25:40 +08:00
hoshi-hiyouga	4133811434	Update requirements.txt ... Former-commit-id: 50ced257e0	2024-04-16 17:10:17 +08:00
hoshi-hiyouga	4aa17105e2	Update setup.py ... Former-commit-id: f4b4a26c64	2024-04-16 17:10:02 +08:00
Jonery	0853312593	remove badam from core requirements ... Former-commit-id: 86900210d3	2024-04-16 12:25:50 +08:00
Jonery	b3260c7456	resolve gradient checkpointing issue. ... Former-commit-id: 7ecb61822b	2024-04-16 12:05:27 +08:00