1141 Commits

Author	SHA1	Message	Date
BUAADreamer	31bce63a10	add llava and instructblip ... Former-commit-id: cfb485eddf	2024-04-25 00:22:43 +08:00
hiyouga	b9fd197a37	update tool template ... Former-commit-id: aa16ff6205	2024-04-25 00:21:34 +08:00
hiyouga	9a21785396	fix log level ... Former-commit-id: 7fbe8add8f	2024-04-24 23:42:59 +08:00
hiyouga	ce490c65ae	support new special token #3420 ... Former-commit-id: 297fb8ead3	2024-04-24 23:39:31 +08:00
hoshi-hiyouga	7592d981b2	fix phi template ... Former-commit-id: e5d23c053a	2024-04-24 13:55:14 +08:00
hoshi-hiyouga	ce36e316bc	fix webchatmodel ... Former-commit-id: 4c71c314fb	2024-04-24 13:54:21 +08:00
hoshi-hiyouga	4a854dfe27	fix inference in llamaboard ... Former-commit-id: f36057ea03	2024-04-24 13:53:39 +08:00
hiyouga	fff1fb1232	add olmo 1.7 ... Former-commit-id: 44a43ee152	2024-04-24 05:50:50 +08:00
hiyouga	80f0a63f73	add dbrx and jamba models ... Former-commit-id: 69eb03a8fe	2024-04-24 05:39:52 +08:00
hiyouga	7d89abb1fd	fix bug ... Former-commit-id: 73ff9c834b	2024-04-24 05:21:18 +08:00
hiyouga	612ba26c4c	fix bug ... Former-commit-id: 8f44dce08a	2024-04-24 05:10:07 +08:00
hiyouga	1f99c367b3	remove redundant code ... Former-commit-id: 667ce08b27	2024-04-24 05:02:18 +08:00
hiyouga	c0afc4074f	support unsloth generate ... Former-commit-id: b1deb0a0b9	2024-04-24 04:46:53 +08:00
hiyouga	8465e54d38	refactor patcher ... Former-commit-id: aa2b79eb23	2024-04-24 03:02:23 +08:00
hiyouga	80c8586534	reenable sdpa and fast tok by default ... Former-commit-id: 07737a3d2d	2024-04-24 02:18:44 +08:00
hiyouga	34ecad4af8	fix #3347 #3387 ... Former-commit-id: 707f0b1d5d	2024-04-24 01:30:16 +08:00
hiyouga	1bea1ed868	support phi-3 ... Former-commit-id: 1a13f05555	2024-04-24 00:28:53 +08:00
BUAADreamer	37705bbfdc	add multimodal LLM BLIP-2 and InstructBLIP ... Former-commit-id: e1afbea68f	2024-04-23 19:22:42 +08:00
BUAADreamer	175b56bced	add multimodal LLM BLIP-2 and InstructBLIP ... Former-commit-id: 4dcb11eab7	2024-04-23 18:45:43 +08:00
hiyouga	d5d6fb3970	update readme ... Former-commit-id: db7f3b9784	2024-04-22 17:09:17 +08:00
hiyouga	31f96ce22a	set dev version ... Former-commit-id: 3e1bf8325c	2024-04-21 23:14:30 +08:00
hiyouga	869777b990	release v0.6.3 ... Former-commit-id: e0d6b72d56	2024-04-21 23:13:23 +08:00
hiyouga	1ce9db5654	fix #3366 ... Former-commit-id: 4469a3237d	2024-04-21 21:34:25 +08:00
hiyouga	6a3ee1edd9	fix optimizers ... Former-commit-id: fbbe0dba2f	2024-04-21 20:40:54 +08:00
hiyouga	79666c298d	fix #3365 ... Former-commit-id: a1d31ffc8c	2024-04-21 19:20:18 +08:00
hiyouga	9e45f82be7	fix bug in galore optimizer ... Former-commit-id: 5c62881c5a	2024-04-21 18:53:22 +08:00
hiyouga	ec81d45d27	fix mod stuff ... Former-commit-id: f58425ab45	2024-04-21 18:11:10 +08:00
hoshi-hiyouga	7c63a9b5fd	Merge pull request #3338 from astramind-ai/main ... Adding Mixture of Depth Former-commit-id: d0273787be	2024-04-21 18:05:52 +08:00
hoshi-hiyouga	e9b1aff447	fix #3348 ... Former-commit-id: 1fa287fd63	2024-04-20 10:34:09 +08:00
hiyouga	97c3f9e22c	fix #3352 ... Former-commit-id: ba559a659a	2024-04-19 22:40:01 +08:00
hiyouga	ac7ec7ed10	fix llama3 template ... Former-commit-id: 14a605a2da	2024-04-19 15:46:51 +08:00
Marco	b6a87e0a3f	fix small typo ... Former-commit-id: 4fb7e046b3	2024-04-18 20:33:29 +02:00
Marco	639297a5ef	Added Mixture of Depths ... Former-commit-id: 620add7b9f	2024-04-18 20:31:24 +02:00
hoshi-hiyouga	15d17a1e86	support llama3 ... Former-commit-id: 2aaaede247	2024-04-19 01:13:50 +08:00
hiyouga	9aa62ffb57	fix #3324 ... Former-commit-id: 942362d008	2024-04-18 15:34:45 +08:00
hiyouga	e2e0bbde12	tiny fix ... Former-commit-id: 3b43a3b7c5	2024-04-18 00:22:17 +08:00
hiyouga	8a369cc084	add mixtral 8x22B models ... Former-commit-id: cab0598fd0	2024-04-17 23:35:59 +08:00
hiyouga	3b491b4e1a	add CodeQwen models ... Former-commit-id: 5f86053d75	2024-04-17 23:27:22 +08:00
hiyouga	0170ef83a6	fix #3316 ... Former-commit-id: c9a477322d	2024-04-17 22:54:34 +08:00
hiyouga	f9c859e97b	fix #3317 ... Former-commit-id: 6d641af703	2024-04-17 22:17:19 +08:00
hiyouga	bdd253228e	lint ... Former-commit-id: 278c5e10c4	2024-04-16 18:21:09 +08:00
hoshi-hiyouga	7daaae2005	Merge pull request #3291 from codemayq/main ... support for previewing custom dataset in directory format Former-commit-id: aa3206ec26	2024-04-16 18:12:09 +08:00
hiyouga	038d524fcd	Update parser.py ... Former-commit-id: c00f0771a5	2024-04-16 18:09:31 +08:00
hiyouga	8beb7a9239	update readme and gradio version ... Former-commit-id: 5d62a51c12	2024-04-16 18:09:16 +08:00
hiyouga	0a94fab357	support badam for all stages ... Former-commit-id: e3d8fc75eb	2024-04-16 17:44:48 +08:00
hoshi-hiyouga	496396b3bc	Merge pull request #3287 from Ledzy/badam ... [Feature] Add BAdam algorithm Former-commit-id: 4d660c5ade	2024-04-16 17:32:16 +08:00
hoshi-hiyouga	6d954b2733	Update utils.py ... Former-commit-id: c9828f4c6e	2024-04-16 17:30:12 +08:00
hoshi-hiyouga	5226c4fa97	Update trainer.py ... Former-commit-id: 6700a1b9fa	2024-04-16 17:29:52 +08:00
hoshi-hiyouga	b92f690190	Update utils.py ... Former-commit-id: 38a56706e0	2024-04-16 17:29:30 +08:00
hoshi-hiyouga	48fb0be1b9	Update patcher.py ... Former-commit-id: a950f3b81d	2024-04-16 17:29:19 +08:00