613 Commits

Author	SHA1	Message	Date
A-Cepheus	8985c43033	fix: ZeRO3 does not work with MoE models ... Former-commit-id: e1d5c98519	2024-01-22 15:21:14 +08:00
hiyouga	48cab43cb5	add array param format ... Former-commit-id: 486cc8d360	2024-01-21 22:17:48 +08:00
hiyouga	daea73cf2b	fix api ... Former-commit-id: f51d48ea08	2024-01-21 19:15:27 +08:00
hiyouga	fb2d563be5	fix #2268 ... Former-commit-id: e0a717aa3a	2024-01-21 14:11:38 +08:00
hiyouga	8c10530181	tiny fix ... Former-commit-id: 3bc301be02	2024-01-21 13:26:12 +08:00
hoshi-hiyouga	37c56fb483	Merge branch 'main' into fix_export_model_dtype ... Former-commit-id: 2533be5e2a	2024-01-21 12:40:24 +08:00
hoshi-hiyouga	5159c9719c	Update tuner.py ... Former-commit-id: 662b9a9dcf	2024-01-21 12:39:38 +08:00
hoshi-hiyouga	f29156bf5b	Merge pull request #2262 from fenglui/main ... fix torch_dtype check of export_model Former-commit-id: 11f612deab	2024-01-21 12:34:37 +08:00
hiyouga	0896d1a1d6	format ... Former-commit-id: 3c1e256992	2024-01-21 12:34:17 +08:00
yhyu13	f036b9c7ba	Remove manully set use_cache; torch_dtype is not str, save model as bfloat16 used to fail; ... Former-commit-id: 9cdbd3bfc8	2024-01-21 11:12:15 +08:00
Aleksandr	4c9721f76e	add russian lang ... Former-commit-id: ace7fd4e0a	2024-01-21 04:28:14 +03:00
fenglui	1c160dd3a5	fix torch_dtype check of export_model ... Former-commit-id: f7c5b2d105	2024-01-21 05:01:53 +08:00
hiyouga	1fbf83acc2	finish agent ... Former-commit-id: 3e982cc714	2024-01-21 01:47:33 +08:00
hiyouga	865f48f1c3	fix api ... Former-commit-id: 55f707196e	2024-01-21 00:03:09 +08:00
hiyouga	cb8abce2f3	fix internlm2 template ... Former-commit-id: a9c18255aa	2024-01-20 23:33:50 +08:00
hiyouga	0be7b16955	fix cli_demo ... Former-commit-id: c550987a72	2024-01-20 23:27:10 +08:00
hiyouga	baaa0acdf1	fix #2260 ... Former-commit-id: cf818a2598	2024-01-20 23:22:09 +08:00
hiyouga	4ac36c14ae	release v0.5.0 ... Former-commit-id: 71cfdc2658	2024-01-20 20:21:39 +08:00
hiyouga	b27e91222c	format style ... Former-commit-id: 638234ceee	2024-01-20 20:15:56 +08:00
hiyouga	2f7684a8ee	fix tests ... Former-commit-id: f6d6e00337	2024-01-20 19:58:04 +08:00
hiyouga	69e8925249	support longlora for main branch ... Former-commit-id: 38af076a75	2024-01-20 19:25:22 +08:00
hoshi-hiyouga	b36dea7e7b	Merge pull request #2201 from liu-zichen/token_embed_resize ... support resize embed for zero3 Former-commit-id: bb92cdd0db	2024-01-20 17:45:38 +08:00
hiyouga	edf725208d	add upcast_lmhead option ... Former-commit-id: 8cbe4e9609	2024-01-19 23:54:25 +08:00
hiyouga	ffde3d94bf	set use_reentrant=False ... Former-commit-id: 0ff9a1fb4f	2024-01-19 23:29:54 +08:00
hiyouga	397eb8fbb9	fix #2249 ... Former-commit-id: 12043aab9c	2024-01-19 21:44:32 +08:00
hiyouga	e199967391	add bf16 lora option ... Former-commit-id: b6ec112beb	2024-01-19 16:29:03 +08:00
hiyouga	a9fe47a848	fix function formatter ... Former-commit-id: 35aef8b287	2024-01-18 16:01:07 +08:00
hiyouga	6e33982849	Update tuner.py ... Former-commit-id: ddd48ce8ab	2024-01-18 15:06:02 +08:00
hiyouga	f7fcfeaa47	fix templates ... Former-commit-id: a73a979afd	2024-01-18 14:49:52 +08:00
hiyouga	6af2f1f217	fix rm dataset ... Former-commit-id: 5edf7cce0e	2024-01-18 14:45:37 +08:00
hiyouga	f266d473b8	fix pretrain data loader ... Former-commit-id: 5ff10fac4f	2024-01-18 14:42:52 +08:00
hiyouga	0a8f46882c	update readme ... Former-commit-id: 5608a0da8e	2024-01-18 14:30:48 +08:00
hiyouga	29c16f6326	add tool hint ... Former-commit-id: 2abfe5fbc2	2024-01-18 13:19:09 +08:00
hiyouga	e95c0242a8	fix dataset ... Former-commit-id: 487dee066f	2024-01-18 12:59:30 +08:00
hiyouga	7f12aedc08	enable cutoff len ... Former-commit-id: f1067d2b58	2024-01-18 12:25:42 +08:00
hiyouga	1323b8f102	add tool test ... Former-commit-id: 83dbfce8c3	2024-01-18 10:26:26 +08:00
hiyouga	4e3bfb799d	support function calling ... Former-commit-id: d9f1cae351	2024-01-18 09:54:23 +08:00
hiyouga	a95dcac6f8	add llamafy_internlm2 ... Former-commit-id: f1d7ca77b1	2024-01-18 00:17:41 +08:00
hiyouga	6a954cc075	support export push_to_hub #2183 ... Former-commit-id: 42859f0734	2024-01-16 23:59:42 +08:00
hiyouga	4be704823c	fix #2195 ... Former-commit-id: a83fb6d3ff	2024-01-16 23:53:50 +08:00
liuzc	61bc5bd0dd	support resize embed for zero3 ... Former-commit-id: a5f6a7f4fb	2024-01-16 15:16:20 +08:00
hiyouga	7e16d27fca	tiny fix ... Former-commit-id: 5a207bb723	2024-01-15 23:34:23 +08:00
hiyouga	21020e51ca	support solar 10.7B #1907 ... Former-commit-id: bf73224f33	2024-01-14 00:30:30 +08:00
hiyouga	9771acfd75	support deepseek moe ... Former-commit-id: ca3933dc52	2024-01-14 00:14:49 +08:00
hiyouga	dad632091d	fix phi modules ... Former-commit-id: d1a73fe26c	2024-01-13 23:12:47 +08:00
hiyouga	4dc16df570	fix #2147 ... Former-commit-id: 9aa1a2fc17	2024-01-12 03:30:56 +08:00
hiyouga	69d966eb1f	fix #2164 ... Former-commit-id: 4b2d11ec28	2024-01-12 00:27:57 +08:00
hiyouga	6378864390	fix #2161 ... Former-commit-id: 898ec3696a	2024-01-11 17:04:13 +08:00
hiyouga	bd6213331f	improve web ui ... Former-commit-id: 1653c22438	2024-01-10 12:37:45 +08:00
hiyouga	fbe945aba0	improve model export ... Former-commit-id: 05ed4e8028	2024-01-09 22:26:24 +08:00