61 Commits

Author	SHA1	Message	Date
hiyouga	5eb8107db2	fix examples #3769 ... Former-commit-id: 3df986c679	2024-05-16 19:12:09 +08:00
hiyouga	6e6267f17c	fix #3694 ... Former-commit-id: 2a67ab3925	2024-05-16 00:35:28 +08:00
hiyouga	213ba09b24	fix examples ... Former-commit-id: 7e69e71a52	2024-05-15 00:26:10 +08:00
hiyouga	c4743674ab	update examples ... Former-commit-id: 5bdad46387	2024-05-15 00:05:17 +08:00
hiyouga	f5df1ceaf1	add npu examples ... Former-commit-id: af343034dd	2024-05-14 23:32:53 +08:00
hiyouga	3318b6e188	update examples ... Former-commit-id: dae83f4199	2024-05-13 20:39:36 +08:00
hiyouga	52cc6bce38	fix #3602 ... Former-commit-id: b0888262e3	2024-05-07 17:50:27 +08:00
hiyouga	fe494fe97e	update examples ... Former-commit-id: 047313f48e	2024-05-06 23:07:55 +08:00
hiyouga	92cafef325	update example docs ... Former-commit-id: f02f87c6fb	2024-05-06 22:51:02 +08:00
hiyouga	eb21a527a6	update docs ... Former-commit-id: 34d33e2257	2024-05-06 21:47:00 +08:00
Oscar	c57a42164c	Fix badam example outdated argument ... Former-commit-id: eeb415f6fa	2024-05-05 23:35:19 +08:00
hiyouga	289d1f3679	update webui and add CLIs ... Former-commit-id: 245fe47ece	2024-05-03 02:58:23 +08:00
hiyouga	4cddd4be26	Update prepare.sh ... Former-commit-id: 39e964a97a	2024-05-02 17:16:02 +08:00
hiyouga	12790601c1	fix llava qlora ... Former-commit-id: fc67b736ba	2024-04-26 18:00:23 +08:00
hiyouga	eb70328eec	add llava to llamaboard ... Former-commit-id: cd3a960f81	2024-04-26 06:41:35 +08:00
hiyouga	d2df4c22ab	support mllm hf inference ... Former-commit-id: e057c8de48	2024-04-26 05:34:58 +08:00
BUAADreamer	ad7d8a6525	Merge branch 'hiyouga:main' into main ... Former-commit-id: 68cdd9a020	2024-04-25 20:02:50 +08:00
BUAADreamer	b6d78b2a64	merge data part to the text stream ... Former-commit-id: c6dd89918f	2024-04-25 19:19:59 +08:00
hiyouga	84031c5bf9	add export_device in webui #3333 ... Former-commit-id: 3a7c1286ce	2024-04-25 19:02:32 +08:00
BUAADreamer	31bce63a10	add llava and instructblip ... Former-commit-id: cfb485eddf	2024-04-25 00:22:43 +08:00
BUAADreamer	37705bbfdc	add multimodal LLM BLIP-2 and InstructBLIP ... Former-commit-id: e1afbea68f	2024-04-23 19:22:42 +08:00
BUAADreamer	5360b327ea	add multimodal LLM BLIP-2 and InstructBLIP ... Former-commit-id: 4f3d558f67	2024-04-23 18:47:03 +08:00
BUAADreamer	629a8f8147	Merge branch 'hiyouga:main' into main ... Former-commit-id: cde4dfe569	2024-04-23 18:46:12 +08:00
BUAADreamer	175b56bced	add multimodal LLM BLIP-2 and InstructBLIP ... Former-commit-id: 4dcb11eab7	2024-04-23 18:45:43 +08:00
hiyouga	23f738fda5	update examples ... Former-commit-id: 2efd9b6ba0	2024-04-23 18:29:46 +08:00
hiyouga	d8deb0f99e	update readme and examples ... Former-commit-id: a1f1fac33b	2024-04-22 00:37:32 +08:00
hiyouga	92e24a73cb	remove extras ... Former-commit-id: ddbd29d777	2024-04-22 00:35:41 +08:00
hiyouga	9e45f82be7	fix bug in galore optimizer ... Former-commit-id: 5c62881c5a	2024-04-21 18:53:22 +08:00
hiyouga	ec81d45d27	fix mod stuff ... Former-commit-id: f58425ab45	2024-04-21 18:11:10 +08:00
Marco	639297a5ef	Added Mixture of Depths ... Former-commit-id: 620add7b9f	2024-04-18 20:31:24 +02:00
hiyouga	0a94fab357	support badam for all stages ... Former-commit-id: e3d8fc75eb	2024-04-16 17:44:48 +08:00
hoshi-hiyouga	507ab397f5	Update sft.sh ... Former-commit-id: 57dcd91e17	2024-04-16 17:25:40 +08:00
Jonery	b3260c7456	resolve gradient checkpointing issue. ... Former-commit-id: 7ecb61822b	2024-04-16 12:05:27 +08:00
Jonery	025f329445	Feature BAdam ... Former-commit-id: 06c8908d3f	2024-04-15 23:15:27 +08:00
hiyouga	fb385b8c26	update examples ... Former-commit-id: cce52351b5	2024-04-15 22:14:34 +08:00
khazic	652caa3cbd	Upgrade README.md ... Former-commit-id: fe5d3bb8f0	2024-04-13 20:50:49 +08:00
khazic	21c4a43085	Added specimens for single-card full parameter prediction ... Former-commit-id: 47111ce506	2024-04-13 20:45:19 +08:00
hiyouga	5dd3c1ab79	update examples ... Former-commit-id: b87f8f1519	2024-04-04 14:48:21 +08:00
hiyouga	86513f28dc	update examples ... Former-commit-id: fc7f1cc365	2024-04-02 21:09:25 +08:00
hiyouga	03c538ebb3	add zh readme ... Former-commit-id: 7765f337c7	2024-04-02 20:58:45 +08:00
hiyouga	e341fa59fe	update examples ... Former-commit-id: f22eaeb5bc	2024-04-02 20:51:21 +08:00
hiyouga	9df316931b	update examples ... Former-commit-id: 31ffbde24d	2024-04-02 20:41:49 +08:00
hiyouga	135c4e3512	update readme ... Former-commit-id: 11a6c1bad6	2024-04-02 20:37:37 +08:00
hiyouga	bf5ffeeae0	simplify readme ... Former-commit-id: 92dab8a90b	2024-04-02 20:07:43 +08:00
hiyouga	cefe7f7bcf	update webui ... Former-commit-id: d0842f6828	2024-04-01 16:23:28 +08:00
hiyouga	2f878bde11	support ORPO ... Former-commit-id: 17bf8a2c3a	2024-03-31 18:29:50 +08:00
hiyouga	89c400633a	update trainers ... Former-commit-id: 8c77b10912	2024-03-28 18:16:27 +08:00
hiyouga	300437a5e9	fix #2981 ... Former-commit-id: b29d5560f1	2024-03-26 17:53:04 +08:00
hiyouga	7999836fb6	support fsdp + qlora ... Former-commit-id: 8408225162	2024-03-21 00:36:06 +08:00
hiyouga	8b8671817f	improve lora+ impl. ... Former-commit-id: 72367307df	2024-03-13 23:32:51 +08:00