118 Commits

Author	SHA1	Message	Date
hiyouga	d2df4c22ab	support mllm hf inference ... Former-commit-id: e057c8de48	2024-04-26 05:34:58 +08:00
hoshi-hiyouga	268c0efd67	Update workflow.py ... Former-commit-id: e16f128dc3	2024-04-26 03:29:12 +08:00
BUAADreamer	a9b0da597b	modify some style ... Former-commit-id: c27f7fbf62	2024-04-25 22:04:09 +08:00
BUAADreamer	a0be27fc9b	modify some style ... Former-commit-id: 2d4ded535f	2024-04-25 21:58:18 +08:00
BUAADreamer	549f35b1fd	modify style ... Former-commit-id: fc0fa9f048	2024-04-25 21:27:48 +08:00
BUAADreamer	e6cf251fb8	modify style ... Former-commit-id: 1dcabafe72	2024-04-25 21:15:16 +08:00
BUAADreamer	cefdbb8728	add some ... Former-commit-id: 94ad744941	2024-04-25 21:08:32 +08:00
BUAADreamer	32baed8302	rm some ... Former-commit-id: eefcd105c1	2024-04-25 20:09:43 +08:00
BUAADreamer	b6d78b2a64	merge data part to the text stream ... Former-commit-id: c6dd89918f	2024-04-25 19:19:59 +08:00
BUAADreamer	4e032ff95e	merge model part to the text stream ... Former-commit-id: 838eb87a96	2024-04-25 08:20:41 +08:00
BUAADreamer	ff8d729b59	remove conflicts ... Former-commit-id: 7ffee90799	2024-04-25 00:34:22 +08:00
BUAADreamer	31bce63a10	add llava and instructblip ... Former-commit-id: cfb485eddf	2024-04-25 00:22:43 +08:00
hiyouga	c0afc4074f	support unsloth generate ... Former-commit-id: b1deb0a0b9	2024-04-24 04:46:53 +08:00
BUAADreamer	175b56bced	add multimodal LLM BLIP-2 and InstructBLIP ... Former-commit-id: 4dcb11eab7	2024-04-23 18:45:43 +08:00
hiyouga	6a3ee1edd9	fix optimizers ... Former-commit-id: fbbe0dba2f	2024-04-21 20:40:54 +08:00
hiyouga	9e45f82be7	fix bug in galore optimizer ... Former-commit-id: 5c62881c5a	2024-04-21 18:53:22 +08:00
hiyouga	0a94fab357	support badam for all stages ... Former-commit-id: e3d8fc75eb	2024-04-16 17:44:48 +08:00
hoshi-hiyouga	6d954b2733	Update utils.py ... Former-commit-id: c9828f4c6e	2024-04-16 17:30:12 +08:00
hoshi-hiyouga	5226c4fa97	Update trainer.py ... Former-commit-id: 6700a1b9fa	2024-04-16 17:29:52 +08:00
Jonery	b3260c7456	resolve gradient checkpointing issue. ... Former-commit-id: 7ecb61822b	2024-04-16 12:05:27 +08:00
Jonery	025f329445	Feature BAdam ... Former-commit-id: 06c8908d3f	2024-04-15 23:15:27 +08:00
hiyouga	fb385b8c26	update examples ... Former-commit-id: cce52351b5	2024-04-15 22:14:34 +08:00
hiyouga	9e7b460b2d	fix model card ... Former-commit-id: c53a11b6fd	2024-04-12 17:11:59 +08:00
hiyouga	c9d3cc181a	fix #3238 ... Former-commit-id: 232642a621	2024-04-12 14:28:11 +08:00
hiyouga	2ecf2bcbf0	fix resize vocab at inference #3022 ... Former-commit-id: 148bda353f	2024-04-03 18:14:24 +08:00
hiyouga	88d9f47a0b	fix #3116 ... Former-commit-id: ce77d98872	2024-04-03 14:47:59 +08:00
hiyouga	bf5ffeeae0	simplify readme ... Former-commit-id: 92dab8a90b	2024-04-02 20:07:43 +08:00
hiyouga	829cf6458a	fix #3083 ... Former-commit-id: 4a6ca621c0	2024-04-01 22:53:52 +08:00
hiyouga	bd52e2b404	fix ORPO loss ... Former-commit-id: 816d714146	2024-04-01 14:42:41 +08:00
hiyouga	69e1d39832	fix IPO and ORPO loss ... Former-commit-id: 5b9b40403d	2024-04-01 14:37:53 +08:00
hiyouga	e7ade84bba	fix plots ... Former-commit-id: 5907216a1c	2024-03-31 19:43:48 +08:00
hiyouga	b873dcb09d	use log1p in orpo loss ... https://github.com/huggingface/trl/pull/1491 Former-commit-id: 68aaa4904b	2024-03-31 19:27:08 +08:00
hiyouga	2f878bde11	support ORPO ... Former-commit-id: 17bf8a2c3a	2024-03-31 18:29:50 +08:00
marko1616	67c05c2031	Fix Llama model save for full param train ... Former-commit-id: eb178eaff3	2024-03-30 23:45:04 +08:00
hiyouga	fc066cad7f	release v0.6.1 ... Former-commit-id: ca793028c6	2024-03-29 11:36:08 +08:00
hiyouga	e4f3d583df	fix #2982 ... Former-commit-id: 8d603f8820	2024-03-28 20:22:31 +08:00
hiyouga	89c400633a	update trainers ... Former-commit-id: 8c77b10912	2024-03-28 18:16:27 +08:00
hoshi-hiyouga	ae9ad13f2a	fix ds optimizer ... Former-commit-id: 3bcd41b639	2024-03-26 23:39:56 +08:00
hiyouga	ec94e5e876	fix #2961 ... Former-commit-id: 511f675402	2024-03-26 17:26:14 +08:00
hiyouga	62312716d9	release v0.6.0 (real) ... Former-commit-id: ba70aca8fb	2024-03-25 23:37:48 +08:00
hiyouga	27151b8c65	release v0.6.0 ... Former-commit-id: 6f2b563f12	2024-03-25 22:38:56 +08:00
hiyouga	2d73831177	tiny fix ... Former-commit-id: 558a538724	2024-03-25 21:18:08 +08:00
marko1616	1d0e24549f	pass ruff check ... Former-commit-id: c8f0d99704	2024-03-24 16:12:10 +08:00
marko1616	a68101cbbb	fix Llama lora merge crash ... Former-commit-id: 6f080fdba3	2024-03-24 03:06:11 +08:00
marko1616	645c27e5e2	fix Llama lora merge crash ... Former-commit-id: 51349ea1cc	2024-03-24 02:55:23 +08:00
marko1616	c083708433	fix Llama lora merge crash ... Former-commit-id: c1e2c4ea45	2024-03-24 02:44:35 +08:00
hiyouga	8717e98200	fix #2777 #2895 ... Former-commit-id: 9bec3c98a2	2024-03-20 17:59:45 +08:00
hiyouga	3d483e0914	fix packages ... Former-commit-id: 8e04794b2d	2024-03-17 22:32:03 +08:00
hiyouga	06860e8f0f	fix export ... Former-commit-id: 6bc2c23b6d	2024-03-15 15:06:30 +08:00
hiyouga	7ef49586be	tiny fix ... Former-commit-id: 6ebde4f23e	2024-03-14 21:19:06 +08:00