73 Commits

Author	SHA1	Message	Date
Kingsley	3053a806e9	Merge branch 'hiyouga:main' into pixtral-patch ... Former-commit-id: 67f59579d7	2024-10-29 21:01:25 +08:00
hiyouga	0d8aa6e6ef	use pre-commit ... Former-commit-id: 21db8ed2f4	2024-10-29 09:07:46 +00:00
hiyouga	163cf2ba5c	update requires ... Former-commit-id: 77666bd227	2024-10-29 16:10:07 +08:00
Kingsley	5523a6fd2c	Merge branch 'hiyouga:main' into pixtral-patch ... Former-commit-id: 93a441a6b7	2024-10-08 21:04:08 +08:00
hiyouga	4464a6ff5b	tiny fix ... Former-commit-id: 451d271718	2024-10-08 17:48:56 +08:00
Kingsley	f3ac97a749	Merge branch 'hiyouga:main' into pixtral-patch ... Former-commit-id: e53f47c0b3	2024-10-01 00:52:31 +08:00
hiyouga	4df090ff48	fix #5542 ... Former-commit-id: fe7ffccdb9	2024-09-30 23:28:55 +08:00
Kingsley	6729ed2c7e	sync with former ... Former-commit-id: 9ddb84052e	2024-09-30 20:27:05 +08:00
Kingsley	94ce8f561f	fix some errors due to inconsistency of model cards ... Former-commit-id: 2166b9bc6b	2024-09-30 19:58:34 +08:00
Zhangchi Feng	69e801d456	Merge branch 'main' into pixtral-patch ... Former-commit-id: 26f45829b4	2024-09-30 12:37:03 +08:00
BUAADreamer	87ab7fc01c	fix constants ... Former-commit-id: 485fc04716	2024-09-29 22:00:01 +08:00
BUAADreamer	ddec40ac16	fix style ... Former-commit-id: 23916d57c1	2024-09-29 21:39:37 +08:00
Zhangchi Feng	8e164f3594	Merge branch 'main' into main ... Former-commit-id: 83abf86657	2024-09-29 21:32:54 +08:00
BUAADreamer	1b71afb277	add more llava-next series template ... Former-commit-id: 65a8923f5a	2024-09-29 21:29:29 +08:00
BUAADreamer	534dc58363	fix readme ... Former-commit-id: bf0bcbc5ec	2024-09-29 20:45:02 +08:00
BUAADreamer	1e2ea34419	fix some ... Former-commit-id: d5c69400cd	2024-09-29 17:55:40 +08:00
hoshi-hiyouga	5df765e376	Update attention.py ... Former-commit-id: fe7057a8a3	2024-09-29 10:47:41 +08:00
Kingsley	a2452d0b1c	Tiny fix ... Former-commit-id: 8f13a3627d	2024-09-29 00:00:23 +08:00
Amirreza A	6ae0e27c8b	made a small change to a warning about fa2 for gemma2 models. ... Former-commit-id: 94ee105526	2024-09-28 19:03:36 +03:30
Kingsley	fd79cf8551	tiny fix ... Former-commit-id: 3d3cc6705d	2024-09-28 22:50:53 +08:00
BUAADreamer	0e33902f61	fix some ... Former-commit-id: 7f3f81009e	2024-09-28 01:15:33 +08:00
BUAADreamer	5aa1e847d9	add llava-next/llava-next-video/video-llava ... Former-commit-id: 6642cd501d	2024-09-28 00:57:03 +08:00
Zhangchi Feng	c576b7ca32	Merge branch 'hiyouga:main' into main ... Former-commit-id: 900631755b	2024-09-27 18:14:39 +08:00
Billy Cao	38e955d4a9	Add qwen_vl to liger kernel supported list ... Former-commit-id: 7a2958a44f	2024-09-14 19:28:20 +08:00
BUAADreamer	16c7326bc5	try to past test ... Former-commit-id: 7b4ba0efb6	2024-09-10 13:12:51 +08:00
BUAADreamer	f00f4ae9b6	support llava-next(video) ... Former-commit-id: 31259e7e0c	2024-09-10 12:31:53 +08:00
hiyouga	0229263fbe	tiny fix ... Former-commit-id: c9b3870adb	2024-09-08 23:18:08 +08:00
hiyouga	f6f58ebef0	fix test case ... Former-commit-id: b332908ab4	2024-09-08 01:50:51 +08:00
hiyouga	945841503e	add test case ... Former-commit-id: 52a06efaf8	2024-09-08 01:40:49 +08:00
hiyouga	0daee7cb39	support activation offloading via unsloth gc ... Former-commit-id: fb72a3adb0	2024-09-08 01:22:19 +08:00
hiyouga	995491594d	tiny fix ... Former-commit-id: 76f2e59504	2024-09-05 23:41:16 +08:00
hiyouga	6e98872622	fix #5324 ... Former-commit-id: a61c8c4890	2024-09-02 23:56:21 +08:00
hiyouga	cb776752f6	fix mixed mm inputs and rlhf-v ... Former-commit-id: 9967ccb3ae	2024-09-01 20:52:47 +08:00
hiyouga	f31e7e0dfc	remove visual_inputs, fix qlora ... Former-commit-id: a025c3df61	2024-08-31 00:24:51 +08:00
hiyouga	a83756b5e9	refactor mm training ... Former-commit-id: 3382317e32	2024-08-30 02:14:31 +08:00
hoshi-hiyouga	98b0c7530c	Merge pull request #5290 from simonJJJ/qwen2_vl ... support qwen2-vl Former-commit-id: 727e184840	2024-08-30 02:10:36 +08:00
hiyouga	0e4ee9d9a3	update liger kernel ... Former-commit-id: a7dd7d325e	2024-08-29 20:46:08 +08:00
simonJJJ	8a09b1e732	initial-commit ... Former-commit-id: aeb85f200b	2024-08-28 16:51:35 +08:00
hiyouga	c765292093	support liger kernel ... Former-commit-id: 72bc8f0111	2024-08-27 11:20:14 +08:00
hiyouga	20013e130b	fix #5048 ... Former-commit-id: b7ca6c8dc1	2024-08-05 23:48:19 +08:00
hiyouga	14bc7b0551	fix up ... Former-commit-id: 29ebcd75d5	2024-07-15 01:04:56 +08:00
hiyouga	12e0e5d0d7	tiny fix ... Former-commit-id: d3c01552e0	2024-07-14 10:56:45 +08:00
hiyouga	0b26011181	fix gemma2 attention ... Former-commit-id: 2f6af73da2	2024-07-13 23:33:45 +08:00
hiyouga	d7657d772d	tiny fix ... Former-commit-id: 0c699de39d	2024-07-04 03:47:05 +08:00
hiyouga	7b3c1f29ff	fix packing for eager/sdpa attn ... Former-commit-id: 6fd6aa4530	2024-07-04 01:52:43 +08:00
hoshi-hiyouga	a38ff842d0	Merge pull request #4224 from chuan298/main ... Implement efficient packing without cross-contamination attention Former-commit-id: 87d9b2d005	2024-07-04 01:18:54 +08:00
hiyouga	bfdaadcc40	update packing ... Former-commit-id: cce7083024	2024-07-04 01:10:55 +08:00
hoshi-hiyouga	51c75985b8	Update packing.py ... Former-commit-id: a36e8f2dd5	2024-07-03 23:36:01 +08:00
hiyouga	13cec0cc2f	update func name ... Former-commit-id: c346f79f99	2024-07-03 23:29:33 +08:00
hiyouga	e671ed520b	update arg name ... Former-commit-id: 8a6a7b9c8a	2024-07-03 23:23:24 +08:00