hiyouga
|
4df090ff48
|
fix #5542
Former-commit-id: fe7ffccdb9
|
2024-09-30 23:28:55 +08:00 |
|
BUAADreamer
|
87ab7fc01c
|
fix constants
Former-commit-id: 485fc04716
|
2024-09-29 22:00:01 +08:00 |
|
BUAADreamer
|
ddec40ac16
|
fix style
Former-commit-id: 23916d57c1
|
2024-09-29 21:39:37 +08:00 |
|
Zhangchi Feng
|
8e164f3594
|
Merge branch 'main' into main
Former-commit-id: 83abf86657
|
2024-09-29 21:32:54 +08:00 |
|
BUAADreamer
|
1b71afb277
|
add more llava-next series template
Former-commit-id: 65a8923f5a
|
2024-09-29 21:29:29 +08:00 |
|
BUAADreamer
|
534dc58363
|
fix readme
Former-commit-id: bf0bcbc5ec
|
2024-09-29 20:45:02 +08:00 |
|
BUAADreamer
|
1e2ea34419
|
fix some
Former-commit-id: d5c69400cd
|
2024-09-29 17:55:40 +08:00 |
|
hoshi-hiyouga
|
5df765e376
|
Update attention.py
Former-commit-id: fe7057a8a3
|
2024-09-29 10:47:41 +08:00 |
|
Amirreza A
|
6ae0e27c8b
|
made a small change to a warning about fa2 for gemma2 models.
Former-commit-id: 94ee105526
|
2024-09-28 19:03:36 +03:30 |
|
BUAADreamer
|
0e33902f61
|
fix some
Former-commit-id: 7f3f81009e
|
2024-09-28 01:15:33 +08:00 |
|
BUAADreamer
|
5aa1e847d9
|
add llava-next/llava-next-video/video-llava
Former-commit-id: 6642cd501d
|
2024-09-28 00:57:03 +08:00 |
|
Zhangchi Feng
|
c576b7ca32
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 900631755b
|
2024-09-27 18:14:39 +08:00 |
|
Billy Cao
|
38e955d4a9
|
Add qwen_vl to liger kernel supported list
Former-commit-id: 7a2958a44f
|
2024-09-14 19:28:20 +08:00 |
|
BUAADreamer
|
16c7326bc5
|
try to past test
Former-commit-id: 7b4ba0efb6
|
2024-09-10 13:12:51 +08:00 |
|
BUAADreamer
|
f00f4ae9b6
|
support llava-next(video)
Former-commit-id: 31259e7e0c
|
2024-09-10 12:31:53 +08:00 |
|
hiyouga
|
0229263fbe
|
tiny fix
Former-commit-id: c9b3870adb
|
2024-09-08 23:18:08 +08:00 |
|
hiyouga
|
f6f58ebef0
|
fix test case
Former-commit-id: b332908ab4
|
2024-09-08 01:50:51 +08:00 |
|
hiyouga
|
945841503e
|
add test case
Former-commit-id: 52a06efaf8
|
2024-09-08 01:40:49 +08:00 |
|
hiyouga
|
0daee7cb39
|
support activation offloading via unsloth gc
Former-commit-id: fb72a3adb0
|
2024-09-08 01:22:19 +08:00 |
|
hiyouga
|
995491594d
|
tiny fix
Former-commit-id: 76f2e59504
|
2024-09-05 23:41:16 +08:00 |
|
hiyouga
|
6e98872622
|
fix #5324
Former-commit-id: a61c8c4890
|
2024-09-02 23:56:21 +08:00 |
|
hiyouga
|
cb776752f6
|
fix mixed mm inputs and rlhf-v
Former-commit-id: 9967ccb3ae
|
2024-09-01 20:52:47 +08:00 |
|
hiyouga
|
f31e7e0dfc
|
remove visual_inputs, fix qlora
Former-commit-id: a025c3df61
|
2024-08-31 00:24:51 +08:00 |
|
hiyouga
|
a83756b5e9
|
refactor mm training
Former-commit-id: 3382317e32
|
2024-08-30 02:14:31 +08:00 |
|
hoshi-hiyouga
|
98b0c7530c
|
Merge pull request #5290 from simonJJJ/qwen2_vl
support qwen2-vl
Former-commit-id: 727e184840
|
2024-08-30 02:10:36 +08:00 |
|
hiyouga
|
0e4ee9d9a3
|
update liger kernel
Former-commit-id: a7dd7d325e
|
2024-08-29 20:46:08 +08:00 |
|
simonJJJ
|
8a09b1e732
|
initial-commit
Former-commit-id: aeb85f200b
|
2024-08-28 16:51:35 +08:00 |
|
hiyouga
|
c765292093
|
support liger kernel
Former-commit-id: 72bc8f0111
|
2024-08-27 11:20:14 +08:00 |
|
hiyouga
|
20013e130b
|
fix #5048
Former-commit-id: b7ca6c8dc1
|
2024-08-05 23:48:19 +08:00 |
|
hiyouga
|
14bc7b0551
|
fix up
Former-commit-id: 29ebcd75d5
|
2024-07-15 01:04:56 +08:00 |
|
hiyouga
|
12e0e5d0d7
|
tiny fix
Former-commit-id: d3c01552e0
|
2024-07-14 10:56:45 +08:00 |
|
hiyouga
|
0b26011181
|
fix gemma2 attention
Former-commit-id: 2f6af73da2
|
2024-07-13 23:33:45 +08:00 |
|
hiyouga
|
d7657d772d
|
tiny fix
Former-commit-id: 0c699de39d
|
2024-07-04 03:47:05 +08:00 |
|
hiyouga
|
7b3c1f29ff
|
fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530
|
2024-07-04 01:52:43 +08:00 |
|
hoshi-hiyouga
|
a38ff842d0
|
Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention
Former-commit-id: 87d9b2d005
|
2024-07-04 01:18:54 +08:00 |
|
hiyouga
|
bfdaadcc40
|
update packing
Former-commit-id: cce7083024
|
2024-07-04 01:10:55 +08:00 |
|
hoshi-hiyouga
|
51c75985b8
|
Update packing.py
Former-commit-id: a36e8f2dd5
|
2024-07-03 23:36:01 +08:00 |
|
hiyouga
|
13cec0cc2f
|
update func name
Former-commit-id: c346f79f99
|
2024-07-03 23:29:33 +08:00 |
|
hiyouga
|
e671ed520b
|
update arg name
Former-commit-id: 8a6a7b9c8a
|
2024-07-03 23:23:24 +08:00 |
|
hiyouga
|
104151d558
|
tiny fix
Former-commit-id: 8b1172b910
|
2024-07-03 02:31:50 +08:00 |
|
hoshi-hiyouga
|
2452f57cd7
|
Merge branch 'main' into main
Former-commit-id: e8e6af2651
|
2024-07-01 21:01:09 +08:00 |
|
hiyouga
|
de4de5b5ab
|
tiny fix
Former-commit-id: 8c41a0aa6d
|
2024-07-01 03:55:20 +08:00 |
|
hiyouga
|
2b006beab1
|
loose gemma2 attention
Former-commit-id: 2f4b89ace1
|
2024-06-29 01:42:14 +08:00 |
|
hiyouga
|
87e60f8bac
|
bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
Former-commit-id: 4d35e218b1
|
2024-06-28 06:00:26 +08:00 |
|
hiyouga
|
58607ec1b0
|
add quant checks
Former-commit-id: 96a5044394
|
2024-06-27 01:12:25 +08:00 |
|
hiyouga
|
d2d9fa4abb
|
support HQQ/EETQ #4113
Former-commit-id: ad144c2265
|
2024-06-27 00:29:42 +08:00 |
|
hiyouga
|
6b2733ce12
|
improve autogptq integration
Former-commit-id: addca926de
|
2024-06-26 22:11:44 +08:00 |
|
stceum
|
9aa640f27b
|
Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this.
Former-commit-id: 3ed063f281
|
2024-06-24 20:39:31 +08:00 |
|
ancv
|
5319447aa5
|
move configure_packing to llamafactory.model.patcher and fix constants
Former-commit-id: 770f75dc83
|
2024-06-21 00:45:06 +07:00 |
|
hiyouga
|
030b4811c7
|
update patcher
Former-commit-id: 3b040e8e0f
|
2024-06-19 21:27:00 +08:00 |
|