hiyouga 2f164c2c41 fix #4160 ...

The split heads should be concatenated in dim=2


Former-commit-id: a793e8456b664ea0b48f0ba162999f18d06b4c2f

2024-06-11 00:37:17 +08:00

..

__init__.py

rename files

2024-06-07 00:09:06 +08:00

attention.py

rename files

2024-06-07 00:09:06 +08:00

checkpointing.py

rename files

2024-06-07 00:09:06 +08:00

embedding.py

rename files

2024-06-07 00:09:06 +08:00

longlora.py

fix #4160

2024-06-11 00:37:17 +08:00

misc.py

rename files

2024-06-07 00:09:06 +08:00

mod.py

rename files

2024-06-07 00:09:06 +08:00

moe.py

rename files

2024-06-07 00:09:06 +08:00

quantization.py

rename files

2024-06-07 00:09:06 +08:00

rope.py

rename files

2024-06-07 00:09:06 +08:00

unsloth.py

rename files

2024-06-07 00:09:06 +08:00

valuehead.py

rename files

2024-06-07 00:09:06 +08:00

visual.py

rename files

2024-06-07 00:09:06 +08:00