codingma
|
03de5ac912
|
add nf4 qlora support on Ascend NPU (#6601)
* add nf4 qlora support on Ascend NPU
* add transformers version check
* add python>=3.10 requirement description for npu
* tiny fix
---------
Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
|
2025-01-13 19:43:36 +08:00 |
|
hiyouga
|
47e17dd689
|
imporve log
|
2025-01-08 09:56:10 +00:00 |
|
hiyouga
|
446441fdb0
|
fix inputs
|
2024-11-23 18:26:02 +00:00 |
|
hiyouga
|
c38aa29336
|
support rank0 logger
|
2024-11-02 18:31:04 +08:00 |
|
hiyouga
|
30567a1487
|
fix incorrect loss value for vlms
|
2024-10-30 08:56:46 +00:00 |
|
hiyouga
|
77666bd227
|
update requires
|
2024-10-29 16:10:07 +08:00 |
|
hiyouga
|
451d271718
|
tiny fix
|
2024-10-08 17:48:56 +08:00 |
|
hiyouga
|
76f2e59504
|
tiny fix
|
2024-09-05 23:41:16 +08:00 |
|
hiyouga
|
3382317e32
|
refactor mm training
|
2024-08-30 02:14:31 +08:00 |
|
hiyouga
|
b7ca6c8dc1
|
fix #5048
|
2024-08-05 23:48:19 +08:00 |
|
hiyouga
|
29ebcd75d5
|
fix up
|
2024-07-15 01:04:56 +08:00 |
|
hiyouga
|
2f6af73da2
|
fix gemma2 attention
|
2024-07-13 23:33:45 +08:00 |
|
hiyouga
|
8b1172b910
|
tiny fix
|
2024-07-03 02:31:50 +08:00 |
|
hiyouga
|
38b6b0f52e
|
tiny fix
|
2024-06-16 01:06:41 +08:00 |
|
hiyouga
|
d87108daa6
|
add license
|
2024-06-15 17:54:33 +08:00 |
|
hiyouga
|
3f24337a8a
|
tiny fix
|
2024-06-11 01:04:16 +08:00 |
|
hiyouga
|
a793e8456b
|
fix #4160
The split heads should be concatenated in dim=2
|
2024-06-11 00:37:17 +08:00 |
|
hiyouga
|
74f96efef9
|
rename files
|
2024-06-07 00:09:06 +08:00 |
|