Commit Graph

18 Commits

Author SHA1 Message Date
codingma
03de5ac912 add nf4 qlora support on Ascend NPU (#6601)
* add nf4 qlora support on Ascend NPU

* add transformers version check

* add python>=3.10 requirement description for npu

* tiny fix

---------

Co-authored-by: hoshi-hiyouga <hiyouga@buaa.edu.cn>
2025-01-13 19:43:36 +08:00
hiyouga
47e17dd689 imporve log 2025-01-08 09:56:10 +00:00
hiyouga
446441fdb0 fix inputs 2024-11-23 18:26:02 +00:00
hiyouga
c38aa29336 support rank0 logger 2024-11-02 18:31:04 +08:00
hiyouga
30567a1487 fix incorrect loss value for vlms 2024-10-30 08:56:46 +00:00
hiyouga
77666bd227 update requires 2024-10-29 16:10:07 +08:00
hiyouga
451d271718 tiny fix 2024-10-08 17:48:56 +08:00
hiyouga
76f2e59504 tiny fix 2024-09-05 23:41:16 +08:00
hiyouga
3382317e32 refactor mm training 2024-08-30 02:14:31 +08:00
hiyouga
b7ca6c8dc1 fix #5048 2024-08-05 23:48:19 +08:00
hiyouga
29ebcd75d5 fix up 2024-07-15 01:04:56 +08:00
hiyouga
2f6af73da2 fix gemma2 attention 2024-07-13 23:33:45 +08:00
hiyouga
8b1172b910 tiny fix 2024-07-03 02:31:50 +08:00
hiyouga
38b6b0f52e tiny fix 2024-06-16 01:06:41 +08:00
hiyouga
d87108daa6 add license 2024-06-15 17:54:33 +08:00
hiyouga
3f24337a8a tiny fix 2024-06-11 01:04:16 +08:00
hiyouga
a793e8456b fix #4160
The split heads should be concatenated in dim=2
2024-06-11 00:37:17 +08:00
hiyouga
74f96efef9 rename files 2024-06-07 00:09:06 +08:00