loose gemma2 attention

Former-commit-id: a0b645017a2de3d58b6cbc71bd91ec96fc7a818b
This commit is contained in:
hiyouga
2024-06-29 01:42:14 +08:00
parent b9f2c6e64e
commit f7a4f3d9c0
2 changed files with 9 additions and 6 deletions

View File

@@ -1,7 +1,4 @@
# Copyright 2024 HuggingFace Inc. and the LlamaFactory team.
#
# This code is inspired by the HuggingFace's transformers library.
# https://github.com/huggingface/transformers/blob/v4.40.0/src/transformers/trainer.py
# Copyright 2024 the LlamaFactory team.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.