hzhaoy
|
6d892dbc23
|
tiny fix
Former-commit-id: 738df47748
|
2024-07-04 10:20:28 +08:00 |
|
hiyouga
|
aa14a625e4
|
update tests
Former-commit-id: 636bb9c1e6
|
2024-07-04 04:00:12 +08:00 |
|
hiyouga
|
d7657d772d
|
tiny fix
Former-commit-id: 0c699de39d
|
2024-07-04 03:47:05 +08:00 |
|
hiyouga
|
cbb93a2b47
|
tiny fix
Former-commit-id: 44747cebd2
|
2024-07-04 03:02:23 +08:00 |
|
hiyouga
|
4987aa32ba
|
fix data map for packing
Former-commit-id: b5d101e1bf
|
2024-07-04 03:01:31 +08:00 |
|
hiyouga
|
c15210a312
|
update wechat
Former-commit-id: b03e4a74ba
|
2024-07-04 01:55:05 +08:00 |
|
hiyouga
|
7b3c1f29ff
|
fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530
|
2024-07-04 01:52:43 +08:00 |
|
hoshi-hiyouga
|
a38ff842d0
|
Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention
Former-commit-id: 87d9b2d005
|
2024-07-04 01:18:54 +08:00 |
|
hiyouga
|
bfdaadcc40
|
update packing
Former-commit-id: cce7083024
|
2024-07-04 01:10:55 +08:00 |
|
hoshi-hiyouga
|
51c75985b8
|
Update packing.py
Former-commit-id: a36e8f2dd5
|
2024-07-03 23:36:01 +08:00 |
|
hiyouga
|
13cec0cc2f
|
update func name
Former-commit-id: c346f79f99
|
2024-07-03 23:29:33 +08:00 |
|
hiyouga
|
e671ed520b
|
update arg name
Former-commit-id: 8a6a7b9c8a
|
2024-07-03 23:23:24 +08:00 |
|
hiyouga
|
ff6fc666c1
|
update hparams
Former-commit-id: 575a02a23d
|
2024-07-03 23:18:58 +08:00 |
|
hiyouga
|
b254df2d34
|
update ui
Former-commit-id: 7f770f6895
|
2024-07-03 23:13:49 +08:00 |
|
hiyouga
|
28c8e083f4
|
test
Former-commit-id: a4a1ddbcb9
|
2024-07-03 23:05:39 +08:00 |
|
hiyouga
|
e5c89890b1
|
update scripts
Former-commit-id: 1e0c860c8c
|
2024-07-03 20:07:44 +08:00 |
|
hiyouga
|
3595d98b4c
|
fix #4609
unwrap_model_for_generation(reward_model) is necessary for zero3 training
Former-commit-id: 8845e94f91
|
2024-07-03 19:45:51 +08:00 |
|
hiyouga
|
0d438e5cf4
|
update readme
Former-commit-id: 87346c0946
|
2024-07-03 19:39:05 +08:00 |
|
hoshi-hiyouga
|
34bec52cc4
|
Merge pull request #4662 from wzh1994/wzh/readme
Add `LazyLLM` to `Projects using LLaMA Factory` in `README.md`
Former-commit-id: 3449c3531f
|
2024-07-03 15:51:02 +08:00 |
|
wangzhihong
|
84f8113bb1
|
Update README_zh.md
Former-commit-id: 6f8f53f879
|
2024-07-03 14:59:09 +08:00 |
|
wangzhihong
|
3881f4eb58
|
add LazyLLM to Projects using LLaMA Factory in README.md
Former-commit-id: 22da47ba27
|
2024-07-03 11:12:20 +08:00 |
|
hiyouga
|
104151d558
|
tiny fix
Former-commit-id: 8b1172b910
|
2024-07-03 02:31:50 +08:00 |
|
hiyouga
|
c9e9beee4e
|
tiny fix
Former-commit-id: 71cdf8956e
|
2024-07-02 23:06:13 +08:00 |
|
hiyouga
|
ea2d3f6c18
|
remove rlhf support for chatglm2&3
Former-commit-id: 821bb6660e
|
2024-07-02 23:03:17 +08:00 |
|
hiyouga
|
4828bed837
|
upcast logits
Former-commit-id: c13ae2df19
|
2024-07-02 22:32:05 +08:00 |
|
hiyouga
|
cc31014002
|
improve rlhf
Former-commit-id: c47ab6c072
|
2024-07-02 22:23:08 +08:00 |
|
ancv
|
7f42932957
|
move efficient_packing from data_args to model_args
Former-commit-id: e8e13b0942
|
2024-07-02 18:37:55 +07:00 |
|
hiyouga
|
1e0a2f722b
|
Update bug-report.yml
Former-commit-id: 9dcff3a5b5
|
2024-07-02 19:18:56 +08:00 |
|
hiyouga
|
591a4cf42a
|
Update bug-report.yml
Former-commit-id: c81687963a
|
2024-07-02 19:16:12 +08:00 |
|
hoshi-hiyouga
|
773d857eb8
|
Merge pull request #4651 from hzhaoy/add-telechat-1b
Add TeleChat-1B
Former-commit-id: 4e4b3cc905
|
2024-07-02 17:56:43 +08:00 |
|
hzhaoy
|
28e787116b
|
add TeleChat-1B
Former-commit-id: 57b7c00430
|
2024-07-02 17:49:04 +08:00 |
|
hiyouga
|
08296f4092
|
fix ppo callbacks
Former-commit-id: 4c296001c4
|
2024-07-02 17:34:56 +08:00 |
|
hoshi-hiyouga
|
2452f57cd7
|
Merge branch 'main' into main
Former-commit-id: e8e6af2651
|
2024-07-01 21:01:09 +08:00 |
|
hiyouga
|
48a299f8ae
|
Update wechat_npu.jpg
Former-commit-id: 33f2ddb8b6
|
2024-07-01 16:28:54 +08:00 |
|
hiyouga
|
2cf03017a0
|
tiny fix
Former-commit-id: 73280b7dc7
|
2024-07-01 05:43:17 +08:00 |
|
hiyouga
|
de4de5b5ab
|
tiny fix
Former-commit-id: 8c41a0aa6d
|
2024-07-01 03:55:20 +08:00 |
|
hiyouga
|
54e786346e
|
add eval acc
Former-commit-id: 1856a08e87
|
2024-07-01 03:51:20 +08:00 |
|
hiyouga
|
a475d808f2
|
Update label_issue.yml
Former-commit-id: fc2c15d713
|
2024-07-01 01:29:09 +08:00 |
|
hiyouga
|
ca7b65439d
|
fix #4402 #4617
Deprecate reserved_label_len arg
Former-commit-id: 1771251ce3
|
2024-07-01 01:19:27 +08:00 |
|
hiyouga
|
768093c789
|
update readme
Former-commit-id: d4e2af1fa4
|
2024-07-01 00:22:52 +08:00 |
|
hiyouga
|
bbc37b2880
|
fix #4398 #4592
Former-commit-id: d74244d568
|
2024-06-30 21:28:51 +08:00 |
|
hiyouga
|
4b1ab6c83d
|
update npu docker
Former-commit-id: 93e6fbb37d
|
2024-06-30 21:05:31 +08:00 |
|
hiyouga
|
2b006beab1
|
loose gemma2 attention
Former-commit-id: 2f4b89ace1
|
2024-06-29 01:42:14 +08:00 |
|
hiyouga
|
c3792dae9f
|
update readme
Former-commit-id: 0e0d69b77c
|
2024-06-28 06:55:19 +08:00 |
|
hiyouga
|
87e60f8bac
|
bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
Former-commit-id: 4d35e218b1
|
2024-06-28 06:00:26 +08:00 |
|
hiyouga
|
b0acd27114
|
increase pissa_iter for stability
Former-commit-id: 64f4337dac
|
2024-06-28 03:18:54 +08:00 |
|
hiyouga
|
cba994b9dc
|
fix docker flashattn
Former-commit-id: e3141f5f1b
|
2024-06-28 01:28:59 +08:00 |
|
hiyouga
|
d3b7c489f2
|
add Gemma2 models
Former-commit-id: 6f63050e1b
|
2024-06-28 01:26:50 +08:00 |
|
hiyouga
|
2105cf6000
|
update examples
Former-commit-id: 2f78b5d62a
|
2024-06-28 01:17:07 +08:00 |
|
hiyouga
|
835f0578c2
|
refactor pissa, improve llamaboard
Former-commit-id: 8baf3b22b0
|
2024-06-28 01:04:24 +08:00 |
|