hiyouga
|
c1262dbf94
|
Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory
Former-commit-id: 226a9e563f15ad125856db371871e6f4a3d3eef0
|
2024-07-04 14:23:37 +08:00 |
|
hiyouga
|
e17f12fcad
|
fix #4677
Former-commit-id: 1e27e8c776acadf312804a6d9a243955427e9978
|
2024-07-04 14:22:07 +08:00 |
|
hoshi-hiyouga
|
d08456c0ce
|
Merge pull request #4673 from hzhaoy/main
tiny fix
Former-commit-id: 07d96d497ca807cad1a6941ec27b019fc6769e06
|
2024-07-04 10:40:41 +08:00 |
|
hzhaoy
|
6d892dbc23
|
tiny fix
Former-commit-id: 738df477485de3633049651a9f1d498adf95a3d5
|
2024-07-04 10:20:28 +08:00 |
|
hiyouga
|
aa14a625e4
|
update tests
Former-commit-id: 636bb9c1e65e72c3a27049dacb3200234d1c2782
|
2024-07-04 04:00:12 +08:00 |
|
hiyouga
|
d7657d772d
|
tiny fix
Former-commit-id: 0c699de39de06eac96af67e8dd4fc4c53335b17e
|
2024-07-04 03:47:05 +08:00 |
|
hiyouga
|
cbb93a2b47
|
tiny fix
Former-commit-id: 44747cebd28d0b800196f032e18d2f4ff51ee5b3
|
2024-07-04 03:02:23 +08:00 |
|
hiyouga
|
4987aa32ba
|
fix data map for packing
Former-commit-id: b5d101e1bf435731e6b8e5aed8727ddfb021e4f0
|
2024-07-04 03:01:31 +08:00 |
|
hiyouga
|
c15210a312
|
update wechat
Former-commit-id: b03e4a74bab17d7fdce36c48123126f502c3f98b
|
2024-07-04 01:55:05 +08:00 |
|
hiyouga
|
7b3c1f29ff
|
fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530f81a2ed306eeb2a5167607288b62c6
|
2024-07-04 01:52:43 +08:00 |
|
hoshi-hiyouga
|
a38ff842d0
|
Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention
Former-commit-id: 87d9b2d00513c163335d3f2e2bb3cb3299cecdaa
|
2024-07-04 01:18:54 +08:00 |
|
hiyouga
|
bfdaadcc40
|
update packing
Former-commit-id: cce7083024bed4c7429ddc8288d1c9190fde29f5
|
2024-07-04 01:10:55 +08:00 |
|
hoshi-hiyouga
|
51c75985b8
|
Update packing.py
Former-commit-id: a36e8f2dd50e0f1c589457a7e785fdbc905d561d
|
2024-07-03 23:36:01 +08:00 |
|
hiyouga
|
13cec0cc2f
|
update func name
Former-commit-id: c346f79f99db5296000e4d22a65e53c26e85b344
|
2024-07-03 23:29:33 +08:00 |
|
hiyouga
|
e671ed520b
|
update arg name
Former-commit-id: 8a6a7b9c8a876da9c16e5ada7df461eb8cabee21
|
2024-07-03 23:23:24 +08:00 |
|
hiyouga
|
ff6fc666c1
|
update hparams
Former-commit-id: 575a02a23d9b41d00ca6291d8a40b5bdb3cbeeec
|
2024-07-03 23:18:58 +08:00 |
|
hiyouga
|
b254df2d34
|
update ui
Former-commit-id: 7f770f6895f1e2e0b8e4f0b49088bfae096f6d3c
|
2024-07-03 23:13:49 +08:00 |
|
hiyouga
|
28c8e083f4
|
test
Former-commit-id: a4a1ddbcb987422cd04125ff3f36f8c739061b5c
|
2024-07-03 23:05:39 +08:00 |
|
hiyouga
|
e5c89890b1
|
update scripts
Former-commit-id: 1e0c860c8c5ae8958d7105acafdac5d253a585f9
|
2024-07-03 20:07:44 +08:00 |
|
hiyouga
|
3595d98b4c
|
fix #4609
unwrap_model_for_generation(reward_model) is necessary for zero3 training
Former-commit-id: 8845e94f917b503bbee0604d7290efea7260a30c
|
2024-07-03 19:45:51 +08:00 |
|
hiyouga
|
0d438e5cf4
|
update readme
Former-commit-id: 87346c094631b054ca975694416df324d2031c9a
|
2024-07-03 19:39:05 +08:00 |
|
hoshi-hiyouga
|
34bec52cc4
|
Merge pull request #4662 from wzh1994/wzh/readme
Add `LazyLLM` to `Projects using LLaMA Factory` in `README.md`
Former-commit-id: 3449c3531f09f0ad45afe765bd4bb8f5d338fe75
|
2024-07-03 15:51:02 +08:00 |
|
wangzhihong
|
84f8113bb1
|
Update README_zh.md
Former-commit-id: 6f8f53f879faf991c494ee9655a47f905fd11867
|
2024-07-03 14:59:09 +08:00 |
|
wangzhihong
|
3881f4eb58
|
add LazyLLM to Projects using LLaMA Factory in README.md
Former-commit-id: 22da47ba27dc9c15887d21d47c456fb26fc81f5b
|
2024-07-03 11:12:20 +08:00 |
|
hiyouga
|
104151d558
|
tiny fix
Former-commit-id: 8b1172b91085125a83a4150943873141c8bbd8bc
|
2024-07-03 02:31:50 +08:00 |
|
hiyouga
|
c9e9beee4e
|
tiny fix
Former-commit-id: 71cdf8956e1640a1f3e5f6a4b86d28db70e72041
|
2024-07-02 23:06:13 +08:00 |
|
hiyouga
|
ea2d3f6c18
|
remove rlhf support for chatglm2&3
Former-commit-id: 821bb6660e57c29ebf6ac482e78dd2efb8d72437
|
2024-07-02 23:03:17 +08:00 |
|
hiyouga
|
4828bed837
|
upcast logits
Former-commit-id: c13ae2df19ed4cdc849bef55d04225e1a98c19b5
|
2024-07-02 22:32:05 +08:00 |
|
hiyouga
|
cc31014002
|
improve rlhf
Former-commit-id: c47ab6c07287fb260ea49b8b7af46bdd416f88f7
|
2024-07-02 22:23:08 +08:00 |
|
ancv
|
7f42932957
|
move efficient_packing from data_args to model_args
Former-commit-id: e8e13b09423dd08a31a3bde8f85833c6e5d43ee5
|
2024-07-02 18:37:55 +07:00 |
|
hiyouga
|
1e0a2f722b
|
Update bug-report.yml
Former-commit-id: 9dcff3a5b5ae627832c0eac256ab234179ad3b98
|
2024-07-02 19:18:56 +08:00 |
|
hiyouga
|
591a4cf42a
|
Update bug-report.yml
Former-commit-id: c81687963a16450b9176825198a06e59e1a0dce6
|
2024-07-02 19:16:12 +08:00 |
|
hoshi-hiyouga
|
773d857eb8
|
Merge pull request #4651 from hzhaoy/add-telechat-1b
Add TeleChat-1B
Former-commit-id: 4e4b3cc9057659bebe2bd8fb1629dde484996744
|
2024-07-02 17:56:43 +08:00 |
|
hzhaoy
|
28e787116b
|
add TeleChat-1B
Former-commit-id: 57b7c00430bcfc83afd11547ceead041e8edfd8d
|
2024-07-02 17:49:04 +08:00 |
|
hiyouga
|
08296f4092
|
fix ppo callbacks
Former-commit-id: 4c296001c4b77b814e4bd6cb4049a279718cb775
|
2024-07-02 17:34:56 +08:00 |
|
hoshi-hiyouga
|
2452f57cd7
|
Merge branch 'main' into main
Former-commit-id: e8e6af26514272e29a50649b38182beb4db4ebfa
|
2024-07-01 21:01:09 +08:00 |
|
hiyouga
|
48a299f8ae
|
Update wechat_npu.jpg
Former-commit-id: 33f2ddb8b68d11370a1e113330a4e10c39fba744
|
2024-07-01 16:28:54 +08:00 |
|
hiyouga
|
2cf03017a0
|
tiny fix
Former-commit-id: 73280b7dc7f8b3210bb08dfc3cf34760190f585a
|
2024-07-01 05:43:17 +08:00 |
|
hiyouga
|
de4de5b5ab
|
tiny fix
Former-commit-id: 8c41a0aa6db8bf31200c83b14819d474927268a1
|
2024-07-01 03:55:20 +08:00 |
|
hiyouga
|
54e786346e
|
add eval acc
Former-commit-id: 1856a08e87b150fa4bffcb0af703ed84d848e24b
|
2024-07-01 03:51:20 +08:00 |
|
hiyouga
|
a475d808f2
|
Update label_issue.yml
Former-commit-id: fc2c15d71321838aad05ff27323c0199840b3956
|
2024-07-01 01:29:09 +08:00 |
|
hiyouga
|
ca7b65439d
|
fix #4402 #4617
Deprecate reserved_label_len arg
Former-commit-id: 1771251ce3f6887b301dac10f3de7a253c5e5884
|
2024-07-01 01:19:27 +08:00 |
|
hiyouga
|
768093c789
|
update readme
Former-commit-id: d4e2af1fa422caeb1a2daff7cb9af17073cab13c
|
2024-07-01 00:22:52 +08:00 |
|
hiyouga
|
bbc37b2880
|
fix #4398 #4592
Former-commit-id: d74244d56858d837044e5c9cea57a1b3c2ca0214
|
2024-06-30 21:28:51 +08:00 |
|
hiyouga
|
4b1ab6c83d
|
update npu docker
Former-commit-id: 93e6fbb37ddb60ed356d0acc720463a8cd1a8baa
|
2024-06-30 21:05:31 +08:00 |
|
hiyouga
|
2b006beab1
|
loose gemma2 attention
Former-commit-id: 2f4b89ace15b7a4d2adf16eeba9feb7de9e25d43
|
2024-06-29 01:42:14 +08:00 |
|
hiyouga
|
c3792dae9f
|
update readme
Former-commit-id: 0e0d69b77c36a6110f43b0c760e9b86e2f5ee267
|
2024-06-28 06:55:19 +08:00 |
|
hiyouga
|
87e60f8bac
|
bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
Former-commit-id: 4d35e218b1d60ff24b368ff5bc608be9c85411de
|
2024-06-28 06:00:26 +08:00 |
|
hiyouga
|
b0acd27114
|
increase pissa_iter for stability
Former-commit-id: 64f4337daca4c914d86a7181dd582508688383cd
|
2024-06-28 03:18:54 +08:00 |
|
hiyouga
|
cba994b9dc
|
fix docker flashattn
Former-commit-id: e3141f5f1b435d12c71d8b1fc6ade6e69deead71
|
2024-06-28 01:28:59 +08:00 |
|