Commit Graph

1897 Commits

Author SHA1 Message Date
hiyouga
d7130ec635 fix ppo trainer
Former-commit-id: fb0c400116
2024-07-10 11:05:45 +08:00
hiyouga
aa15ca1719 fix #4742
Former-commit-id: 2f09520c0d
2024-07-09 23:24:24 +08:00
hiyouga
7e9d51fb95 Update wechat.jpg
Former-commit-id: 86b1594823
2024-07-09 09:25:11 +08:00
hoshi-hiyouga
553e517f0f Merge pull request #4706 from T-Atlas/main
chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 563a27dab7
2024-07-07 15:50:38 +08:00
hoshi-hiyouga
7483e187c6 Update packages.py
Former-commit-id: f84b007ebb
2024-07-07 15:48:29 +08:00
Lian Junhong
7ca84e0a09 chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 322663bf90
2024-07-07 15:08:12 +08:00
hiyouga
f3c105f088 fix #4705
Former-commit-id: a15782cb9f
2024-07-07 13:10:06 +08:00
hiyouga
7fcffb860d add codegeex4, internlm2.5
Former-commit-id: 53b1002fb7
2024-07-06 16:16:47 +08:00
hiyouga
d97bb11821 update pissa example
Former-commit-id: c9bb0757ec
2024-07-06 15:47:32 +08:00
hiyouga
8379a39776 fix processors
Former-commit-id: 9f33f1edf5
2024-07-05 08:33:22 +08:00
hiyouga
9aa3403687 fix #4683
Former-commit-id: e43809bced
2024-07-05 00:58:05 +08:00
hiyouga
956e555310 fix #4674
Former-commit-id: ed232311e8
2024-07-05 00:41:03 +08:00
hiyouga
c1262dbf94 Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory
Former-commit-id: 226a9e563f
2024-07-04 14:23:37 +08:00
hiyouga
e17f12fcad fix #4677
Former-commit-id: 1e27e8c776
2024-07-04 14:22:07 +08:00
hoshi-hiyouga
d08456c0ce Merge pull request #4673 from hzhaoy/main
tiny fix

Former-commit-id: 07d96d497c
2024-07-04 10:40:41 +08:00
hzhaoy
6d892dbc23 tiny fix
Former-commit-id: 738df47748
2024-07-04 10:20:28 +08:00
hiyouga
aa14a625e4 update tests
Former-commit-id: 636bb9c1e6
2024-07-04 04:00:12 +08:00
hiyouga
d7657d772d tiny fix
Former-commit-id: 0c699de39d
2024-07-04 03:47:05 +08:00
hiyouga
cbb93a2b47 tiny fix
Former-commit-id: 44747cebd2
2024-07-04 03:02:23 +08:00
hiyouga
4987aa32ba fix data map for packing
Former-commit-id: b5d101e1bf
2024-07-04 03:01:31 +08:00
hiyouga
c15210a312 update wechat
Former-commit-id: b03e4a74ba
2024-07-04 01:55:05 +08:00
hiyouga
7b3c1f29ff fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530
2024-07-04 01:52:43 +08:00
hoshi-hiyouga
a38ff842d0 Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention

Former-commit-id: 87d9b2d005
2024-07-04 01:18:54 +08:00
hiyouga
bfdaadcc40 update packing
Former-commit-id: cce7083024
2024-07-04 01:10:55 +08:00
hoshi-hiyouga
51c75985b8 Update packing.py
Former-commit-id: a36e8f2dd5
2024-07-03 23:36:01 +08:00
hiyouga
13cec0cc2f update func name
Former-commit-id: c346f79f99
2024-07-03 23:29:33 +08:00
hiyouga
e671ed520b update arg name
Former-commit-id: 8a6a7b9c8a
2024-07-03 23:23:24 +08:00
hiyouga
ff6fc666c1 update hparams
Former-commit-id: 575a02a23d
2024-07-03 23:18:58 +08:00
hiyouga
b254df2d34 update ui
Former-commit-id: 7f770f6895
2024-07-03 23:13:49 +08:00
hiyouga
28c8e083f4 test
Former-commit-id: a4a1ddbcb9
2024-07-03 23:05:39 +08:00
hiyouga
e5c89890b1 update scripts
Former-commit-id: 1e0c860c8c
2024-07-03 20:07:44 +08:00
hiyouga
3595d98b4c fix #4609
unwrap_model_for_generation(reward_model) is necessary for zero3 training


Former-commit-id: 8845e94f91
2024-07-03 19:45:51 +08:00
hiyouga
0d438e5cf4 update readme
Former-commit-id: 87346c0946
2024-07-03 19:39:05 +08:00
hoshi-hiyouga
34bec52cc4 Merge pull request #4662 from wzh1994/wzh/readme
Add `LazyLLM` to `Projects using LLaMA Factory` in `README.md`

Former-commit-id: 3449c3531f
2024-07-03 15:51:02 +08:00
wangzhihong
84f8113bb1 Update README_zh.md
Former-commit-id: 6f8f53f879
2024-07-03 14:59:09 +08:00
wangzhihong
3881f4eb58 add LazyLLM to Projects using LLaMA Factory in README.md
Former-commit-id: 22da47ba27
2024-07-03 11:12:20 +08:00
hiyouga
104151d558 tiny fix
Former-commit-id: 8b1172b910
2024-07-03 02:31:50 +08:00
hiyouga
c9e9beee4e tiny fix
Former-commit-id: 71cdf8956e
2024-07-02 23:06:13 +08:00
hiyouga
ea2d3f6c18 remove rlhf support for chatglm2&3
Former-commit-id: 821bb6660e
2024-07-02 23:03:17 +08:00
hiyouga
4828bed837 upcast logits
Former-commit-id: c13ae2df19
2024-07-02 22:32:05 +08:00
hiyouga
cc31014002 improve rlhf
Former-commit-id: c47ab6c072
2024-07-02 22:23:08 +08:00
ancv
7f42932957 move efficient_packing from data_args to model_args
Former-commit-id: e8e13b0942
2024-07-02 18:37:55 +07:00
hiyouga
1e0a2f722b Update bug-report.yml
Former-commit-id: 9dcff3a5b5
2024-07-02 19:18:56 +08:00
hiyouga
591a4cf42a Update bug-report.yml
Former-commit-id: c81687963a
2024-07-02 19:16:12 +08:00
hoshi-hiyouga
773d857eb8 Merge pull request #4651 from hzhaoy/add-telechat-1b
Add TeleChat-1B

Former-commit-id: 4e4b3cc905
2024-07-02 17:56:43 +08:00
hzhaoy
28e787116b add TeleChat-1B
Former-commit-id: 57b7c00430
2024-07-02 17:49:04 +08:00
hiyouga
08296f4092 fix ppo callbacks
Former-commit-id: 4c296001c4
2024-07-02 17:34:56 +08:00
hoshi-hiyouga
2452f57cd7 Merge branch 'main' into main
Former-commit-id: e8e6af2651
2024-07-01 21:01:09 +08:00
hiyouga
48a299f8ae Update wechat_npu.jpg
Former-commit-id: 33f2ddb8b6
2024-07-01 16:28:54 +08:00
hiyouga
2cf03017a0 tiny fix
Former-commit-id: 73280b7dc7
2024-07-01 05:43:17 +08:00