hiyouga
|
e1e01d7efd
|
add unittest
Former-commit-id: 608de799a21f37319bf31c04c0aa50c4542ec757
|
2024-07-19 01:06:27 +08:00 |
|
hiyouga
|
34f16cc635
|
follow #4878 fix #4684
Former-commit-id: 779aae83d253de0a86201ff87543b5d695e28d23
|
2024-07-18 22:06:12 +08:00 |
|
Shiyu Zhang
|
249adacc4d
|
仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2489055574fd3365425d26360d73897
|
2024-07-18 15:30:25 +08:00 |
|
hiyouga
|
3c7b10b1fa
|
fix metrics #4786
Former-commit-id: beec77a0898a39d94f41c23920415f5b4873a23a
|
2024-07-17 00:47:00 +08:00 |
|
hiyouga
|
e90fae61f4
|
support batch_eval_metrics, fix #4826
Former-commit-id: d774b94f124923829b2eae428e25199d503ebfcb
|
2024-07-17 00:33:00 +08:00 |
|
hiyouga
|
ca40e42b3c
|
tiny fix
Former-commit-id: bda302fbfbdb114dee7782d405732600d2d73279
|
2024-07-15 23:09:50 +08:00 |
|
hoshi-hiyouga
|
b19e2f84b6
|
Merge pull request #4821 from codemayq/feature-eval-split
add "split" as suffix in eval task name
Former-commit-id: 38bc411d42108e7859ec6a031f63c5188246f18c
|
2024-07-15 22:59:44 +08:00 |
|
hiyouga
|
84e6715423
|
fix #4820
Former-commit-id: fd8cc490084aba9b5155eaaaf26129efd2871fa3
|
2024-07-15 22:32:07 +08:00 |
|
codingma
|
76046dfda8
|
1. change the task name format
2. delete split param in data_args.py
Former-commit-id: 645211dc01b5d4db3ccd0e3dce03a53860eded26
|
2024-07-15 09:55:33 +08:00 |
|
hiyouga
|
22859b8734
|
allow computing rouge in training
Former-commit-id: 99ab7a8c1c966232faa11b6a42b9740d9a20ace3
|
2024-07-15 01:16:26 +08:00 |
|
hiyouga
|
14bc7b0551
|
fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
|
2024-07-15 01:04:56 +08:00 |
|
hoshi-hiyouga
|
2b22a7da48
|
Merge pull request #4691 from codemayq/feature-suppot-eval-dataset
add eval dataset support
Former-commit-id: 15b399a82f45b08fc07d2957884fb7821eba9fd9
|
2024-07-15 01:00:34 +08:00 |
|
hoshi-hiyouga
|
788dc1c679
|
Update data_args.py
Former-commit-id: cba673f491c5d97aba62aea03f310bd54fb3fe28
|
2024-07-15 00:56:03 +08:00 |
|
hoshi-hiyouga
|
30a3c6e886
|
Update preprocess.py
Former-commit-id: df52fb05b1b08887288bbaab7c612b7ac27c2290
|
2024-07-15 00:55:36 +08:00 |
|
hoshi-hiyouga
|
eed7cbb453
|
Update parser.py
Former-commit-id: 84e4047f8a1f78256be65f3f7bddce358ed9e882
|
2024-07-15 00:55:21 +08:00 |
|
hoshi-hiyouga
|
5633c0ab1e
|
Update data_utils.py
Former-commit-id: 97a0e291c79f145950b54a11d03d81ada4784d22
|
2024-07-15 00:54:34 +08:00 |
|
hoshi-hiyouga
|
2e9c9471da
|
Update loader.py
Former-commit-id: a5b809516e7de1d6d5f4583089fee3028d0db01d
|
2024-07-15 00:50:06 +08:00 |
|
hoshi-hiyouga
|
140b512426
|
Update parser.py
Former-commit-id: 3d39d74003c4ca36f9c9b77f622d366383b0af7e
|
2024-07-14 23:04:34 +08:00 |
|
hiyouga
|
dfd2d912cd
|
fix #4699
slow tokenizer for yi models
Former-commit-id: 88a20ba7972c533d650967a118d612471fe2b2e8
|
2024-07-14 15:34:22 +08:00 |
|
hiyouga
|
12e0e5d0d7
|
tiny fix
Former-commit-id: d3c01552e0f978f150902175f096f6e3bfb64363
|
2024-07-14 10:56:45 +08:00 |
|
hiyouga
|
0b26011181
|
fix gemma2 attention
Former-commit-id: 2f6af73da28c4f8321b625fd09ddec8bd4977b08
|
2024-07-13 23:33:45 +08:00 |
|
hoshi-hiyouga
|
e83e36e475
|
Merge pull request #4781 from hzhaoy/fix-dockerfile-cuda
Fix cuda Dockerfile
Former-commit-id: 5da54deb50d50385197a5aa9743e6695c066088a
|
2024-07-13 22:25:32 +08:00 |
|
hiyouga
|
3baf1d1f7e
|
fix #4792
Former-commit-id: 6b48308ef9be34d072f3e6bb2444e186a38c2779
|
2024-07-13 22:07:58 +08:00 |
|
hzhaoy
|
955e01c038
|
tiny fix
Former-commit-id: 8bab99c5829a80752e461cf65a9124fdea609676
|
2024-07-12 00:28:44 +08:00 |
|
hoshi-hiyouga
|
f85187b4dd
|
Merge pull request #4700 from marko1616/patch-1
Fix Windows command preview
Former-commit-id: 555194e15026c444b2bd1c09f521950cbff86c21
|
2024-07-10 13:51:50 +08:00 |
|
hoshi-hiyouga
|
4edd7c3529
|
Update callbacks.py
Former-commit-id: 39cd89ce17220dc50c8331299ae5af230fe40cc9
|
2024-07-10 13:32:20 +08:00 |
|
-.-
|
973aac3203
|
fix src/llamafactory/train/callbacks.py
Former-commit-id: cff89a2e8907f3fe89406006105cb6494e2ee993
|
2024-07-10 12:05:51 +08:00 |
|
hiyouga
|
a9ce54d143
|
fix #4731
Former-commit-id: 51942acee84cdb20002f8fdccf6be8c7fe9bd0d3
|
2024-07-10 11:32:36 +08:00 |
|
hiyouga
|
d7130ec635
|
fix ppo trainer
Former-commit-id: fb0c40011689b3ae84cc3b258bf3c66af3e1e430
|
2024-07-10 11:05:45 +08:00 |
|
hiyouga
|
aa15ca1719
|
fix #4742
Former-commit-id: 2f09520c0d5039a5a8be310ab668272cb4dc1bd3
|
2024-07-09 23:24:24 +08:00 |
|
hoshi-hiyouga
|
7483e187c6
|
Update packages.py
Former-commit-id: f84b007ebbb9fa63f797b4bd1c487372877bbc65
|
2024-07-07 15:48:29 +08:00 |
|
Lian Junhong
|
7ca84e0a09
|
chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 322663bf90ce7b99ca5b0b43ff9dbd95eb36ff6b
|
2024-07-07 15:08:12 +08:00 |
|
hiyouga
|
f3c105f088
|
fix #4705
Former-commit-id: a15782cb9f3ee64ba1f5fc2a3da20ac6c6ef0aa0
|
2024-07-07 13:10:06 +08:00 |
|
marko1616
|
c8205c5163
|
Update utils.py
In windows mutiline command should like
command --arg1 xxx `
--arg2 xxx `
Former-commit-id: e0562521bbd7cf6b3b90f8c87e52690931f736bd
|
2024-07-06 20:40:13 +08:00 |
|
hiyouga
|
7fcffb860d
|
add codegeex4, internlm2.5
Former-commit-id: 53b1002fb74123095e7466c75b941a31a7cfba4d
|
2024-07-06 16:16:47 +08:00 |
|
codingma
|
74f0d02eb8
|
1. add custom eval dataset support
2. merge load dataset and split dataset function
Former-commit-id: 76f3bbcfc0e11aa41f8f5cbebc60b77b987f7901
|
2024-07-05 15:52:10 +08:00 |
|
hiyouga
|
8379a39776
|
fix processors
Former-commit-id: 9f33f1edf544807e498f60881f30b00149fe570f
|
2024-07-05 08:33:22 +08:00 |
|
hiyouga
|
9aa3403687
|
fix #4683
Former-commit-id: e43809bced009323b3bac9accdd3baa3a2836fdb
|
2024-07-05 00:58:05 +08:00 |
|
hiyouga
|
956e555310
|
fix #4674
Former-commit-id: ed232311e857865da2f493d3ead9a9ffa44953e9
|
2024-07-05 00:41:03 +08:00 |
|
hiyouga
|
c1262dbf94
|
Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory
Former-commit-id: 226a9e563f15ad125856db371871e6f4a3d3eef0
|
2024-07-04 14:23:37 +08:00 |
|
hiyouga
|
e17f12fcad
|
fix #4677
Former-commit-id: 1e27e8c776acadf312804a6d9a243955427e9978
|
2024-07-04 14:22:07 +08:00 |
|
hzhaoy
|
6d892dbc23
|
tiny fix
Former-commit-id: 738df477485de3633049651a9f1d498adf95a3d5
|
2024-07-04 10:20:28 +08:00 |
|
hiyouga
|
d7657d772d
|
tiny fix
Former-commit-id: 0c699de39de06eac96af67e8dd4fc4c53335b17e
|
2024-07-04 03:47:05 +08:00 |
|
hiyouga
|
cbb93a2b47
|
tiny fix
Former-commit-id: 44747cebd28d0b800196f032e18d2f4ff51ee5b3
|
2024-07-04 03:02:23 +08:00 |
|
hiyouga
|
4987aa32ba
|
fix data map for packing
Former-commit-id: b5d101e1bf435731e6b8e5aed8727ddfb021e4f0
|
2024-07-04 03:01:31 +08:00 |
|
hiyouga
|
7b3c1f29ff
|
fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530f81a2ed306eeb2a5167607288b62c6
|
2024-07-04 01:52:43 +08:00 |
|
hoshi-hiyouga
|
a38ff842d0
|
Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention
Former-commit-id: 87d9b2d00513c163335d3f2e2bb3cb3299cecdaa
|
2024-07-04 01:18:54 +08:00 |
|
hiyouga
|
bfdaadcc40
|
update packing
Former-commit-id: cce7083024bed4c7429ddc8288d1c9190fde29f5
|
2024-07-04 01:10:55 +08:00 |
|
hoshi-hiyouga
|
51c75985b8
|
Update packing.py
Former-commit-id: a36e8f2dd50e0f1c589457a7e785fdbc905d561d
|
2024-07-03 23:36:01 +08:00 |
|
hiyouga
|
13cec0cc2f
|
update func name
Former-commit-id: c346f79f99db5296000e4d22a65e53c26e85b344
|
2024-07-03 23:29:33 +08:00 |
|