2091 Commits

Author SHA1 Message Date
hoshi-hiyouga
9d8e0f0837 Merge pull request #4822 from codemayq/test-ci
add github action check to ignore some test cases

Former-commit-id: f2aaebdbde45018e0d08db853ddb975bc2547e14
2024-07-15 23:07:55 +08:00
hoshi-hiyouga
d63c3be556 Update test_template.py
Former-commit-id: 10289eab158c2de13bdde2d5a7c644195e516201
2024-07-15 23:04:39 +08:00
hoshi-hiyouga
c790997fbc Update test_template.py
Former-commit-id: da990f76b881382b9ae6fcfef78dc7df8034947b
2024-07-15 23:00:27 +08:00
hoshi-hiyouga
b19e2f84b6 Merge pull request #4821 from codemayq/feature-eval-split
add "split" as suffix in eval task name

Former-commit-id: 38bc411d42108e7859ec6a031f63c5188246f18c
2024-07-15 22:59:44 +08:00
hoshi-hiyouga
df1f0a1258 Update llama3_lora_eval.yaml
Former-commit-id: 91ba083f37146da0ee321a75701ae79c527ecb51
2024-07-15 22:55:12 +08:00
hoshi-hiyouga
c0493daa60 Update test_template.py
Former-commit-id: 33420bab81cfc7db1dfd3cd4200b8681bf7de9e6
2024-07-15 22:55:05 +08:00
hoshi-hiyouga
f67ddc05d6 Update test_template.py
Former-commit-id: 52a4256ad9aa866f6e1bcbe2c663c0f8ecfdb604
2024-07-15 22:52:25 +08:00
hiyouga
84e6715423 fix #4820
Former-commit-id: fd8cc490084aba9b5155eaaaf26129efd2871fa3
2024-07-15 22:32:07 +08:00
hiyouga
ae0f4ba2d3 update wechat
Former-commit-id: b0aa321a4ad6f146b5d30de20c07feef59f9d0d0
2024-07-15 22:02:52 +08:00
codingma
7146b9457c add IN_GITHUB_ACTIONS
Former-commit-id: 32c3afdfa18dc9560009b324fdf4f2987fc739a9
2024-07-15 10:28:07 +08:00
codingma
76046dfda8 1. change the task name format
2. delete split param in data_args.py


Former-commit-id: 645211dc01b5d4db3ccd0e3dce03a53860eded26
2024-07-15 09:55:33 +08:00
hiyouga
22859b8734 allow computing rouge in training
Former-commit-id: 99ab7a8c1c966232faa11b6a42b9740d9a20ace3
2024-07-15 01:16:26 +08:00
hiyouga
14bc7b0551 fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
2024-07-15 01:04:56 +08:00
hoshi-hiyouga
2b22a7da48 Merge pull request #4691 from codemayq/feature-suppot-eval-dataset
add eval dataset support

Former-commit-id: 15b399a82f45b08fc07d2957884fb7821eba9fd9
2024-07-15 01:00:34 +08:00
hoshi-hiyouga
788dc1c679 Update data_args.py
Former-commit-id: cba673f491c5d97aba62aea03f310bd54fb3fe28
2024-07-15 00:56:03 +08:00
hoshi-hiyouga
30a3c6e886 Update preprocess.py
Former-commit-id: df52fb05b1b08887288bbaab7c612b7ac27c2290
2024-07-15 00:55:36 +08:00
hoshi-hiyouga
eed7cbb453 Update parser.py
Former-commit-id: 84e4047f8a1f78256be65f3f7bddce358ed9e882
2024-07-15 00:55:21 +08:00
hoshi-hiyouga
5633c0ab1e Update data_utils.py
Former-commit-id: 97a0e291c79f145950b54a11d03d81ada4784d22
2024-07-15 00:54:34 +08:00
hoshi-hiyouga
2e9c9471da Update loader.py
Former-commit-id: a5b809516e7de1d6d5f4583089fee3028d0db01d
2024-07-15 00:50:06 +08:00
hiyouga
a9a652eb6f update test template
Former-commit-id: a4ae3ab4ab8e3c6ad9feba4c185e3b592eda3f09
2024-07-15 00:49:34 +08:00
hoshi-hiyouga
140b512426 Update parser.py
Former-commit-id: 3d39d74003c4ca36f9c9b77f622d366383b0af7e
2024-07-14 23:04:34 +08:00
hoshi-hiyouga
ddbd848e49 Update README.md
Former-commit-id: 9d64507bd5d47f096e81c90bfb347690afaaec2b
2024-07-14 21:27:04 +08:00
hiyouga
2564269826 add gemma test
Former-commit-id: f1d8d29bc3ba1b41a72a24834a16a3d125d56461
2024-07-14 18:01:45 +08:00
hiyouga
380c7741f5 fix test
Former-commit-id: 173921419dc24506527cf506bfbfc01541fd2b66
2024-07-14 15:44:30 +08:00
hiyouga
dfd2d912cd fix #4699
slow tokenizer for yi models


Former-commit-id: 88a20ba7972c533d650967a118d612471fe2b2e8
2024-07-14 15:34:22 +08:00
hiyouga
12e0e5d0d7 tiny fix
Former-commit-id: d3c01552e0f978f150902175f096f6e3bfb64363
2024-07-14 10:56:45 +08:00
hiyouga
0b26011181 fix gemma2 attention
Former-commit-id: 2f6af73da28c4f8321b625fd09ddec8bd4977b08
2024-07-13 23:33:45 +08:00
hiyouga
fb387ae1c3 update workflows
Former-commit-id: 7b19e99ed73faea99c35d49a611187ba1a5c8c73
2024-07-13 22:31:15 +08:00
hoshi-hiyouga
e83e36e475 Merge pull request #4781 from hzhaoy/fix-dockerfile-cuda
Fix cuda Dockerfile

Former-commit-id: 5da54deb50d50385197a5aa9743e6695c066088a
2024-07-13 22:25:32 +08:00
hiyouga
3baf1d1f7e fix #4792
Former-commit-id: 6b48308ef9be34d072f3e6bb2444e186a38c2779
2024-07-13 22:07:58 +08:00
hoshi-hiyouga
f616fd61bd Merge pull request #4804 from codemayq/fix-examples
tiny fix of examples

Former-commit-id: 32699a82a6dc3c0104c0884b763a623e521b9a5f
2024-07-13 20:49:13 +08:00
hoshi-hiyouga
f9a4d96194 Update llava1_5.yaml
Former-commit-id: f618b80fa2173003b7e960dd20cecbede3db41c9
2024-07-13 20:30:06 +08:00
codingma
1ccc6153c7 1. fix output_dir in llama3_lora_pretrain.yaml
2. add llava1_5.yaml for inference


Former-commit-id: 982a1cdd24dfa51535af3e49c7ea80fddc95b0ee
2024-07-13 13:16:22 +08:00
hzhaoy
955e01c038 tiny fix
Former-commit-id: 8bab99c5829a80752e461cf65a9124fdea609676
2024-07-12 00:28:44 +08:00
hzhaoy
93ba3bd5b0 fix #4780
Former-commit-id: 642c6d666f3bd00fcdea45c65a6394bcae9c2080
2024-07-12 00:25:48 +08:00
hzhaoy
b3e4793ded fix #4779
Former-commit-id: a8bf1abf0fd39f84748c94ac3ba39eaa53137529
2024-07-12 00:15:15 +08:00
codemayq
0fa59c9b4c update wechat_npu.jpg
Former-commit-id: 67040f149c0b3fbae443ba656ed0dcab0ebaf730
2024-07-11 20:03:39 +08:00
hoshi-hiyouga
f85187b4dd Merge pull request #4700 from marko1616/patch-1
Fix Windows command preview

Former-commit-id: 555194e15026c444b2bd1c09f521950cbff86c21
2024-07-10 13:51:50 +08:00
hoshi-hiyouga
2528487847 Merge pull request #4746 from yzoaim/fix
fix src/llamafactory/train/callbacks.py

Former-commit-id: 40c3b88b68b205e4124a9704d73500e3c404364d
2024-07-10 13:32:49 +08:00
hoshi-hiyouga
4edd7c3529 Update callbacks.py
Former-commit-id: 39cd89ce17220dc50c8331299ae5af230fe40cc9
2024-07-10 13:32:20 +08:00
-.-
973aac3203 fix src/llamafactory/train/callbacks.py
Former-commit-id: cff89a2e8907f3fe89406006105cb6494e2ee993
2024-07-10 12:05:51 +08:00
hiyouga
a9ce54d143 fix #4731
Former-commit-id: 51942acee84cdb20002f8fdccf6be8c7fe9bd0d3
2024-07-10 11:32:36 +08:00
hiyouga
d7130ec635 fix ppo trainer
Former-commit-id: fb0c40011689b3ae84cc3b258bf3c66af3e1e430
2024-07-10 11:05:45 +08:00
hiyouga
aa15ca1719 fix #4742
Former-commit-id: 2f09520c0d5039a5a8be310ab668272cb4dc1bd3
2024-07-09 23:24:24 +08:00
hiyouga
7e9d51fb95 Update wechat.jpg
Former-commit-id: 86b1594823f3e7d61c61981d53f353a9724ea9c4
2024-07-09 09:25:11 +08:00
hoshi-hiyouga
553e517f0f Merge pull request #4706 from T-Atlas/main
chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 563a27dab7e66d9454c6a09404c354d9fca06908
2024-07-07 15:50:38 +08:00
hoshi-hiyouga
7483e187c6 Update packages.py
Former-commit-id: f84b007ebbb9fa63f797b4bd1c487372877bbc65
2024-07-07 15:48:29 +08:00
Lian Junhong
7ca84e0a09 chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 322663bf90ce7b99ca5b0b43ff9dbd95eb36ff6b
2024-07-07 15:08:12 +08:00
hiyouga
f3c105f088 fix #4705
Former-commit-id: a15782cb9f3ee64ba1f5fc2a3da20ac6c6ef0aa0
2024-07-07 13:10:06 +08:00
marko1616
c8205c5163 Update utils.py
In windows mutiline command should like
command --arg1 xxx `
--arg2 xxx `

Former-commit-id: e0562521bbd7cf6b3b90f8c87e52690931f736bd
2024-07-06 20:40:13 +08:00