1372 Commits

Author SHA1 Message Date
“Wzw”
3e159a0a83 fix Llama-template's system prompt bug
Former-commit-id: bcbbf4506300fc132e68a39a9a6dfa5e61497c8b
2024-08-12 19:22:12 +08:00
hiyouga
a8add5c04b add qwen2 math models
Former-commit-id: dc770efb14bd6e18421511912fbb959a3cf9f78d
2024-08-09 20:20:35 +08:00
hiyouga
5eacd17090 add adam_mini to readme
Former-commit-id: e2a28f51c635d64ff9de65a37087d89356bdedcc
2024-08-09 20:02:03 +08:00
hoshi-hiyouga
792da85866 Merge pull request #5095 from relic-yuexi/feat-optimizer
Feat optimizer

Former-commit-id: ef482394f0e2820ee8a245f8a6b050a32591b40a
2024-08-09 19:51:33 +08:00
hiyouga
b5146facff follow #5115
Former-commit-id: c87023d539875cd8e622d40212a5627c9c182fb8
2024-08-09 18:03:00 +08:00
hoshi-hiyouga
397e4daa5d Merge pull request #5115 from YeQiuO/main
fix: `Train on the last turn only` truncate bug
Former-commit-id: 51542cb15fea785d445ecf80bbad0364ebc0cb77
2024-08-09 17:58:27 +08:00
hoshi-hiyouga
54f57fb354 Update template.py
Former-commit-id: 4f62e1cb243d996d1764c3c86ca234847ad2c022
2024-08-09 16:27:42 +08:00
“Wzw”
13e5fff97a mask_history args verify valid
Former-commit-id: 2fa1e0b2add60142c178e5e21ebaad7132fa5b00
2024-08-08 10:12:01 +08:00
“Wzw”
0bd25c3a6b fix mask_history tiny bug
Former-commit-id: b5ca86cc07d38cf342e351aab16cce4319245792
2024-08-08 10:09:33 +08:00
moontidef
44f7c4dd56 feat: add support for adammini
Former-commit-id: 82bc15dc795f95768b81c25eaaabdc613da30cd8
2024-08-07 10:08:22 +08:00
moontidef
b0d32b2041 fix: rename optimzer to optimizer
Former-commit-id: 40908a36fae3393715f75156867c11e6373fabad
2024-08-07 10:05:01 +08:00
moontidef
1cc927b536 Merge branch 'hiyouga:main' into main
Former-commit-id: 55f32dfbf9fd94d6a4315d87caf034fbdfc3c914
2024-08-06 00:18:45 +08:00
moontidef
733cb9087b fix: fix the deepseekcoder template to avoid repeat problem
Former-commit-id: b82ecbedd0fecd85195217916cba3c21998bd10b
2024-08-05 23:55:45 +08:00
hiyouga
20013e130b fix #5048
Former-commit-id: b7ca6c8dc14f689d0df16684a6121cc0ec24f8ba
2024-08-05 23:48:19 +08:00
codingma
7125b6cf70 support gemma-2-2b
Former-commit-id: dc09d454f285b8584d9017349a9cee3b44eadb72
2024-08-01 13:45:48 +08:00
hoshi-hiyouga
e678c1ccb2 Merge pull request #5010 from Eruly/main
Add Korean web UI (llamafactory-cli webui)

Former-commit-id: cd420c193858547c72c8e08e7c051aa432d4e93d
2024-07-30 01:55:54 +08:00
eruly
ccc0825008 Add Korean web UI (llamafactory-cli webui)
Former-commit-id: 371009e5220c2db7f07087b7cfc679829ba53f7d
2024-07-29 13:47:13 +00:00
codingma
8132725f2e fix pissa save
Former-commit-id: 2c1ca9f7425b84e158fef527fd6e13297c8253c6
2024-07-29 10:44:34 +08:00
hoshi-hiyouga
0ac7824822 Merge pull request #4892 from piamo/main
update deepseek template

Former-commit-id: 8a2846cfe1266bedde84da175805dac78439c20e
2024-07-26 11:49:34 +08:00
hoshi-hiyouga
29d9a9827a Merge pull request #4950 from liuwwang/main and fi
fix: Repair the issue where quantization failed after merging the adapter.
Former-commit-id: 9839c6d1f6fd69287afeb3b6528571cf2bedf91a
2024-07-26 11:48:56 +08:00
hiyouga
d984942c82 update webui
Former-commit-id: 30f8149d11d4e19c1fe87d06f53504b7eaf4c1cf
2024-07-24 21:11:51 +08:00
hiyouga
0aad78694a tiny fix
Former-commit-id: ace1d44857368dbbc868e4bba2d7ff17329921f5
2024-07-24 18:33:39 +08:00
hiyouga
d63beb7a24 fix #4928
Former-commit-id: 091010492b2afc8ad25359323aba760523a4c5af
2024-07-24 17:00:29 +08:00
hiyouga
91e54d458f add mistral nemo model
Former-commit-id: 1550fe7331370ad39e8ed69c1b060ead902a77e4
2024-07-24 16:25:53 +08:00
hiyouga
e0875f82b3 add llama3.1
Former-commit-id: 26533c0604ef765170f93986bc06f3066c5e28ee
2024-07-24 16:20:11 +08:00
Liuww
ed05486b98 fix: Repair the issue where quantization failed after merging the adapter.
Former-commit-id: f91a9a250afa0c2e1554b2c81c1860d7968dc816
2024-07-24 14:31:29 +08:00
hiyouga
1cddf80a97 tiny fix
Former-commit-id: 5665062ca0bfb166cd8f2e896e2b0970037373f6
2024-07-22 21:10:15 +08:00
hoshi-hiyouga
37c6a0c6dc fix #4917
Former-commit-id: 26082fc6c90e6a399ae5b44f2c3df8019afc7766
2024-07-22 11:28:31 +08:00
hiyouga
dbe26e7cdf tiny fix
Former-commit-id: c333e2f49d23243489fa16622f43f768bcfd45e2
2024-07-22 00:06:03 +08:00
hiyouga
8d06679a3f fix flashattn + packing
Former-commit-id: 4135e69406c09f3892276e4fee7e5757a52a42d6
2024-07-21 17:07:45 +08:00
huangpan.foo
ee4c3f32d1 update deepseek template
Former-commit-id: 44e48e2b82929888b0880c00519102da4eb38ca8
2024-07-19 15:02:54 +08:00
hiyouga
726e7046db set dev version
Former-commit-id: 88c7fc159999511e6e19fff3d37147a6a7064335
2024-07-19 02:01:46 +08:00
hiyouga
542658c986 update parser
Former-commit-id: 8f6995081cbdbb2424da586a443e5220a8990faa
2024-07-19 01:36:39 +08:00
hiyouga
f5cfea56bd release v0.8.3
Former-commit-id: bbd5a644230d633f507c72929e8819c07ae38bba
2024-07-19 01:21:18 +08:00
hiyouga
e1e01d7efd add unittest
Former-commit-id: 608de799a21f37319bf31c04c0aa50c4542ec757
2024-07-19 01:06:27 +08:00
hiyouga
34f16cc635 follow #4878 fix #4684
Former-commit-id: 779aae83d253de0a86201ff87543b5d695e28d23
2024-07-18 22:06:12 +08:00
Shiyu Zhang
249adacc4d 仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2489055574fd3365425d26360d73897
2024-07-18 15:30:25 +08:00
hiyouga
3c7b10b1fa fix metrics #4786
Former-commit-id: beec77a0898a39d94f41c23920415f5b4873a23a
2024-07-17 00:47:00 +08:00
hiyouga
e90fae61f4 support batch_eval_metrics, fix #4826
Former-commit-id: d774b94f124923829b2eae428e25199d503ebfcb
2024-07-17 00:33:00 +08:00
hiyouga
ca40e42b3c tiny fix
Former-commit-id: bda302fbfbdb114dee7782d405732600d2d73279
2024-07-15 23:09:50 +08:00
hoshi-hiyouga
b19e2f84b6 Merge pull request #4821 from codemayq/feature-eval-split
add "split" as suffix in eval task name

Former-commit-id: 38bc411d42108e7859ec6a031f63c5188246f18c
2024-07-15 22:59:44 +08:00
hiyouga
84e6715423 fix #4820
Former-commit-id: fd8cc490084aba9b5155eaaaf26129efd2871fa3
2024-07-15 22:32:07 +08:00
codingma
76046dfda8 1. change the task name format
2. delete split param in data_args.py


Former-commit-id: 645211dc01b5d4db3ccd0e3dce03a53860eded26
2024-07-15 09:55:33 +08:00
hiyouga
22859b8734 allow computing rouge in training
Former-commit-id: 99ab7a8c1c966232faa11b6a42b9740d9a20ace3
2024-07-15 01:16:26 +08:00
hiyouga
14bc7b0551 fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
2024-07-15 01:04:56 +08:00
hoshi-hiyouga
2b22a7da48 Merge pull request #4691 from codemayq/feature-suppot-eval-dataset
add eval dataset support

Former-commit-id: 15b399a82f45b08fc07d2957884fb7821eba9fd9
2024-07-15 01:00:34 +08:00
hoshi-hiyouga
788dc1c679 Update data_args.py
Former-commit-id: cba673f491c5d97aba62aea03f310bd54fb3fe28
2024-07-15 00:56:03 +08:00
hoshi-hiyouga
30a3c6e886 Update preprocess.py
Former-commit-id: df52fb05b1b08887288bbaab7c612b7ac27c2290
2024-07-15 00:55:36 +08:00
hoshi-hiyouga
eed7cbb453 Update parser.py
Former-commit-id: 84e4047f8a1f78256be65f3f7bddce358ed9e882
2024-07-15 00:55:21 +08:00
hoshi-hiyouga
5633c0ab1e Update data_utils.py
Former-commit-id: 97a0e291c79f145950b54a11d03d81ada4784d22
2024-07-15 00:54:34 +08:00