337 Commits

Author SHA1 Message Date
moontidef
44f7c4dd56 feat: add support for adammini
Former-commit-id: 82bc15dc795f95768b81c25eaaabdc613da30cd8
2024-08-07 10:08:22 +08:00
moontidef
b0d32b2041 fix: rename optimzer to optimizer
Former-commit-id: 40908a36fae3393715f75156867c11e6373fabad
2024-08-07 10:05:01 +08:00
moontidef
1cc927b536 Merge branch 'hiyouga:main' into main
Former-commit-id: 55f32dfbf9fd94d6a4315d87caf034fbdfc3c914
2024-08-06 00:18:45 +08:00
moontidef
733cb9087b fix: fix the deepseekcoder template to avoid repeat problem
Former-commit-id: b82ecbedd0fecd85195217916cba3c21998bd10b
2024-08-05 23:55:45 +08:00
hiyouga
20013e130b fix #5048
Former-commit-id: b7ca6c8dc14f689d0df16684a6121cc0ec24f8ba
2024-08-05 23:48:19 +08:00
codingma
7125b6cf70 support gemma-2-2b
Former-commit-id: dc09d454f285b8584d9017349a9cee3b44eadb72
2024-08-01 13:45:48 +08:00
hoshi-hiyouga
e678c1ccb2 Merge pull request #5010 from Eruly/main
Add Korean web UI (llamafactory-cli webui)

Former-commit-id: cd420c193858547c72c8e08e7c051aa432d4e93d
2024-07-30 01:55:54 +08:00
eruly
ccc0825008 Add Korean web UI (llamafactory-cli webui)
Former-commit-id: 371009e5220c2db7f07087b7cfc679829ba53f7d
2024-07-29 13:47:13 +00:00
codingma
8132725f2e fix pissa save
Former-commit-id: 2c1ca9f7425b84e158fef527fd6e13297c8253c6
2024-07-29 10:44:34 +08:00
hoshi-hiyouga
0ac7824822 Merge pull request #4892 from piamo/main
update deepseek template

Former-commit-id: 8a2846cfe1266bedde84da175805dac78439c20e
2024-07-26 11:49:34 +08:00
hoshi-hiyouga
29d9a9827a Merge pull request #4950 from liuwwang/main and fi
fix: Repair the issue where quantization failed after merging the adapter.
Former-commit-id: 9839c6d1f6fd69287afeb3b6528571cf2bedf91a
2024-07-26 11:48:56 +08:00
hiyouga
d984942c82 update webui
Former-commit-id: 30f8149d11d4e19c1fe87d06f53504b7eaf4c1cf
2024-07-24 21:11:51 +08:00
hiyouga
0aad78694a tiny fix
Former-commit-id: ace1d44857368dbbc868e4bba2d7ff17329921f5
2024-07-24 18:33:39 +08:00
hiyouga
d63beb7a24 fix #4928
Former-commit-id: 091010492b2afc8ad25359323aba760523a4c5af
2024-07-24 17:00:29 +08:00
hiyouga
91e54d458f add mistral nemo model
Former-commit-id: 1550fe7331370ad39e8ed69c1b060ead902a77e4
2024-07-24 16:25:53 +08:00
hiyouga
e0875f82b3 add llama3.1
Former-commit-id: 26533c0604ef765170f93986bc06f3066c5e28ee
2024-07-24 16:20:11 +08:00
Liuww
ed05486b98 fix: Repair the issue where quantization failed after merging the adapter.
Former-commit-id: f91a9a250afa0c2e1554b2c81c1860d7968dc816
2024-07-24 14:31:29 +08:00
hiyouga
1cddf80a97 tiny fix
Former-commit-id: 5665062ca0bfb166cd8f2e896e2b0970037373f6
2024-07-22 21:10:15 +08:00
hoshi-hiyouga
37c6a0c6dc fix #4917
Former-commit-id: 26082fc6c90e6a399ae5b44f2c3df8019afc7766
2024-07-22 11:28:31 +08:00
hiyouga
dbe26e7cdf tiny fix
Former-commit-id: c333e2f49d23243489fa16622f43f768bcfd45e2
2024-07-22 00:06:03 +08:00
hiyouga
8d06679a3f fix flashattn + packing
Former-commit-id: 4135e69406c09f3892276e4fee7e5757a52a42d6
2024-07-21 17:07:45 +08:00
huangpan.foo
ee4c3f32d1 update deepseek template
Former-commit-id: 44e48e2b82929888b0880c00519102da4eb38ca8
2024-07-19 15:02:54 +08:00
hiyouga
726e7046db set dev version
Former-commit-id: 88c7fc159999511e6e19fff3d37147a6a7064335
2024-07-19 02:01:46 +08:00
hiyouga
542658c986 update parser
Former-commit-id: 8f6995081cbdbb2424da586a443e5220a8990faa
2024-07-19 01:36:39 +08:00
hiyouga
f5cfea56bd release v0.8.3
Former-commit-id: bbd5a644230d633f507c72929e8819c07ae38bba
2024-07-19 01:21:18 +08:00
hiyouga
e1e01d7efd add unittest
Former-commit-id: 608de799a21f37319bf31c04c0aa50c4542ec757
2024-07-19 01:06:27 +08:00
hiyouga
34f16cc635 follow #4878 fix #4684
Former-commit-id: 779aae83d253de0a86201ff87543b5d695e28d23
2024-07-18 22:06:12 +08:00
Shiyu Zhang
249adacc4d 仅仅训练最后一轮对话
Former-commit-id: 1e7b396ff2489055574fd3365425d26360d73897
2024-07-18 15:30:25 +08:00
hiyouga
3c7b10b1fa fix metrics #4786
Former-commit-id: beec77a0898a39d94f41c23920415f5b4873a23a
2024-07-17 00:47:00 +08:00
hiyouga
e90fae61f4 support batch_eval_metrics, fix #4826
Former-commit-id: d774b94f124923829b2eae428e25199d503ebfcb
2024-07-17 00:33:00 +08:00
hiyouga
ca40e42b3c tiny fix
Former-commit-id: bda302fbfbdb114dee7782d405732600d2d73279
2024-07-15 23:09:50 +08:00
hoshi-hiyouga
b19e2f84b6 Merge pull request #4821 from codemayq/feature-eval-split
add "split" as suffix in eval task name

Former-commit-id: 38bc411d42108e7859ec6a031f63c5188246f18c
2024-07-15 22:59:44 +08:00
hiyouga
84e6715423 fix #4820
Former-commit-id: fd8cc490084aba9b5155eaaaf26129efd2871fa3
2024-07-15 22:32:07 +08:00
codingma
76046dfda8 1. change the task name format
2. delete split param in data_args.py


Former-commit-id: 645211dc01b5d4db3ccd0e3dce03a53860eded26
2024-07-15 09:55:33 +08:00
hiyouga
22859b8734 allow computing rouge in training
Former-commit-id: 99ab7a8c1c966232faa11b6a42b9740d9a20ace3
2024-07-15 01:16:26 +08:00
hiyouga
14bc7b0551 fix up
Former-commit-id: 29ebcd75d55f70f2891632eba187b643cc3a9e51
2024-07-15 01:04:56 +08:00
hoshi-hiyouga
2b22a7da48 Merge pull request #4691 from codemayq/feature-suppot-eval-dataset
add eval dataset support

Former-commit-id: 15b399a82f45b08fc07d2957884fb7821eba9fd9
2024-07-15 01:00:34 +08:00
hoshi-hiyouga
788dc1c679 Update data_args.py
Former-commit-id: cba673f491c5d97aba62aea03f310bd54fb3fe28
2024-07-15 00:56:03 +08:00
hoshi-hiyouga
30a3c6e886 Update preprocess.py
Former-commit-id: df52fb05b1b08887288bbaab7c612b7ac27c2290
2024-07-15 00:55:36 +08:00
hoshi-hiyouga
eed7cbb453 Update parser.py
Former-commit-id: 84e4047f8a1f78256be65f3f7bddce358ed9e882
2024-07-15 00:55:21 +08:00
hoshi-hiyouga
5633c0ab1e Update data_utils.py
Former-commit-id: 97a0e291c79f145950b54a11d03d81ada4784d22
2024-07-15 00:54:34 +08:00
hoshi-hiyouga
2e9c9471da Update loader.py
Former-commit-id: a5b809516e7de1d6d5f4583089fee3028d0db01d
2024-07-15 00:50:06 +08:00
hoshi-hiyouga
140b512426 Update parser.py
Former-commit-id: 3d39d74003c4ca36f9c9b77f622d366383b0af7e
2024-07-14 23:04:34 +08:00
hiyouga
dfd2d912cd fix #4699
slow tokenizer for yi models


Former-commit-id: 88a20ba7972c533d650967a118d612471fe2b2e8
2024-07-14 15:34:22 +08:00
hiyouga
12e0e5d0d7 tiny fix
Former-commit-id: d3c01552e0f978f150902175f096f6e3bfb64363
2024-07-14 10:56:45 +08:00
hiyouga
0b26011181 fix gemma2 attention
Former-commit-id: 2f6af73da28c4f8321b625fd09ddec8bd4977b08
2024-07-13 23:33:45 +08:00
hoshi-hiyouga
e83e36e475 Merge pull request #4781 from hzhaoy/fix-dockerfile-cuda
Fix cuda Dockerfile

Former-commit-id: 5da54deb50d50385197a5aa9743e6695c066088a
2024-07-13 22:25:32 +08:00
hiyouga
3baf1d1f7e fix #4792
Former-commit-id: 6b48308ef9be34d072f3e6bb2444e186a38c2779
2024-07-13 22:07:58 +08:00
hzhaoy
955e01c038 tiny fix
Former-commit-id: 8bab99c5829a80752e461cf65a9124fdea609676
2024-07-12 00:28:44 +08:00
hoshi-hiyouga
f85187b4dd Merge pull request #4700 from marko1616/patch-1
Fix Windows command preview

Former-commit-id: 555194e15026c444b2bd1c09f521950cbff86c21
2024-07-10 13:51:50 +08:00