423A35C7/LLaMA-Factory
1
0
Fork 0
mirror of https://github.com/hiyouga/LLaMA-Factory.git synced 2025-12-14 19:06:26 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,126 Commits 1 Branch 34 Tags
38505ae9e1393048581301ff6a929229961b0316
Commit Graph

2126 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga
2faa1af4eb fix qwen eos token 
Former-commit-id: e21ae01356
 2023-08-06 13:31:17 +08:00
hiyouga
39955c28ff fix qwen tokenizer #361 
Former-commit-id: 7f18d2a335
 2023-08-05 17:06:05 +08:00
hiyouga
45af1a951f fix template for tiktoken 
Former-commit-id: 1afa51c2fa
 2023-08-05 13:42:42 +08:00
hiyouga
1a1caf2116 remove redundant code 
Former-commit-id: 53d95725c5
 2023-08-05 00:27:27 +08:00
hiyouga
ab95f569a4 fix template 
Former-commit-id: c183b3551d
 2023-08-05 00:25:00 +08:00
hiyouga
7a89fce4c7 fix llama2 template 
Former-commit-id: e4a15f863c
 2023-08-05 00:07:54 +08:00
hoshi-hiyouga
3ca0c3be60 Support safe ChatML template, fix qwen tok #351 #354 
https://github.com/openai/openai-python/blob/main/chatml.md
Former-commit-id: f30fc3b030
 2023-08-05 00:00:23 +08:00
hiyouga
65369ecf48 fix bos and eos token 
Former-commit-id: d87c8fd8ab
 2023-08-04 23:55:57 +08:00
hiyouga
dbb284b5a2 fix encode 
Former-commit-id: 8172ad1b5e
 2023-08-04 23:27:55 +08:00
hiyouga
ea045b0e5b support chatml safe encoding 
Former-commit-id: b4852f9406
 2023-08-04 23:14:28 +08:00
hiyouga
b32ed1d7be support interleave probs 
Former-commit-id: 69744c17e8
 2023-08-04 21:27:35 +08:00
hiyouga
44823ec2c7 Update wechat.jpg 
Former-commit-id: 6bdb7f0910
 2023-08-04 15:03:53 +08:00
hiyouga
cddf324a5e fix webui export model 
Former-commit-id: d6b14658d4
 2023-08-04 14:20:27 +08:00
hiyouga
0328c0e07c fix mtloader 
Former-commit-id: a0173c427d
 2023-08-03 19:29:02 +08:00
hiyouga
2d96ec9c3e tiny fix 
Former-commit-id: ff98f1cba8
 2023-08-03 17:42:28 +08:00
hiyouga
788d1250c1 fix qwen inference 
Former-commit-id: 2780792754
 2023-08-03 16:31:55 +08:00
hiyouga
65ef0ff491 fix qwen inference 
Former-commit-id: ea30da4794
 2023-08-03 16:15:38 +08:00
hiyouga
9c84c4ed5d support Qwen-7B, fix InternLM-7B inference 
Former-commit-id: 87f8f830e2
 2023-08-03 15:53:32 +08:00
hiyouga
471ef69218 update web demo 
Former-commit-id: 53d6dc396d
 2023-08-03 13:28:28 +08:00
hiyouga
91d178f14d fix webui 
Former-commit-id: e23a3a366c
 2023-08-03 12:43:12 +08:00
hiyouga
4242897b78 modify code structure 
Former-commit-id: 08f180e788
 2023-08-02 23:17:36 +08:00
hiyouga
4b8e4398bc fix PPO trainer 
Former-commit-id: 1d8a1878ea
 2023-08-02 19:10:23 +08:00
hiyouga
569df8ccd6 update ppo trainer 
Former-commit-id: b5ba87952a
 2023-08-02 18:46:41 +08:00
hiyouga
ab739e72ea fix memory leak of PPO trainer 
Former-commit-id: 286f7be346
 2023-08-02 17:41:34 +08:00
hiyouga
534e3320b5 release v0.1.5 
Former-commit-id: c689857bbb
 2023-08-02 16:10:31 +08:00
hoshi-hiyouga
5c38dda3ea Merge pull request #307 from GitYCC/feature/fix-llama2-prompt-template 
[feature] Fix template of Llama2 to match the offical template

Former-commit-id: 8ca01e53a8
 2023-08-02 15:51:28 +08:00
YC Chen
bb2b38a31f [fix] Remove useless code 
Former-commit-id: ca125da0eb
 2023-08-02 14:35:35 +08:00
YC Chen
bf844e8a99 [feature] Fix template of Llama2 to match the offical template 
Former-commit-id: 4323773089
 2023-08-02 14:10:15 +08:00
hiyouga
de407b59ea fix bug in preprocessing 
Former-commit-id: 968ce0dcce
 2023-08-02 01:10:28 +08:00
hiyouga
40d277ae5e update readme 
Former-commit-id: ccde51c5ea
 2023-08-01 18:48:27 +08:00
hiyouga
43762f96e6 fix #296 
Former-commit-id: e3f80774c4
 2023-08-01 18:43:53 +08:00
hiyouga
5c7337d6f3 Fix #294 
Former-commit-id: e6a3894b99
 2023-08-01 18:13:03 +08:00
hiyouga
4898a0a865 restore from git lfs 
Former-commit-id: b9cdff41bb
 2023-08-01 16:33:25 +08:00
hiyouga
780147f5b7 Update .gitattributes 
Former-commit-id: 7cdb720da2
 2023-08-01 16:28:54 +08:00
hiyouga
21ae875166 Update wechat.jpg 
Former-commit-id: 9879cd64da
 2023-08-01 12:27:37 +08:00
hiyouga
40f3f5722e fix webui 
Former-commit-id: befaab5720
 2023-08-01 12:11:37 +08:00
hiyouga
c5ad96375e fix RM save model 
Former-commit-id: ac88ce5233
 2023-08-01 11:56:17 +08:00
hiyouga
3b8e33d91c use git lfs 
Former-commit-id: 82e793ddb4
 2023-08-01 10:14:08 +08:00
hiyouga
aa4335eac7 release v0.1.4 
Former-commit-id: 973a638665
 2023-08-01 10:08:47 +08:00
hiyouga
e34fc5fd2e fix inference 
Former-commit-id: d3a0692d4d
 2023-08-01 00:06:48 +08:00
hiyouga
d5d3b2a42f fix arg check 
Former-commit-id: 9cb1f119a4
 2023-07-31 23:48:57 +08:00
hiyouga
a437424381 update readme 
Former-commit-id: 62dca5bb82
 2023-07-31 23:42:32 +08:00
hiyouga
e80b75b560 support streaming data, fix #284 #274 #268 
Former-commit-id: 0411a4b3e1
 2023-07-31 23:33:00 +08:00
hiyouga
2a664783c3 Update data_args.py 
Former-commit-id: 513e1f1ec9
 2023-07-28 17:42:41 +08:00
hiyouga
f65f0745cc update readme 
Former-commit-id: 5ee87138e4
 2023-07-28 17:36:00 +08:00
hiyouga
3e3652f4e0 fix #268 
Former-commit-id: 91dd17d8a6
 2023-07-28 17:02:26 +08:00
hiyouga
ea2eb8e58c Update wechat.jpg 
Former-commit-id: 553b97a9d5
 2023-07-27 15:09:29 +08:00
hiyouga
ba911f988d update dataset 
Former-commit-id: f5c2ccdde4
 2023-07-26 17:05:12 +08:00
hiyouga
c52dd3e86f fix #242 
Former-commit-id: 00efa8a07f
 2023-07-25 17:04:02 +08:00
hiyouga
b249c71b17 update wechat 
Former-commit-id: 2c31e05e63
 2023-07-24 20:33:40 +08:00