Commit Graph

887 Commits

Author SHA1 Message Date
hiyouga
7924ffc55d support llama pro #2338 , add rslora 2024-02-15 02:27:36 +08:00
hoshi-hiyouga
8a1b389086 Merge pull request #2474 from younesbelkada/add-hf-tags
FEAT: add HF tags for models that have been trained with llama-factory
2024-02-14 10:26:03 +08:00
younesbelkada
0ca0f08162 add v1 hf tags 2024-02-13 05:58:49 +00:00
hiyouga
12b2066e34 fix #2471 2024-02-12 21:07:46 +08:00
hiyouga
91d09a01ac add option to disable version check 2024-02-10 22:31:23 +08:00
hiyouga
a754f6e9ec update data/readme 2024-02-10 21:04:29 +08:00
hiyouga
a5fb2806cd update default template 2024-02-10 16:44:47 +08:00
hiyouga
7d2dc83c5e improve aligner 2024-02-10 16:39:19 +08:00
hoshi-hiyouga
388b705a8d Merge pull request #2462 from mnmueller/main
Enable Parsing of SlimOrca
2024-02-09 22:55:48 +08:00
hiyouga
54ea9684ed improve fix tokenizer 2024-02-09 14:53:14 +08:00
Mark Mueller
1d3598afa1 Slim Orca data parsing 2024-02-08 19:32:20 +01:00
Mark Mueller
6703d0546d Slim Orca data parsing 2024-02-08 17:56:18 +01:00
Mark Mueller
7f792dfede Slim Orca data parsing 2024-02-08 17:54:18 +01:00
Mark Mueller
8bd4182609 Slim Orca data parsing 2024-02-08 17:52:36 +01:00
Mark Mueller
36d7a75966 SlimOrca aligner 2024-02-08 08:28:32 -08:00
hoshi-hiyouga
d0daaa01f9 Merge pull request #2423 from mayflower/main
Support for german sft and dpo
2024-02-07 15:58:20 +08:00
Johann-Peter Hartmann
49c69ea4b9 WS fix 2024-02-06 20:13:04 +01:00
Johann-Peter Hartmann
1126563505 add ranking to dpo dataset 2024-02-06 20:12:36 +01:00
hiyouga
d6775c6522 Update tests.yml 2024-02-07 01:18:22 +08:00
hiyouga
88a1bc9773 lint 2024-02-07 01:10:04 +08:00
hiyouga
aacc823b0f Update pyproject.toml 2024-02-07 00:45:58 +08:00
hiyouga
0ae9a16b9d update gc kwargs 2024-02-07 00:38:24 +08:00
hiyouga
ebf31b62eb fix #2438 2024-02-06 15:23:08 +08:00
hiyouga
85622ae757 add models 2024-02-06 14:57:23 +08:00
hiyouga
ccabb5b04a support qwen1.5 2024-02-06 00:10:51 +08:00
hoshi-hiyouga
7f48c599eb fix #2436
Update test_toolcall.py
2024-02-05 22:55:28 +08:00
hoshi-hiyouga
b5007afb19 Update test_toolcall.py 2024-02-05 22:51:03 +08:00
hoshi-hiyouga
d4994235f0 Update test_toolcall.py 2024-02-05 22:50:43 +08:00
tao.jun
4081c88723 Update test_toolcall.py
Add openai version notes
2024-02-05 20:49:23 +08:00
Johann-Peter Hartmann
1ecea9de63 Merge branch 'hiyouga:main' into main 2024-02-04 13:55:00 +00:00
hiyouga
3dc86c4af9 fix #2421 2024-02-04 21:02:55 +08:00
Johann-Peter Hartmann
63da6294dd Merge branch 'hiyouga:main' into main 2024-02-04 12:51:25 +00:00
hiyouga
db0ab4d601 fix reserved label len 2024-02-04 17:54:26 +08:00
hiyouga
19d33ede13 fix #2420 2024-02-04 15:51:47 +08:00
hiyouga
b988ce0a0c fix #2189 2024-02-04 00:47:37 +08:00
hiyouga
38e63bfd28 bump up transformers version 2024-02-04 00:01:16 +08:00
hiyouga
51df865734 fix #2397 2024-02-03 23:45:31 +08:00
hiyouga
6545c02790 add hint for freeze #2412 2024-02-03 23:38:56 +08:00
hiyouga
4ecadc3512 fix #2376 2024-02-03 23:14:31 +08:00
hiyouga
901faa16cc support minicpm #2404 2024-02-03 22:36:46 +08:00
Johann-Peter Hartmann
b0ffde6e98 add simple german chatml template chatml_de 2024-02-03 09:01:15 +01:00
Johann-Peter Hartmann
870182c3a9 remove comma 2024-02-03 08:48:39 +01:00
Johann-Peter Hartmann
5318cc650e Merge branch 'hiyouga:main' into main 2024-02-03 08:43:12 +01:00
hoshi-hiyouga
2eaaa9522f Merge pull request #2411 from lxsyz/main
fix eos_token_id=0 bug
2024-02-02 17:38:16 +08:00
Fallen Angel
3399c0d645 fix eos_token_id=0 bug
when eos_token_id=0, will never add eos_token
2024-02-02 17:34:48 +08:00
Johann-Peter Hartmann
a5d559a89e Merge branch 'hiyouga:main' into main 2024-02-01 07:13:31 +01:00
hiyouga
ec70eb5d8d Update wechat.jpg 2024-02-01 11:01:12 +08:00
Johann-Peter Hartmann
4e27950acb Merge branch 'hiyouga:main' into main 2024-01-31 14:05:52 +01:00
hiyouga
39bd5bd524 fix #2388 2024-01-31 17:23:56 +08:00
hiyouga
521ad76552 fix autoset attn impl, update data readme 2024-01-31 11:58:07 +08:00