74 Commits

Author SHA1 Message Date
hiyouga
ec81d45d27 fix mod stuff
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
2024-04-21 18:11:10 +08:00
hiyouga
97c3f9e22c fix #3352
Former-commit-id: ba559a659a82d1e2ffb8ea7939fe4d6b4b37fd92
2024-04-19 22:40:01 +08:00
hiyouga
ac7ec7ed10 fix llama3 template
Former-commit-id: 14a605a2da16367ff64219b9f301c352b4812c4c
2024-04-19 15:46:51 +08:00
hoshi-hiyouga
15d17a1e86 support llama3
Former-commit-id: 2aaaede2470a0bb8ce3aabb19c1e11a5f20e36e8
2024-04-19 01:13:50 +08:00
hiyouga
8a369cc084 add mixtral 8x22B models
Former-commit-id: cab0598fd0a7e01ca2b40cb8f556992c0626cba1
2024-04-17 23:35:59 +08:00
hiyouga
627f281e5b add empty template
Former-commit-id: b3ac14ffc4c31cb54689c26b66963c20db64f21f
2024-04-16 03:10:02 +08:00
hoshi-hiyouga
b29b42cc42 Update template.py
Former-commit-id: 3ccf0d097708d1d96e52d820599fe74700b935c4
2024-04-15 22:58:01 +08:00
marko1616
8ba5704eaf change default_system accroding to official template
Former-commit-id: 2c89b38720bc9105d20ca9ea121dabf165adddad
2024-04-15 20:45:46 +08:00
marko1616
210cf1cb57 Revert "Add support for function call(Not strictly following origin)"
This reverts commit 81c44a43906fe4cd7ebe15a4aa97dc52b87d9c46 [formerly d7b9bbc8b956a4aeb16b5b33179687b0972ae9a6].


Former-commit-id: 90c5dddf9a34f7c504f2b404ee86027f08f15339
2024-04-15 20:27:09 +08:00
marko1616
81c44a4390 Add support for function call(Not strictly following origin)
Former-commit-id: d7b9bbc8b956a4aeb16b5b33179687b0972ae9a6
2024-04-15 20:16:52 +08:00
marko1616
65ce4140e9 Typo fix
Former-commit-id: 42806323f068e4857fce84682a9cb571c17b52d3
2024-04-13 07:52:11 +08:00
marko1616
6f1323722c Add template&support(Not tested)
Former-commit-id: 6574a721d20108174fc770caf9f17cf8fa81c4b4
2024-04-13 04:31:33 +08:00
hiyouga
3069f37021 tiny fix
Former-commit-id: 9a99fbc86d0be7bd0e6dd1a5475868c32006b08d
2024-04-08 21:28:39 +08:00
codingma
fecab4d3f1 rename template to breeze
Former-commit-id: 34bdcba0176a1612ab10351e59927ea744c6749c
2024-04-07 18:27:20 +08:00
codingma
ed14f8bae7 rename template to breeze
Former-commit-id: 5a780e9eec7e8c560d417c1a95afa1be0f878d32
2024-04-07 11:39:54 +08:00
codingma
80aa1f70b6 support https://github.com/hiyouga/LLaMA-Factory/issues/3152
Former-commit-id: 2565a32bd98ef46a3b6e1a5c334093ca46b820d2
2024-04-07 11:34:01 +08:00
hiyouga
ab6476a9a4 set dev version
Former-commit-id: dd73a0c2489a69e32afc2131407ee62be7779d8b
2024-04-01 23:24:08 +08:00
hiyouga
ec94e5e876 fix #2961
Former-commit-id: 511f6754026fbbf48bd481018015338a6a3ad92f
2024-03-26 17:26:14 +08:00
hiyouga
14ed926a2d support olmo
Former-commit-id: b3247d6a1604f4cbeb0d7c163d0082ce91afb870
2024-03-12 18:30:38 +08:00
hiyouga
868444e124 allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
2024-03-09 22:21:46 +08:00
hiyouga
843d3f7a97 fix chatglm3 template
Former-commit-id: 921ee822679bd10fcc14d084d0845e6132e570dd
2024-03-07 14:26:16 +08:00
hiyouga
8b21a60d9c fix add tokens
Former-commit-id: 9658c63cd94d28bba730a19f73397580b9865d6b
2024-03-06 15:04:02 +08:00
hiyouga
eeb34e5696 auto set chat template
Former-commit-id: 9e56eaf2d3e42d3985b0e68929a3a32e1db157ef
2024-03-05 02:41:20 +08:00
hiyouga
b04316d9a8 update readme
Former-commit-id: 24a79bd50f972008ca1a862edaff7cdd6c211cef
2024-03-04 19:29:26 +08:00
hiyouga
60ceace8a0 fix #2629
Former-commit-id: 4cc2781efebd696ca42ce3c71d80e2eb707040cf
2024-02-29 00:37:29 +08:00
hiyouga
57f85add58 update chatglm3 template
Former-commit-id: 38d8b2cef8d70ce8c390de0317559df7f04b4a5d
2024-02-28 21:11:23 +08:00
hiyouga
3af5fea981 update readme
Former-commit-id: 3ba10545937cd9a1dea9cf65d98dd174a205337d
2024-02-26 17:25:47 +08:00
Rayrtfr
41e9dd2cf8 Support Atom Model
Former-commit-id: 6e0fba60b3857c8920edb6bd2a34a7f2d4ac46be
2024-02-26 10:44:10 +08:00
hiyouga
279ba19ef7 fix data entry
Former-commit-id: 354f13c01a31d468c214cd35acf614433392e96a
2024-02-23 18:29:24 +08:00
hiyouga
223633556b fix gemma template
Former-commit-id: 6bf4c1274f4e9c91a6b37bd4c420c2369eaae65a
2024-02-23 13:49:53 +08:00
hiyouga
9f22befe4c fix template
Former-commit-id: a87838ded1245b00016e7568635ed7146eadb207
2024-02-22 12:09:21 +08:00
hiyouga
e1246cc507 fix template
Former-commit-id: c375a20230cfad3f398dfa0a1140d5b071fca687
2024-02-22 12:06:48 +08:00
hiyouga
1845e03921 support gemma
Former-commit-id: c99e19641a9b893da0a3277bd41bd1d3996d1913
2024-02-21 23:27:36 +08:00
hiyouga
abc04be06e update default template
Former-commit-id: a5fb2806cd6669a16320ef5bc9fb610c5ef8fd9b
2024-02-10 16:44:47 +08:00
hiyouga
db2051684b improve aligner
Former-commit-id: 7d2dc83c5e2085da6273241269c9e9d7509ae51b
2024-02-10 16:39:19 +08:00
hiyouga
36f092b53f improve fix tokenizer
Former-commit-id: 54ea9684ed05ac7fa5bbaa04d39636eda37cd34e
2024-02-09 14:53:14 +08:00
hoshi-hiyouga
186ba72d72 Merge pull request #2423 from mayflower/main
Support for german sft and dpo

Former-commit-id: d0daaa01f9119d4feef45327bbd43964a73bc0c2
2024-02-07 15:58:20 +08:00
hiyouga
9debd64cef add models
Former-commit-id: 85622ae757e2ffe7f3da15f0a9123e8410d82b28
2024-02-06 14:57:23 +08:00
Johann-Peter Hartmann
e7ff724a83 Merge branch 'hiyouga:main' into main
Former-commit-id: 1ecea9de6371a78243cd4e122bdc510f83952dcc
2024-02-04 13:55:00 +00:00
hiyouga
d296e56fe9 fix #2421
Former-commit-id: 3dc86c4af9b859efbea87e47a40f666c3adb5484
2024-02-04 21:02:55 +08:00
Johann-Peter Hartmann
eb45057257 Merge branch 'hiyouga:main' into main
Former-commit-id: 63da6294ddfc5a9f3fdacb124755e89fe94d9c66
2024-02-04 12:51:25 +00:00
hiyouga
91b7fd1ec3 fix reserved label len
Former-commit-id: db0ab4d601b5e68660c00f07998ff26a8745ba90
2024-02-04 17:54:26 +08:00
hiyouga
40514bf865 support minicpm #2404
Former-commit-id: 901faa16ccebc3fa11260daac98981dd99904af9
2024-02-03 22:36:46 +08:00
Johann-Peter Hartmann
6998b57726 add simple german chatml template chatml_de
Former-commit-id: b0ffde6e989ab59be7370cfdb6b1e3def796b2a9
2024-02-03 09:01:15 +01:00
Fallen Angel
b4c776fa93 fix eos_token_id=0 bug
when eos_token_id=0, will never add eos_token

Former-commit-id: 3399c0d6459e797946daf966e32134a12f8e48f3
2024-02-02 17:34:48 +08:00
hiyouga
9898712a24 add orion models
Former-commit-id: 6fc2d5cc0375a183ec95f003e7a27567b2a71514
2024-01-22 21:26:53 +08:00
hiyouga
865f48f1c3 fix api
Former-commit-id: 55f707196e772514907226d5a09fad1cdee6395d
2024-01-21 00:03:09 +08:00
hiyouga
cb8abce2f3 fix internlm2 template
Former-commit-id: a9c18255aa039550ca65145b930576edeb905d53
2024-01-20 23:33:50 +08:00
hiyouga
0be7b16955 fix cli_demo
Former-commit-id: c550987a72b0b88ea0116eb47a507142c8544df4
2024-01-20 23:27:10 +08:00
hiyouga
baaa0acdf1 fix #2260
Former-commit-id: cf818a25982c8a2808cf21f22e1e5eb4dd7e0713
2024-01-20 23:22:09 +08:00