hiyouga
|
ec94e5e876
|
fix #2961
Former-commit-id: 511f6754026fbbf48bd481018015338a6a3ad92f
|
2024-03-26 17:26:14 +08:00 |
|
hiyouga
|
14ed926a2d
|
support olmo
Former-commit-id: b3247d6a1604f4cbeb0d7c163d0082ce91afb870
|
2024-03-12 18:30:38 +08:00 |
|
hiyouga
|
868444e124
|
allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
|
2024-03-09 22:21:46 +08:00 |
|
hiyouga
|
843d3f7a97
|
fix chatglm3 template
Former-commit-id: 921ee822679bd10fcc14d084d0845e6132e570dd
|
2024-03-07 14:26:16 +08:00 |
|
hiyouga
|
8b21a60d9c
|
fix add tokens
Former-commit-id: 9658c63cd94d28bba730a19f73397580b9865d6b
|
2024-03-06 15:04:02 +08:00 |
|
hiyouga
|
eeb34e5696
|
auto set chat template
Former-commit-id: 9e56eaf2d3e42d3985b0e68929a3a32e1db157ef
|
2024-03-05 02:41:20 +08:00 |
|
hiyouga
|
b04316d9a8
|
update readme
Former-commit-id: 24a79bd50f972008ca1a862edaff7cdd6c211cef
|
2024-03-04 19:29:26 +08:00 |
|
hiyouga
|
60ceace8a0
|
fix #2629
Former-commit-id: 4cc2781efebd696ca42ce3c71d80e2eb707040cf
|
2024-02-29 00:37:29 +08:00 |
|
hiyouga
|
57f85add58
|
update chatglm3 template
Former-commit-id: 38d8b2cef8d70ce8c390de0317559df7f04b4a5d
|
2024-02-28 21:11:23 +08:00 |
|
hiyouga
|
3af5fea981
|
update readme
Former-commit-id: 3ba10545937cd9a1dea9cf65d98dd174a205337d
|
2024-02-26 17:25:47 +08:00 |
|
Rayrtfr
|
41e9dd2cf8
|
Support Atom Model
Former-commit-id: 6e0fba60b3857c8920edb6bd2a34a7f2d4ac46be
|
2024-02-26 10:44:10 +08:00 |
|
hiyouga
|
279ba19ef7
|
fix data entry
Former-commit-id: 354f13c01a31d468c214cd35acf614433392e96a
|
2024-02-23 18:29:24 +08:00 |
|
hiyouga
|
223633556b
|
fix gemma template
Former-commit-id: 6bf4c1274f4e9c91a6b37bd4c420c2369eaae65a
|
2024-02-23 13:49:53 +08:00 |
|
hiyouga
|
9f22befe4c
|
fix template
Former-commit-id: a87838ded1245b00016e7568635ed7146eadb207
|
2024-02-22 12:09:21 +08:00 |
|
hiyouga
|
e1246cc507
|
fix template
Former-commit-id: c375a20230cfad3f398dfa0a1140d5b071fca687
|
2024-02-22 12:06:48 +08:00 |
|
hiyouga
|
1845e03921
|
support gemma
Former-commit-id: c99e19641a9b893da0a3277bd41bd1d3996d1913
|
2024-02-21 23:27:36 +08:00 |
|
hiyouga
|
abc04be06e
|
update default template
Former-commit-id: a5fb2806cd6669a16320ef5bc9fb610c5ef8fd9b
|
2024-02-10 16:44:47 +08:00 |
|
hiyouga
|
db2051684b
|
improve aligner
Former-commit-id: 7d2dc83c5e2085da6273241269c9e9d7509ae51b
|
2024-02-10 16:39:19 +08:00 |
|
hiyouga
|
36f092b53f
|
improve fix tokenizer
Former-commit-id: 54ea9684ed05ac7fa5bbaa04d39636eda37cd34e
|
2024-02-09 14:53:14 +08:00 |
|
hoshi-hiyouga
|
186ba72d72
|
Merge pull request #2423 from mayflower/main
Support for german sft and dpo
Former-commit-id: d0daaa01f9119d4feef45327bbd43964a73bc0c2
|
2024-02-07 15:58:20 +08:00 |
|
hiyouga
|
9debd64cef
|
add models
Former-commit-id: 85622ae757e2ffe7f3da15f0a9123e8410d82b28
|
2024-02-06 14:57:23 +08:00 |
|
Johann-Peter Hartmann
|
e7ff724a83
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 1ecea9de6371a78243cd4e122bdc510f83952dcc
|
2024-02-04 13:55:00 +00:00 |
|
hiyouga
|
d296e56fe9
|
fix #2421
Former-commit-id: 3dc86c4af9b859efbea87e47a40f666c3adb5484
|
2024-02-04 21:02:55 +08:00 |
|
Johann-Peter Hartmann
|
eb45057257
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 63da6294ddfc5a9f3fdacb124755e89fe94d9c66
|
2024-02-04 12:51:25 +00:00 |
|
hiyouga
|
91b7fd1ec3
|
fix reserved label len
Former-commit-id: db0ab4d601b5e68660c00f07998ff26a8745ba90
|
2024-02-04 17:54:26 +08:00 |
|
hiyouga
|
40514bf865
|
support minicpm #2404
Former-commit-id: 901faa16ccebc3fa11260daac98981dd99904af9
|
2024-02-03 22:36:46 +08:00 |
|
Johann-Peter Hartmann
|
6998b57726
|
add simple german chatml template chatml_de
Former-commit-id: b0ffde6e989ab59be7370cfdb6b1e3def796b2a9
|
2024-02-03 09:01:15 +01:00 |
|
Fallen Angel
|
b4c776fa93
|
fix eos_token_id=0 bug
when eos_token_id=0, will never add eos_token
Former-commit-id: 3399c0d6459e797946daf966e32134a12f8e48f3
|
2024-02-02 17:34:48 +08:00 |
|
hiyouga
|
9898712a24
|
add orion models
Former-commit-id: 6fc2d5cc0375a183ec95f003e7a27567b2a71514
|
2024-01-22 21:26:53 +08:00 |
|
hiyouga
|
865f48f1c3
|
fix api
Former-commit-id: 55f707196e772514907226d5a09fad1cdee6395d
|
2024-01-21 00:03:09 +08:00 |
|
hiyouga
|
cb8abce2f3
|
fix internlm2 template
Former-commit-id: a9c18255aa039550ca65145b930576edeb905d53
|
2024-01-20 23:33:50 +08:00 |
|
hiyouga
|
0be7b16955
|
fix cli_demo
Former-commit-id: c550987a72b0b88ea0116eb47a507142c8544df4
|
2024-01-20 23:27:10 +08:00 |
|
hiyouga
|
baaa0acdf1
|
fix #2260
Former-commit-id: cf818a25982c8a2808cf21f22e1e5eb4dd7e0713
|
2024-01-20 23:22:09 +08:00 |
|
hiyouga
|
b27e91222c
|
format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
|
2024-01-20 20:15:56 +08:00 |
|
hiyouga
|
397eb8fbb9
|
fix #2249
Former-commit-id: 12043aab9c9ea2acaa3ff80232ce0451ccaa557d
|
2024-01-19 21:44:32 +08:00 |
|
hiyouga
|
f7fcfeaa47
|
fix templates
Former-commit-id: a73a979afd660afd3f2091c7b813a82b3a28645d
|
2024-01-18 14:49:52 +08:00 |
|
hiyouga
|
7f12aedc08
|
enable cutoff len
Former-commit-id: f1067d2b585cf24b3e48463692ac99a8222161c9
|
2024-01-18 12:25:42 +08:00 |
|
hiyouga
|
1323b8f102
|
add tool test
Former-commit-id: 83dbfce8c30bc1183a5c86fb77a5676bf0b753af
|
2024-01-18 10:26:26 +08:00 |
|
hiyouga
|
4e3bfb799d
|
support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
|
2024-01-18 09:54:23 +08:00 |
|
hiyouga
|
21020e51ca
|
support solar 10.7B #1907
Former-commit-id: bf73224f33c93647a6101d36bde5bf8ddfc91438
|
2024-01-14 00:30:30 +08:00 |
|
hiyouga
|
4dc16df570
|
fix #2147
Former-commit-id: 9aa1a2fc172730eabc4f14bcb08c0d66fcb2d844
|
2024-01-12 03:30:56 +08:00 |
|
hiyouga
|
a78cd5c5ad
|
fix qwen template
Former-commit-id: ed216bbc4693860eaf27c2a95108f705d530cbdb
|
2024-01-05 16:14:56 +08:00 |
|
hiyouga
|
16688b773a
|
fix export format
Former-commit-id: e165354facf7e69f535f9b7d99438f03dbf0293d
|
2023-12-28 18:40:46 +08:00 |
|
hiyouga
|
9337568e23
|
fix stop words
Former-commit-id: dec360d5aee58c11804b8e45dd8d4c375086887f
|
2023-12-20 19:06:43 +08:00 |
|
hiyouga
|
622d31e398
|
fix yi template #1895
Former-commit-id: 5af8841c4f6c97df522d2cf4e283d5ef0af21a18
|
2023-12-20 18:58:16 +08:00 |
|
hiyouga
|
3981927d6b
|
add codegeex template
Former-commit-id: a67a440644687dc2262134c0f2895f3ae42cae19
|
2023-12-18 19:52:35 +08:00 |
|
hiyouga
|
bd03307bbd
|
refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
|
2023-12-15 20:53:11 +08:00 |
|
hiyouga
|
b7d99ad5f4
|
support mixtral
Former-commit-id: 96380f5e1887bb166be339e58ab8f65e464d4010
|
2023-12-12 11:39:04 +08:00 |
|
hiyouga
|
9b84a706af
|
add models
Former-commit-id: e25f7bae16b7ea41a4a1fd1e8db1b961e55d0c5b
|
2023-12-06 13:33:18 +08:00 |
|
hiyouga
|
f8376b228a
|
add xuanyuan models
Former-commit-id: 6e7af11b989e4cf97ffacbab4736e3434ff6c925
|
2023-12-02 00:35:29 +08:00 |
|