hiyouga
|
dff77004f2
|
support olmo
Former-commit-id: 2719510e8c6baa591c74458b773e4e47215e6052
|
2024-03-12 18:30:38 +08:00 |
|
hiyouga
|
4881f4e631
|
allow non-packing pretraining
Former-commit-id: 3fee5cc5a3db9ce874ad90f2500ec092d904bd4e
|
2024-03-09 22:21:46 +08:00 |
|
hiyouga
|
cef1ede826
|
fix chatglm3 template
Former-commit-id: 9be0aa70fdd2e9ec208aa1850ace5c287efc8c3a
|
2024-03-07 14:26:16 +08:00 |
|
hiyouga
|
67f02f75d0
|
fix add tokens
Former-commit-id: ff5353681a87d033903bf8cf6133c6bdb3fa9e5a
|
2024-03-06 15:04:02 +08:00 |
|
hiyouga
|
0229fffde5
|
auto set chat template
Former-commit-id: d8bf2f0efe6919990c7032aaa06010980cfde019
|
2024-03-05 02:41:20 +08:00 |
|
hiyouga
|
3555b87363
|
update readme
Former-commit-id: c95bc2774800ed2e6d54a6099a466bdacc0cfb78
|
2024-03-04 19:29:26 +08:00 |
|
hiyouga
|
0e621c2dc9
|
fix #2629
Former-commit-id: c18822669568327d4fbf480a80c5fe5b8fc95e7a
|
2024-02-29 00:37:29 +08:00 |
|
hiyouga
|
c53c7af168
|
update chatglm3 template
Former-commit-id: f55e75ef3b86ea7930bb9d84b46cfc953a74441d
|
2024-02-28 21:11:23 +08:00 |
|
hiyouga
|
4b06aa134f
|
update readme
Former-commit-id: 1b1b427ea13d2a84683514d924555db974865d73
|
2024-02-26 17:25:47 +08:00 |
|
Rayrtfr
|
d0ea203694
|
Support Atom Model
Former-commit-id: da3e76f22aca9acaf772ff821b7eb03c2a2ac869
|
2024-02-26 10:44:10 +08:00 |
|
hiyouga
|
75603c45fc
|
fix data entry
Former-commit-id: e5c116816f2d00e3bfe1a9be5886fe1e41d93212
|
2024-02-23 18:29:24 +08:00 |
|
hiyouga
|
89f86cc970
|
fix gemma template
Former-commit-id: 75950d115845e00318bd457e66440e2c2d98efbd
|
2024-02-23 13:49:53 +08:00 |
|
hiyouga
|
c09a0e4f08
|
fix template
Former-commit-id: 84673463221f2b359732de8a936a8e7ca1d003b6
|
2024-02-22 12:09:21 +08:00 |
|
hiyouga
|
7bac6c9460
|
fix template
Former-commit-id: 1737c7389264ef80bb8ba85c73ede0b0381e11f9
|
2024-02-22 12:06:48 +08:00 |
|
hiyouga
|
0c7d0bf172
|
support gemma
Former-commit-id: b9674aa2f6f1b6b09b2a37375313d8d5abfcd453
|
2024-02-21 23:27:36 +08:00 |
|
hiyouga
|
1d16e87c5f
|
update default template
Former-commit-id: f32b55649a9f95109a6d180216eb67f959d060da
|
2024-02-10 16:44:47 +08:00 |
|
hiyouga
|
1955a8ea5a
|
improve aligner
Former-commit-id: cc7296b92e10c24967fc753393275b71d300683f
|
2024-02-10 16:39:19 +08:00 |
|
hiyouga
|
b98a64448a
|
improve fix tokenizer
Former-commit-id: 57b138abad6397596bc47be94e092e8fabedc06f
|
2024-02-09 14:53:14 +08:00 |
|
hoshi-hiyouga
|
2c3ef480a6
|
Merge pull request #2423 from mayflower/main
Support for german sft and dpo
Former-commit-id: 8e282e4e6bee6493b1bd38ba239ca49a6a840a92
|
2024-02-07 15:58:20 +08:00 |
|
hiyouga
|
0dd68d1e06
|
add models
Former-commit-id: 0fdf61b2f765c125acda4f406eb25b3e59e75db2
|
2024-02-06 14:57:23 +08:00 |
|
Johann-Peter Hartmann
|
4d78fe6ece
|
Merge branch 'hiyouga:main' into main
Former-commit-id: efbb0153981d0650f3a581e324b83054ca8063c1
|
2024-02-04 13:55:00 +00:00 |
|
hiyouga
|
a3e3ea9846
|
fix #2421
Former-commit-id: 43918c12310f7560d3820e5c6d72964309afeb8b
|
2024-02-04 21:02:55 +08:00 |
|
Johann-Peter Hartmann
|
feba34e82d
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 0395d0aafb69e86645e6b0a36b8f8dadb82219e0
|
2024-02-04 12:51:25 +00:00 |
|
hiyouga
|
e134013e04
|
fix reserved label len
Former-commit-id: b06d6c05a1911f329252a7572240048e456affdc
|
2024-02-04 17:54:26 +08:00 |
|
hiyouga
|
bcd76d2c7a
|
support minicpm #2404
Former-commit-id: 4449e91cbee8fd804cf8bf1ff6b9f5301fde94ed
|
2024-02-03 22:36:46 +08:00 |
|
Johann-Peter Hartmann
|
36fcbedc11
|
add simple german chatml template chatml_de
Former-commit-id: 9f1d67c09f1af2c7aa383adec66842cacde92e33
|
2024-02-03 09:01:15 +01:00 |
|
Fallen Angel
|
08dfac8352
|
fix eos_token_id=0 bug
when eos_token_id=0, will never add eos_token
Former-commit-id: 576b4881c386d897462a875b28066ce9d6e06dd5
|
2024-02-02 17:34:48 +08:00 |
|
hiyouga
|
1fe1ca1c8b
|
add orion models
Former-commit-id: a34db89d2a281d1a1ace29dfd5bd5d4ff7c2f657
|
2024-01-22 21:26:53 +08:00 |
|
hiyouga
|
50459a39f4
|
fix api
Former-commit-id: a4149fbcd600d4f3815f9353e5e92c569719bed6
|
2024-01-21 00:03:09 +08:00 |
|
hiyouga
|
5c9815ef6f
|
fix internlm2 template
Former-commit-id: ae05b23eb86555dbfafc174aa6ceff736e7fc9fa
|
2024-01-20 23:33:50 +08:00 |
|
hiyouga
|
aed00a97b6
|
fix cli_demo
Former-commit-id: e8336b3653f43618cf7cd70f8da004208de970c0
|
2024-01-20 23:27:10 +08:00 |
|
hiyouga
|
7543dc4a9d
|
fix #2260
Former-commit-id: ba97550671811a27177306dd231bb427130b26fb
|
2024-01-20 23:22:09 +08:00 |
|
hiyouga
|
66e0e651b9
|
format style
Former-commit-id: 53b683531b83cd1d19de97c6565f16c1eca6f5e1
|
2024-01-20 20:15:56 +08:00 |
|
hiyouga
|
0868d5c550
|
fix #2249
Former-commit-id: 7ec64588c541422875adfdaf5692a27d05b96cb9
|
2024-01-19 21:44:32 +08:00 |
|
hiyouga
|
790acc4c17
|
fix templates
Former-commit-id: 382cc48b2a823b9a7d4ccf2c2a163f0e5b6e3169
|
2024-01-18 14:49:52 +08:00 |
|
hiyouga
|
e4a424cb6a
|
enable cutoff len
Former-commit-id: e9513d300c338dfcae98eee7d057bfd00da2da0e
|
2024-01-18 12:25:42 +08:00 |
|
hiyouga
|
d8affd3967
|
add tool test
Former-commit-id: 639a355a9ceb2e4585b81aea71fc810f4b510776
|
2024-01-18 10:26:26 +08:00 |
|
hiyouga
|
a423274fd9
|
support function calling
Former-commit-id: 66533b3f65babf2429c92c0f8fafe4eff5e0ff63
|
2024-01-18 09:54:23 +08:00 |
|
hiyouga
|
cfe1e24471
|
support solar 10.7B #1907
Former-commit-id: ecf9b35c612e5514dd25b0d15835d28447a7437e
|
2024-01-14 00:30:30 +08:00 |
|
hiyouga
|
c5f099138d
|
fix #2147
Former-commit-id: 49445a03cd46af4e7036cf444cd041dfab2d8941
|
2024-01-12 03:30:56 +08:00 |
|
hiyouga
|
c3e574ceaa
|
fix qwen template
Former-commit-id: c1923e0daa02b49ac07e96ce29877729acc78d31
|
2024-01-05 16:14:56 +08:00 |
|
hiyouga
|
af3f5b6e16
|
fix export format
Former-commit-id: 7c82bd396b9e6ff395850ad544d95cbf1b7557cd
|
2023-12-28 18:40:46 +08:00 |
|
hiyouga
|
acf5241845
|
fix stop words
Former-commit-id: 6ce6cac9fa8f0af33697e824cf93a9a80cdbd064
|
2023-12-20 19:06:43 +08:00 |
|
hiyouga
|
2bce99b82f
|
fix yi template #1895
Former-commit-id: 05b4fa1e2b13a15ee261a151ac8cd0a2ebdf5edc
|
2023-12-20 18:58:16 +08:00 |
|
hiyouga
|
4b27cf5460
|
add codegeex template
Former-commit-id: a8222722b8097158f1c92e3729f41d411eff3926
|
2023-12-18 19:52:35 +08:00 |
|
hiyouga
|
f902b0d420
|
refactor adapter hparam
Former-commit-id: f82aece9ebd6df83a7a005cc7cbbcec07fa6e14d
|
2023-12-15 20:53:11 +08:00 |
|
hiyouga
|
6975124a57
|
support mixtral
Former-commit-id: 75b5b8e36ab1933b2625f11b645f56cbc805fd85
|
2023-12-12 11:39:04 +08:00 |
|
hiyouga
|
24ce319b6f
|
add models
Former-commit-id: 758ae7937a41a95016e70180fb343011763c1b67
|
2023-12-06 13:33:18 +08:00 |
|
hiyouga
|
8ca196d51f
|
add xuanyuan models
Former-commit-id: 1dfa9de3723550cddf24bbc0739cad6207731212
|
2023-12-02 00:35:29 +08:00 |
|
hiyouga
|
7ef8f46591
|
add models
Former-commit-id: b9eaadde8b5f4b9f89fa7bb910b325fcf9c84434
|
2023-11-30 19:16:13 +08:00 |
|