hiyouga
|
1d16e87c5f
|
update default template
Former-commit-id: f32b55649a9f95109a6d180216eb67f959d060da
|
2024-02-10 16:44:47 +08:00 |
|
hiyouga
|
1955a8ea5a
|
improve aligner
Former-commit-id: cc7296b92e10c24967fc753393275b71d300683f
|
2024-02-10 16:39:19 +08:00 |
|
hoshi-hiyouga
|
a41fa6e730
|
Merge pull request #2462 from mnmueller/main
Enable Parsing of SlimOrca
Former-commit-id: 99eed520b87152ca6b89c2a068b09200fd45f30d
|
2024-02-09 22:55:48 +08:00 |
|
hiyouga
|
b98a64448a
|
improve fix tokenizer
Former-commit-id: 57b138abad6397596bc47be94e092e8fabedc06f
|
2024-02-09 14:53:14 +08:00 |
|
Mark Mueller
|
1ce82f391a
|
Slim Orca data parsing
Former-commit-id: f2d8efede7e20edafed0d5446eb64f2d419949b1
|
2024-02-08 19:32:20 +01:00 |
|
Mark Mueller
|
4d473894fd
|
Slim Orca data parsing
Former-commit-id: ca57d27c39d4e7bc3dd7c3207a23d23d2cbd446b
|
2024-02-08 17:56:18 +01:00 |
|
Mark Mueller
|
5788b7c7d0
|
Slim Orca data parsing
Former-commit-id: 3016427be4e63fd25f40bc5a0d1f8cedc0997334
|
2024-02-08 17:54:18 +01:00 |
|
Mark Mueller
|
04515f6b55
|
Slim Orca data parsing
Former-commit-id: 4dca3907964d27abc2b21eb55c75676901c98912
|
2024-02-08 17:52:36 +01:00 |
|
Mark Mueller
|
96f8ccf3d5
|
SlimOrca aligner
Former-commit-id: 928dda93867c2327a7957c04648592044ccf9daf
|
2024-02-08 08:28:32 -08:00 |
|
hoshi-hiyouga
|
2c3ef480a6
|
Merge pull request #2423 from mayflower/main
Support for german sft and dpo
Former-commit-id: 8e282e4e6bee6493b1bd38ba239ca49a6a840a92
|
2024-02-07 15:58:20 +08:00 |
|
hiyouga
|
34bc0c22b1
|
lint
Former-commit-id: 6b1f89b6494e9b6b087fe90600617a3024e014e5
|
2024-02-07 01:10:04 +08:00 |
|
hiyouga
|
0dd68d1e06
|
add models
Former-commit-id: 0fdf61b2f765c125acda4f406eb25b3e59e75db2
|
2024-02-06 14:57:23 +08:00 |
|
Johann-Peter Hartmann
|
4d78fe6ece
|
Merge branch 'hiyouga:main' into main
Former-commit-id: efbb0153981d0650f3a581e324b83054ca8063c1
|
2024-02-04 13:55:00 +00:00 |
|
hiyouga
|
a3e3ea9846
|
fix #2421
Former-commit-id: 43918c12310f7560d3820e5c6d72964309afeb8b
|
2024-02-04 21:02:55 +08:00 |
|
Johann-Peter Hartmann
|
feba34e82d
|
Merge branch 'hiyouga:main' into main
Former-commit-id: 0395d0aafb69e86645e6b0a36b8f8dadb82219e0
|
2024-02-04 12:51:25 +00:00 |
|
hiyouga
|
e134013e04
|
fix reserved label len
Former-commit-id: b06d6c05a1911f329252a7572240048e456affdc
|
2024-02-04 17:54:26 +08:00 |
|
hiyouga
|
996cc5d900
|
fix #2397
Former-commit-id: 7404692808f2288d539668d364965ad104dacadb
|
2024-02-03 23:45:31 +08:00 |
|
hiyouga
|
5fa52e87cb
|
fix #2376
Former-commit-id: 8e2cfa7cca21b7fd4538d72114e36f704bcc82fe
|
2024-02-03 23:14:31 +08:00 |
|
hiyouga
|
bcd76d2c7a
|
support minicpm #2404
Former-commit-id: 4449e91cbee8fd804cf8bf1ff6b9f5301fde94ed
|
2024-02-03 22:36:46 +08:00 |
|
Johann-Peter Hartmann
|
36fcbedc11
|
add simple german chatml template chatml_de
Former-commit-id: 9f1d67c09f1af2c7aa383adec66842cacde92e33
|
2024-02-03 09:01:15 +01:00 |
|
Fallen Angel
|
08dfac8352
|
fix eos_token_id=0 bug
when eos_token_id=0, will never add eos_token
Former-commit-id: 576b4881c386d897462a875b28066ce9d6e06dd5
|
2024-02-02 17:34:48 +08:00 |
|
hiyouga
|
75be329994
|
fix #2282 and update tool prompt
Former-commit-id: 1c412f803866bde32b76f7c26c7b464b6b3651f3
|
2024-01-22 22:27:30 +08:00 |
|
hiyouga
|
1fe1ca1c8b
|
add orion models
Former-commit-id: a34db89d2a281d1a1ace29dfd5bd5d4ff7c2f657
|
2024-01-22 21:26:53 +08:00 |
|
hiyouga
|
fe4d93c6db
|
add array param format
Former-commit-id: bf910f8a5b21ee552fa9ab069610a3f5f611de57
|
2024-01-21 22:17:48 +08:00 |
|
hiyouga
|
7abc3065fb
|
tiny fix
Former-commit-id: 66839ae94985ddfa13eca4542127119c919b9648
|
2024-01-21 13:26:12 +08:00 |
|
hiyouga
|
27f281480a
|
finish agent
Former-commit-id: d8d9d3afe32725fe79120fcd1a0970fdcdc45625
|
2024-01-21 01:47:33 +08:00 |
|
hiyouga
|
50459a39f4
|
fix api
Former-commit-id: a4149fbcd600d4f3815f9353e5e92c569719bed6
|
2024-01-21 00:03:09 +08:00 |
|
hiyouga
|
5c9815ef6f
|
fix internlm2 template
Former-commit-id: ae05b23eb86555dbfafc174aa6ceff736e7fc9fa
|
2024-01-20 23:33:50 +08:00 |
|
hiyouga
|
aed00a97b6
|
fix cli_demo
Former-commit-id: e8336b3653f43618cf7cd70f8da004208de970c0
|
2024-01-20 23:27:10 +08:00 |
|
hiyouga
|
7543dc4a9d
|
fix #2260
Former-commit-id: ba97550671811a27177306dd231bb427130b26fb
|
2024-01-20 23:22:09 +08:00 |
|
hiyouga
|
841fa0030f
|
release v0.5.0
Former-commit-id: 602bb9b685009b9af234499be278404721542ac7
|
2024-01-20 20:21:39 +08:00 |
|
hiyouga
|
66e0e651b9
|
format style
Former-commit-id: 53b683531b83cd1d19de97c6565f16c1eca6f5e1
|
2024-01-20 20:15:56 +08:00 |
|
hiyouga
|
1750218057
|
fix tests
Former-commit-id: 23f97bd437424ef43b2b84743d56acc5d1ca70d5
|
2024-01-20 19:58:04 +08:00 |
|
hiyouga
|
0868d5c550
|
fix #2249
Former-commit-id: 7ec64588c541422875adfdaf5692a27d05b96cb9
|
2024-01-19 21:44:32 +08:00 |
|
hiyouga
|
9b390c4bea
|
fix function formatter
Former-commit-id: 363a87376ad8fe4149b387f7ccd60f31f2a5fdf7
|
2024-01-18 16:01:07 +08:00 |
|
hiyouga
|
790acc4c17
|
fix templates
Former-commit-id: 382cc48b2a823b9a7d4ccf2c2a163f0e5b6e3169
|
2024-01-18 14:49:52 +08:00 |
|
hiyouga
|
ffc874ec6f
|
fix pretrain data loader
Former-commit-id: 2a812b706ecc527013e79edc504ec18a4193123d
|
2024-01-18 14:42:52 +08:00 |
|
hiyouga
|
b7df920860
|
fix dataset
Former-commit-id: a7ce244a6d83d62f5bbecc588f1978e3791fd3b3
|
2024-01-18 12:59:30 +08:00 |
|
hiyouga
|
e4a424cb6a
|
enable cutoff len
Former-commit-id: e9513d300c338dfcae98eee7d057bfd00da2da0e
|
2024-01-18 12:25:42 +08:00 |
|
hiyouga
|
d8affd3967
|
add tool test
Former-commit-id: 639a355a9ceb2e4585b81aea71fc810f4b510776
|
2024-01-18 10:26:26 +08:00 |
|
hiyouga
|
a423274fd9
|
support function calling
Former-commit-id: 66533b3f65babf2429c92c0f8fafe4eff5e0ff63
|
2024-01-18 09:54:23 +08:00 |
|
hiyouga
|
cfe1e24471
|
support solar 10.7B #1907
Former-commit-id: ecf9b35c612e5514dd25b0d15835d28447a7437e
|
2024-01-14 00:30:30 +08:00 |
|
hiyouga
|
c5f099138d
|
fix #2147
Former-commit-id: 49445a03cd46af4e7036cf444cd041dfab2d8941
|
2024-01-12 03:30:56 +08:00 |
|
hiyouga
|
c3e574ceaa
|
fix qwen template
Former-commit-id: c1923e0daa02b49ac07e96ce29877729acc78d31
|
2024-01-05 16:14:56 +08:00 |
|
hiyouga
|
e85c205a81
|
fix #2014
Former-commit-id: 077f6bf64e50f01f62aa4a957438bedc4e7925b3
|
2023-12-29 15:17:22 +08:00 |
|
hiyouga
|
af3f5b6e16
|
fix export format
Former-commit-id: 7c82bd396b9e6ff395850ad544d95cbf1b7557cd
|
2023-12-28 18:40:46 +08:00 |
|
hiyouga
|
f869e44fe5
|
fix #1909
Former-commit-id: 3e93c33af9f80e28c9f30af9b7ba20757358afb4
|
2023-12-23 14:42:20 +08:00 |
|
hiyouga
|
acf5241845
|
fix stop words
Former-commit-id: 6ce6cac9fa8f0af33697e824cf93a9a80cdbd064
|
2023-12-20 19:06:43 +08:00 |
|
hiyouga
|
2bce99b82f
|
fix yi template #1895
Former-commit-id: 05b4fa1e2b13a15ee261a151ac8cd0a2ebdf5edc
|
2023-12-20 18:58:16 +08:00 |
|
hiyouga
|
dba1af4841
|
add max_memory for gptq #1923
Former-commit-id: 9afc42c8b999fbbc206d9a467ca5795b27a10096
|
2023-12-20 18:15:17 +08:00 |
|