hiyouga
|
3b5a9c60b6
|
fix #763
Former-commit-id: 370bdb6e4309db03e26cad311fb13e5cbb1fc1bf
|
2023-09-01 23:13:05 +08:00 |
|
hiyouga
|
a4fd976048
|
refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: a9d1fb72f791ae57a4d12f4e3a7e2abccf6a7077
|
2023-09-01 19:00:45 +08:00 |
|
hiyouga
|
a46f277477
|
fix streaming in pt stage #548 #549
Former-commit-id: b0ed0dec5e6788a0344c09a6cc58d1116265fd68
|
2023-08-17 17:59:26 +08:00 |
|
hiyouga
|
edc15c62fa
|
fix system prompt
Former-commit-id: 7407d9daa16bf6b3cd5002e16b2c53e402d2bc39
|
2023-08-16 01:35:52 +08:00 |
|
hiyouga
|
79f4ba0d26
|
Release v0.1.6
Former-commit-id: a48cb0d474ef0648a97387daf5f623498b5e3ee6
|
2023-08-11 23:25:57 +08:00 |
|
hiyouga
|
21bf79e72b
|
add defaults
Former-commit-id: d3844e97e387b2106a32a576a61318ecec948e23
|
2023-08-11 13:56:26 +08:00 |
|
hiyouga
|
f1485ab927
|
fix baichuan template
Former-commit-id: 9c6dd1051417c91074daa7dd6ed6cc53448135ad
|
2023-08-11 13:45:47 +08:00 |
|
hiyouga
|
abdfa26d06
|
support DPO training (2305.18290)
Former-commit-id: 3ec4351cfdaf2aefcc7d13345e19d79874ed61d3
|
2023-08-11 03:02:53 +08:00 |
|
hiyouga
|
6404167ab7
|
support val set in streaming mode
Former-commit-id: d86ea314a197fd821770d895e988c48d46679047
|
2023-08-09 23:00:26 +08:00 |
|
hiyouga
|
28a807472b
|
fix rm #420, fix template #426, fix #423
Former-commit-id: 39cd8b6989c9190d213e65467ec41f34ea04c5bc
|
2023-08-09 16:23:31 +08:00 |
|
hiyouga
|
77aa9853fb
|
fix tokenizer #417
Former-commit-id: eecc4b2131e88b38fcd2659b52799a2f6459822f
|
2023-08-08 23:59:41 +08:00 |
|
hiyouga
|
9e49438c41
|
fix bug
Former-commit-id: caa0eda27dbb6cd198b2c2c244edae468417b77d
|
2023-08-08 21:28:28 +08:00 |
|
hiyouga
|
c796c542c8
|
fix chatml template #408
Former-commit-id: a9980617f5c6e3356b672c8635696b2f2e308a5e
|
2023-08-08 17:44:39 +08:00 |
|
hiyouga
|
733b395822
|
update readme
Former-commit-id: 20cf27976f24db2667955a8007e0ce2baa35fc82
|
2023-08-07 15:02:02 +08:00 |
|
hiyouga
|
65369ecf48
|
fix bos and eos token
Former-commit-id: d87c8fd8ab84c9f58c0b1f3fb4ad0adf98b25715
|
2023-08-04 23:55:57 +08:00 |
|
hiyouga
|
dbb284b5a2
|
fix encode
Former-commit-id: 8172ad1b5e3fa0b224d761ce6069d0db4397da2d
|
2023-08-04 23:27:55 +08:00 |
|
hiyouga
|
ea045b0e5b
|
support chatml safe encoding
Former-commit-id: b4852f94065a11c8cd00ffa7e71ac0e0b2bf477a
|
2023-08-04 23:14:28 +08:00 |
|
hiyouga
|
b32ed1d7be
|
support interleave probs
Former-commit-id: 69744c17e8180e0ad549b57d575454724b820d01
|
2023-08-04 21:27:35 +08:00 |
|
hiyouga
|
de407b59ea
|
fix bug in preprocessing
Former-commit-id: 968ce0dcce6bfef582ce37aea6566a65f5aac811
|
2023-08-02 01:10:28 +08:00 |
|
hiyouga
|
43762f96e6
|
fix #296
Former-commit-id: e3f80774c46625dbeb85adeb5443450a41fb7ba2
|
2023-08-01 18:43:53 +08:00 |
|
hiyouga
|
e80b75b560
|
support streaming data, fix #284 #274 #268
Former-commit-id: 0411a4b3e122e7907441bc7a64b004948741a620
|
2023-07-31 23:33:00 +08:00 |
|
hiyouga
|
f769c2d3fc
|
update web UI, support rm predict #210
Former-commit-id: ed0e186a134de816d6a9278f4e47baa6250a52d1
|
2023-07-21 13:27:27 +08:00 |
|
hiyouga
|
64b4f71673
|
simplify code
Former-commit-id: 67a27730744b71795b10260d050501bfe2329c26
|
2023-07-20 15:08:57 +08:00 |
|
hiyouga
|
a696148d6b
|
modity code structure
Former-commit-id: f75137661358f9070bc70c341dfa2cc5fd69cf94
|
2023-07-15 16:54:28 +08:00 |
|