hiyouga
|
de447e7aeb
|
support QLoRA
Former-commit-id: d89597e28fe9b91246e58c55eeb9082436940481
|
2023-06-04 00:08:56 +08:00 |
|
hiyouga
|
d2e80fff76
|
fix int8 inference
Former-commit-id: d05202943e9634526f96d189288f67852d3d1c40
|
2023-06-03 23:22:05 +08:00 |
|
hiyouga
|
eaf536378c
|
reduce repetition penalty
Former-commit-id: 0381d93fc10ea5346724fe6295caa565a8eb4f61
|
2023-06-03 21:57:39 +08:00 |
|
hiyouga
|
4e224fac7c
|
fix int8 inference
Former-commit-id: fcf3506bef28504dd679c2210bdc84e5868e05fe
|
2023-06-03 21:17:47 +08:00 |
|
hiyouga
|
315e2bea67
|
add ziya prompt template
Former-commit-id: 321e44ac54a91260cf00a4caa1991708814473fc
|
2023-06-03 19:05:51 +08:00 |
|
hiyouga
|
5389fdacd4
|
use low_cpu_mem_usage to speed up loading
Former-commit-id: 7891e4c200566a4a47088e93efd1fbebcb46528e
|
2023-06-03 18:19:01 +08:00 |
|
hiyouga
|
cba25893d3
|
add logits processor
Former-commit-id: f6f4b1554ae1e8849b437d705ffa34ce7ebd56bb
|
2023-06-03 16:34:54 +08:00 |
|
hiyouga
|
92acd4f1a5
|
remove unused code
Former-commit-id: f5c784dd75e152edb162ea02bf601d279f9de893
|
2023-06-03 00:10:54 +08:00 |
|
hiyouga
|
bc42983d75
|
add wechat
Former-commit-id: 0251b1788081a81773d87ca5ca2bac8428489852
|
2023-06-02 21:47:10 +08:00 |
|
hiyouga
|
1e6a013413
|
tiny fix
Former-commit-id: d479aaf07a0997737da90c00558c42b32109928f
|
2023-06-02 19:02:25 +08:00 |
|
hiyouga
|
dc7e3f75c9
|
fix layer norm name in PPO
Former-commit-id: 3ffc2efb997b717b3efad92a507584276e4bdfa1
|
2023-06-02 17:30:01 +08:00 |
|
hiyouga
|
b5b6767f4b
|
fix #1
Former-commit-id: b8e556e4632a79251a2225075c570337eeafa559
|
2023-06-02 14:25:00 +08:00 |
|
hiyouga
|
587d0f5311
|
alter rewards data type
Former-commit-id: 3eb7eb2d37525da50fe401ab7c59532e6e1ef984
|
2023-06-02 14:19:51 +08:00 |
|
hiyouga
|
7ef5821cba
|
fix possibly OOM error
Former-commit-id: 0d590dffb41b0e832d9f87d20a23bcd0acd983aa
|
2023-06-01 23:54:44 +08:00 |
|
hiyouga
|
4edd01fc08
|
fix bug at inference
Former-commit-id: df9b41af4401006b8040eb53c44dd290b604e0eb
|
2023-05-31 18:11:53 +08:00 |
|
hiyouga
|
3176b86454
|
update readme
Former-commit-id: 4054e85c664c541f435619baebcd687f80445d4a
|
2023-05-31 16:57:43 +08:00 |
|
hiyouga
|
a74fcc4149
|
support BLOOM models
Former-commit-id: 1314b6ea39a01aa8ac325e1d875ac013d43aec45
|
2023-05-31 16:54:06 +08:00 |
|
hiyouga
|
f8d03f3aa9
|
remove dummy code
Former-commit-id: e6bc89d280945bbf48281107145c40a41d7cbd56
|
2023-05-30 16:28:00 +08:00 |
|
hiyouga
|
a02df1f2f8
|
update readme
Former-commit-id: 64f7fa45a4dbd173a3e5eb66d17044aa1243cc4b
|
2023-05-29 21:54:01 +08:00 |
|
hiyouga
|
0fa508b904
|
update readme
Former-commit-id: eed2773df8081b229d13b1d679bf2913715f23ac
|
2023-05-29 21:53:02 +08:00 |
|
hiyouga
|
bb6f731461
|
add pre-training script
Former-commit-id: 935d58de2b3a2eadc4f0bed28c3ad7dee32e9fd5
|
2023-05-29 21:37:22 +08:00 |
|
hiyouga
|
6f89f64c73
|
fix checkpoint loading
Former-commit-id: d31aa5c2c0bcb6a4ef4a62e21693548dd9acaae6
|
2023-05-29 17:43:16 +08:00 |
|
hiyouga
|
e158cd8b32
|
tiny fix
Former-commit-id: eae79707d31fd8be2cf4bee4d610557bbd49f6e7
|
2023-05-29 09:42:29 +08:00 |
|
hiyouga
|
684afbf32c
|
tiny fix
Former-commit-id: 08f7e0862b9df353a0e4d8274617c1a5e6fa6619
|
2023-05-28 21:48:33 +08:00 |
|
hiyouga
|
a4384e442c
|
use fp16 model, add logcallback
Former-commit-id: bea275d51338b49ce855eec0178e759607265e3d
|
2023-05-28 21:30:28 +08:00 |
|
hiyouga
|
54574f1dfa
|
Initial commit
Former-commit-id: 5ca8e1d63727e7bcb8cab16542c763c47e48184a
|
2023-05-28 18:09:04 +08:00 |
|