14 Commits

Author SHA1 Message Date
BUAADreamer
2012cb5cbc add code for reading from multi files in one directory
Former-commit-id: b7ebb83a96619e5111b0faa9da9d0feb8d9cdff0
2023-06-10 15:53:47 +08:00
hiyouga
5e96a45bec add belle template
Former-commit-id: c489c8ecbaaa511ddc7dc1de685981531eedd38c
2023-06-07 12:30:11 +08:00
hiyouga
8875f565ad add prompt template class
Former-commit-id: 3d7e3a38d00aa5d9664824093043951af8c3f707
2023-06-07 11:55:25 +08:00
hiyouga
2770a2ee58 tiny fix
Former-commit-id: 3c5da617cdab34c6cae038e3a06d0468ae4c6c86
2023-06-05 15:25:22 +08:00
hiyouga
363e0da084 tiny fix
Former-commit-id: a98ebf62fb82ffe5aaaea6a1ce3d4c60d23a5728
2023-06-04 12:55:40 +08:00
hiyouga
de447e7aeb support QLoRA
Former-commit-id: d89597e28fe9b91246e58c55eeb9082436940481
2023-06-04 00:08:56 +08:00
hiyouga
315e2bea67 add ziya prompt template
Former-commit-id: 321e44ac54a91260cf00a4caa1991708814473fc
2023-06-03 19:05:51 +08:00
hiyouga
5389fdacd4 use low_cpu_mem_usage to speed up loading
Former-commit-id: 7891e4c200566a4a47088e93efd1fbebcb46528e
2023-06-03 18:19:01 +08:00
hiyouga
cba25893d3 add logits processor
Former-commit-id: f6f4b1554ae1e8849b437d705ffa34ce7ebd56bb
2023-06-03 16:34:54 +08:00
hiyouga
b5b6767f4b fix #1
Former-commit-id: b8e556e4632a79251a2225075c570337eeafa559
2023-06-02 14:25:00 +08:00
hiyouga
a74fcc4149 support BLOOM models
Former-commit-id: 1314b6ea39a01aa8ac325e1d875ac013d43aec45
2023-05-31 16:54:06 +08:00
hiyouga
6f89f64c73 fix checkpoint loading
Former-commit-id: d31aa5c2c0bcb6a4ef4a62e21693548dd9acaae6
2023-05-29 17:43:16 +08:00
hiyouga
e158cd8b32 tiny fix
Former-commit-id: eae79707d31fd8be2cf4bee4d610557bbd49f6e7
2023-05-29 09:42:29 +08:00
hiyouga
54574f1dfa Initial commit
Former-commit-id: 5ca8e1d63727e7bcb8cab16542c763c47e48184a
2023-05-28 18:09:04 +08:00