26 Commits

Author SHA1 Message Date
hiyouga
25182c4779 fix Baichuan-13B
Former-commit-id: 6d9d826b3246349454c68f4d13b862da4de986e2
2023-07-13 23:08:45 +08:00
hiyouga
82cbbc0e48 fix freeze tuning
Former-commit-id: e32a1db967da02f502559df59ec6d1ab4554febf
2023-07-05 21:18:28 +08:00
hiyouga
6b5a085ddf support falcon model #72
Former-commit-id: 72cc3ff0e6de641073de1159196319705f8efe85
2023-07-05 15:00:06 +08:00
hiyouga
4f2c204f13 fix initializing data arguments
Former-commit-id: e6b83c8b87cb93358086121a6f9ccaba5dfa7497
2023-06-27 22:50:23 +08:00
hiyouga
b6968a6940 support prefixes, loading multiple local files
Former-commit-id: 6672e09836ed0103693a381ece010377bd0ef4f8
2023-06-26 15:32:40 +08:00
hiyouga
d97da03cd5 update api
Former-commit-id: a90db46e336a657d5fcf480986bfc68c77ad416b
2023-06-26 13:39:57 +08:00
hiyouga
bfe015e30f match api with OpenAI format
Former-commit-id: 9cbe2b98b024393817e86ff8e3ff1636776fa263
2023-06-22 20:27:00 +08:00
hiyouga
b9e225bc20 add default template
Former-commit-id: c64fb6b83fdbedd62073417213f0215207ff1311
2023-06-16 21:12:17 +08:00
hiyouga
3db9b51f04 fix freeze layers
Former-commit-id: 8a16359c121d543aeea3650612df46fc1bad1428
2023-06-16 17:38:21 +08:00
hiyouga
6d1e733311 support loading lora from hub
Former-commit-id: 0b34c962bc3368dca62b18ad6c27a0293c3affa5
2023-06-16 00:02:17 +08:00
hiyouga
fdfc22196c fix generating args
Former-commit-id: 52805a8441bd7b324bd89489de60f18f103c8e4c
2023-06-13 01:33:56 +08:00
hiyouga
0da1b7d9ab support RM metrics, add generating Args
Former-commit-id: c461c6190bc124e98dde7f3cf96a59ce40b26fb0
2023-06-12 15:48:48 +08:00
BUAADreamer
2012cb5cbc add code for reading from multi files in one directory
Former-commit-id: b7ebb83a96619e5111b0faa9da9d0feb8d9cdff0
2023-06-10 15:53:47 +08:00
hiyouga
5e96a45bec add belle template
Former-commit-id: c489c8ecbaaa511ddc7dc1de685981531eedd38c
2023-06-07 12:30:11 +08:00
hiyouga
8875f565ad add prompt template class
Former-commit-id: 3d7e3a38d00aa5d9664824093043951af8c3f707
2023-06-07 11:55:25 +08:00
hiyouga
2770a2ee58 tiny fix
Former-commit-id: 3c5da617cdab34c6cae038e3a06d0468ae4c6c86
2023-06-05 15:25:22 +08:00
hiyouga
363e0da084 tiny fix
Former-commit-id: a98ebf62fb82ffe5aaaea6a1ce3d4c60d23a5728
2023-06-04 12:55:40 +08:00
hiyouga
de447e7aeb support QLoRA
Former-commit-id: d89597e28fe9b91246e58c55eeb9082436940481
2023-06-04 00:08:56 +08:00
hiyouga
315e2bea67 add ziya prompt template
Former-commit-id: 321e44ac54a91260cf00a4caa1991708814473fc
2023-06-03 19:05:51 +08:00
hiyouga
5389fdacd4 use low_cpu_mem_usage to speed up loading
Former-commit-id: 7891e4c200566a4a47088e93efd1fbebcb46528e
2023-06-03 18:19:01 +08:00
hiyouga
cba25893d3 add logits processor
Former-commit-id: f6f4b1554ae1e8849b437d705ffa34ce7ebd56bb
2023-06-03 16:34:54 +08:00
hiyouga
b5b6767f4b fix #1
Former-commit-id: b8e556e4632a79251a2225075c570337eeafa559
2023-06-02 14:25:00 +08:00
hiyouga
a74fcc4149 support BLOOM models
Former-commit-id: 1314b6ea39a01aa8ac325e1d875ac013d43aec45
2023-05-31 16:54:06 +08:00
hiyouga
6f89f64c73 fix checkpoint loading
Former-commit-id: d31aa5c2c0bcb6a4ef4a62e21693548dd9acaae6
2023-05-29 17:43:16 +08:00
hiyouga
e158cd8b32 tiny fix
Former-commit-id: eae79707d31fd8be2cf4bee4d610557bbd49f6e7
2023-05-29 09:42:29 +08:00
hiyouga
54574f1dfa Initial commit
Former-commit-id: 5ca8e1d63727e7bcb8cab16542c763c47e48184a
2023-05-28 18:09:04 +08:00