13 Commits

Author SHA1 Message Date
hiyouga
1ce7b5e0f3 update loading logic
Former-commit-id: 4d0fddba213beaa55146b047a78963d1d18185a1
2023-06-28 12:07:16 +08:00
hiyouga
307f5866e9 support save full model, replace BOS token
Former-commit-id: 2e01abfda5706d8913860f52ce3bab98739eae55
2023-06-27 21:40:11 +08:00
hiyouga
c6d56e7109 support loading lora from hub
Former-commit-id: 0574b590ef3c4e317f7e2da25b0e5084dcef42a1
2023-06-16 00:02:17 +08:00
hiyouga
a68808d6d9 support baichuan model
Former-commit-id: 0cee6ad67ffb06f0d7165a0284e39f510a2abc36
2023-06-15 16:02:01 +08:00
hiyouga
ca90a1e6d9 fix loading valuehead
Former-commit-id: 875e8e23498f6933d657ad154b53611310327e3e
2023-06-13 11:13:06 +08:00
hiyouga
ce08b4a7ec add prompt template class
Former-commit-id: 909af8f49698a1de3010becf61817cbedecf7879
2023-06-07 11:55:25 +08:00
hiyouga
8849bee763 recover logging
Former-commit-id: 13d1f0709c774bb5ec5fb2b4e3c66b2f1226afd2
2023-06-06 21:36:37 +08:00
hiyouga
794c2fd506 support distributed quantized training
Former-commit-id: 4eb17bcf6c8ac51a3ec8cc5459064d1b35c82634
2023-06-06 17:39:41 +08:00
hiyouga
1a49937351 add API demo from #1
Former-commit-id: 3d8d5ee5d54102dd73856fac3a80922ea3104a06
2023-06-05 21:32:18 +08:00
hiyouga
e92ac44cd2 implement stream generating
Former-commit-id: fe1d9308163699b7c4dd791915788855b2e6854f
2023-06-05 16:43:44 +08:00
hiyouga
4003ddcc3b alter rewards data type
Former-commit-id: 50d9a20f8103fcfb92a3e2a5e6f0055d27b29d53
2023-06-02 14:19:51 +08:00
hiyouga
3bfb086399 support BLOOM models
Former-commit-id: 740a5daf5634f70a61b41fa8a31ee4a587fa03f3
2023-05-31 16:54:06 +08:00
hiyouga
54b8ce7b63 Initial commit
Former-commit-id: 769c6ab56be0c9d26e9289f61ac54a4068d935c1
2023-05-28 18:09:04 +08:00