2872 Commits

Author SHA1 Message Date
hiyouga
1392242958 remove unused code
Former-commit-id: ed6161fa6a5f23dfacc52a2a77ddaeeb4adf8443
2023-06-03 00:10:54 +08:00
hiyouga
0f6efcc77a add wechat
Former-commit-id: 72a85ccc39e19a800cf638407fd3b53976a5af15
2023-06-02 21:47:10 +08:00
hiyouga
36790c4e32 tiny fix
Former-commit-id: b8a034807e97730bc95a5f0bf0ca0763d7c6824c
2023-06-02 19:02:25 +08:00
hiyouga
6ab22a0181 fix layer norm name in PPO
Former-commit-id: e3aaef7d4a37e4aa388a9158c382db8239843a5e
2023-06-02 17:30:01 +08:00
hiyouga
b0e9a673be fix #1
Former-commit-id: bd565af3706d74712e50884797ee2e2056a49809
2023-06-02 14:25:00 +08:00
hiyouga
4003ddcc3b alter rewards data type
Former-commit-id: 50d9a20f8103fcfb92a3e2a5e6f0055d27b29d53
2023-06-02 14:19:51 +08:00
hiyouga
7e1be4c21a fix possibly OOM error
Former-commit-id: e6126244c161dc87b0d4d45b8976c02fc9933545
2023-06-01 23:54:44 +08:00
hiyouga
3f3b475412 fix bug at inference
Former-commit-id: fd709eacff09d52636541cba009a1ded6aac22dc
2023-05-31 18:11:53 +08:00
hiyouga
79011936c9 update readme
Former-commit-id: 38ca4292280df93c2037cf7075f5b0fe5e994a5f
2023-05-31 16:57:43 +08:00
hiyouga
3bfb086399 support BLOOM models
Former-commit-id: 740a5daf5634f70a61b41fa8a31ee4a587fa03f3
2023-05-31 16:54:06 +08:00
hoshi-hiyouga
1a5eacc98a Merge pull request #1 from mMrBun/main
Support conversation via API.

Former-commit-id: c36620ece4b65301d38704a0482730c3e6a9445b
2023-05-30 16:34:00 +08:00
hiyouga
ddb456bbcb remove dummy code
Former-commit-id: a72492e6490c44a7edccd572da73c47d6f278cc7
2023-05-30 16:28:00 +08:00
mMrBun
bc2e530e16 Support conversation via API.
Former-commit-id: 748b804bac8e2c972246bc7f7d50884fe105a7fe
2023-05-30 15:00:28 +08:00
mMrBun
21ef968922 Support conversation via API.
Former-commit-id: e82168243060ba77ff458a5b1e8479468b8e7265
2023-05-30 14:46:22 +08:00
hiyouga
6ba162ef6c update readme
Former-commit-id: 6ccdfb400118774b78dbee5a7aee5969fb9f480c
2023-05-29 21:54:01 +08:00
hiyouga
e6a1469467 update readme
Former-commit-id: 7698f9aa9a4ea579f1eefaac637675043581e9c8
2023-05-29 21:53:02 +08:00
hiyouga
4c7c96e656 add pre-training script
Former-commit-id: 8ff96509fa621054368919988a15b50da1891852
2023-05-29 21:37:22 +08:00
hiyouga
0ab4419b86 fix checkpoint loading
Former-commit-id: c0e5df92d601966444956c65482441bd757fd7a1
2023-05-29 17:43:16 +08:00
hiyouga
03338163c2 tiny fix
Former-commit-id: ce71cc8b6db5d13b87b7d0302f4176c5c76ac4b2
2023-05-29 09:42:29 +08:00
hiyouga
b1517e7a0e tiny fix
Former-commit-id: 166c837b95d42513f7b977b189822b5c7980606d
2023-05-28 21:48:33 +08:00
hiyouga
87ba09e035 use fp16 model, add logcallback
Former-commit-id: 0c9fda01e3c61727c939efd9d9398f657a2d69b6
2023-05-28 21:30:28 +08:00
hiyouga
54b8ce7b63 Initial commit
Former-commit-id: 769c6ab56be0c9d26e9289f61ac54a4068d935c1
2023-05-28 18:09:04 +08:00