7 Commits

Author SHA1 Message Date
hiyouga
1fbda5d139 support RM metrics, add generating Args
Former-commit-id: cec6524d6b1be65c5d171a5b3dcaae7818132bc5
2023-06-12 15:48:48 +08:00
hiyouga
4003ddcc3b alter rewards data type
Former-commit-id: 50d9a20f8103fcfb92a3e2a5e6f0055d27b29d53
2023-06-02 14:19:51 +08:00
hiyouga
3bfb086399 support BLOOM models
Former-commit-id: 740a5daf5634f70a61b41fa8a31ee4a587fa03f3
2023-05-31 16:54:06 +08:00
hiyouga
4c7c96e656 add pre-training script
Former-commit-id: 8ff96509fa621054368919988a15b50da1891852
2023-05-29 21:37:22 +08:00
hiyouga
03338163c2 tiny fix
Former-commit-id: ce71cc8b6db5d13b87b7d0302f4176c5c76ac4b2
2023-05-29 09:42:29 +08:00
hiyouga
87ba09e035 use fp16 model, add logcallback
Former-commit-id: 0c9fda01e3c61727c939efd9d9398f657a2d69b6
2023-05-28 21:30:28 +08:00
hiyouga
54b8ce7b63 Initial commit
Former-commit-id: 769c6ab56be0c9d26e9289f61ac54a4068d935c1
2023-05-28 18:09:04 +08:00