7 Commits

Author SHA1 Message Date
hiyouga
4724ae3492 support RM metrics, add generating Args
Former-commit-id: c461c6190bc124e98dde7f3cf96a59ce40b26fb0
2023-06-12 15:48:48 +08:00
hiyouga
e9ab06678f alter rewards data type
Former-commit-id: 3eb7eb2d37525da50fe401ab7c59532e6e1ef984
2023-06-02 14:19:51 +08:00
hiyouga
693c049eac support BLOOM models
Former-commit-id: 1314b6ea39a01aa8ac325e1d875ac013d43aec45
2023-05-31 16:54:06 +08:00
hiyouga
33fee45217 add pre-training script
Former-commit-id: 935d58de2b3a2eadc4f0bed28c3ad7dee32e9fd5
2023-05-29 21:37:22 +08:00
hiyouga
35d04a2c05 tiny fix
Former-commit-id: eae79707d31fd8be2cf4bee4d610557bbd49f6e7
2023-05-29 09:42:29 +08:00
hiyouga
1fc551e1be use fp16 model, add logcallback
Former-commit-id: bea275d51338b49ce855eec0178e759607265e3d
2023-05-28 21:30:28 +08:00
hiyouga
17024ebc1a Initial commit
Former-commit-id: 5ca8e1d63727e7bcb8cab16542c763c47e48184a
2023-05-28 18:09:04 +08:00