hiyouga
|
c7d71dd8af
|
use low_cpu_mem_usage to speed up loading
Former-commit-id: 771f454ff1deee4929927c58feab7dcd3b854f9c
|
2023-06-03 18:19:01 +08:00 |
|
hiyouga
|
42c9c8de39
|
add logits processor
Former-commit-id: dca27b4412e8e41cadcd623582222e1c216db78b
|
2023-06-03 16:34:54 +08:00 |
|
hiyouga
|
4003ddcc3b
|
alter rewards data type
Former-commit-id: 50d9a20f8103fcfb92a3e2a5e6f0055d27b29d53
|
2023-06-02 14:19:51 +08:00 |
|
hiyouga
|
7e1be4c21a
|
fix possibly OOM error
Former-commit-id: e6126244c161dc87b0d4d45b8976c02fc9933545
|
2023-06-01 23:54:44 +08:00 |
|
hiyouga
|
3bfb086399
|
support BLOOM models
Former-commit-id: 740a5daf5634f70a61b41fa8a31ee4a587fa03f3
|
2023-05-31 16:54:06 +08:00 |
|
hiyouga
|
ddb456bbcb
|
remove dummy code
Former-commit-id: a72492e6490c44a7edccd572da73c47d6f278cc7
|
2023-05-30 16:28:00 +08:00 |
|
hiyouga
|
4c7c96e656
|
add pre-training script
Former-commit-id: 8ff96509fa621054368919988a15b50da1891852
|
2023-05-29 21:37:22 +08:00 |
|
hiyouga
|
0ab4419b86
|
fix checkpoint loading
Former-commit-id: c0e5df92d601966444956c65482441bd757fd7a1
|
2023-05-29 17:43:16 +08:00 |
|
hiyouga
|
03338163c2
|
tiny fix
Former-commit-id: ce71cc8b6db5d13b87b7d0302f4176c5c76ac4b2
|
2023-05-29 09:42:29 +08:00 |
|
hiyouga
|
87ba09e035
|
use fp16 model, add logcallback
Former-commit-id: 0c9fda01e3c61727c939efd9d9398f657a2d69b6
|
2023-05-28 21:30:28 +08:00 |
|
hiyouga
|
54b8ce7b63
|
Initial commit
Former-commit-id: 769c6ab56be0c9d26e9289f61ac54a4068d935c1
|
2023-05-28 18:09:04 +08:00 |
|