Commit Graph

135 Commits

Author SHA1 Message Date
hiyouga
0c1ad5f3fb fix llamaboard with ray
Former-commit-id: c46675d5e5
2025-01-07 09:59:24 +00:00
hiyouga
b4174021d6 refactor ray integration, support save ckpt
Former-commit-id: d8cac6f546
2025-01-07 09:39:10 +00:00
Eric Tang
bba52e258e run style check
Former-commit-id: 1e8e7be0a5
2025-01-07 08:55:44 +00:00
Kourosh Hakhamaneshi
1217240918 drafting ray integration
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>

Former-commit-id: 163ddb680b
2025-01-07 08:55:44 +00:00
hiyouga
8c57169eb7 fix #6546
Former-commit-id: 870f23d7ea
2025-01-07 06:30:44 +00:00
hiyouga
da8721a70e fix #6499
Former-commit-id: 1800f8c72d
2025-01-02 11:28:54 +00:00
hiyouga
813f5919a3 fix #6482
Former-commit-id: 6f5bb3b8e5
2024-12-30 06:03:07 +00:00
hiyouga
3bcb4633ca fix #6448
Former-commit-id: 2719867982
2024-12-27 16:54:39 +00:00
hiyouga
47c2d91933 support report custom args
Former-commit-id: 5111cac6f8
2024-12-21 21:42:45 +00:00
hoshi-hiyouga
547f76e56e Merge pull request #6401 from Zeyi-Lin/hiyouga/swanlab
feat: add swanlab for experiment tracking and visualization.
Former-commit-id: 947e22a4a3
2024-12-21 14:09:33 +08:00
ZeYi Lin
cc703b58f5 fix: by hiyouga suggestion
Former-commit-id: 3a7ea2048a
2024-12-20 16:43:03 +08:00
ZeYi Lin
8f786ee938 feat: ui improve
Former-commit-id: 5f6dafd70e
2024-12-20 11:03:02 +08:00
ZeYi Lin
dd22454fc5 fix: bugs
Former-commit-id: d0eb64d5e3
2024-12-19 21:08:16 +08:00
hiyouga
8524dcaa4a fix #6391
Former-commit-id: d4c1fda1ad
2024-12-19 12:16:38 +00:00
ZeYi Lin
53103f55b6 feat: optimize frontend
Former-commit-id: 8c2df41b93
2024-12-19 19:04:19 +08:00
ZeYi Lin
cc5cde734b feat: swanlab params
Former-commit-id: d5cf87990e
2024-12-19 18:47:27 +08:00
hiyouga
95d3c2620b support disable shuffling
Former-commit-id: c7cedc7569
2024-12-19 08:53:21 +00:00
hiyouga
1a48340680 add swanlab
Former-commit-id: 96f8f103e5
2024-12-19 07:12:31 +00:00
hiyouga
a94a1eac67 support control eos, fix #6345
Former-commit-id: eda76de32b
2024-12-17 10:42:05 +00:00
hiyouga
50ca43c3fb fix #6348
Former-commit-id: 142191e466
2024-12-17 10:06:46 +00:00
hiyouga
6f1e450739 fix mrope
Former-commit-id: 2811814fc4
2024-12-12 15:08:17 +00:00
hiyouga
235cdcacee support batch infer in vllm
Former-commit-id: 1324d158f9
2024-12-04 13:50:00 +00:00
hoshi-hiyouga
302e4e22bf Merge pull request #6078 from wtmlon/support-efficient-tokens-calculation
support effective tokens calculation on sft/dpo

Former-commit-id: bd639a137e
2024-11-20 13:43:15 +08:00
Ting
e27a0c3d53 code refactor
Former-commit-id: 40627c601e
2024-11-19 20:33:18 +08:00
Ting
32656bc50d update
Former-commit-id: f566ecc8d1
2024-11-19 19:12:10 +08:00
Ting
bf2b8df540 update
Former-commit-id: ef6e14550d
2024-11-19 19:10:07 +08:00
Ting
7ad5b5c088 support efficient tokens calculation on sft/dpo
Former-commit-id: b9f00286d8
2024-11-19 17:15:47 +08:00
hoshi-hiyouga
9815d1712c fix #6050
Former-commit-id: dc82821872
2024-11-16 16:11:16 +08:00
hiyouga
c2766af6f4 fix dpo metrics
Former-commit-id: 4270f7dfb9
2024-11-02 20:59:01 +08:00
hiyouga
e83cb17f97 support rank0 logger
Former-commit-id: c38aa29336
2024-11-02 18:31:04 +08:00
hiyouga
3f7c874594 update tests
Former-commit-id: 93d3b8f43f
2024-11-02 12:41:44 +08:00
hiyouga
584ce3a105 fix incorrect loss value for vlms
Former-commit-id: 30567a1487
2024-10-30 08:56:46 +00:00
hiyouga
13c7e873e0 fix #5749
Former-commit-id: 23dbe9a099
2024-10-29 13:02:13 +00:00
hiyouga
d183966a5d fix pissa
Former-commit-id: 51e5f96247
2024-10-29 12:18:45 +00:00
hiyouga
825ea1c72d fix #5747
Former-commit-id: ae045c884f
2024-10-29 10:47:04 +00:00
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4
2024-10-29 09:07:46 +00:00
hoshi-hiyouga
bdb77bc85a fix test
Former-commit-id: 74a79cc059
2024-10-22 12:35:36 +08:00
hiyouga
4464a6ff5b tiny fix
Former-commit-id: 451d271718
2024-10-08 17:48:56 +08:00
Chengcheng Pei
e80c98367e 1, log exceptions in details; 2, check processor is None before calling it.
Former-commit-id: 573e3183e6
2024-09-25 12:59:48 -07:00
hiyouga
009500bc6d fix #5411
Former-commit-id: c7e51ff187
2024-09-11 17:36:42 +08:00
hiyouga
3aefdad4ec release v0.9.0 (real)
Former-commit-id: 90d6df6222
2024-09-09 01:00:25 +08:00
hiyouga
7ccb86b215 add docstrings, refactor logger
Former-commit-id: 54c6905937
2024-09-08 00:56:56 +08:00
hoshi-hiyouga
f6014742fa fix #5366
Former-commit-id: e9bda48c6d
2024-09-05 18:08:09 +08:00
hiyouga
666013d09d fix ci
Former-commit-id: 1173f7fc1d
2024-09-05 03:02:59 +08:00
hiyouga
d5ea05cfff update get template
Former-commit-id: dabad5570b
2024-09-04 22:36:20 +08:00
hiyouga
22deca0e9e lazy image load
Former-commit-id: 47ea97fb1b
2024-09-04 02:27:08 +08:00
hiyouga
982585e375 lint
Former-commit-id: 22959bcdd3
2024-09-03 00:46:25 +08:00
hiyouga
6e98872622 fix #5324
Former-commit-id: a61c8c4890
2024-09-02 23:56:21 +08:00
hoshi-hiyouga
5af92971bc fix trainer predict
Former-commit-id: 99fd9637bd
2024-09-02 10:15:29 +08:00
hoshi-hiyouga
5c9972a2d5 remove .cpu()
Former-commit-id: a6c6750e8a
2024-09-02 10:10:53 +08:00