2123 Commits

Author SHA1 Message Date
hiyouga
3aefdad4ec release v0.9.0 (real)
Former-commit-id: 90d6df622252c6fad985f68b97771c979357e2fc
v0.9.0
2024-09-09 01:00:25 +08:00
hiyouga
561ae4d1af fix constants
Former-commit-id: 653fe70acbe44853fa0ad073a9b8391d75ef6c2a
2024-09-08 23:52:30 +08:00
hiyouga
fb9280a0a7 release v0.9.0
Former-commit-id: 54b5c4b8195d23bd9dcc1921af9910d5bdd181fd
2024-09-08 23:43:35 +08:00
hiyouga
0229263fbe tiny fix
Former-commit-id: c9b3870adb60a2aca8cfd82c1a8b8044319bacbc
2024-09-08 23:18:08 +08:00
hiyouga
ec6b85d8f9 update wechat
Former-commit-id: 60114179eb699a7d3906e085f917957c7056d320
2024-09-08 14:18:12 +08:00
hiyouga
dc64166d13 update scripts
Former-commit-id: f2aa02c070b1442bfb58a075f22af25386192bfa
2024-09-08 14:17:41 +08:00
hiyouga
78cf256067 support vllm 0.6.0
Former-commit-id: b6681d7198acf4acbebfe271dd22095e236bc430
2024-09-08 02:26:20 +08:00
hiyouga
f6f58ebef0 fix test case
Former-commit-id: b332908ab4aad392e39f0b8661d100f096d8a6ec
2024-09-08 01:50:51 +08:00
hiyouga
945841503e add test case
Former-commit-id: 52a06efaf8af26d16137ba9095f1fd81e8f61983
2024-09-08 01:40:49 +08:00
hiyouga
0daee7cb39 support activation offloading via unsloth gc
Former-commit-id: fb72a3adb0916232cc9ac9f0c725c02d07b9354c
2024-09-08 01:22:19 +08:00
hiyouga
7ccb86b215 add docstrings, refactor logger
Former-commit-id: 54c69059379d77dc9046c144cbe2d0253de3a4da
2024-09-08 00:56:56 +08:00
hoshi-hiyouga
857d5b9d0a Merge pull request #5388 from yzoaim/cal_mfu_update
update cal_mfu.py

Former-commit-id: 8eac1b929ff7e42f34d443030f9582692ec753db
2024-09-08 00:49:28 +08:00
hoshi-hiyouga
4d8b782268 fix
Former-commit-id: 842c5455b0e7c4b8d307af950304d4ed52bbb3e8
2024-09-08 00:41:45 +08:00
hoshi-hiyouga
4f28e0e5d2 Update cal_mfu.py
Former-commit-id: e71133cab14eed2c071cfd4ce044ae9905447427
2024-09-08 00:39:48 +08:00
-.-
ab1775cd95 update cal_mfu.py
Former-commit-id: 66ec36522c9bf8dfffc1065202362801875a104d
2024-09-07 23:21:35 +08:00
hoshi-hiyouga
4ee9efbd98 fix #5384
Former-commit-id: 36665f3001647b8411ba0e256d1e64eb157abfaf
2024-09-07 01:21:14 +08:00
hiyouga
995491594d tiny fix
Former-commit-id: 76f2e5950483c669a15a961f0554442b6eb5c4a6
2024-09-05 23:41:16 +08:00
hiyouga
52d3c42265 fix ci
Former-commit-id: eb5aa9adce7c01d453d45d2c901e530584e46eb6
2024-09-05 22:39:47 +08:00
hiyouga
5585713182 fix ci
Former-commit-id: 2f939b708f7f183f87aca67aa076db33a3c8a610
2024-09-05 22:27:48 +08:00
hiyouga
3aa6a3e45b add e2e tests
Former-commit-id: 94d5b1bd8f49dabeb9e3c53d634cfb3c06b0241d
2024-09-05 21:52:28 +08:00
hoshi-hiyouga
de277a8ab8 Merge pull request #5372 from LDLINGLINGLING/main
增加了对minicpm3.0的适配'

Former-commit-id: 12743562639ccc6eb0caf170e7123d9844e2b4a6
2024-09-05 21:35:42 +08:00
liudan
1797fe50a4 根据代码规范修改了代码
Former-commit-id: 3d3fbaaff98da327e10bdebb4aedbdf1ec9565e8
2024-09-05 20:17:55 +08:00
hoshi-hiyouga
f6014742fa fix #5366
Former-commit-id: e9bda48c6d7bde135df6456513708a997ada916c
2024-09-05 18:08:09 +08:00
hiyouga
dec6ff046b update data readme
Former-commit-id: 70e36ff2f4b500d987160f3a57d5fb3d4d2007d5
2024-09-05 04:44:49 +08:00
hiyouga
c4d7d76358 update data readme
Former-commit-id: 6055fe02deb3585b4330a7902bf8821dd41ea5cb
2024-09-05 04:25:27 +08:00
hiyouga
4fccc65579 support Yi-Coder models
Former-commit-id: 359ef8bb0ebb8ccf9651ac2b737c5a705dab6bad
2024-09-05 03:12:24 +08:00
hiyouga
666013d09d fix ci
Former-commit-id: 1173f7fc1dbdcf814650bfdf854ade5212fc4738
2024-09-05 03:02:59 +08:00
hiyouga
9f36534b49 fix ci
Former-commit-id: b6a3fdd056d77dbe692053bc22a8923e24ed2256
2024-09-05 02:49:22 +08:00
hiyouga
cc02fb6180 update ci
Former-commit-id: 315284f6272f2510f28b3267015aeb7336721bce
2024-09-05 02:26:10 +08:00
hoshi-hiyouga
ce77a89d8c Merge pull request #5365 from hiyouga/video_finetuning
Support Qwen2-VL Fine-Tuning on Video Datasets

Former-commit-id: 46b1765d0374bfc93d6a3af8669af1c2307814a7
2024-09-05 02:24:58 +08:00
hiyouga
ac33d2f4da tiny fix
Former-commit-id: c122b9f8657d1ca3032b1b6a6cf9cc61f11aaa82
2024-09-05 02:16:49 +08:00
hiyouga
9df7a26e6b video datasets
Former-commit-id: 8cafc7b055a854f483ad1c67f3d487ffd34b5f89
2024-09-05 02:04:17 +08:00
liudan
09cff03026 增加了对minicpm3.0的适配'
Former-commit-id: d7ba97be484bf781d6fe80252ea29eb505b261bb
2024-09-04 23:10:05 +08:00
hiyouga
60d770e4b1 fix test
Former-commit-id: c5e1736470c4c54de5a89ea1c58154b7fed2405d
2024-09-04 22:38:26 +08:00
hiyouga
d5ea05cfff update get template
Former-commit-id: dabad5570bf4a6b1044c963d8f27717030f373ef
2024-09-04 22:36:20 +08:00
hoshi-hiyouga
1dfd1aaf82 Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument
Add batch size of map function in the preprocessed dataset

Former-commit-id: 8f441c2b3a5bb84dec2c037a541084c0201726c6
2024-09-04 22:09:36 +08:00
hoshi-hiyouga
8ac74c8ccb fix #5228
Former-commit-id: 44d6947e554cd61cff23c297248fff32a5f554da
2024-09-04 19:10:30 +08:00
hiyouga
53aeacae81 fix #5252
Former-commit-id: ebddce5d4a2ebb40ce71462f81701e274eb3c29f
2024-09-04 03:17:54 +08:00
hiyouga
af8c4b4e20 add vl_feedback dataset
Former-commit-id: 57497135bf0a956af9c6893177ee97504b9f34ac
2024-09-04 03:13:03 +08:00
hiyouga
a3d47818b7 fix #5344
Former-commit-id: d41d43a7c37cd10e34c9f399d1a346ffaee641c3
2024-09-04 03:06:06 +08:00
hoshi-hiyouga
a65b5061af Merge pull request #5346 from hiyouga/lazy_image
[exp] Lazyload for multimodal inputs

Former-commit-id: ce7ed6eb99f075e4a3337a86fd6a245bc98c479e
2024-09-04 03:00:53 +08:00
hiyouga
22deca0e9e lazy image load
Former-commit-id: 47ea97fb1ba77de2e8a561904aa8fdc27c3f5025
2024-09-04 02:27:08 +08:00
hiyouga
5ef58eb655 fix #5334
Former-commit-id: 59d2b31e968677263f005f57ae8a56fc758307a7
2024-09-03 19:09:42 +08:00
hiyouga
f837ae8cb5 fix #5338
Former-commit-id: 69d0acacc38dc90a97ce18447f865f525fff086a
2024-09-03 17:45:17 +08:00
hiyouga
982585e375 lint
Former-commit-id: 22959bcdd3b124a642e2acaadc050e36d0520f52
2024-09-03 00:46:25 +08:00
hiyouga
6e98872622 fix #5324
Former-commit-id: a61c8c4890962f3847b19eff31b170cd7f54316c
2024-09-02 23:56:21 +08:00
naem1023
46695e42cc feat: add batch size of map function in the preprocessed dataset
Former-commit-id: 209313eeeab8d1a7c320bd9aa90a5f4656082b7c
2024-09-02 13:52:47 +09:00
hoshi-hiyouga
5af92971bc fix trainer predict
Former-commit-id: 99fd9637bdc25f41fd1abc8a162f1069cb9060d4
2024-09-02 10:15:29 +08:00
hoshi-hiyouga
5c9972a2d5 remove .cpu()
Former-commit-id: a6c6750e8af5bc1ece1dfe6111d3e484fd19ee75
2024-09-02 10:10:53 +08:00
hiyouga
b2a5f49a24 fix mm inference
Former-commit-id: 60fc6b926ead923dbb487b595ed4aa4cbfd94805
2024-09-02 01:47:40 +08:00