86 Commits

Author SHA1 Message Date
hiyouga
de3400a521 set dev version
Former-commit-id: 3ac11e77cccf686e0da499bd152997133b49a265
2024-06-08 06:46:09 +08:00
hiyouga
ce40d12692 release v0.8.0
Former-commit-id: 5aa4ce47567146cd97c61623018153b41d7c1278
2024-06-08 05:20:54 +08:00
hiyouga
a8318723a4 add resume args in webui
Former-commit-id: 06e5d136a4916413d1c116e341ba7d5136d7748a
2024-06-08 00:22:16 +08:00
hiyouga
d3196318be fix #4120
Former-commit-id: f9e818d79cf686cb34789327add7ed1f749966c6
2024-06-07 04:18:05 +08:00
hiyouga
8a0263551d add qwen2 models
Former-commit-id: 8e95648850fdd5075724359ffdb22beb48b75952
2024-06-07 00:22:57 +08:00
hiyouga
6cbc66a602 fix torch gc
Former-commit-id: 451b6693c0cb86cc9ac03d1a9389cf1fd2b918ec
2024-06-06 20:30:25 +08:00
hiyouga
cceff9f520 lora modules: all by default
Former-commit-id: cae47379079ff811aa385c297481a27020a8da6b
2024-06-06 03:53:28 +08:00
hiyouga
679810a3d2 add codestral 22B
Former-commit-id: c23cc63d3d3c4fd8edd6c3b3ca1a2a32ec328d7d
2024-06-06 03:42:50 +08:00
hiyouga
8f25af89b6 lint
Former-commit-id: 7daf8366db0e161d46993fd87cf983a27a0ce2a3
2024-06-06 03:33:44 +08:00
hoshi-hiyouga
229794a148 Merge pull request #4066 from injet-zhou/main
add throughput entry to training log

Former-commit-id: f2580ad403cd0ae91aa0954c0a15363c46452438
2024-06-06 03:32:04 +08:00
hiyouga
00b3fb4d14 update train hparams
Former-commit-id: dc4a00dd63769dc02d898c8bad2c158e4e5c0447
2024-06-06 01:49:20 +08:00
hiyouga
0398338a0f add llamafactory-cli env
Former-commit-id: d4908d57085bbcfcd29e0a8d4ee6425318ee4285
2024-06-06 01:28:14 +08:00
hiyouga
a16786d8ba fix #4090
Former-commit-id: 67fe822324a9f830175e44f89acdd9d759b38852
2024-06-06 00:50:32 +08:00
hiyouga
94c37490d1 support glm-4
Former-commit-id: f48f5e646e2da9e02333d027033141b0e75dfcf8
2024-06-05 15:16:38 +08:00
faddddeout
a2931b813b add throughput entry to log
Former-commit-id: b2f04595423b8e84b3763d169e402a0cd34f3175
2024-06-04 11:04:29 +00:00
hiyouga
af7748139a bump versions
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6


Former-commit-id: 876bc92865605be872bc811a56a1d1e05490ec8a
2024-06-03 18:29:38 +08:00
hiyouga
820404946e better llamaboard
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui


Former-commit-id: 80708717329b4552920dd4ce8cebc683e65d54c5
2024-05-29 23:55:38 +08:00
hiyouga
a71a6a05c3 update readme
Former-commit-id: 89ca832740731dfb121175aa5c16b13bd4944011
2024-05-29 18:39:11 +08:00
hzhaoy
ce1be3da4b add TeleChat-12B/TeleChat-12B-v2 models
Former-commit-id: 0dd632fe9e5bbf08605d4b9c6887208b7a127317
2024-05-29 15:00:37 +08:00
hiyouga
3ea8f5e6b9 support DDP in webui
Former-commit-id: 7c016b22aa9208ec14f00a9bdb51f69aebb02af5
2024-05-28 19:24:22 +08:00
hiyouga
0706dbf7e6 tiny fix
Former-commit-id: c1fdf81df6ade5da7be4eb66b715f0efd171d5aa
2024-05-27 20:54:26 +08:00
hoshi-hiyouga
ad3ca3f556 Merge pull request #3921 from gusye1234/main
Add openchat-3.6-8B support

Former-commit-id: 87ea0a8bcd8d76a9e916cc8da6905bc805bb18aa
2024-05-27 20:52:37 +08:00
Jianbai Ye
d2c1df7f3d add openchat-3.6-8B support
Former-commit-id: cff815391fd15f30647e8694e08c47a514fd6eb2
2024-05-27 20:42:08 +08:00
hiyouga
fc5a6b5c4e support Aya23
Former-commit-id: e626e264460d12b282099bfbb8e6679c31e85fc0
2024-05-27 20:23:24 +08:00
hiyouga
51a1097c64 add phi-3 7b/14b, mistral v0.3 models
Former-commit-id: efa4b196ca8053881bb9d15cfb571204bcb0bbda
2024-05-27 18:20:16 +08:00
hiyouga
df33548b39 update readme
Former-commit-id: 5581cb2e4e59f3f8109e2acd4611789f9e50bfca
2024-05-27 18:14:02 +08:00
hiyouga
4807c11db8 support SimPO #3900
Former-commit-id: cb63b32986c43f97994211ec34dc5928fc3bb9d7
2024-05-26 23:46:33 +08:00
hiyouga
11f79ea20e fix #3847
Former-commit-id: 335501e228b7c2c2e3041533ddd996127b958f23
2024-05-21 17:53:06 +08:00
hiyouga
cce3892f91 support paligemma
Former-commit-id: 2a67457e3944d5e528286cb7203857c13078c484
2024-05-21 00:01:22 +08:00
hiyouga
446c681b58 fix paligemma inference
Former-commit-id: 542229abb3aba2032d4c52a878c0fd35ba299691
2024-05-20 23:36:43 +08:00
hiyouga
32a65e89e5 fix envs
Former-commit-id: 8ee8ac6eba3e2916cf7c6401a0e9d803b3ff88ba
2024-05-19 18:27:18 +08:00
hoshi-hiyouga
97469892c3 Merge pull request #3785 from enji-zhou/feature/add_kto
add kto

Former-commit-id: 33a354548e78a7f7f51d63f80974920827d30252
2024-05-18 03:07:18 +08:00
hiyouga
9af3dce3c8 add deepseek v2 lite model
Former-commit-id: 8af98176055b6fc28d16b03207b5abaa7de6104a
2024-05-17 13:25:36 +08:00
enji.zhou
03956053b8 add kto
Former-commit-id: db1d5a4f51faae61fe18666057353747b01f5b8d
2024-05-17 13:09:17 +08:00
hiyouga
22f71c152a add falcon 11b
Former-commit-id: d77bed4091a6a8fea682b39d3261e1e93dfe093f
2024-05-17 00:08:33 +08:00
hiyouga
cae823ddf0 rename package
Former-commit-id: 308edbc4260d45907b4a9d3a45ec21d83e48aacb
2024-05-16 18:39:08 +08:00