626 Commits

Author SHA1 Message Date
hiyouga
bd28dd0fe6 update readme
Former-commit-id: 8cace7780867dd78760f40c46fd5b6ddd47dea0a
2023-12-12 11:44:30 +08:00
hiyouga
b7d99ad5f4 support mixtral
Former-commit-id: 96380f5e1887bb166be339e58ab8f65e464d4010
2023-12-12 11:39:04 +08:00
hiyouga
e3e86340ec fix baichuan resize
Former-commit-id: f4657de7d574fdab5d164c679bd474d35140894a
2023-12-11 20:55:50 +08:00
hiyouga
2e42e38ff2 tiny fix
Former-commit-id: 0239d29fa02a88b50f27caa706834f3c3ce0262d
2023-12-11 18:09:40 +08:00
hiyouga
9ead5a2d21 support resize embeddings #1786
Former-commit-id: 64744dde89ccb9a24a46985a99151ad2dde03919
2023-12-11 17:50:02 +08:00
hiyouga
5819eb7121 use peft 0.7.0, fix #1561 #1764
Former-commit-id: 9ce1b0e2f21a4601defe8e8f1f3f312626abe3d8
2023-12-11 17:13:40 +08:00
hiyouga
b641e9e97e fix #1784
Former-commit-id: 28d5de7e785f31b223a4646c9c1c770f43e187ec
2023-12-09 20:53:18 +08:00
yuze.zyz
c523613f0a support ms dataset
Former-commit-id: 9c2247d700763f480d88a5dd46480cb32cfc174e
2023-12-08 18:00:57 +08:00
hiyouga
89cf856776 fix #1771 and temporarily fix #1764
Former-commit-id: d42c0b1d3482af5912ebe578b3e6b4d08cd7ee99
2023-12-08 16:26:20 +08:00
hiyouga
9b84a706af add models
Former-commit-id: e25f7bae16b7ea41a4a1fd1e8db1b961e55d0c5b
2023-12-06 13:33:18 +08:00
hiyouga
027caabbb6 fix ppo trainer save logic
Former-commit-id: d3dccd0693ede18a99f04780f2fd6e3a89810405
2023-12-04 19:00:19 +08:00
hiyouga
cd2b0a024b fix #1715
Former-commit-id: c9b166615c882ea6df29a1b379654fdbc680d904
2023-12-03 22:35:47 +08:00
hiyouga
16b7296ae1 release v0.3.3
Former-commit-id: 438dea679bfa343922252e0a0ae4e5627fde98e0
2023-12-03 21:59:45 +08:00
hiyouga
6493558c3b fix bug
Former-commit-id: 8b681ee273c28813c599d9d55b2a3540c8ac257d
2023-12-03 21:40:40 +08:00
hiyouga
64eead3fb1 ppo support rm server
Former-commit-id: 747db4017291b0eb91946f57011bb31659056037
2023-12-03 21:38:51 +08:00
hiyouga
1cb390b9b2 implement rm server #1543
Former-commit-id: 7df4f3ab206fddb462f6ed865eaf04234fd72ed6
2023-12-03 20:52:54 +08:00
hiyouga
2279b1948e fix #1707 #1710
Former-commit-id: 03d05991f81b51826d3a4d9da214504e19a301bd
2023-12-03 11:33:12 +08:00
hiyouga
6720189f3f fix #1642
Former-commit-id: b69763ff9237a450194c0de6377745ba3086a4ce
2023-12-02 00:37:53 +08:00
hiyouga
f8376b228a add xuanyuan models
Former-commit-id: 6e7af11b989e4cf97ffacbab4736e3434ff6c925
2023-12-02 00:35:29 +08:00
hiyouga
4cc08e00c7 fix gptq training
Former-commit-id: f57445c7a01b726160070c4ea29486702a650ed6
2023-12-02 00:27:15 +08:00
hiyouga
c8eff09c7c tiny fix
Former-commit-id: a973ce6e890d3f384fd225334f53a49907fff10d
2023-12-01 23:37:10 +08:00
hiyouga
e0da912f8e fix gptq model inference
Former-commit-id: 01e6c539b08e45c18878deb99550099d62f7645b
2023-12-01 23:34:14 +08:00
hiyouga
a388af4adc fix #1703
Former-commit-id: 662d9a3a4ec5ee408f5c9574c502e0af662fd821
2023-12-01 22:55:41 +08:00
hiyouga
c60e79c12e patch modelscope
Former-commit-id: bd42c229b01a0bf3ceadb8cee5ad49a060cc2d13
2023-12-01 22:53:15 +08:00
hoshi-hiyouga
9a26819a58 Merge branch 'main' into feat/support_ms
Former-commit-id: 00f5c9ee1608b98ab8f40bcafdc3edc71833257f
2023-12-01 20:23:46 +08:00
yuze.zyz
fcd61657ee remove useless code
Former-commit-id: 5a2392f105704810e9ce96c13fcc8a555726f9b8
2023-12-01 17:28:23 +08:00
tastelikefeet
eb835b693d fix bug
Former-commit-id: d9e52957e272e8133f1b37cf20d193084425e09e
2023-12-01 17:27:00 +08:00
hiyouga
e964fa7df7 fix err hint
Former-commit-id: a5a248d569f8bf97cb9be71221783d97c666583c
2023-12-01 17:13:22 +08:00
hiyouga
dbb8342ec0 add err hint
Former-commit-id: a51b8ec620e52cbfcad91d12f0acd7c73f448444
2023-12-01 17:04:37 +08:00
yuze.zyz
b2200409f5 add readme
Former-commit-id: 5aa6751e52b5c2e06727c50e60218226b146b7bf
2023-12-01 16:11:30 +08:00
hiyouga
a44ba7a2b8 tiny fix
Former-commit-id: e597d3c084c8700e247bad6e26d2ee40fc3c316b
2023-12-01 15:58:50 +08:00
hoshi-hiyouga
6e094e491e Merge pull request #1695 from Samge0/dev
Improve:"CUDA_VISIBLE_DEVICES" read from the env

Former-commit-id: fbc6220692ba3a20c749eeda1d8c3abe1a037537
2023-12-01 15:56:18 +08:00
hoshi-hiyouga
752b3dd58d Merge pull request #1690 from billvsme/main
Improve get_current_device

Former-commit-id: d043a4e7ba2457679eeca8de5820a4f07b7d8401
2023-12-01 15:44:35 +08:00
hiyouga
9a6b694e12 fix #1696
Former-commit-id: bf6f6aeefe65b4949633648b8711525c0029c001
2023-12-01 15:34:50 +08:00
tastelikefeet
63e12226a0 add model
Former-commit-id: 8ce4d11e38518b0b4657c7e64394d471cbb0bd6d
2023-12-01 15:06:17 +08:00
samge
7cf4e3b9c6 Improve:"CUDA_VISIBLE_DEVICES" read from the env
Former-commit-id: 421d4de604493e1e26ec8348dab3eae138f46b86
2023-12-01 11:35:02 +08:00
billvsme
e400f2e8ad improve get_current_device
Former-commit-id: 40dfcbc3d4571ce022b6aa39db581c8b88a75b8d
2023-11-30 22:40:35 +08:00
hiyouga
3d291a82d3 fix #1597
Former-commit-id: 327d7f7efe1fefe4bf4646c07fc4917a42c13383
2023-11-30 21:47:06 +08:00
hiyouga
ba6d290d0b fix #1668
Former-commit-id: 1585962eb7ed042890d4c56422aae749c669dda8
2023-11-30 21:02:00 +08:00
hiyouga
bb6b4823ad fix #1682
Former-commit-id: a38dbf55e32a18838eea7f254fd9022fe33bca08
2023-11-30 20:03:32 +08:00
hiyouga
1c43fb6a41 add models
Former-commit-id: 509abe8864ada29ac7fa0f636b662531c8dd3a33
2023-11-30 19:16:13 +08:00
yuze.zyz
45925e4a9c fix
Former-commit-id: fb2204c183ae8c061ed6ec7f4f1bfbb0b4900c9b
2023-11-29 21:43:58 +08:00
yuze.zyz
e08e0e5814 support ms
Former-commit-id: d38a2e7341100902b6c761895b1fe6191c905d06
2023-11-29 20:36:55 +08:00
hiyouga
ecfc7d1b50 fix #1658
Former-commit-id: 77d1b14fc2d9703d15bbd879f67df037db9fbb28
2023-11-28 20:57:24 +08:00
hiyouga
ae1048db6d fix #1659
Former-commit-id: 475a3fa0f4c09d4cfd55ec66271a6d3c9eb5f4d2
2023-11-28 20:52:28 +08:00
hiyouga
b015ac35d8 support export size setting
Former-commit-id: 859a6ea9425a09d7263f6436d05102df8129c248
2023-11-26 18:34:09 +08:00
hiyouga
5f2943dc84 support Yi-34B-Chat models
Former-commit-id: ff1c289229ee382d3e76578bbb6a5e299b969ded
2023-11-23 19:31:49 +08:00
hiyouga
9697c3e970 set version
Former-commit-id: 35c2da3eba064e16b21c20a4cde3355173d5d9fd
2023-11-20 22:57:44 +08:00
hiyouga
4966bd7911 support GPTQ tuning #729 #1481 #1545 , fix chatglm template #1453 #1480 #1569
Former-commit-id: 9ea93801459b0d271d21a2d730c44abae9106c51
2023-11-20 22:52:11 +08:00
hiyouga
f06c4c8f7a update ppo trainer
Former-commit-id: 5021062493ed63ad1f6133cfb543e4e7f528d2cc
2023-11-20 21:39:15 +08:00