484 Commits

Author SHA1 Message Date
hiyouga
116de2ce48 update readme
Former-commit-id: 261f631a1cc708a5713e40102ad558c5dfa6a379
2024-02-25 16:26:08 +08:00
hiyouga
757564caa1 add papers
Former-commit-id: aca948da8fcd682e43cd2064eeb9a368af221833
2024-02-25 15:34:47 +08:00
hiyouga
f3feddd502 add papers
Former-commit-id: ad76482cf9d4407787fb7fde526c584948a2c0e9
2024-02-25 15:18:58 +08:00
hiyouga
1845e03921 support gemma
Former-commit-id: c99e19641a9b893da0a3277bd41bd1d3996d1913
2024-02-21 23:27:36 +08:00
hiyouga
ec42d2c385 tiny fix
Former-commit-id: daa318535097a51bdb8546960a9e4b4681c11dfe
2024-02-21 18:30:29 +08:00
hoshi-hiyouga
4a9eee7e25 Update README_zh.md
Former-commit-id: 175a48d79d869da9d162fa881c3bed0e43235ee2
2024-02-20 16:06:59 +08:00
codemayq
16599f2376 1. update the version of pre-built bitsandbytes library
2. add pre-built flash-attn library


Former-commit-id: 95f53a46bd1d0012d90a1b6198d35807de1dc100
2024-02-20 11:26:22 +08:00
hiyouga
96265ec154 support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
2024-02-15 02:27:36 +08:00
hiyouga
db2051684b improve aligner
Former-commit-id: 7d2dc83c5e2085da6273241269c9e9d7509ae51b
2024-02-10 16:39:19 +08:00
hiyouga
36f092b53f improve fix tokenizer
Former-commit-id: 54ea9684ed05ac7fa5bbaa04d39636eda37cd34e
2024-02-09 14:53:14 +08:00
hiyouga
dcfb9b5cfa support qwen1.5
Former-commit-id: ccabb5b04a6ec36e102c3be680184e4f76e08b2b
2024-02-06 00:10:51 +08:00
hiyouga
9f11bdfe8a release v0.5.0 (real)
Former-commit-id: a0d59aa4ec240a402e1490b4bf690666ffed474b
2024-01-21 01:54:49 +08:00
hiyouga
f266d473b8 fix pretrain data loader
Former-commit-id: 5ff10fac4fd7fa0545ec7bcaa6268764f77342cf
2024-01-18 14:42:52 +08:00
hiyouga
0a8f46882c update readme
Former-commit-id: 5608a0da8e24f499a04db9bfbd45e296d8011977
2024-01-18 14:30:48 +08:00
hiyouga
7e16d27fca tiny fix
Former-commit-id: 5a207bb7230789ddefba932095de83002d01c005
2024-01-15 23:34:23 +08:00
hiyouga
a994279a3a Update README_zh.md
Former-commit-id: 3c8e72f585fbfd6738a0df6cfc00abff65205e04
2024-01-14 00:17:28 +08:00
hiyouga
dad632091d fix phi modules
Former-commit-id: d1a73fe26ce2c12953c8eebd1d1118abc90dcf74
2024-01-13 23:12:47 +08:00
JessyTsu1
365e75cc76 Update README_zh.md
Former-commit-id: cdeca0cabc6a441c5e9903b77276b8277f5bdbb0
2024-01-11 23:17:48 +08:00
hiyouga
61960189b2 fix #1789
Former-commit-id: 4571068e1e00dc234c9131185fe0924c726add84
2024-01-09 18:31:27 +08:00
hiyouga
4735cb96c1 add yuan model
Former-commit-id: c7ea17d6168d0a032960dbf51c12482f97529b1e
2023-12-29 13:50:24 +08:00
hiyouga
cae66bce3d fix args
Former-commit-id: 65c5b0477c0e62691a1f8790670ba04d7f6d2804
2023-12-28 18:47:19 +08:00
hiyouga
a52aafdbdc tiny update
Former-commit-id: 5b93d545e2090d8d6db2cee3a047565f834e87f1
2023-12-25 18:29:34 +08:00
hiyouga
5d440f978e update patcher
Former-commit-id: e44b82ee245a7ee99057c7b58b1edef5c222dc1f
2023-12-23 15:24:27 +08:00
hiyouga
18c6e6fea9 update readme
Former-commit-id: 0ad86a4f6237dddf0f200cf596ce5f80293c6861
2023-12-23 02:17:41 +08:00
hiyouga
f0d405f392 support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
2023-12-23 00:14:33 +08:00
hiyouga
54e58adf09 update readme
Former-commit-id: edb7d177c210b800e2778bb5b638e12ac1078ef9
2023-12-18 22:29:45 +08:00
hiyouga
dee19b11ba update readme
Former-commit-id: 2b4e5f0d3239984f62c7eca6dc7b9e3bbc6f8c4e
2023-12-18 15:46:45 +08:00
hiyouga
f0f9d253d8 support autogptq in llama board #246
Former-commit-id: 71389be37cb0f1a65db6e501e11ca14e615c1a24
2023-12-16 16:31:30 +08:00
hiyouga
7dbc670902 support quantization in export model
Former-commit-id: 3524aa1e58da94ab00e9a2024952ea1b4119b2af
2023-12-15 23:44:50 +08:00
hiyouga
2db4cfab40 update dc link
Former-commit-id: 87ef3f47b519677e6a7c81ff45584acb34339f3a
2023-12-15 22:11:31 +08:00
hiyouga
bd03307bbd refactor adapter hparam
Former-commit-id: 0716f5e470afffd2df5a815712b552a4b4797153
2023-12-15 20:53:11 +08:00
hiyouga
15b321da8e remove loftq
Former-commit-id: 3a8a50d4d42082b3bdce549653b398e49f2eb554
2023-12-13 01:53:46 +08:00
hiyouga
fdaba1648a update readme
Former-commit-id: 28cc07868c5f65644245e37c1559e230aac18ed0
2023-12-12 23:30:29 +08:00
hiyouga
4c69025a83 support loftq
Former-commit-id: 6219dfbd9377528bce286c724ae2dd0090881095
2023-12-12 22:47:06 +08:00
hiyouga
1a0bdd305c support system column #1765
Former-commit-id: 0a9c6e0146ebc71d5438c837463d6ab236e227c4
2023-12-12 19:45:59 +08:00
hiyouga
bd28dd0fe6 update readme
Former-commit-id: 8cace7780867dd78760f40c46fd5b6ddd47dea0a
2023-12-12 11:44:30 +08:00
hiyouga
b7d99ad5f4 support mixtral
Former-commit-id: 96380f5e1887bb166be339e58ab8f65e464d4010
2023-12-12 11:39:04 +08:00
hiyouga
58cbc9e0be update readme
Former-commit-id: 997b65f291fdd7da8fe0fd0150dc423c34738fde
2023-12-04 11:22:01 +08:00
hiyouga
469568c0cd update readme
Former-commit-id: 8ede3128df13b408f774523be99398073a57336e
2023-12-04 11:02:29 +08:00
hiyouga
c0df6b581c add logo
Former-commit-id: 5b78e269b6840a72049d8aa459d54e071ffc8003
2023-12-02 01:31:24 +08:00
hiyouga
5d7c97b4de update readme
Former-commit-id: 0cb260f453e480e5eb65b6424ac73e101b038ef1
2023-12-01 22:58:29 +08:00
hiyouga
c60e79c12e patch modelscope
Former-commit-id: bd42c229b01a0bf3ceadb8cee5ad49a060cc2d13
2023-12-01 22:53:15 +08:00
hoshi-hiyouga
9a26819a58 Merge branch 'main' into feat/support_ms
Former-commit-id: 00f5c9ee1608b98ab8f40bcafdc3edc71833257f
2023-12-01 20:23:46 +08:00
yuze.zyz
b2200409f5 add readme
Former-commit-id: 5aa6751e52b5c2e06727c50e60218226b146b7bf
2023-12-01 16:11:30 +08:00
hiyouga
9a6b694e12 fix #1696
Former-commit-id: bf6f6aeefe65b4949633648b8711525c0029c001
2023-12-01 15:34:50 +08:00
hiyouga
1c43fb6a41 add models
Former-commit-id: 509abe8864ada29ac7fa0f636b662531c8dd3a33
2023-11-30 19:16:13 +08:00
hiyouga
8ec3617f19 add gpu requirement #1657
Former-commit-id: 9d38e5687d6edd692a33f10729450e8d9e0ab0bf
2023-11-29 12:05:03 +08:00
hiyouga
c4f6cf1270 update readme
Former-commit-id: 5085b00a1d84a5a83c857c2716313d4ea84ba424
2023-11-21 13:15:46 +08:00
hiyouga
4966bd7911 support GPTQ tuning #729 #1481 #1545 , fix chatglm template #1453 #1480 #1569
Former-commit-id: 9ea93801459b0d271d21a2d730c44abae9106c51
2023-11-20 22:52:11 +08:00
hiyouga
f06c4c8f7a update ppo trainer
Former-commit-id: 5021062493ed63ad1f6133cfb543e4e7f528d2cc
2023-11-20 21:39:15 +08:00