36 Commits

Author SHA1 Message Date
hiyouga
ec81d45d27 fix mod stuff
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
2024-04-21 18:11:10 +08:00
Marco
b6a87e0a3f fix small typo
Former-commit-id: 4fb7e046b3599aebeeba5b150acb6369f70ecb49
2024-04-18 20:33:29 +02:00
Marco
639297a5ef Added Mixture of Depths
Former-commit-id: 620add7b9f634de1a711f7b87b16050adf735e9b
2024-04-18 20:31:24 +02:00
hiyouga
038d524fcd Update parser.py
Former-commit-id: c00f0771a5ab2a422e0300dcb6d88e8609a3b997
2024-04-16 18:09:31 +08:00
hoshi-hiyouga
0f6d691aa6 Update parser.py
Former-commit-id: 4660703674233949a8ba8c76bdb17dafc9d620d4
2024-04-16 17:27:25 +08:00
hoshi-hiyouga
d68212d016 Update parser.py
Former-commit-id: 5b59ff421204115ced405a2e3d56ac0ee8c5b788
2024-04-16 17:27:02 +08:00
Jonery
025f329445 Feature BAdam
Former-commit-id: 06c8908d3fe48907ddb585c5fa15677fc5416f94
2024-04-15 23:15:27 +08:00
hiyouga
fb385b8c26 update examples
Former-commit-id: cce52351b54f70904f33902d9c17411134f9f6eb
2024-04-15 22:14:34 +08:00
hiyouga
ceccad3419 fix #3273
Former-commit-id: efc345c4b0095ec959ea23bbe54c344278780cbe
2024-04-15 15:32:58 +08:00
hiyouga
c9d3cc181a fix #3238
Former-commit-id: 232642a6215de9b57a1627f39b4efea127948a01
2024-04-12 14:28:11 +08:00
hiyouga
88d9f47a0b fix #3116
Former-commit-id: ce77d98872fa377fd4bc961701b07982f4b51491
2024-04-03 14:47:59 +08:00
hiyouga
e4f3d583df fix #2982
Former-commit-id: 8d603f8820efd1617557f2bc5d9674143abe7c57
2024-03-28 20:22:31 +08:00
hiyouga
196a33cca4 tiny fix
Former-commit-id: 98a42cbdaa4a90dbe5edda1c412c17e628324f52
2024-03-25 23:28:52 +08:00
hiyouga
b18749fb01 add arg check
Former-commit-id: 1484f76a95bcf40e4c668d52fed68d68c9745a75
2024-03-25 22:42:58 +08:00
hiyouga
bbf272f96e support QDoRA
Former-commit-id: 19ef4826490b79e0c2aee20ad67430aa0e4724a7
2024-03-12 22:12:42 +08:00
hiyouga
7124b71676 fix #2782 #2798
Former-commit-id: 07f9b754a7418b489e839bd674aa47094583a92d
2024-03-12 15:53:29 +08:00
hiyouga
566bfad930 update parser
Former-commit-id: be99799413e1ba37807a02838bf2d87fd966bf55
2024-03-10 13:35:20 +08:00
hiyouga
868444e124 allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
2024-03-09 22:21:46 +08:00
hiyouga
5c00783697 update hardware requirements
Former-commit-id: 393c2de27ce0a2dee793092843ec0afa54f49a6d
2024-03-09 03:58:18 +08:00
hiyouga
5b50458acf fix galore
Former-commit-id: 33a4c24a8a3c153bc62edf74b9246699a0ae3233
2024-03-08 00:44:51 +08:00
hiyouga
2c010c72b8 support galore
Former-commit-id: 28f78621883917425fabe49f5473778111012127
2024-03-07 22:41:36 +08:00
hiyouga
34533b2f35 support vllm
Former-commit-id: d07ad5cc1cdbc13879afd84f653afdfee03a6933
2024-03-07 20:26:31 +08:00
hiyouga
37e40563f1 fix #2735
Former-commit-id: f74f804a715dfb16bf24a056bc95db6b102f9ed7
2024-03-07 16:15:53 +08:00
hiyouga
e887aface7 fix version checking
Former-commit-id: 3016e6565708637c1d760f2cd5a67cbd8a5a6c26
2024-03-06 14:51:51 +08:00
hiyouga
9561809ce9 improve aqlm optim
Former-commit-id: 259af60d28985b919911587716c24a3ac7f7de64
2024-03-05 20:49:50 +08:00
hiyouga
d1e6e02461 fix #2649
Former-commit-id: 4e5fae2fac85227641bd16159cf296a32e0b18b4
2024-03-01 13:02:41 +08:00
hiyouga
8e7d50dae4 release v0.5.3
Former-commit-id: fa5ab21ebc0ab738178c0c57578db3bda995ae06
2024-02-29 00:34:19 +08:00
hiyouga
5abbca70d3 support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
2024-02-28 19:53:28 +08:00
hiyouga
96265ec154 support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
2024-02-15 02:27:36 +08:00
hiyouga
75adbfec79 add option to disable version check
Former-commit-id: 91d09a01ac3b5da29d284b8d51cdfe4252b391e0
2024-02-10 22:31:23 +08:00
hiyouga
db2051684b improve aligner
Former-commit-id: 7d2dc83c5e2085da6273241269c9e9d7509ae51b
2024-02-10 16:39:19 +08:00
hiyouga
40514bf865 support minicpm #2404
Former-commit-id: 901faa16ccebc3fa11260daac98981dd99904af9
2024-02-03 22:36:46 +08:00
hiyouga
509e35ffc8 fix #2282 and update tool prompt
Former-commit-id: b2fb0eca56ee835438cc20e83f36ac3f6eb95c83
2024-01-22 22:27:30 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
6af2f1f217 fix rm dataset
Former-commit-id: 5edf7cce0eb4cd569438bb406fe6f148eb05ee46
2024-01-18 14:45:37 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00