hiyouga
|
ec94e5e876
|
fix #2961
Former-commit-id: 511f6754026fbbf48bd481018015338a6a3ad92f
|
2024-03-26 17:26:14 +08:00 |
|
hiyouga
|
196a33cca4
|
tiny fix
Former-commit-id: 98a42cbdaa4a90dbe5edda1c412c17e628324f52
|
2024-03-25 23:28:52 +08:00 |
|
hiyouga
|
b18749fb01
|
add arg check
Former-commit-id: 1484f76a95bcf40e4c668d52fed68d68c9745a75
|
2024-03-25 22:42:58 +08:00 |
|
hiyouga
|
8b8671817f
|
improve lora+ impl.
Former-commit-id: 72367307dfadf936fb989ebe8bc9f0ff229fb933
|
2024-03-13 23:32:51 +08:00 |
|
齐保元
|
24c9277488
|
[FEATURE]: ADD LORA+ ALGORITHM
Former-commit-id: a0965cd62c85545aa2364e244295df2963308354
|
2024-03-13 19:43:27 +08:00 |
|
hiyouga
|
a74426df0f
|
fix kv cache
Former-commit-id: 96ce76cd2753bc91c781ad13aa8f7a972abe815a
|
2024-03-13 01:21:50 +08:00 |
|
hiyouga
|
bbf272f96e
|
support QDoRA
Former-commit-id: 19ef4826490b79e0c2aee20ad67430aa0e4724a7
|
2024-03-12 22:12:42 +08:00 |
|
hiyouga
|
0b7e870b07
|
fix #2802
Former-commit-id: 8d8956bad542c0e1c0f7edbf4ffc22bb0f8788ae
|
2024-03-12 17:08:34 +08:00 |
|
hiyouga
|
7124b71676
|
fix #2782 #2798
Former-commit-id: 07f9b754a7418b489e839bd674aa47094583a92d
|
2024-03-12 15:53:29 +08:00 |
|
hiyouga
|
566bfad930
|
update parser
Former-commit-id: be99799413e1ba37807a02838bf2d87fd966bf55
|
2024-03-10 13:35:20 +08:00 |
|
hiyouga
|
4a4e4b4354
|
support layerwise galore
Former-commit-id: 8664262cde3919e10eaecbd66e8c5d356856362e
|
2024-03-10 00:24:11 +08:00 |
|
hiyouga
|
868444e124
|
allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
|
2024-03-09 22:21:46 +08:00 |
|
hiyouga
|
5c00783697
|
update hardware requirements
Former-commit-id: 393c2de27ce0a2dee793092843ec0afa54f49a6d
|
2024-03-09 03:58:18 +08:00 |
|
hiyouga
|
7443ac3116
|
fix chat engine, update webui
Former-commit-id: 5d956e2a5167201aecdfce2794c25d8a2d84e234
|
2024-03-08 03:01:53 +08:00 |
|
hiyouga
|
2235020cc9
|
update galore args
Former-commit-id: 0ac6b40a4772b61a3476bb74b976d24c408a2c35
|
2024-03-08 01:17:32 +08:00 |
|
hiyouga
|
5b50458acf
|
fix galore
Former-commit-id: 33a4c24a8a3c153bc62edf74b9246699a0ae3233
|
2024-03-08 00:44:51 +08:00 |
|
hiyouga
|
2c010c72b8
|
support galore
Former-commit-id: 28f78621883917425fabe49f5473778111012127
|
2024-03-07 22:41:36 +08:00 |
|
hiyouga
|
34533b2f35
|
support vllm
Former-commit-id: d07ad5cc1cdbc13879afd84f653afdfee03a6933
|
2024-03-07 20:26:31 +08:00 |
|
hiyouga
|
37e40563f1
|
fix #2735
Former-commit-id: f74f804a715dfb16bf24a056bc95db6b102f9ed7
|
2024-03-07 16:15:53 +08:00 |
|
hiyouga
|
e887aface7
|
fix version checking
Former-commit-id: 3016e6565708637c1d760f2cd5a67cbd8a5a6c26
|
2024-03-06 14:51:51 +08:00 |
|
hiyouga
|
9561809ce9
|
improve aqlm optim
Former-commit-id: 259af60d28985b919911587716c24a3ac7f7de64
|
2024-03-05 20:49:50 +08:00 |
|
hiyouga
|
d1e6e02461
|
fix #2649
Former-commit-id: 4e5fae2fac85227641bd16159cf296a32e0b18b4
|
2024-03-01 13:02:41 +08:00 |
|
hiyouga
|
8e7d50dae4
|
release v0.5.3
Former-commit-id: fa5ab21ebc0ab738178c0c57578db3bda995ae06
|
2024-02-29 00:34:19 +08:00 |
|
hiyouga
|
5abbca70d3
|
support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
|
2024-02-28 19:53:28 +08:00 |
|
hiyouga
|
2f738a1db6
|
fix #2532
Former-commit-id: 3cc10a01a792a92b99b952a45bb21c25097fccf6
|
2024-02-21 21:55:14 +08:00 |
|
hiyouga
|
0fcb931f18
|
support lora for llama pro
Former-commit-id: 9aeb404a946795d6c4fa3cb45e3e96ffeec13646
|
2024-02-21 02:17:22 +08:00 |
|
hiyouga
|
48ae2110aa
|
update webui
Former-commit-id: ba998c67abb56b2679068572f4eb8398635bbda9
|
2024-02-19 16:49:58 +08:00 |
|
hiyouga
|
96265ec154
|
support llama pro #2338 , add rslora
Former-commit-id: 7924ffc55d98e33bfbfbca303e46c8f476435673
|
2024-02-15 02:27:36 +08:00 |
|
hiyouga
|
75adbfec79
|
add option to disable version check
Former-commit-id: 91d09a01ac3b5da29d284b8d51cdfe4252b391e0
|
2024-02-10 22:31:23 +08:00 |
|
hiyouga
|
db2051684b
|
improve aligner
Former-commit-id: 7d2dc83c5e2085da6273241269c9e9d7509ae51b
|
2024-02-10 16:39:19 +08:00 |
|
hiyouga
|
23dd337ac2
|
lint
Former-commit-id: 88a1bc97736bf06f292cd768fc8b61503aca1988
|
2024-02-07 01:10:04 +08:00 |
|
hiyouga
|
91b7fd1ec3
|
fix reserved label len
Former-commit-id: db0ab4d601b5e68660c00f07998ff26a8745ba90
|
2024-02-04 17:54:26 +08:00 |
|
hiyouga
|
0fc8612b97
|
add hint for freeze #2412
Former-commit-id: 6545c02790e39395a87d664682ab73e0e3191099
|
2024-02-03 23:38:56 +08:00 |
|
hiyouga
|
40514bf865
|
support minicpm #2404
Former-commit-id: 901faa16ccebc3fa11260daac98981dd99904af9
|
2024-02-03 22:36:46 +08:00 |
|
hiyouga
|
509e35ffc8
|
fix #2282 and update tool prompt
Former-commit-id: b2fb0eca56ee835438cc20e83f36ac3f6eb95c83
|
2024-01-22 22:27:30 +08:00 |
|
hiyouga
|
4ac36c14ae
|
release v0.5.0
Former-commit-id: 71cfdc2658e346e3fd05b3a8a678c811b3ba1bd5
|
2024-01-20 20:21:39 +08:00 |
|
hiyouga
|
b27e91222c
|
format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
|
2024-01-20 20:15:56 +08:00 |
|
hiyouga
|
edf725208d
|
add upcast_lmhead option
Former-commit-id: 8cbe4e960983ace47f8b956cdc31411347592129
|
2024-01-19 23:54:25 +08:00 |
|
hiyouga
|
e199967391
|
add bf16 lora option
Former-commit-id: b6ec112bebcb379caa32617a135df4d5d3cf865b
|
2024-01-19 16:29:03 +08:00 |
|
hiyouga
|
6af2f1f217
|
fix rm dataset
Former-commit-id: 5edf7cce0eb4cd569438bb406fe6f148eb05ee46
|
2024-01-18 14:45:37 +08:00 |
|
hiyouga
|
4e3bfb799d
|
support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
|
2024-01-18 09:54:23 +08:00 |
|
hiyouga
|
6a954cc075
|
support export push_to_hub #2183
Former-commit-id: 42859f073434eab0928940e8a9c52f275a2fc93a
|
2024-01-16 23:59:42 +08:00 |
|
hiyouga
|
4be704823c
|
fix #2195
Former-commit-id: a83fb6d3ff1e2a9657e926083a926d48b0f3e1a6
|
2024-01-16 23:53:50 +08:00 |
|
hiyouga
|
cae66bce3d
|
fix args
Former-commit-id: 65c5b0477c0e62691a1f8790670ba04d7f6d2804
|
2023-12-28 18:47:19 +08:00 |
|
hiyouga
|
16688b773a
|
fix export format
Former-commit-id: e165354facf7e69f535f9b7d99438f03dbf0293d
|
2023-12-28 18:40:46 +08:00 |
|
hiyouga
|
2a3980d6ba
|
update loader
Former-commit-id: 6629087e12f64f2635f24311234202077814083c
|
2023-12-24 19:10:23 +08:00 |
|
hiyouga
|
5d440f978e
|
update patcher
Former-commit-id: e44b82ee245a7ee99057c7b58b1edef5c222dc1f
|
2023-12-23 15:24:27 +08:00 |
|
hiyouga
|
11a6c8a9a0
|
fix #1909
Former-commit-id: 0bbf7118dfeb936baf03e74269211fa593003cfe
|
2023-12-23 14:42:20 +08:00 |
|
hiyouga
|
f0d405f392
|
support unsloth
Former-commit-id: 7aad0b889d9a316fffd65f32a419078418fc0986
|
2023-12-23 00:14:33 +08:00 |
|
hiyouga
|
ce79528bb1
|
fix param type
Former-commit-id: ba69378841778410f8004385df3fd4c41e5fa573
|
2023-12-21 17:33:01 +08:00 |
|