2060 Commits

Author SHA1 Message Date
hiyouga
f31e7e0dfc remove visual_inputs, fix qlora
Former-commit-id: a025c3df61db154bef13033518903bbf846f4fc8
2024-08-31 00:24:51 +08:00
hiyouga
51a0016873 optimize predict vram
Former-commit-id: a244f143f48a01910ce1cd56c0855ef11d62a72a
2024-08-30 23:08:45 +08:00
hiyouga
c883542583 add examples
Former-commit-id: e08045a9468986edf1e84001e6043db0ee2e5265
2024-08-30 21:43:19 +08:00
hiyouga
92c398166d tiny fix
Former-commit-id: bee1bd43b946501690d70e4980205f9d82404296
2024-08-30 03:21:50 +08:00
hiyouga
913ee05e74 fix #5307
Former-commit-id: 8b588c7224e631a96c09f3460effc5dbfca6ec14
2024-08-30 02:45:40 +08:00
hiyouga
a83756b5e9 refactor mm training
Former-commit-id: 3382317e32f88ed377d3e7759bdeaf0f2559d22a
2024-08-30 02:14:31 +08:00
hoshi-hiyouga
98b0c7530c Merge pull request #5290 from simonJJJ/qwen2_vl
support qwen2-vl

Former-commit-id: 727e1848401d306274fb60ba78f66fed577b7b55
2024-08-30 02:10:36 +08:00
hoshi-hiyouga
5730243179 fix bug
Former-commit-id: a8f22d8895c07ce37e8cb34b7014f3e9bcdbf6a3
2024-08-30 02:05:26 +08:00
hiyouga
0e4ee9d9a3 update liger kernel
Former-commit-id: a7dd7d325e68c92c7470c1e9ef83a7c8abcbc616
2024-08-29 20:46:08 +08:00
hiyouga
f153ee13be fix #5292
Former-commit-id: aa1afdc75614868172bd2f9c052647b8f226d3f2
2024-08-29 20:37:47 +08:00
hiyouga
21d3976eea fix #5295
Former-commit-id: ad72f3e06593f124d661d61774def336511716e0
2024-08-29 20:30:18 +08:00
hiyouga
1494fa1f18 fix #5305
Former-commit-id: 364b757e306f7a154359a2bc8245a839f39c4fab
2024-08-29 20:16:01 +08:00
simonJJJ
d9fd8f26cc update
Former-commit-id: 734e019cc1c120c23305d6f6bc1fb5b8e0d21b30
2024-08-28 20:22:46 +08:00
simonJJJ
8a09b1e732 initial-commit
Former-commit-id: aeb85f200bd824748008dae6047c2607dfcdf174
2024-08-28 16:51:35 +08:00
hiyouga
efd60f0306 update wechat
Former-commit-id: 0f5a0f64f798eccd1fe76a74cf537002135e7e85
2024-08-27 12:55:23 +08:00
hiyouga
c2df70e925 add extra requires
Former-commit-id: d14edd350ddf268cfeea0f4e9e3c43f38516b848
2024-08-27 12:52:12 +08:00
hiyouga
7b5834b2dd tiny fix
Former-commit-id: f6ae4e75ddaeb4ac4a527f0141ac5b1afefde10e
2024-08-27 12:49:32 +08:00
hoshi-hiyouga
7cbfd64289 Merge pull request #5237 from marko1616/patch-1
Fix mllm api

Former-commit-id: dbe886ae5cf613f537d70c352cb758a524a14279
2024-08-27 12:24:43 +08:00
marko1616
388c3e4e47 ruff pass.
Former-commit-id: df8d5b6985bb209e841347ee51fc6787d9bcd069
2024-08-27 11:30:16 +08:00
marko1616
53a2b16c38 Update chat.py
Former-commit-id: 1545684c3f176a95554afa64f313f00b53a32a77
2024-08-27 11:27:56 +08:00
hiyouga
c765292093 support liger kernel
Former-commit-id: 72bc8f01111ad69b92a647b54b4af988515d9c34
2024-08-27 11:20:14 +08:00
marko1616
f3778f65f8 Force re check.
Former-commit-id: 3a285217107f3042a4d6b7a60eedcdd07f73627d
2024-08-23 14:43:18 +08:00
marko1616
95500687dd Update chat.py
Former-commit-id: 8eb20929217feed91097f60460802f6c6ba7b92b
2024-08-22 12:24:34 +08:00
marko1616
7f6d267e98 Update chat.py
Former-commit-id: a4f1de9d82743bfd35a6dbc1027242533b22ed5f
2024-08-22 12:14:34 +08:00
hoshi-hiyouga
e9800212fa Merge pull request #5230 from MengqingCao/image
[NPU] Update npu base image

Former-commit-id: 36039b0fe01c17ae30dba60e247d7ba8a1beb20a
2024-08-21 22:13:07 +08:00
hiyouga
f78735528d update wechat
Former-commit-id: 8907150c1ba56ef406838b2a0993f1f8fc6b95b5
2024-08-21 22:07:34 +08:00
MengqingCao
a620fa8be3 update npu base image
Former-commit-id: b3f4acd1b4636d15afdfde61d77af521fff39b19
2024-08-21 09:12:38 +00:00
hiyouga
daebca2368 tiny fix
Former-commit-id: c8b4c7fee5398654683b713ad5c03b5daf13218a
2024-08-20 00:10:52 +08:00
hoshi-hiyouga
a7604a95c1 Merge pull request #5156 from YeQiuO/main
fix Llama-template's system prompt bug

Former-commit-id: 15be2963477e7d3a9fe4330d7701d457dc49b583
2024-08-20 00:09:03 +08:00
hoshi-hiyouga
103132aa99 Update template.py
Former-commit-id: ec72eeca521ba4ec71f0c52de9eec49da2cf0feb
2024-08-20 00:03:33 +08:00
hoshi-hiyouga
033dd1f1dc Merge pull request #5163 from liu-zichen/fix_ppo_optim
fix lr not change

Former-commit-id: da335d42c30df2c2898516e290c0059250d57b63
2024-08-19 23:56:24 +08:00
hoshi-hiyouga
5e19a604a6 Merge pull request #5185 from chenhuiyu/feature/add-sailorllm-template
Add SailorLLM template

Former-commit-id: f59c9bef31429a0775e71b0ee01f84f0d33c3149
2024-08-19 23:51:49 +08:00
hoshi-hiyouga
5582674f06 Merge pull request #5188 from Zxilly/main
fix: report correct device count for intel xpu
Former-commit-id: d39f4a62d3c5a3bbbf39d1eb4b92439acedae18e
2024-08-19 23:51:39 +08:00
hoshi-hiyouga
57b51c8617 Merge pull request #5193 from Ricardo-L-C/main
_is_bf16_available judgment supports npu

Former-commit-id: 5d5bfc83e646ae41701ce208386b56297efd85f0
2024-08-19 23:40:59 +08:00
hoshi-hiyouga
a921505f59 Update template.py
Former-commit-id: 5f3300ec5de564df23c94ebd9662c86708f37ddb
2024-08-19 23:40:16 +08:00
hiyouga
fc1aefa4b1 update readme
Former-commit-id: 3804ddec9e4227c02f0e0d43b7dd240cf15716a8
2024-08-19 23:32:04 +08:00
Ricardo
a9312387bc _is_bf16_available judgment supports npu
Former-commit-id: 384ab8db84eef7d1f6a7643c15c565a7d4906a5c
2024-08-16 02:58:22 +00:00
Zxilly
41a8387195 fix: report correct device count for intel xpu
Former-commit-id: dc36fcc3de721bdd28edd4eed36677e59a7614be
2024-08-15 08:30:43 +00:00
Huiyu Chen
66a7f4f128 Add SailorLLM template
Former-commit-id: 2502833a7755d653e8492cb7f1215dc0105b6ee0
2024-08-15 15:10:14 +08:00
liu-zichen
8a7ab8ab21 fix lr not change
Former-commit-id: ddee718b31a5bf3cb39c5adf3f8e0be8fddf9dbb
2024-08-13 16:33:34 +08:00
codingma
753cb0f9b6 add tutorial and doc links
Former-commit-id: 625a0e32c47aeb72a6fe9c3536914996912e89d4
2024-08-13 16:13:10 +08:00
codingma
919472435f update wechat.jpg
Former-commit-id: 5b9d99ebc617f9830552e15897a347ff9d5bdeb7
2024-08-13 16:12:36 +08:00
“Wzw”
3e159a0a83 fix Llama-template's system prompt bug
Former-commit-id: bcbbf4506300fc132e68a39a9a6dfa5e61497c8b
2024-08-12 19:22:12 +08:00
hiyouga
684d621edc update readme
Former-commit-id: c93d55bfb084fd91436b99dba5a79aa16432e136
2024-08-10 10:17:35 +08:00
hiyouga
a0f1cc7445 update readme
Former-commit-id: 576a894f7734711a5b11ae764f42fa8d00427d4a
2024-08-09 20:46:02 +08:00
hiyouga
bea270042b add magpie ultra dataset
Former-commit-id: c75b5b83c4982a6da1512ad6f9cc4d98cc761094
2024-08-09 20:28:55 +08:00
hiyouga
a8add5c04b add qwen2 math models
Former-commit-id: dc770efb14bd6e18421511912fbb959a3cf9f78d
2024-08-09 20:20:35 +08:00
hiyouga
f8c11bd540 update examples
Former-commit-id: 0a690ada6f9f791e7d013eb89799975b12212ed0
2024-08-09 20:13:46 +08:00
hiyouga
5eacd17090 add adam_mini to readme
Former-commit-id: e2a28f51c635d64ff9de65a37087d89356bdedcc
2024-08-09 20:02:03 +08:00
hoshi-hiyouga
792da85866 Merge pull request #5095 from relic-yuexi/feat-optimizer
Feat optimizer

Former-commit-id: ef482394f0e2820ee8a245f8a6b050a32591b40a
2024-08-09 19:51:33 +08:00