232 Commits

Author SHA1 Message Date
hiyouga
3b491b4e1a add CodeQwen models
Former-commit-id: 5f86053d7555423cd35bd2b8610adf423ba3dbd0
2024-04-17 23:27:22 +08:00
hiyouga
f9c859e97b fix #3317
Former-commit-id: 6d641af70361756131eaee456362909bd82a6c58
2024-04-17 22:17:19 +08:00
hiyouga
8beb7a9239 update readme and gradio version
Former-commit-id: 5d62a51c12061c59b509db8fe367817f4e48f737
2024-04-16 18:09:16 +08:00
hiyouga
bd2b758b48 add codegemma
Former-commit-id: 6543f3d4496218f7f90c582cb6aa8c852d716cbf
2024-04-16 00:11:15 +08:00
hiyouga
2dc3343b1c support cohere commandR #3184
Former-commit-id: e0dbac28450a0e1e0b84e1577ef785fc762c0b46
2024-04-15 23:26:42 +08:00
hoshi-hiyouga
57ddf739c2 Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus
Add template&support for c4ai-command-r/plus (tested)

Former-commit-id: 7a8ae3f4ac278f2773ec23db7f760099e18b8d0c
2024-04-15 22:59:35 +08:00
hoshi-hiyouga
63f3f6b80c Update constants.py
Former-commit-id: 268f53dddbda5905859c6facfce90e90736c6f7d
2024-04-15 22:56:55 +08:00
hiyouga
fb385b8c26 update examples
Former-commit-id: cce52351b54f70904f33902d9c17411134f9f6eb
2024-04-15 22:14:34 +08:00
marko1616
94d988a8e6 Typo fix
Former-commit-id: ab033dac4fde392b18955984e40473a923f745af
2024-04-13 17:30:21 +08:00
marko1616
768153d0f0 Add c4ai-command-r-plus link
Former-commit-id: d0705518ee85408364172803ca3dd68e978e829e
2024-04-13 07:32:40 +08:00
marko1616
6f1323722c Add template&support(Not tested)
Former-commit-id: 6574a721d20108174fc770caf9f17cf8fa81c4b4
2024-04-13 04:31:33 +08:00
hiyouga
431e9804ee release v0.6.2
Former-commit-id: 9d4c949461d232a959c14859ae7fef191faab711
2024-04-11 20:08:51 +08:00
hiyouga
d5ca8763ea fix #3225
Former-commit-id: a99f5ed0b6f7932810c6baf127d21f4be44144ad
2024-04-10 23:57:59 +08:00
hiyouga
3069f37021 tiny fix
Former-commit-id: 9a99fbc86d0be7bd0e6dd1a5475868c32006b08d
2024-04-08 21:28:39 +08:00
hoshi-hiyouga
8682d033eb Merge pull request #3161 from hiyouga/feature/add-mediatek-model
support Breeze-7B

Former-commit-id: 4c6c4a0d8829bc098c202e4c3df36f702d579537
2024-04-08 20:56:51 +08:00
codingma
b5f0ac4c3f add empty line
Former-commit-id: 7b76b4ca08066af0465f138fa756615cbaef32ad
2024-04-07 18:28:08 +08:00
codingma
ed14f8bae7 rename template to breeze
Former-commit-id: 5a780e9eec7e8c560d417c1a95afa1be0f878d32
2024-04-07 11:39:54 +08:00
codingma
80aa1f70b6 support https://github.com/hiyouga/LLaMA-Factory/issues/3152
Former-commit-id: 2565a32bd98ef46a3b6e1a5c334093ca46b820d2
2024-04-07 11:34:01 +08:00
sliderSun
7037dcbf38 fix spell error
Former-commit-id: 1d117b7bb6b71ff9ff98b7d5cc0bbf7b879ad385
2024-04-07 10:59:15 +08:00
sliderSun
1fbf190eda support Qwen1.5-32B
Former-commit-id: 21650d467c19c99d30f538f8a70984d4e3417604
2024-04-07 10:56:03 +08:00
sliderSun
09107affda support Qwen1.5-32B
Former-commit-id: 77044d9ef4ce39a038ad769f93569d5eb2f3bfb0
2024-04-07 10:26:13 +08:00
hiyouga
f334b89616 back to gradio 4.21 and fix chat
Former-commit-id: 4b920f24d35c73814b83d56373dd5c913bb57e49
2024-04-04 02:07:20 +08:00
hiyouga
54a4a8217a fix bug in latest gradio
Former-commit-id: 5ddcecda50ccff93d51bebc9ac72c2a0dd483e9b
2024-04-04 00:55:31 +08:00
hiyouga
bf5ffeeae0 simplify readme
Former-commit-id: 92dab8a90bdd82a72a06559943467b56dde12c71
2024-04-02 20:07:43 +08:00
hiyouga
f4be51f356 add moe aux loss control #3085
Former-commit-id: b267aeb53fc49d2eeb0f3fc5ebe55e643f5db377
2024-04-02 14:26:31 +08:00
hiyouga
8d987b7af7 add qwen1.5 moe
Former-commit-id: 54b7d349088a828d32551fde56b3467a82df1b9b
2024-04-01 21:49:40 +08:00
hiyouga
34f1de0574 fix #3077
Former-commit-id: aee634cd20e6dfdfbe2fbb47ae57f62b2da2bf9a
2024-04-01 21:35:18 +08:00
hiyouga
2f878bde11 support ORPO
Former-commit-id: 17bf8a2c3a7bb5b83071c8659cfd8751e894e692
2024-03-31 18:29:50 +08:00
hiyouga
3bf6dde3a5 support save args in webui #2807 #3046
some ideas are borrowed from @marko1616


Former-commit-id: 7a086ed33388551e0f835adf61fac638f96ed188
2024-03-30 23:09:12 +08:00
hiyouga
e4f3d583df fix #2982
Former-commit-id: 8d603f8820efd1617557f2bc5d9674143abe7c57
2024-03-28 20:22:31 +08:00
hiyouga
eac2a5b1d3 fix #3010
Former-commit-id: b19c14870d30c57fbea81e9cfa737d762922c54b
2024-03-28 18:31:17 +08:00
hiyouga
84c3d509fa fix #2936
Former-commit-id: 140ad4ad567de8817a14972175e668971bae6a0a
2024-03-24 00:43:21 +08:00
hiyouga
58aa576ae5 fix #2941
Former-commit-id: a1c8c98c5fecfc0dd0ed1be33ee8dd2ade05b708
2024-03-24 00:28:44 +08:00
hiyouga
7999836fb6 support fsdp + qlora
Former-commit-id: 84082251621e1470b3b5406a56d0a967780a1804
2024-03-21 00:36:06 +08:00
hiyouga
096c31bfb6 patch for gemma cpt
Former-commit-id: 70a3052dd8a2d1322fa01ab19e369e465842d416
2024-03-12 21:21:54 +08:00
hiyouga
c28818c39f fix plot issues
Former-commit-id: 60cc17f3a8b56c0b2ad76be7c10ca0b4e1738121
2024-03-12 18:41:35 +08:00
hiyouga
14ed926a2d support olmo
Former-commit-id: b3247d6a1604f4cbeb0d7c163d0082ce91afb870
2024-03-12 18:30:38 +08:00
hiyouga
868444e124 allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
2024-03-09 22:21:46 +08:00
hiyouga
f373290012 add Yi-9B model
Former-commit-id: 57452a4aa1d37a047d659f002c1aaa6246f64178
2024-03-07 23:11:57 +08:00
hiyouga
2c010c72b8 support galore
Former-commit-id: 28f78621883917425fabe49f5473778111012127
2024-03-07 22:41:36 +08:00
hiyouga
34533b2f35 support vllm
Former-commit-id: d07ad5cc1cdbc13879afd84f653afdfee03a6933
2024-03-07 20:26:31 +08:00
hiyouga
31c618f1f7 tiny fix
Former-commit-id: 0048a2021e94d068f7c6054df0b9569ae4912eb1
2024-03-06 17:25:08 +08:00
hiyouga
e887aface7 fix version checking
Former-commit-id: 3016e6565708637c1d760f2cd5a67cbd8a5a6c26
2024-03-06 14:51:51 +08:00
hiyouga
0e58cd6422 fix sub-process error in thread
Former-commit-id: 9c10854b46fc67d45ff9fc2f62af4d6af826f9c1
2024-03-03 15:04:35 +08:00
hiyouga
9ae1514a75 update readme, add starcoder2, cosmopedia
Former-commit-id: 894d183214417b10af64d6add7be082d63e8b1f3
2024-03-03 01:01:46 +08:00
hiyouga
57f85add58 update chatglm3 template
Former-commit-id: 38d8b2cef8d70ce8c390de0317559df7f04b4a5d
2024-02-28 21:11:23 +08:00
hiyouga
5abbca70d3 support DoRA, AWQ, AQLM #2512
Former-commit-id: cfefacaa37453a15c55866d019887f24e886a577
2024-02-28 19:53:28 +08:00
hiyouga
3af5fea981 update readme
Former-commit-id: 3ba10545937cd9a1dea9cf65d98dd174a205337d
2024-02-26 17:25:47 +08:00
Rayrtfr
41e9dd2cf8 Support Atom Model
Former-commit-id: 6e0fba60b3857c8920edb6bd2a34a7f2d4ac46be
2024-02-26 10:44:10 +08:00
hiyouga
1845e03921 support gemma
Former-commit-id: c99e19641a9b893da0a3277bd41bd1d3996d1913
2024-02-21 23:27:36 +08:00