2609 Commits

Author SHA1 Message Date
hiyouga
0d18cca0db add vllm config
Former-commit-id: 58ab4579dc81a1dcea2bf5938ba3f3116cecfc76
2024-11-10 21:28:18 +08:00
hoshi-hiyouga
0386fa6a4f Merge pull request #5973 from JJJJerry/fix_vllm_generate
fix VllmEngine: 将inputs参数替换为prompt

Former-commit-id: 40a2fcc02dad2f1633c117d457651b221b8c5ae0
2024-11-10 21:04:38 +08:00
hoshi-hiyouga
d7476aa55b Update vllm_engine.py
Former-commit-id: a543bc478dfb3472d5d81e2f81922d5ab3b90373
2024-11-10 20:57:00 +08:00
JJJJerry
d996bea1c7 fix VllmEngine: 将inputs参数替换为prompt
Former-commit-id: 1d04078bb5d460f0cb3d26798bd2f0e43c8a0467
2024-11-09 11:45:59 +08:00
hoshi-hiyouga
1e00de38cb Merge pull request #5971 from hiyouga/hiyouga/fix_webui
[webui] fix extra args

Former-commit-id: adc5849ce75cc8eda800c73c59b1f44d3108e992
2024-11-09 00:25:24 +08:00
hiyouga
d7e35ddcaa fix extra args
Former-commit-id: eb294fed1319e97657b54b9aa479d87734c711dc
2024-11-09 00:24:27 +08:00
hoshi-hiyouga
162f7028fc Merge pull request #5970 from hiyouga/hiyouga/fix_beam
[generation] fix vllm v0.6.3

Former-commit-id: 39e330196d8e2774ac43d6f37ccabc0a07efd970
2024-11-08 23:58:15 +08:00
hiyouga
97f4451912 fix #5966
Former-commit-id: 8f3a32286ebcfb3234e3981db2292dd165b1568d
2024-11-08 23:49:16 +08:00
hoshi-hiyouga
265875fffd Merge pull request #5929 from hiyouga/hiyouga/dev_wechat
[readme] update wechat

Former-commit-id: 707ff5a3703ead7b1d374d928f92ed8a128573f0
2024-11-04 16:44:31 +08:00
hiyouga
bf2959c175 update wechat
Former-commit-id: 882635cac3419193c78202fa5fb854c97acea9ed
2024-11-04 08:43:21 +00:00
hoshi-hiyouga
2e6dd72539 Merge pull request #5927 from hiyouga/hiyouga/dev_fixmmchat
[fix] chat engines

Former-commit-id: bcbd1bebb0c2c1f9bfbe920c62008383cb044dba
2024-11-04 16:36:23 +08:00
hiyouga
1598e5d355 add image input type
Former-commit-id: ffa39ba3db0dbfd375cdf20b9f3cbecd359be1a1
2024-11-04 08:27:20 +00:00
hiyouga
2360d63ebc fix chat engines
Former-commit-id: 8c88065c38d0e7dd60e06e27c7f921f7931471ee
2024-11-04 08:18:12 +00:00
hoshi-hiyouga
d68af5b04a Merge pull request #5926 from hiyouga/hiyouga/dev_deps
[version] update datasets version

Former-commit-id: 22ee197a40566cec092f957dd81458bf00caf9fa
2024-11-04 16:04:00 +08:00
hiyouga
3730fc046f update datasets version
Former-commit-id: c5fae465ec8cbc30f9e91e6c32b88e74c805874a
2024-11-04 07:52:26 +00:00
steven
7f7ee0a660 support granite3 models
Former-commit-id: 6eefb4d7d25879db42cefae8332ca9db88bff851
2024-11-04 10:35:03 +08:00
hoshi-hiyouga
e3fb3c313c Merge pull request #5914 from hiyouga/hiyouga/dev_read
[misc] update readme

Former-commit-id: 04c10d2e80b7f7e516eba67fea420498a1238bb5
2024-11-02 21:44:10 +08:00
hoshi-hiyouga
9d463b611c Merge pull request #5475 from menibrief/main
Fix phi-3-small issues 

Former-commit-id: 9a42c5f76f4fff3203ea0ceac08ea5043e1519d6
2024-11-02 21:31:34 +08:00
hiyouga
feb547aa99 fix phi3 template
Former-commit-id: 2e843d989e946725e2dc096d6540531eaaf5b782
2024-11-02 21:31:23 +08:00
hiyouga
f05685c7cf update readme
Former-commit-id: e7ed5091e1f8fb35e458f368558ceac71c6983b4
2024-11-02 21:28:04 +08:00
hoshi-hiyouga
8c2b7aa1ab update template
Former-commit-id: 478cbb1aa72f218df37b5a4686db2248ad2605dd
2024-11-02 21:21:22 +08:00
hoshi-hiyouga
d99e164cad Merge branch 'main' into main
Former-commit-id: 5f14910910154ba569435e7e68acbd6c30f79e80
2024-11-02 21:20:27 +08:00
hoshi-hiyouga
7dbb338df7 Merge pull request #5913 from hiyouga/hiyouga/dev_metrics
[train] support gather DPO metrics, fix return output

Former-commit-id: 344ff76d26a42c859f31cd03765b1b613ffe6bfa
2024-11-02 21:13:43 +08:00
hiyouga
604f4005c9 fix webchat
Former-commit-id: ba10d54bf93c54ab8f691ea53bff850e3595a1a6
2024-11-02 21:04:18 +08:00
hiyouga
c2766af6f4 fix dpo metrics
Former-commit-id: 4270f7dfb9a12471c91f6c03dce7ca6fd88566e1
2024-11-02 20:59:01 +08:00
hoshi-hiyouga
e7b11e4fdb Merge pull request #5880 from sd3ntato/make-image-parametric
make base image parametric.

Former-commit-id: 07e5088851b3a175ad9cfc83268159eac4334031
2024-11-02 20:26:14 +08:00
hoshi-hiyouga
5ad86fc71d Update Dockerfile
Former-commit-id: 5e8a619d1d20048ad912a1f6d9ccdae5740811bc
2024-11-02 20:20:26 +08:00
hoshi-hiyouga
6f79974e8b Merge pull request #5910 from Cuiyn/index
Support Index series models.

Former-commit-id: c58cc22d06eb1a466ad92601ceb74c9bae6abb51
2024-11-02 20:16:54 +08:00
Cuiyn
51177c933a fix: rename to Index-1.9B-Charater-Chat and Index-1.9B-Chat-32K
Former-commit-id: ecca9db66ba1f0fe903a9e02eca317c0bbb28a5f
2024-11-02 20:04:14 +08:00
hoshi-hiyouga
0f53217bbc Merge pull request #5912 from hiyouga/hiyouga/dev_logging
[misc] support rank0 logger

Former-commit-id: 83535bbe8bf50d9653265437d379fcdd8c82b989
2024-11-02 18:48:41 +08:00
hiyouga
e83cb17f97 support rank0 logger
Former-commit-id: c38aa29336f286266553da4909a7267d7ef21f37
2024-11-02 18:31:04 +08:00
Cuiyn
7806bde8ad Add support for Index
Former-commit-id: a15a69ab4417c6f3273c874cf7ee2c34a5a64141
2024-11-02 13:45:27 +08:00
hoshi-hiyouga
4b2c47fcae Merge pull request #5909 from hiyouga/hiyouga/dev2
[data] support auto convert for single image, add image_dir argument

Former-commit-id: bd08b8c441c47076faa03cc1efde21b22f14f058
2024-11-02 13:43:04 +08:00
hoshi-hiyouga
33e8bfc3ae Merge pull request #5907 from hiyouga/hiyouga/dev
[data] fix template replace behavior

Former-commit-id: 8408339d8388a610a4e5fe303086d7536d1e72d5
2024-11-02 13:42:53 +08:00
hiyouga
ac677205c9 fix #5904
Former-commit-id: bfe1abd7afe4595135b568783753d064cb6e0b28
2024-11-02 13:08:15 +08:00
hiyouga
7fa46a24df fix #5883
Former-commit-id: 24da9f59b0bf4874506bbf1ec214f3d5ca43d943
2024-11-02 13:06:34 +08:00
hoshi-hiyouga
7555c54c9f Merge pull request #5906 from hiyouga/dev
[test] update tests

Former-commit-id: 3ef7d590b13301e1c5531ec5942f4a65dc44d47e
2024-11-02 12:50:43 +08:00
hiyouga
3f7c874594 update tests
Former-commit-id: 93d3b8f43faf4a81b809d2f7d897e39bdb5475c3
2024-11-02 12:41:44 +08:00
hoshi-hiyouga
25093c2d82 Merge pull request #5895 from hiyouga/dev
[inference] support multiple images

Former-commit-id: 0a55e60693ab15d92fbe3d7d536408e26228ab82
2024-11-01 16:52:55 +08:00
hiyouga
2eba98e152 add examples
Former-commit-id: e824b715ad4bf885241b245b12d75563adab2e26
2024-11-01 08:41:54 +00:00
hiyouga
8ecc12ee2a support multiimage inference
Former-commit-id: e80a4819274d46ac9e85db7469dc59d7c4e323c7
2024-11-01 07:25:20 +00:00
Valerio Mariani
1ab3ea21ce make base image parametric.
default `BASE_IMAGE` is nvcr.io/nvidia/pytorch:24.02-py3 for retro-compatibility


Former-commit-id: d5b2def7c029d6f808a97cb062340810e0cd075d
2024-10-30 21:53:32 +01:00
hoshi-hiyouga
9108df2b97 Merge pull request #5873 from hiyouga/dev
[misc] update readme

Former-commit-id: 641d0dab08d96a93c34657742213d8994d9ed476
2024-10-30 17:14:44 +08:00
hiyouga
7487bd7b1f update readme
Former-commit-id: 2417b70a620ec3bba7581c1a444e09c2440a58a0
2024-10-30 09:14:01 +00:00
hoshi-hiyouga
efda735f32 Merge pull request #5871 from hiyouga/dev
[loss&ui] fix incorrect loss of vlms, add extra args to ui

Former-commit-id: b2d4b9a7a870aba92ed6e74b7805d606ddc0edbc
2024-10-30 17:13:17 +08:00
hiyouga
584ce3a105 fix incorrect loss value for vlms
Former-commit-id: 30567a1487727473950104718e626ff660f10cbb
2024-10-30 08:56:46 +00:00
hiyouga
1b02915d19 tiny fix
Former-commit-id: 0c22da4f1cc710b471f6d511d50ce878521173ca
2024-10-30 08:56:29 +00:00
hiyouga
aba4268607 support extra args in llamaboard
Former-commit-id: 86e5affc0d5f5682a20b28d27f80e0015b36fdd9
2024-10-30 08:55:54 +00:00
hoshi-hiyouga
5142faca8f Merge pull request #5581 from Kuangdd01/pixtral-patch
[WIP] Support Pixtral-12B

Former-commit-id: 9009a467e621a17ad9fa25bb30fb9ac9ee15df97
2024-10-29 22:29:10 +08:00
hoshi-hiyouga
15786539d7 fix bug
Former-commit-id: bb0afda8fbb7d3556c1742bccf0b33ee3bf0f0b6
2024-10-29 22:19:04 +08:00