2641 Commits

Author SHA1 Message Date
hiyouga
feb547aa99 fix phi3 template
Former-commit-id: 2e843d989e946725e2dc096d6540531eaaf5b782
2024-11-02 21:31:23 +08:00
hiyouga
f05685c7cf update readme
Former-commit-id: e7ed5091e1f8fb35e458f368558ceac71c6983b4
2024-11-02 21:28:04 +08:00
hoshi-hiyouga
8c2b7aa1ab update template
Former-commit-id: 478cbb1aa72f218df37b5a4686db2248ad2605dd
2024-11-02 21:21:22 +08:00
hoshi-hiyouga
d99e164cad Merge branch 'main' into main
Former-commit-id: 5f14910910154ba569435e7e68acbd6c30f79e80
2024-11-02 21:20:27 +08:00
hoshi-hiyouga
7dbb338df7 Merge pull request #5913 from hiyouga/hiyouga/dev_metrics
[train] support gather DPO metrics, fix return output

Former-commit-id: 344ff76d26a42c859f31cd03765b1b613ffe6bfa
2024-11-02 21:13:43 +08:00
hiyouga
604f4005c9 fix webchat
Former-commit-id: ba10d54bf93c54ab8f691ea53bff850e3595a1a6
2024-11-02 21:04:18 +08:00
hiyouga
c2766af6f4 fix dpo metrics
Former-commit-id: 4270f7dfb9a12471c91f6c03dce7ca6fd88566e1
2024-11-02 20:59:01 +08:00
hoshi-hiyouga
e7b11e4fdb Merge pull request #5880 from sd3ntato/make-image-parametric
make base image parametric.

Former-commit-id: 07e5088851b3a175ad9cfc83268159eac4334031
2024-11-02 20:26:14 +08:00
hoshi-hiyouga
5ad86fc71d Update Dockerfile
Former-commit-id: 5e8a619d1d20048ad912a1f6d9ccdae5740811bc
2024-11-02 20:20:26 +08:00
hoshi-hiyouga
6f79974e8b Merge pull request #5910 from Cuiyn/index
Support Index series models.

Former-commit-id: c58cc22d06eb1a466ad92601ceb74c9bae6abb51
2024-11-02 20:16:54 +08:00
Cuiyn
51177c933a fix: rename to Index-1.9B-Charater-Chat and Index-1.9B-Chat-32K
Former-commit-id: ecca9db66ba1f0fe903a9e02eca317c0bbb28a5f
2024-11-02 20:04:14 +08:00
hoshi-hiyouga
0f53217bbc Merge pull request #5912 from hiyouga/hiyouga/dev_logging
[misc] support rank0 logger

Former-commit-id: 83535bbe8bf50d9653265437d379fcdd8c82b989
2024-11-02 18:48:41 +08:00
hiyouga
e83cb17f97 support rank0 logger
Former-commit-id: c38aa29336f286266553da4909a7267d7ef21f37
2024-11-02 18:31:04 +08:00
Cuiyn
7806bde8ad Add support for Index
Former-commit-id: a15a69ab4417c6f3273c874cf7ee2c34a5a64141
2024-11-02 13:45:27 +08:00
hoshi-hiyouga
4b2c47fcae Merge pull request #5909 from hiyouga/hiyouga/dev2
[data] support auto convert for single image, add image_dir argument

Former-commit-id: bd08b8c441c47076faa03cc1efde21b22f14f058
2024-11-02 13:43:04 +08:00
hoshi-hiyouga
33e8bfc3ae Merge pull request #5907 from hiyouga/hiyouga/dev
[data] fix template replace behavior

Former-commit-id: 8408339d8388a610a4e5fe303086d7536d1e72d5
2024-11-02 13:42:53 +08:00
hiyouga
ac677205c9 fix #5904
Former-commit-id: bfe1abd7afe4595135b568783753d064cb6e0b28
2024-11-02 13:08:15 +08:00
hiyouga
7fa46a24df fix #5883
Former-commit-id: 24da9f59b0bf4874506bbf1ec214f3d5ca43d943
2024-11-02 13:06:34 +08:00
hoshi-hiyouga
7555c54c9f Merge pull request #5906 from hiyouga/dev
[test] update tests

Former-commit-id: 3ef7d590b13301e1c5531ec5942f4a65dc44d47e
2024-11-02 12:50:43 +08:00
hiyouga
3f7c874594 update tests
Former-commit-id: 93d3b8f43faf4a81b809d2f7d897e39bdb5475c3
2024-11-02 12:41:44 +08:00
hoshi-hiyouga
25093c2d82 Merge pull request #5895 from hiyouga/dev
[inference] support multiple images

Former-commit-id: 0a55e60693ab15d92fbe3d7d536408e26228ab82
2024-11-01 16:52:55 +08:00
hiyouga
2eba98e152 add examples
Former-commit-id: e824b715ad4bf885241b245b12d75563adab2e26
2024-11-01 08:41:54 +00:00
hiyouga
8ecc12ee2a support multiimage inference
Former-commit-id: e80a4819274d46ac9e85db7469dc59d7c4e323c7
2024-11-01 07:25:20 +00:00
Valerio Mariani
1ab3ea21ce make base image parametric.
default `BASE_IMAGE` is nvcr.io/nvidia/pytorch:24.02-py3 for retro-compatibility


Former-commit-id: d5b2def7c029d6f808a97cb062340810e0cd075d
2024-10-30 21:53:32 +01:00
hoshi-hiyouga
9108df2b97 Merge pull request #5873 from hiyouga/dev
[misc] update readme

Former-commit-id: 641d0dab08d96a93c34657742213d8994d9ed476
2024-10-30 17:14:44 +08:00
hiyouga
7487bd7b1f update readme
Former-commit-id: 2417b70a620ec3bba7581c1a444e09c2440a58a0
2024-10-30 09:14:01 +00:00
hoshi-hiyouga
efda735f32 Merge pull request #5871 from hiyouga/dev
[loss&ui] fix incorrect loss of vlms, add extra args to ui

Former-commit-id: b2d4b9a7a870aba92ed6e74b7805d606ddc0edbc
2024-10-30 17:13:17 +08:00
hiyouga
584ce3a105 fix incorrect loss value for vlms
Former-commit-id: 30567a1487727473950104718e626ff660f10cbb
2024-10-30 08:56:46 +00:00
hiyouga
1b02915d19 tiny fix
Former-commit-id: 0c22da4f1cc710b471f6d511d50ce878521173ca
2024-10-30 08:56:29 +00:00
hiyouga
aba4268607 support extra args in llamaboard
Former-commit-id: 86e5affc0d5f5682a20b28d27f80e0015b36fdd9
2024-10-30 08:55:54 +00:00
hoshi-hiyouga
5142faca8f Merge pull request #5581 from Kuangdd01/pixtral-patch
[WIP] Support Pixtral-12B

Former-commit-id: 9009a467e621a17ad9fa25bb30fb9ac9ee15df97
2024-10-29 22:29:10 +08:00
hoshi-hiyouga
15786539d7 fix bug
Former-commit-id: bb0afda8fbb7d3556c1742bccf0b33ee3bf0f0b6
2024-10-29 22:19:04 +08:00
hoshi-hiyouga
49054329d0 Update mm_plugin.py
Former-commit-id: 049c554aee25cf1e29bee88dfb21381b3a4a2947
2024-10-29 22:16:22 +08:00
hoshi-hiyouga
54961946ac Update template.py
Former-commit-id: c3239ba6b24481b092e86ce94a6337fba18c25c0
2024-10-29 22:11:21 +08:00
hoshi-hiyouga
2179b91acb Update visual.py
Former-commit-id: 0baa7735f64cbef9bd90e1db485c120b4c1c88bd
2024-10-29 22:10:29 +08:00
hoshi-hiyouga
fb8f35558a Update collator.py
Former-commit-id: f745c4b28f532c7084d4b8522c972e735729ecee
2024-10-29 22:03:42 +08:00
hoshi-hiyouga
90cd3538de Update hf_engine.py
Former-commit-id: 6e212fdab5f48c955db250ecfc197b89f8856e4b
2024-10-29 22:00:59 +08:00
hoshi-hiyouga
eca50b89a2 Update README_zh.md
Former-commit-id: 8fa20bf4272666e0ed9bcbfee8e4fe66801ef10c
2024-10-29 21:58:03 +08:00
hoshi-hiyouga
2876b429bc Update README.md
Former-commit-id: 1b57df074ab4deb29749086ccb10b459eebf5143
2024-10-29 21:57:28 +08:00
hoshi-hiyouga
acfff4319a Merge pull request #5801 from NLPJCL/main
使用了 LLaMA Factory 的项目:RAG-Retrieval 使用LLaMA-Factory作为生成方法做Reranker任务的微调框架。

Former-commit-id: 4ff6e564f8a03abda7a853744d14abe7451991c8
2024-10-29 21:20:16 +08:00
hoshi-hiyouga
b86b869187 Update README_zh.md
Former-commit-id: 08d9a03c30b7aebf74bef7f59e6aea229af2aeb3
2024-10-29 21:19:17 +08:00
hoshi-hiyouga
233556d1c7 Update README.md
Former-commit-id: a76478c127bc98749079fbc7e5aacd6e60648f37
2024-10-29 21:18:15 +08:00
hoshi-hiyouga
4f10d3e28c Merge pull request #5857 from hiyouga/dev
[train] fix saving processor

Former-commit-id: a7c79d8f6a22b93dc52f3b6ba7145cb27d54f30c
2024-10-29 21:12:04 +08:00
hiyouga
13c7e873e0 fix #5749
Former-commit-id: 23dbe9a09999fe0f9eb2902a40e33b36db4ca584
2024-10-29 13:02:13 +00:00
Kingsley
3053a806e9 Merge branch 'hiyouga:main' into pixtral-patch
Former-commit-id: 67f59579d79e97689a4b3cba7101a423c30dab2b
2024-10-29 21:01:25 +08:00
hoshi-hiyouga
6cd0d7da29 Merge pull request #5852 from hiyouga/dev
[misc] several important updates

Former-commit-id: 935adaeed948ef0d6df407bc432ae93ad46d0d97
2024-10-29 20:30:02 +08:00
hiyouga
d183966a5d fix pissa
Former-commit-id: 51e5f962474739bbf396782afdaa68743636fe90
2024-10-29 12:18:45 +00:00
hiyouga
825ea1c72d fix #5747
Former-commit-id: ae045c884f8ac2aa0ea27592e0757b7bca2dba13
2024-10-29 10:47:04 +00:00
hiyouga
0d8aa6e6ef use pre-commit
Former-commit-id: 21db8ed2f4a0eba203754a92ce0741538e8ee709
2024-10-29 09:07:46 +00:00
hiyouga
163cf2ba5c update requires
Former-commit-id: 77666bd2278a3cfe5b567f4fe285b0f93871d166
2024-10-29 16:10:07 +08:00