mirror of
				https://github.com/hiyouga/LLaMA-Factory.git
				synced 2025-11-04 18:02:19 +08:00 
			
		
		
		
	update benchmark
Former-commit-id: 1cd2ae910e3ffca92978772d000de6fde2f6bb13
This commit is contained in:
		
							parent
							
								
									821a6f2fa6
								
							
						
					
					
						commit
						775ce62950
					
				@ -39,12 +39,12 @@ https://github.com/hiyouga/LLaMA-Factory/assets/16256802/6ba60acc-e2e2-4bec-b846
 | 
			
		||||
 | 
			
		||||
## Benchmark
 | 
			
		||||
 | 
			
		||||
Compared to ChatGLM's [P-Tuning](https://github.com/THUDM/ChatGLM2-6B/tree/main/ptuning), LLaMA-Factory's LoRA tuning offers up to **3.7 times faster** training speed with a better BLEU score on the advertising text generation task. By leveraging 4-bit quantization technique, LLaMA-Factory's QLoRA further improves the efficiency regarding the GPU memory.
 | 
			
		||||
Compared to ChatGLM's [P-Tuning](https://github.com/THUDM/ChatGLM2-6B/tree/main/ptuning), LLaMA-Factory's LoRA tuning offers up to **3.7 times faster** training speed with a better Rouge score on the advertising text generation task. By leveraging 4-bit quantization technique, LLaMA-Factory's QLoRA further improves the efficiency regarding the GPU memory.
 | 
			
		||||
 | 
			
		||||

 | 
			
		||||
 | 
			
		||||
- **Training Speed**: the number of training samples processed per second during the training. (bs=4, cutoff_len=1024)
 | 
			
		||||
- **BLEU Score**: BLEU-4 score on the development set of the [advertising text generation](https://aclanthology.org/D19-1321.pdf) task. (bs=4, cutoff_len=1024)
 | 
			
		||||
- **Rouge Score**: Rouge-2 score on the development set of the [advertising text generation](https://aclanthology.org/D19-1321.pdf) task. (bs=4, cutoff_len=1024)
 | 
			
		||||
- **GPU Memory**: Peak GPU memory usage in 4-bit quantized training. (bs=1, cutoff_len=1024)
 | 
			
		||||
- We adopt `pre_seq_len=128` for ChatGLM's P-Tuning and `lora_rank=32` for LLaMA-Factory's LoRA tuning.
 | 
			
		||||
 | 
			
		||||
 | 
			
		||||
@ -39,12 +39,12 @@ https://github.com/hiyouga/LLaMA-Factory/assets/16256802/6ba60acc-e2e2-4bec-b846
 | 
			
		||||
 | 
			
		||||
## 性能指标
 | 
			
		||||
 | 
			
		||||
与 ChatGLM 官方的 [P-Tuning](https://github.com/THUDM/ChatGLM2-6B/tree/main/ptuning) 微调相比,LLaMA-Factory 的 LoRA 微调提供了 **3.7 倍**的加速比,同时在广告文案生成任务上取得了更高的 BLEU 分数。结合 4 比特量化技术,LLaMA-Factory 的 QLoRA 微调进一步降低了 GPU 显存消耗。
 | 
			
		||||
与 ChatGLM 官方的 [P-Tuning](https://github.com/THUDM/ChatGLM2-6B/tree/main/ptuning) 微调相比,LLaMA-Factory 的 LoRA 微调提供了 **3.7 倍**的加速比,同时在广告文案生成任务上取得了更高的 Rouge 分数。结合 4 比特量化技术,LLaMA-Factory 的 QLoRA 微调进一步降低了 GPU 显存消耗。
 | 
			
		||||
 | 
			
		||||

 | 
			
		||||
 | 
			
		||||
- **Training Speed**: 训练阶段每秒处理的样本数量。(批处理大小=4,截断长度=1024)
 | 
			
		||||
- **BLEU Score**: [广告文案生成](https://aclanthology.org/D19-1321.pdf)任务验证集上的 BLEU-4 分数。(批处理大小=4,截断长度=1024)
 | 
			
		||||
- **Rouge Score**: [广告文案生成](https://aclanthology.org/D19-1321.pdf)任务验证集上的 Rouge-2 分数。(批处理大小=4,截断长度=1024)
 | 
			
		||||
- **GPU Memory**: 4 比特量化训练的 GPU 显存峰值。(批处理大小=1,截断长度=1024)
 | 
			
		||||
- 我们在 ChatGLM 的 P-Tuning 中采用 `pre_seq_len=128`,在 LLaMA-Factory 的 LoRA 微调中采用 `lora_rank=32`。
 | 
			
		||||
 | 
			
		||||
 | 
			
		||||
@ -6,7 +6,7 @@
 | 
			
		||||
  <rdf:RDF xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:cc="http://creativecommons.org/ns#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
 | 
			
		||||
   <cc:Work>
 | 
			
		||||
    <dc:type rdf:resource="http://purl.org/dc/dcmitype/StillImage"/>
 | 
			
		||||
    <dc:date>2023-11-18T09:17:37.531653</dc:date>
 | 
			
		||||
    <dc:date>2023-11-18T11:28:03.028228</dc:date>
 | 
			
		||||
    <dc:format>image/svg+xml</dc:format>
 | 
			
		||||
    <dc:creator>
 | 
			
		||||
     <cc:Agent>
 | 
			
		||||
@ -41,12 +41,12 @@ z
 | 
			
		||||
    <g id="xtick_1">
 | 
			
		||||
     <g id="line2d_1">
 | 
			
		||||
      <defs>
 | 
			
		||||
       <path id="m1fc138b5bb" d="M 0 0 
 | 
			
		||||
       <path id="md49eeea5b7" d="M 0 0 
 | 
			
		||||
L 0 3.5 
 | 
			
		||||
" style="stroke: #000000; stroke-width: 0.8"/>
 | 
			
		||||
      </defs>
 | 
			
		||||
      <g>
 | 
			
		||||
       <use xlink:href="#m1fc138b5bb" x="56.236364" y="244.078125" style="stroke: #000000; stroke-width: 0.8"/>
 | 
			
		||||
       <use xlink:href="#md49eeea5b7" x="56.236364" y="244.078125" style="stroke: #000000; stroke-width: 0.8"/>
 | 
			
		||||
      </g>
 | 
			
		||||
     </g>
 | 
			
		||||
     <g id="text_1">
 | 
			
		||||
@ -313,105 +313,39 @@ z
 | 
			
		||||
    <g id="xtick_2">
 | 
			
		||||
     <g id="line2d_2">
 | 
			
		||||
      <g>
 | 
			
		||||
       <use xlink:href="#m1fc138b5bb" x="174.6" y="244.078125" style="stroke: #000000; stroke-width: 0.8"/>
 | 
			
		||||
       <use xlink:href="#md49eeea5b7" x="174.6" y="244.078125" style="stroke: #000000; stroke-width: 0.8"/>
 | 
			
		||||
      </g>
 | 
			
		||||
     </g>
 | 
			
		||||
     <g id="text_2">
 | 
			
		||||
      <!-- BLEU Score -->
 | 
			
		||||
      <g transform="translate(142.529687 258.676562) scale(0.1 -0.1)">
 | 
			
		||||
      <!-- Rouge Score -->
 | 
			
		||||
      <g transform="translate(139.1875 258.598437) scale(0.1 -0.1)">
 | 
			
		||||
       <defs>
 | 
			
		||||
        <path id="DejaVuSans-Bold-42" d="M 2456 2859 
 | 
			
		||||
Q 2741 2859 2887 2984 
 | 
			
		||||
Q 3034 3109 3034 3353 
 | 
			
		||||
Q 3034 3594 2887 3720 
 | 
			
		||||
Q 2741 3847 2456 3847 
 | 
			
		||||
L 1791 3847 
 | 
			
		||||
L 1791 2859 
 | 
			
		||||
L 2456 2859 
 | 
			
		||||
        <path id="DejaVuSans-Bold-52" d="M 2297 2597 
 | 
			
		||||
Q 2675 2597 2839 2737 
 | 
			
		||||
Q 3003 2878 3003 3200 
 | 
			
		||||
Q 3003 3519 2839 3656 
 | 
			
		||||
Q 2675 3794 2297 3794 
 | 
			
		||||
L 1791 3794 
 | 
			
		||||
L 1791 2597 
 | 
			
		||||
L 2297 2597 
 | 
			
		||||
z
 | 
			
		||||
M 2497 819 
 | 
			
		||||
Q 2859 819 3042 972 
 | 
			
		||||
Q 3225 1125 3225 1434 
 | 
			
		||||
Q 3225 1738 3044 1889 
 | 
			
		||||
Q 2863 2041 2497 2041 
 | 
			
		||||
L 1791 2041 
 | 
			
		||||
L 1791 819 
 | 
			
		||||
L 2497 819 
 | 
			
		||||
z
 | 
			
		||||
M 3616 2497 
 | 
			
		||||
Q 4003 2384 4215 2081 
 | 
			
		||||
Q 4428 1778 4428 1338 
 | 
			
		||||
Q 4428 663 3972 331 
 | 
			
		||||
Q 3516 0 2584 0 
 | 
			
		||||
M 1791 1766 
 | 
			
		||||
L 1791 0 
 | 
			
		||||
L 588 0 
 | 
			
		||||
L 588 4666 
 | 
			
		||||
L 2394 4666 
 | 
			
		||||
Q 3366 4666 3802 4372 
 | 
			
		||||
Q 4238 4078 4238 3431 
 | 
			
		||||
Q 4238 3091 4078 2852 
 | 
			
		||||
Q 3919 2613 3616 2497 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-4c" d="M 588 4666 
 | 
			
		||||
L 1791 4666 
 | 
			
		||||
L 1791 909 
 | 
			
		||||
L 3903 909 
 | 
			
		||||
L 3903 0 
 | 
			
		||||
L 588 0 
 | 
			
		||||
L 588 4666 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-45" d="M 588 4666 
 | 
			
		||||
L 3834 4666 
 | 
			
		||||
L 3834 3756 
 | 
			
		||||
L 1791 3756 
 | 
			
		||||
L 1791 2888 
 | 
			
		||||
L 3713 2888 
 | 
			
		||||
L 3713 1978 
 | 
			
		||||
L 1791 1978 
 | 
			
		||||
L 1791 909 
 | 
			
		||||
L 3903 909 
 | 
			
		||||
L 3903 0 
 | 
			
		||||
L 588 0 
 | 
			
		||||
L 588 4666 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-55" d="M 588 4666 
 | 
			
		||||
L 1791 4666 
 | 
			
		||||
L 1791 1869 
 | 
			
		||||
Q 1791 1291 1980 1042 
 | 
			
		||||
Q 2169 794 2597 794 
 | 
			
		||||
Q 3028 794 3217 1042 
 | 
			
		||||
Q 3406 1291 3406 1869 
 | 
			
		||||
L 3406 4666 
 | 
			
		||||
L 4609 4666 
 | 
			
		||||
L 4609 1869 
 | 
			
		||||
Q 4609 878 4112 393 
 | 
			
		||||
Q 3616 -91 2597 -91 
 | 
			
		||||
Q 1581 -91 1084 393 
 | 
			
		||||
Q 588 878 588 1869 
 | 
			
		||||
L 588 4666 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-63" d="M 3366 3391 
 | 
			
		||||
L 3366 2478 
 | 
			
		||||
Q 3138 2634 2908 2709 
 | 
			
		||||
Q 2678 2784 2431 2784 
 | 
			
		||||
Q 1963 2784 1702 2511 
 | 
			
		||||
Q 1441 2238 1441 1747 
 | 
			
		||||
Q 1441 1256 1702 982 
 | 
			
		||||
Q 1963 709 2431 709 
 | 
			
		||||
Q 2694 709 2930 787 
 | 
			
		||||
Q 3166 866 3366 1019 
 | 
			
		||||
L 3366 103 
 | 
			
		||||
Q 3103 6 2833 -42 
 | 
			
		||||
Q 2563 -91 2291 -91 
 | 
			
		||||
Q 1344 -91 809 395 
 | 
			
		||||
Q 275 881 275 1747 
 | 
			
		||||
Q 275 2613 809 3098 
 | 
			
		||||
Q 1344 3584 2291 3584 
 | 
			
		||||
Q 2566 3584 2833 3536 
 | 
			
		||||
Q 3100 3488 3366 3391 
 | 
			
		||||
L 2425 4666 
 | 
			
		||||
Q 3347 4666 3776 4356 
 | 
			
		||||
Q 4206 4047 4206 3378 
 | 
			
		||||
Q 4206 2916 3982 2619 
 | 
			
		||||
Q 3759 2322 3309 2181 
 | 
			
		||||
Q 3556 2125 3751 1926 
 | 
			
		||||
Q 3947 1728 4147 1325 
 | 
			
		||||
L 4800 0 
 | 
			
		||||
L 3519 0 
 | 
			
		||||
L 2950 1159 
 | 
			
		||||
Q 2778 1509 2601 1637 
 | 
			
		||||
Q 2425 1766 2131 1766 
 | 
			
		||||
L 1791 1766 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-6f" d="M 2203 2784 
 | 
			
		||||
@ -434,25 +368,70 @@ Q 275 884 275 1747
 | 
			
		||||
Q 275 2609 786 3096 
 | 
			
		||||
Q 1297 3584 2203 3584 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-75" d="M 500 1363 
 | 
			
		||||
L 500 3500 
 | 
			
		||||
L 1625 3500 
 | 
			
		||||
L 1625 3150 
 | 
			
		||||
Q 1625 2866 1622 2436 
 | 
			
		||||
Q 1619 2006 1619 1863 
 | 
			
		||||
Q 1619 1441 1641 1255 
 | 
			
		||||
Q 1663 1069 1716 984 
 | 
			
		||||
Q 1784 875 1895 815 
 | 
			
		||||
Q 2006 756 2150 756 
 | 
			
		||||
Q 2500 756 2700 1025 
 | 
			
		||||
Q 2900 1294 2900 1772 
 | 
			
		||||
L 2900 3500 
 | 
			
		||||
L 4019 3500 
 | 
			
		||||
L 4019 0 
 | 
			
		||||
L 2900 0 
 | 
			
		||||
L 2900 506 
 | 
			
		||||
Q 2647 200 2364 54 
 | 
			
		||||
Q 2081 -91 1741 -91 
 | 
			
		||||
Q 1134 -91 817 281 
 | 
			
		||||
Q 500 653 500 1363 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-63" d="M 3366 3391 
 | 
			
		||||
L 3366 2478 
 | 
			
		||||
Q 3138 2634 2908 2709 
 | 
			
		||||
Q 2678 2784 2431 2784 
 | 
			
		||||
Q 1963 2784 1702 2511 
 | 
			
		||||
Q 1441 2238 1441 1747 
 | 
			
		||||
Q 1441 1256 1702 982 
 | 
			
		||||
Q 1963 709 2431 709 
 | 
			
		||||
Q 2694 709 2930 787 
 | 
			
		||||
Q 3166 866 3366 1019 
 | 
			
		||||
L 3366 103 
 | 
			
		||||
Q 3103 6 2833 -42 
 | 
			
		||||
Q 2563 -91 2291 -91 
 | 
			
		||||
Q 1344 -91 809 395 
 | 
			
		||||
Q 275 881 275 1747 
 | 
			
		||||
Q 275 2613 809 3098 
 | 
			
		||||
Q 1344 3584 2291 3584 
 | 
			
		||||
Q 2566 3584 2833 3536 
 | 
			
		||||
Q 3100 3488 3366 3391 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
       </defs>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-42"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-4c" x="76.220703"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-45" x="139.941406"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-55" x="208.251953"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-20" x="289.453125"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-53" x="324.267578"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-63" x="396.289062"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-6f" x="455.566406"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-72" x="524.267578"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-65" x="573.583984"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-52"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-6f" x="77.001953"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-75" x="145.703125"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-67" x="216.894531"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-65" x="288.476562"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-20" x="356.298828"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-53" x="391.113281"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-63" x="463.134766"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-6f" x="522.412109"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-72" x="591.113281"/>
 | 
			
		||||
       <use xlink:href="#DejaVuSans-Bold-65" x="640.429688"/>
 | 
			
		||||
      </g>
 | 
			
		||||
     </g>
 | 
			
		||||
    </g>
 | 
			
		||||
    <g id="xtick_3">
 | 
			
		||||
     <g id="line2d_3">
 | 
			
		||||
      <g>
 | 
			
		||||
       <use xlink:href="#m1fc138b5bb" x="292.963636" y="244.078125" style="stroke: #000000; stroke-width: 0.8"/>
 | 
			
		||||
       <use xlink:href="#md49eeea5b7" x="292.963636" y="244.078125" style="stroke: #000000; stroke-width: 0.8"/>
 | 
			
		||||
      </g>
 | 
			
		||||
     </g>
 | 
			
		||||
     <g id="text_3">
 | 
			
		||||
@ -504,6 +483,23 @@ Q 3188 3456 2997 3625
 | 
			
		||||
Q 2806 3794 2456 3794 
 | 
			
		||||
L 1791 3794 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-55" d="M 588 4666 
 | 
			
		||||
L 1791 4666 
 | 
			
		||||
L 1791 1869 
 | 
			
		||||
Q 1791 1291 1980 1042 
 | 
			
		||||
Q 2169 794 2597 794 
 | 
			
		||||
Q 3028 794 3217 1042 
 | 
			
		||||
Q 3406 1291 3406 1869 
 | 
			
		||||
L 3406 4666 
 | 
			
		||||
L 4609 4666 
 | 
			
		||||
L 4609 1869 
 | 
			
		||||
Q 4609 878 4112 393 
 | 
			
		||||
Q 3616 -91 2597 -91 
 | 
			
		||||
Q 1581 -91 1084 393 
 | 
			
		||||
Q 588 878 588 1869 
 | 
			
		||||
L 588 4666 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-4d" d="M 588 4666 
 | 
			
		||||
L 2119 4666 
 | 
			
		||||
@ -582,6 +578,38 @@ Q 1613 2700 1613 2009
 | 
			
		||||
Q 1613 1319 1811 609 
 | 
			
		||||
Q 2009 -100 2413 -844 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-42" d="M 2456 2859 
 | 
			
		||||
Q 2741 2859 2887 2984 
 | 
			
		||||
Q 3034 3109 3034 3353 
 | 
			
		||||
Q 3034 3594 2887 3720 
 | 
			
		||||
Q 2741 3847 2456 3847 
 | 
			
		||||
L 1791 3847 
 | 
			
		||||
L 1791 2859 
 | 
			
		||||
L 2456 2859 
 | 
			
		||||
z
 | 
			
		||||
M 2497 819 
 | 
			
		||||
Q 2859 819 3042 972 
 | 
			
		||||
Q 3225 1125 3225 1434 
 | 
			
		||||
Q 3225 1738 3044 1889 
 | 
			
		||||
Q 2863 2041 2497 2041 
 | 
			
		||||
L 1791 2041 
 | 
			
		||||
L 1791 819 
 | 
			
		||||
L 2497 819 
 | 
			
		||||
z
 | 
			
		||||
M 3616 2497 
 | 
			
		||||
Q 4003 2384 4215 2081 
 | 
			
		||||
Q 4428 1778 4428 1338 
 | 
			
		||||
Q 4428 663 3972 331 
 | 
			
		||||
Q 3516 0 2584 0 
 | 
			
		||||
L 588 0 
 | 
			
		||||
L 588 4666 
 | 
			
		||||
L 2394 4666 
 | 
			
		||||
Q 3366 4666 3802 4372 
 | 
			
		||||
Q 4238 4078 4238 3431 
 | 
			
		||||
Q 4238 3091 4078 2852 
 | 
			
		||||
Q 3919 2613 3616 2497 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
        <path id="DejaVuSans-Bold-29" d="M 513 -844 
 | 
			
		||||
Q 913 -100 1113 609 
 | 
			
		||||
@ -622,7 +650,7 @@ L 56.236364 244.078125
 | 
			
		||||
L 56.236364 195.339663 
 | 
			
		||||
L 22.418182 195.339663 
 | 
			
		||||
z
 | 
			
		||||
" clip-path="url(#pbb30b31dec)" style="fill: #6baed6"/>
 | 
			
		||||
" clip-path="url(#p080f205d85)" style="fill: #6baed6"/>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="patch_4">
 | 
			
		||||
    <path d="M 140.781818 244.078125 
 | 
			
		||||
@ -630,7 +658,7 @@ L 174.6 244.078125
 | 
			
		||||
L 174.6 146.601202 
 | 
			
		||||
L 140.781818 146.601202 
 | 
			
		||||
z
 | 
			
		||||
" clip-path="url(#pbb30b31dec)" style="fill: #6baed6"/>
 | 
			
		||||
" clip-path="url(#p080f205d85)" style="fill: #6baed6"/>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="patch_5">
 | 
			
		||||
    <path d="M 259.145455 244.078125 
 | 
			
		||||
@ -638,7 +666,7 @@ L 292.963636 244.078125
 | 
			
		||||
L 292.963636 205.087356 
 | 
			
		||||
L 259.145455 205.087356 
 | 
			
		||||
z
 | 
			
		||||
" clip-path="url(#pbb30b31dec)" style="fill: #6baed6"/>
 | 
			
		||||
" clip-path="url(#p080f205d85)" style="fill: #6baed6"/>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="patch_6">
 | 
			
		||||
    <path d="M 56.236364 244.078125 
 | 
			
		||||
@ -646,7 +674,7 @@ L 90.054545 244.078125
 | 
			
		||||
L 90.054545 32.878125 
 | 
			
		||||
L 56.236364 32.878125 
 | 
			
		||||
z
 | 
			
		||||
" clip-path="url(#pbb30b31dec)" style="fill: #3182bd"/>
 | 
			
		||||
" clip-path="url(#p080f205d85)" style="fill: #3182bd"/>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="patch_7">
 | 
			
		||||
    <path d="M 174.6 244.078125 
 | 
			
		||||
@ -654,7 +682,7 @@ L 208.418182 244.078125
 | 
			
		||||
L 208.418182 130.355048 
 | 
			
		||||
L 174.6 130.355048 
 | 
			
		||||
z
 | 
			
		||||
" clip-path="url(#pbb30b31dec)" style="fill: #3182bd"/>
 | 
			
		||||
" clip-path="url(#p080f205d85)" style="fill: #3182bd"/>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="patch_8">
 | 
			
		||||
    <path d="M 292.963636 244.078125 
 | 
			
		||||
@ -662,7 +690,7 @@ L 326.781818 244.078125
 | 
			
		||||
L 326.781818 218.084279 
 | 
			
		||||
L 292.963636 218.084279 
 | 
			
		||||
z
 | 
			
		||||
" clip-path="url(#pbb30b31dec)" style="fill: #3182bd"/>
 | 
			
		||||
" clip-path="url(#p080f205d85)" style="fill: #3182bd"/>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="patch_9">
 | 
			
		||||
    <path d="M 7.2 244.078125 
 | 
			
		||||
@ -766,7 +794,7 @@ z
 | 
			
		||||
    </g>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="text_5">
 | 
			
		||||
    <!-- 7.71 -->
 | 
			
		||||
    <!-- 7.20 -->
 | 
			
		||||
    <g transform="translate(145.354972 144.521514) scale(0.1 -0.1)">
 | 
			
		||||
     <defs>
 | 
			
		||||
      <path id="DejaVuSans-Bold-37" d="M 428 4666 
 | 
			
		||||
@ -779,26 +807,6 @@ L 428 3781
 | 
			
		||||
L 428 4666 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
     </defs>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-37"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-2e" x="69.580078"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-37" x="107.568359"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-31" x="177.148438"/>
 | 
			
		||||
    </g>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="text_6">
 | 
			
		||||
    <!-- 5.78 -->
 | 
			
		||||
    <g transform="translate(263.718608 203.007668) scale(0.1 -0.1)">
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-35"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-2e" x="69.580078"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-37" x="107.568359"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-38" x="177.148438"/>
 | 
			
		||||
    </g>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="text_7">
 | 
			
		||||
    <!-- 21.67 -->
 | 
			
		||||
    <g transform="translate(57.330611 30.798438) scale(0.1 -0.1)">
 | 
			
		||||
     <defs>
 | 
			
		||||
      <path id="DejaVuSans-Bold-32" d="M 1844 884 
 | 
			
		||||
L 3897 884 
 | 
			
		||||
L 3897 0 
 | 
			
		||||
@ -821,6 +829,47 @@ Q 3472 2313 2841 1759
 | 
			
		||||
L 1844 884 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
      <path id="DejaVuSans-Bold-30" d="M 2944 2338 
 | 
			
		||||
Q 2944 3213 2780 3570 
 | 
			
		||||
Q 2616 3928 2228 3928 
 | 
			
		||||
Q 1841 3928 1675 3570 
 | 
			
		||||
Q 1509 3213 1509 2338 
 | 
			
		||||
Q 1509 1453 1675 1090 
 | 
			
		||||
Q 1841 728 2228 728 
 | 
			
		||||
Q 2613 728 2778 1090 
 | 
			
		||||
Q 2944 1453 2944 2338 
 | 
			
		||||
z
 | 
			
		||||
M 4147 2328 
 | 
			
		||||
Q 4147 1169 3647 539 
 | 
			
		||||
Q 3147 -91 2228 -91 
 | 
			
		||||
Q 1306 -91 806 539 
 | 
			
		||||
Q 306 1169 306 2328 
 | 
			
		||||
Q 306 3491 806 4120 
 | 
			
		||||
Q 1306 4750 2228 4750 
 | 
			
		||||
Q 3147 4750 3647 4120 
 | 
			
		||||
Q 4147 3491 4147 2328 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
     </defs>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-37"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-2e" x="69.580078"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-32" x="107.568359"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-30" x="177.148438"/>
 | 
			
		||||
    </g>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="text_6">
 | 
			
		||||
    <!-- 5.78 -->
 | 
			
		||||
    <g transform="translate(263.718608 203.007668) scale(0.1 -0.1)">
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-35"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-2e" x="69.580078"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-37" x="107.568359"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-38" x="177.148438"/>
 | 
			
		||||
    </g>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="text_7">
 | 
			
		||||
    <!-- 21.67 -->
 | 
			
		||||
    <g transform="translate(57.330611 30.798438) scale(0.1 -0.1)">
 | 
			
		||||
     <defs>
 | 
			
		||||
      <path id="DejaVuSans-Bold-36" d="M 2316 2303 
 | 
			
		||||
Q 2000 2303 1842 2098 
 | 
			
		||||
Q 1684 1894 1684 1484 
 | 
			
		||||
@ -860,35 +909,46 @@ z
 | 
			
		||||
    </g>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="text_8">
 | 
			
		||||
    <!-- 8.07 -->
 | 
			
		||||
    <!-- 7.36 -->
 | 
			
		||||
    <g transform="translate(179.173153 128.275361) scale(0.1 -0.1)">
 | 
			
		||||
     <defs>
 | 
			
		||||
      <path id="DejaVuSans-Bold-30" d="M 2944 2338 
 | 
			
		||||
Q 2944 3213 2780 3570 
 | 
			
		||||
Q 2616 3928 2228 3928 
 | 
			
		||||
Q 1841 3928 1675 3570 
 | 
			
		||||
Q 1509 3213 1509 2338 
 | 
			
		||||
Q 1509 1453 1675 1090 
 | 
			
		||||
Q 1841 728 2228 728 
 | 
			
		||||
Q 2613 728 2778 1090 
 | 
			
		||||
Q 2944 1453 2944 2338 
 | 
			
		||||
z
 | 
			
		||||
M 4147 2328 
 | 
			
		||||
Q 4147 1169 3647 539 
 | 
			
		||||
Q 3147 -91 2228 -91 
 | 
			
		||||
Q 1306 -91 806 539 
 | 
			
		||||
Q 306 1169 306 2328 
 | 
			
		||||
Q 306 3491 806 4120 
 | 
			
		||||
Q 1306 4750 2228 4750 
 | 
			
		||||
Q 3147 4750 3647 4120 
 | 
			
		||||
Q 4147 3491 4147 2328 
 | 
			
		||||
      <path id="DejaVuSans-Bold-33" d="M 2981 2516 
 | 
			
		||||
Q 3453 2394 3698 2092 
 | 
			
		||||
Q 3944 1791 3944 1325 
 | 
			
		||||
Q 3944 631 3412 270 
 | 
			
		||||
Q 2881 -91 1863 -91 
 | 
			
		||||
Q 1503 -91 1142 -33 
 | 
			
		||||
Q 781 25 428 141 
 | 
			
		||||
L 428 1069 
 | 
			
		||||
Q 766 900 1098 814 
 | 
			
		||||
Q 1431 728 1753 728 
 | 
			
		||||
Q 2231 728 2486 893 
 | 
			
		||||
Q 2741 1059 2741 1369 
 | 
			
		||||
Q 2741 1688 2480 1852 
 | 
			
		||||
Q 2219 2016 1709 2016 
 | 
			
		||||
L 1228 2016 
 | 
			
		||||
L 1228 2791 
 | 
			
		||||
L 1734 2791 
 | 
			
		||||
Q 2188 2791 2409 2933 
 | 
			
		||||
Q 2631 3075 2631 3366 
 | 
			
		||||
Q 2631 3634 2415 3781 
 | 
			
		||||
Q 2200 3928 1806 3928 
 | 
			
		||||
Q 1516 3928 1219 3862 
 | 
			
		||||
Q 922 3797 628 3669 
 | 
			
		||||
L 628 4550 
 | 
			
		||||
Q 984 4650 1334 4700 
 | 
			
		||||
Q 1684 4750 2022 4750 
 | 
			
		||||
Q 2931 4750 3382 4451 
 | 
			
		||||
Q 3834 4153 3834 3553 
 | 
			
		||||
Q 3834 3144 3618 2883 
 | 
			
		||||
Q 3403 2622 2981 2516 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
     </defs>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-38"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-37"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-2e" x="69.580078"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-30" x="107.568359"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-37" x="177.148438"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-33" x="107.568359"/>
 | 
			
		||||
     <use xlink:href="#DejaVuSans-Bold-36" x="177.148438"/>
 | 
			
		||||
    </g>
 | 
			
		||||
   </g>
 | 
			
		||||
   <g id="text_9">
 | 
			
		||||
@ -988,6 +1048,15 @@ L 641 3500
 | 
			
		||||
L 641 4494 
 | 
			
		||||
L 1759 4494 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
      <path id="DejaVuSans-Bold-4c" d="M 588 4666 
 | 
			
		||||
L 1791 4666 
 | 
			
		||||
L 1791 909 
 | 
			
		||||
L 3903 909 
 | 
			
		||||
L 3903 0 
 | 
			
		||||
L 588 0 
 | 
			
		||||
L 588 4666 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
      <path id="DejaVuSans-Bold-2d" d="M 347 2297 
 | 
			
		||||
L 2309 2297 
 | 
			
		||||
@ -1077,31 +1146,6 @@ z
 | 
			
		||||
    <g id="text_11">
 | 
			
		||||
     <!-- ChatGLM P-Tuning -->
 | 
			
		||||
     <g transform="translate(231.507812 38.916562) scale(0.1 -0.1)">
 | 
			
		||||
      <defs>
 | 
			
		||||
       <path id="DejaVuSans-Bold-75" d="M 500 1363 
 | 
			
		||||
L 500 3500 
 | 
			
		||||
L 1625 3500 
 | 
			
		||||
L 1625 3150 
 | 
			
		||||
Q 1625 2866 1622 2436 
 | 
			
		||||
Q 1619 2006 1619 1863 
 | 
			
		||||
Q 1619 1441 1641 1255 
 | 
			
		||||
Q 1663 1069 1716 984 
 | 
			
		||||
Q 1784 875 1895 815 
 | 
			
		||||
Q 2006 756 2150 756 
 | 
			
		||||
Q 2500 756 2700 1025 
 | 
			
		||||
Q 2900 1294 2900 1772 
 | 
			
		||||
L 2900 3500 
 | 
			
		||||
L 4019 3500 
 | 
			
		||||
L 4019 0 
 | 
			
		||||
L 2900 0 
 | 
			
		||||
L 2900 506 
 | 
			
		||||
Q 2647 200 2364 54 
 | 
			
		||||
Q 2081 -91 1741 -91 
 | 
			
		||||
Q 1134 -91 817 281 
 | 
			
		||||
Q 500 653 500 1363 
 | 
			
		||||
z
 | 
			
		||||
" transform="scale(0.015625)"/>
 | 
			
		||||
      </defs>
 | 
			
		||||
      <use xlink:href="#DejaVuSans-Bold-43"/>
 | 
			
		||||
      <use xlink:href="#DejaVuSans-Bold-68" x="73.388672"/>
 | 
			
		||||
      <use xlink:href="#DejaVuSans-Bold-61" x="144.580078"/>
 | 
			
		||||
@ -1165,7 +1209,7 @@ z
 | 
			
		||||
  </g>
 | 
			
		||||
 </g>
 | 
			
		||||
 <defs>
 | 
			
		||||
  <clipPath id="pbb30b31dec">
 | 
			
		||||
  <clipPath id="p080f205d85">
 | 
			
		||||
   <rect x="7.2" y="22.318125" width="334.8" height="221.76"/>
 | 
			
		||||
  </clipPath>
 | 
			
		||||
 </defs>
 | 
			
		||||
 | 
			
		||||
| 
		 Before Width: | Height: | Size: 28 KiB After Width: | Height: | Size: 29 KiB  | 
		Loading…
	
	
			
			x
			
			
		
	
		Reference in New Issue
	
	Block a user