From a994279a3a06d850711c435df9f9063836bcdecf Mon Sep 17 00:00:00 2001 From: hiyouga Date: Sun, 14 Jan 2024 00:17:28 +0800 Subject: [PATCH] Update README_zh.md Former-commit-id: 3c8e72f585fbfd6738a0df6cfc00abff65205e04 --- README_zh.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README_zh.md b/README_zh.md index 7e8d3e3c..25c8fc9f 100644 --- a/README_zh.md +++ b/README_zh.md @@ -100,6 +100,7 @@ https://github.com/hiyouga/LLaMA-Factory/assets/16256802/6ba60acc-e2e2-4bec-b846 | [BLOOM](https://huggingface.co/bigscience/bloom) | 560M/1.1B/1.7B/3B/7.1B/176B | query_key_value | - | | [BLOOMZ](https://huggingface.co/bigscience/bloomz) | 560M/1.1B/1.7B/3B/7.1B/176B | query_key_value | - | | [ChatGLM3](https://huggingface.co/THUDM/chatglm3-6b) | 6B | query_key_value | chatglm3 | +| [Deepseek (MoE)](https://huggingface.co/deepseek-ai) | 7B/16B/67B | q_proj,v_proj | deepseek | | [Falcon](https://huggingface.co/tiiuae) | 7B/40B/180B | query_key_value | falcon | | [InternLM](https://huggingface.co/internlm) | 7B/20B | q_proj,v_proj | intern | | [LLaMA](https://github.com/facebookresearch/llama) | 7B/13B/33B/65B | q_proj,v_proj | - |