support InternLM

Former-commit-id: a2f507c562
This commit is contained in:
hiyouga
2023-07-07 11:02:28 +08:00
parent 50a27509a3
commit 8b4ef062b7
3 changed files with 15 additions and 2 deletions

View File

@@ -9,6 +9,8 @@
## Changelog
[23/07/07] Now we support training the InternLM-7B model in this repo. Try `--model_name_or_path internlm/internlm-7b` argument to use the InternLM model. Remember to use `--prompt_template intern` argument when using the InternLM-chat model.
[23/07/05] Now we support training the Falcon-7B/40B models in this repo. Try `--model_name_or_path tiiuae/falcon-7b` and `--lora_target query_key_value` arguments to use the Falcon model.
[23/06/29] We provide a reproducible example of training a chat model using instruction-following datasets, see this [HuggingFace Repo](https://huggingface.co/hiyouga/baichuan-7b-sft) for details.