support InternLM

Former-commit-id: a454ef7d57d9c06302d51464cfe39f6d0c48c5a8
This commit is contained in:
hiyouga
2023-07-07 11:02:28 +08:00
parent 601b1747d1
commit 113cdaf1cb
3 changed files with 15 additions and 2 deletions

View File

@@ -9,6 +9,8 @@
## Changelog
[23/07/07] Now we support training the InternLM-7B model in this repo. Try `--model_name_or_path internlm/internlm-7b` argument to use the InternLM model. Remember to use `--prompt_template intern` argument when using the InternLM-chat model.
[23/07/05] Now we support training the Falcon-7B/40B models in this repo. Try `--model_name_or_path tiiuae/falcon-7b` and `--lora_target query_key_value` arguments to use the Falcon model.
[23/06/29] We provide a reproducible example of training a chat model using instruction-following datasets, see this [HuggingFace Repo](https://huggingface.co/hiyouga/baichuan-7b-sft) for details.