Commit Graph

69 Commits

Author SHA1 Message Date
hiyouga
84b7486885 fix layer norm dtype 2023-09-28 00:25:55 +08:00
hiyouga
465ee8119a add MMLU and C-Eval script 2023-09-23 00:34:17 +08:00
hiyouga
b218c271ed remove PeftTrainer 2023-09-10 22:23:23 +08:00
hiyouga
0531886e1f update baichuan2 template 2023-09-06 21:43:06 +08:00
hiyouga
62ce65c628 add Baichuan2 models 2023-09-06 18:36:04 +08:00
hiyouga
a9d1fb72f7 refactor dataset_attr, add eos in pt, fix #757 2023-09-01 19:00:45 +08:00
codemayq
c0e4d1e81b add dataset stage and filter dataset when stage chosen in webui 2023-08-23 18:54:23 +08:00
hiyouga
9d0f6214b6 update webui 2023-08-14 22:45:26 +08:00
codemayq
79c68e5527 add template match and stage in webui 2023-08-14 20:42:59 +08:00
hiyouga
fa940c17b8 support rope scaling, fix #475 #476 #478 2023-08-12 20:46:27 +08:00
codemayq
6bc8e9866d add sft script preview in webui 2023-08-12 13:53:55 +08:00
hiyouga
a48cb0d474 Release v0.1.6 2023-08-11 23:25:57 +08:00
hiyouga
3ec4351cfd support DPO training (2305.18290) 2023-08-11 03:02:53 +08:00
hiyouga
69744c17e8 support interleave probs 2023-08-04 21:27:35 +08:00
hiyouga
4d1641c1bf update UI, fix #212 2023-07-20 22:09:06 +08:00
hiyouga
7a3ade8c69 support LLaMA-2 2023-07-19 16:42:14 +08:00
hiyouga
262252d67b a monkey patch for lora_target 2023-07-18 00:31:40 +08:00
hiyouga
f8193e8009 release v0.1.0 2023-07-18 00:18:25 +08:00
hiyouga
f751376613 modity code structure 2023-07-15 16:54:28 +08:00