34 Commits

Author	SHA1	Message	Date
hiyouga	88a1bc9773	lint	2024-02-07 01:10:04 +08:00
hiyouga	db0ab4d601	fix reserved label len	2024-02-04 17:54:26 +08:00
hiyouga	638234ceee	format style	2024-01-20 20:15:56 +08:00
hiyouga	d9f1cae351	support function calling	2024-01-18 09:54:23 +08:00
hiyouga	0bbf7118df	fix #1909	2023-12-23 14:42:20 +08:00
hiyouga	0a9c6e0146	support system column #1765	2023-12-12 19:45:59 +08:00
hiyouga	d5b2c57a35	fix modelscope data hub	2023-12-12 18:33:06 +08:00
hoshi-hiyouga	6382efec52	Merge branch 'main' into feat/support_ms	2023-12-12 17:55:32 +08:00
hiyouga	28d5de7e78	fix #1784	2023-12-09 20:53:18 +08:00
yuze.zyz	9c2247d700	support ms dataset	2023-12-08 18:00:57 +08:00
hiyouga	a5a248d569	fix err hint	2023-12-01 17:13:22 +08:00
hiyouga	d125ef5535	fix #1494	2023-11-14 18:07:20 +08:00
hiyouga	442aefb925	refactor evaluation, upgrade trl to 074	2023-11-13 22:20:35 +08:00
hiyouga	cc8ffa10d8	update data readme (zh)	2023-11-02 23:42:49 +08:00
hiyouga	a837172413	support sharegpt format, add datasets	2023-11-02 23:10:04 +08:00
hiyouga	dff128c7e3	fix #1356	2023-11-02 16:51:52 +08:00
hiyouga	083787dbfe	fix #1325	2023-11-01 23:38:49 +08:00
hiyouga	3fe7df628d	support dataset cache	2023-10-26 21:48:45 +08:00
hiyouga	b665e9e133	fix #1232	2023-10-20 23:28:52 +08:00
hiyouga	7a11a42dfd	fix #1218	2023-10-19 16:17:41 +08:00
hiyouga	af18b0dce7	fix #1184	2023-10-14 19:20:11 +08:00
hiyouga	90375f600d	support LongLoRA	2023-09-27 21:55:50 +08:00
hiyouga	338b8664ed	fix #944	2023-09-21 19:51:02 +08:00
hiyouga	8ea32e4046	change to right-padding, update reward score #803	2023-09-08 20:04:31 +08:00
hiyouga	a9d1fb72f7	refactor dataset_attr, add eos in pt, fix #757	2023-09-01 19:00:45 +08:00
codemayq	ba94c8729d	add stage in DatasetAttr	2023-08-23 20:54:53 +08:00
hiyouga	7407d9daa1	fix system prompt	2023-08-16 01:35:52 +08:00
hiyouga	3ec4351cfd	support DPO training (2305.18290)	2023-08-11 03:02:53 +08:00
hiyouga	d86ea314a1	support val set in streaming mode	2023-08-09 23:00:26 +08:00
hiyouga	69744c17e8	support interleave probs	2023-08-04 21:27:35 +08:00
hiyouga	0411a4b3e1	support streaming data, fix #284 #274 #268	2023-07-31 23:33:00 +08:00
hiyouga	513e1f1ec9	Update data_args.py	2023-07-28 17:42:41 +08:00
hiyouga	657cf0f55a	create chat model	2023-07-15 19:26:20 +08:00
hiyouga	f751376613	modity code structure	2023-07-15 16:54:28 +08:00