hiyouga
|
4581d09fa6
|
fix #944
Former-commit-id: 338b8664edea5ae65192ac657bb013581245ae15
|
2023-09-21 19:51:02 +08:00 |
|
hiyouga
|
8ab5566dc0
|
support FlashAttention2
Former-commit-id: d8aa1404bee9842f3e4cd037ad8d66c85470ac37
|
2023-09-10 20:43:56 +08:00 |
|
hiyouga
|
9ed4bb63d4
|
change to right-padding, update reward score #803
Former-commit-id: 8ea32e4046d75ddfa9517669e9de9f48fea720c6
|
2023-09-08 20:04:31 +08:00 |
|
hiyouga
|
a4fd976048
|
refactor dataset_attr, add eos in pt, fix #757
Former-commit-id: a9d1fb72f791ae57a4d12f4e3a7e2abccf6a7077
|
2023-09-01 19:00:45 +08:00 |
|
codemayq
|
2b979d39f2
|
add stage in DatasetAttr
Former-commit-id: ba94c8729dd8c90bedf7079a6978e150fc92b737
|
2023-08-23 20:54:53 +08:00 |
|
hiyouga
|
802494e20a
|
update template
Former-commit-id: 4318347d3f1982c773dad1074636ec7b550770fd
|
2023-08-22 19:46:09 +08:00 |
|
hiyouga
|
b88f0b396c
|
support ppo score norm (trl 0.5.1.dev required)
Former-commit-id: 53e33418d02ee0f34c783e30ae510b811308c598
|
2023-08-18 12:02:42 +08:00 |
|
hiyouga
|
03edfd07e7
|
fix PPO trainer #551 , update readme
Former-commit-id: 90205244186df558cd6b0000728d638348db3a10
|
2023-08-18 11:43:10 +08:00 |
|
hiyouga
|
edc15c62fa
|
fix system prompt
Former-commit-id: 7407d9daa16bf6b3cd5002e16b2c53e402d2bc39
|
2023-08-16 01:35:52 +08:00 |
|
hiyouga
|
3f0a2d6adc
|
support rope scaling, fix #475 #476 #478
Former-commit-id: fa940c17b8d3e379af08804003f1a522c1cd6ac4
|
2023-08-12 20:46:27 +08:00 |
|
hiyouga
|
79f4ba0d26
|
Release v0.1.6
Former-commit-id: a48cb0d474ef0648a97387daf5f623498b5e3ee6
|
2023-08-11 23:25:57 +08:00 |
|
hiyouga
|
abdfa26d06
|
support DPO training (2305.18290)
Former-commit-id: 3ec4351cfdaf2aefcc7d13345e19d79874ed61d3
|
2023-08-11 03:02:53 +08:00 |
|
jiongxuc
|
7ffd961b8b
|
huggingface login for projects must login while running
Former-commit-id: 3e000c2b60c2e29bcafcf8d39c1a5d567ae2491c
|
2023-08-10 14:57:12 +08:00 |
|
hiyouga
|
6404167ab7
|
support val set in streaming mode
Former-commit-id: d86ea314a197fd821770d895e988c48d46679047
|
2023-08-09 23:00:26 +08:00 |
|
hiyouga
|
921778a7cf
|
update args spec
Former-commit-id: 5453b93db04ee26223b7616dfdf26e749bea7473
|
2023-08-07 15:23:35 +08:00 |
|
hiyouga
|
b32ed1d7be
|
support interleave probs
Former-commit-id: 69744c17e8180e0ad549b57d575454724b820d01
|
2023-08-04 21:27:35 +08:00 |
|
hiyouga
|
9c84c4ed5d
|
support Qwen-7B, fix InternLM-7B inference
Former-commit-id: 87f8f830e20aa839e089559c1d038954742000ef
|
2023-08-03 15:53:32 +08:00 |
|
hiyouga
|
e80b75b560
|
support streaming data, fix #284 #274 #268
Former-commit-id: 0411a4b3e122e7907441bc7a64b004948741a620
|
2023-07-31 23:33:00 +08:00 |
|
hiyouga
|
2a664783c3
|
Update data_args.py
Former-commit-id: 513e1f1ec952dc5901d90dd34e32440230bca3f0
|
2023-07-28 17:42:41 +08:00 |
|
hiyouga
|
2e0342dc54
|
fix #194
Former-commit-id: 8f7819fcaa00f6ddcf59552c2866d8fc5659d0e9
|
2023-07-19 17:07:33 +08:00 |
|
hiyouga
|
b8b38a9ade
|
create chat model
Former-commit-id: 657cf0f55a7f0886bc837bdd44528971dc5e5caa
|
2023-07-15 19:26:20 +08:00 |
|
hiyouga
|
a696148d6b
|
modity code structure
Former-commit-id: f75137661358f9070bc70c341dfa2cc5fd69cf94
|
2023-07-15 16:54:28 +08:00 |
|