10 Commits

Author SHA1 Message Date
hiyouga
0fbaa42752 refactor constants
Former-commit-id: 3697a3dc9a0be8141951dfe65812844f66059517
2023-11-10 14:16:10 +08:00
hiyouga
3d40bdb600 upgrade peft, fix #1088 #1411
Former-commit-id: b2a60905f384ada92618bf21301fe96dac1c10bf
2023-11-07 16:13:36 +08:00
hiyouga
daeff710eb update neftune logic
Former-commit-id: 7de7174ce3ea804b2ba58560193cda25cbd675ef
2023-10-22 17:42:13 +08:00
hiyouga
59fd3155a1 add new options in webui
Former-commit-id: f793ca0a2c9e7abab360658d0e65506c1f97e1ae
2023-10-22 17:17:58 +08:00
hiyouga
ce112dc744 fix recursion error
Former-commit-id: b79ca8781e368b17c83e585f1644346628d7e2de
2023-10-22 16:28:37 +08:00
hiyouga
d6c77d9196 reimplement neftune
Former-commit-id: 7b4acf7265b04cc4a674b3dcafdb90e76f149e39
2023-10-22 16:15:08 +08:00
hiyouga
c9d1cd108d refactor model_dtype, fix PPO trainer
Former-commit-id: 2818af0b0967d7695f27658acac0b7e2c2728e5d
2023-10-11 23:16:01 +08:00
hiyouga
deb17942ab fix layer norm dtype
Former-commit-id: 84b7486885c600e5e65c5ba9095d56ecc2502977
2023-09-28 00:25:55 +08:00
hiyouga
f865d0bd51 fix lora target
Former-commit-id: a51b7c98acc599de5ed2eaeeebe7b184105722c5
2023-09-09 17:04:45 +08:00
hiyouga
c818a7ff60 support lora target auto find
Former-commit-id: bca1a247bcef51dced59655c8a14c197569367ca
2023-09-09 15:38:37 +08:00