16 Commits

Author SHA1 Message Date
hiyouga
096c31bfb6 patch for gemma cpt
Former-commit-id: 70a3052dd8a2d1322fa01ab19e369e465842d416
2024-03-12 21:21:54 +08:00
hiyouga
868444e124 allow non-packing pretraining
Former-commit-id: bdb496644ce2c18806fc4fdae1fedcb3e5b5f808
2024-03-09 22:21:46 +08:00
hiyouga
279ba19ef7 fix data entry
Former-commit-id: 354f13c01a31d468c214cd35acf614433392e96a
2024-02-23 18:29:24 +08:00
hiyouga
0fcb931f18 support lora for llama pro
Former-commit-id: 9aeb404a946795d6c4fa3cb45e3e96ffeec13646
2024-02-21 02:17:22 +08:00
hiyouga
e87a17464f fix #2516
Former-commit-id: 02c8c55ce36b242338219a9a9132edfc52302206
2024-02-20 20:44:24 +08:00
hiyouga
91b7fd1ec3 fix reserved label len
Former-commit-id: db0ab4d601b5e68660c00f07998ff26a8745ba90
2024-02-04 17:54:26 +08:00
hiyouga
a9e58740f5 fix #2376
Former-commit-id: 4ecadc35122340b3e520804270c1c1d16c696830
2024-02-03 23:14:31 +08:00
hiyouga
509e35ffc8 fix #2282 and update tool prompt
Former-commit-id: b2fb0eca56ee835438cc20e83f36ac3f6eb95c83
2024-01-22 22:27:30 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee1b19716e45b6e5f4ea54d9122da4df
2024-01-20 20:15:56 +08:00
hiyouga
7f12aedc08 enable cutoff len
Former-commit-id: f1067d2b585cf24b3e48463692ac99a8222161c9
2024-01-18 12:25:42 +08:00
hiyouga
1323b8f102 add tool test
Former-commit-id: 83dbfce8c30bc1183a5c86fb77a5676bf0b753af
2024-01-18 10:26:26 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae35150cce594a7abd96dd2beb811fa33f2
2024-01-18 09:54:23 +08:00
hiyouga
c14bf033a3 fix #2014
Former-commit-id: ce2156eaa83e2b572f4198a1eb77a835fb502319
2023-12-29 15:17:22 +08:00
hiyouga
f64be8ee84 optimize data loading logic
Former-commit-id: ec1fe1daa98c61f62c753b22847de028b5c5cded
2023-12-20 16:15:41 +08:00
hiyouga
633624dc3c fix #1909
Former-commit-id: c6abbbfe90dcb0e832f73f0c611fc32eaa7ea78d
2023-12-20 16:11:07 +08:00
hiyouga
06a4820836 disentangle model from tuner and rename modules
Former-commit-id: 4736344eb1595ee023a50d49e8118f4eee46305f
2023-11-15 16:29:09 +08:00