Commit Graph

64 Commits

Author SHA1 Message Date
hiyouga
91b7fd1ec3 fix reserved label len
Former-commit-id: db0ab4d601
2024-02-04 17:54:26 +08:00
hiyouga
961368a8c4 fix #2397
Former-commit-id: 51df865734
2024-02-03 23:45:31 +08:00
hiyouga
a9e58740f5 fix #2376
Former-commit-id: 4ecadc3512
2024-02-03 23:14:31 +08:00
hiyouga
40514bf865 support minicpm #2404
Former-commit-id: 901faa16cc
2024-02-03 22:36:46 +08:00
Fallen Angel
b4c776fa93 fix eos_token_id=0 bug
when eos_token_id=0, will never add eos_token

Former-commit-id: 3399c0d645
2024-02-02 17:34:48 +08:00
hiyouga
509e35ffc8 fix #2282 and update tool prompt
Former-commit-id: b2fb0eca56
2024-01-22 22:27:30 +08:00
hiyouga
9898712a24 add orion models
Former-commit-id: 6fc2d5cc03
2024-01-22 21:26:53 +08:00
hiyouga
48cab43cb5 add array param format
Former-commit-id: 486cc8d360
2024-01-21 22:17:48 +08:00
hiyouga
8c10530181 tiny fix
Former-commit-id: 3bc301be02
2024-01-21 13:26:12 +08:00
hiyouga
1fbf83acc2 finish agent
Former-commit-id: 3e982cc714
2024-01-21 01:47:33 +08:00
hiyouga
865f48f1c3 fix api
Former-commit-id: 55f707196e
2024-01-21 00:03:09 +08:00
hiyouga
cb8abce2f3 fix internlm2 template
Former-commit-id: a9c18255aa
2024-01-20 23:33:50 +08:00
hiyouga
0be7b16955 fix cli_demo
Former-commit-id: c550987a72
2024-01-20 23:27:10 +08:00
hiyouga
baaa0acdf1 fix #2260
Former-commit-id: cf818a2598
2024-01-20 23:22:09 +08:00
hiyouga
4ac36c14ae release v0.5.0
Former-commit-id: 71cfdc2658
2024-01-20 20:21:39 +08:00
hiyouga
b27e91222c format style
Former-commit-id: 638234ceee
2024-01-20 20:15:56 +08:00
hiyouga
2f7684a8ee fix tests
Former-commit-id: f6d6e00337
2024-01-20 19:58:04 +08:00
hiyouga
397eb8fbb9 fix #2249
Former-commit-id: 12043aab9c
2024-01-19 21:44:32 +08:00
hiyouga
a9fe47a848 fix function formatter
Former-commit-id: 35aef8b287
2024-01-18 16:01:07 +08:00
hiyouga
f7fcfeaa47 fix templates
Former-commit-id: a73a979afd
2024-01-18 14:49:52 +08:00
hiyouga
f266d473b8 fix pretrain data loader
Former-commit-id: 5ff10fac4f
2024-01-18 14:42:52 +08:00
hiyouga
e95c0242a8 fix dataset
Former-commit-id: 487dee066f
2024-01-18 12:59:30 +08:00
hiyouga
7f12aedc08 enable cutoff len
Former-commit-id: f1067d2b58
2024-01-18 12:25:42 +08:00
hiyouga
1323b8f102 add tool test
Former-commit-id: 83dbfce8c3
2024-01-18 10:26:26 +08:00
hiyouga
4e3bfb799d support function calling
Former-commit-id: d9f1cae351
2024-01-18 09:54:23 +08:00
hiyouga
21020e51ca support solar 10.7B #1907
Former-commit-id: bf73224f33
2024-01-14 00:30:30 +08:00
hiyouga
4dc16df570 fix #2147
Former-commit-id: 9aa1a2fc17
2024-01-12 03:30:56 +08:00
hiyouga
a78cd5c5ad fix qwen template
Former-commit-id: ed216bbc46
2024-01-05 16:14:56 +08:00
hiyouga
c14bf033a3 fix #2014
Former-commit-id: ce2156eaa8
2023-12-29 15:17:22 +08:00
hiyouga
16688b773a fix export format
Former-commit-id: e165354fac
2023-12-28 18:40:46 +08:00
hiyouga
11a6c8a9a0 fix #1909
Former-commit-id: 0bbf7118df
2023-12-23 14:42:20 +08:00
hiyouga
9337568e23 fix stop words
Former-commit-id: dec360d5ae
2023-12-20 19:06:43 +08:00
hiyouga
622d31e398 fix yi template #1895
Former-commit-id: 5af8841c4f
2023-12-20 18:58:16 +08:00
hiyouga
c1233ab65f add max_memory for gptq #1923
Former-commit-id: c4a3977ad7
2023-12-20 18:15:17 +08:00
hiyouga
f64be8ee84 optimize data loading logic
Former-commit-id: ec1fe1daa9
2023-12-20 16:15:41 +08:00
hiyouga
633624dc3c fix #1909
Former-commit-id: c6abbbfe90
2023-12-20 16:11:07 +08:00
hiyouga
3981927d6b add codegeex template
Former-commit-id: a67a440644
2023-12-18 19:52:35 +08:00
hiyouga
7dbc670902 support quantization in export model
Former-commit-id: 3524aa1e58
2023-12-15 23:44:50 +08:00
hiyouga
bd03307bbd refactor adapter hparam
Former-commit-id: 0716f5e470
2023-12-15 20:53:11 +08:00
hiyouga
c9a2a7a3b3 fix sharegpt loading
Former-commit-id: 2c8e88f9c1
2023-12-13 00:56:16 +08:00
hiyouga
1a0bdd305c support system column #1765
Former-commit-id: 0a9c6e0146
2023-12-12 19:45:59 +08:00
hiyouga
cefc0b2f03 fix modelscope data hub
Former-commit-id: d5b2c57a35
2023-12-12 18:33:06 +08:00
hoshi-hiyouga
b67085e13a Merge branch 'main' into feat/support_ms
Former-commit-id: 6382efec52
2023-12-12 17:55:32 +08:00
xingjun.wang
6cb2c99e7d add use_streaming
Former-commit-id: adc98c86da
2023-12-12 14:23:05 +08:00
xingjun.wang
1bd75afae8 fix cache dir
Former-commit-id: 1909f0d117
2023-12-12 14:21:33 +08:00
xingjun.wang
c1974c91e5 add print info for test
Former-commit-id: 168321a4da
2023-12-12 14:14:40 +08:00
xingjun.wang
e17f2a3f7f update cache dir
Former-commit-id: edc82b923a
2023-12-12 13:08:18 +08:00
xingjun.wang
879209829e update args for MsDataset.load
Former-commit-id: 09533e95ed
2023-12-12 13:02:54 +08:00
xingjun.wang
6520aecef1 update
Former-commit-id: cfba1009d0
2023-12-12 12:03:23 +08:00
xingjun.wang
1d65d24071 for test
Former-commit-id: 5b979147f0
2023-12-12 11:52:59 +08:00