357 Commits

Author SHA1 Message Date
hiyouga
a12785fd9b fix #199
Former-commit-id: d111e658a29a70b9f3fd4c18c35eaf3f8a5ae109
2023-07-19 22:51:29 +08:00
hiyouga
fa47c99fa9 add datasets
Former-commit-id: 7159bc54ed0f1bba974662a87ba5039d9aacadee
2023-07-19 20:59:15 +08:00
hiyouga
1a23cb2578 fix #196
Former-commit-id: 925a790bc9507c4d23af275a5abfb149959dbdcb
2023-07-19 17:35:38 +08:00
hiyouga
2e0342dc54 fix #194
Former-commit-id: 8f7819fcaa00f6ddcf59552c2866d8fc5659d0e9
2023-07-19 17:07:33 +08:00
hiyouga
f7f2accf05 support LLaMA-2
Former-commit-id: 7a3ade8c699ff1cd2d17590e2f8df79e1738cee2
2023-07-19 16:42:14 +08:00
hiyouga
18c5eb4a44 add LLaMA2 template
Former-commit-id: 38eb1aaf550b6b5952d757c37eb274587c59dece
2023-07-19 00:44:49 +08:00
hiyouga
18656a6316 fix API
Former-commit-id: 29af67b015ff92e5dd9bf2985ce7723dc036d989
2023-07-19 00:01:14 +08:00
hiyouga
af37ac077c support dev set in web ui
Former-commit-id: fe2887ca1304e5b5cfd7fbd820a9a0c8dedd23ef
v0.1.1
2023-07-18 20:40:49 +08:00
hiyouga
b062d980c8 add web demo
Former-commit-id: b447fa85aa563b6105cfa64c9ec802c5bd63af56
2023-07-18 17:21:16 +08:00
hiyouga
35d52c4100 update baichuan template
Former-commit-id: bdf91846da12c9d0aee26bf17f5431e4c0eb4bc8
2023-07-18 16:43:51 +08:00
hiyouga
4a18759864 fix template
Former-commit-id: d1ae428c6ec2a50e0cfc70657111fc5b67eff51e
2023-07-18 16:37:23 +08:00
hiyouga
77c4bb2985 fix #176
Former-commit-id: cadeac0f4475719454d18a8ed12f7573f115a2c4
2023-07-18 16:36:24 +08:00
hiyouga
92c393dc2a fix webUI, fix #171 #177
Former-commit-id: 6f9360c0bdc36ed2c6d0881136b191c96535ffc0
2023-07-18 15:51:48 +08:00
hiyouga
0b6f769971 update webUI, fix #179
Former-commit-id: 12d8a8633f1d8db8eb72223f69c074d98af16e01
2023-07-18 15:35:17 +08:00
hiyouga
483cc3c26b tiny fix
Former-commit-id: b9fe83fb75dc65e1c49167a0b836415becf48564
2023-07-18 00:52:31 +08:00
hiyouga
4e1997a343 a monkey patch for lora_target
Former-commit-id: 262252d67bbe4ebcbb315b5d7a34f9a091f8af0c
v0.1.0
2023-07-18 00:31:40 +08:00
hiyouga
091805d38e release v0.1.0
Former-commit-id: f8193e8009451cf569a28a10eb4bd88831844441
2023-07-18 00:18:25 +08:00
hiyouga
799524b37b fix #175
Former-commit-id: 85c2210452cc45470c228f17b2b0df09b47e9575
2023-07-17 18:07:17 +08:00
hiyouga
c4f1d98a1c fix saving custom code
Former-commit-id: 1e1358431dde1ed774b0e1e48760ca9f0db685ef
2023-07-16 18:04:41 +08:00
hiyouga
fd023ad416 add custom baichuan-13B code supports left-padding
Former-commit-id: 2c867b9bb1c50cc42acee326f49ceddca0492a55
v0.0.9
2023-07-15 22:37:17 +08:00
hiyouga
20e4bf3b5b fix callback
Former-commit-id: 552d773dad0a8e6bcfdd4f4f587e1fe17edcd7b3
2023-07-15 22:01:43 +08:00
hiyouga
22e979c482 update stream_chat
Former-commit-id: 8528a84e7486351af6b53db91649fa5772a99d13
2023-07-15 19:51:02 +08:00
hiyouga
b8b38a9ade create chat model
Former-commit-id: 657cf0f55a7f0886bc837bdd44528971dc5e5caa
2023-07-15 19:26:20 +08:00
hiyouga
8ba0996a53 Update callbacks.py
Former-commit-id: d640c5545f6b2fcf7840df2b35a80f49a2de4ba5
2023-07-15 17:39:16 +08:00
hiyouga
7c0f2ab0a4 Update README.md
Former-commit-id: 1e2b7e0c4bc2cbd8d990cef9a85ccd16b971fb84
2023-07-15 17:20:39 +08:00
hiyouga
70b5232f9a fix callback
Former-commit-id: 22d9a9c2af6674eb832ae4aee80d679f19b7006f
2023-07-15 17:18:16 +08:00
hiyouga
a696148d6b modity code structure
Former-commit-id: f75137661358f9070bc70c341dfa2cc5fd69cf94
2023-07-15 16:54:28 +08:00
hiyouga
09b52a3078 Update wechat.jpg
Former-commit-id: 2a0f1f8398bd771982d41eb53dd38a0dc8087f05
2023-07-14 17:29:43 +08:00
hiyouga
7ea072536b fix eval and pred loss
Former-commit-id: c30db9f1f0db5a6a660cdc60016755241762aae7
2023-07-14 13:11:57 +08:00
hiyouga
32ec440d2e fix pretrain
Former-commit-id: a04115ec278e646347a6fec12f562494abd66e51
2023-07-13 23:41:54 +08:00
hiyouga
2b0fced03b fix Baichuan-13B
Former-commit-id: 08439d29b2031ffbe77fe581c148e6d94e68bfc4
2023-07-13 23:08:45 +08:00
hoshi-hiyouga
cecdf886cb Merge pull request #156 from ZhengJun-AI/main
Support for WebNovel dataset

Former-commit-id: 8cd76ef3c3ac4b92d2ea9b605251a3abbaff90aa
2023-07-12 20:11:19 +08:00
zxbsmk
3b15aacf02 Support for WebNovel dataset
Former-commit-id: 4955dc9eed33a904e4e2b9d5985b3fda87c3674a
2023-07-12 17:29:47 +08:00
hoshi-hiyouga
9c319f3d49 Merge pull request #145 from elicassion/patch-1
Fix typo in common.py

Former-commit-id: 894f13e41f31ff49704ee2f633899f9c88035a9c
2023-07-12 13:50:39 +08:00
Jinghuan Shang
d42d175670 Fix typo in common.py
lastest -> latest

Former-commit-id: dc1e8b7181ba86f028dc22bea9d3c419814c1e19
2023-07-11 18:03:53 -04:00
hiyouga
925a026853 fix sft encode
Former-commit-id: b2f7cb446591e3722b5be8d250ddfe0caa226384
2023-07-11 19:50:33 +08:00
hiyouga
685ba1e02e add baichuan template
Former-commit-id: 1af031c02b3871341cc4d719b5d62cfd02bc126a
2023-07-11 18:57:50 +08:00
hiyouga
507726b2f0 support Baichuan-13B
Former-commit-id: f936a7af0be98cd886ce9a0611a744033818e20f
2023-07-11 16:16:14 +08:00
hiyouga
804cc07db0 Update README.md
Former-commit-id: 8447206bbc2ca579e1fc57d6bda76180c7f89c86
2023-07-10 23:09:11 +08:00
hiyouga
53b8e444b8 Update wechat.jpg
Former-commit-id: 061c324972ac8e20da1445a70332cdd0e347425e
2023-07-10 18:41:53 +08:00
hiyouga
e5c7681146 Update README.md
Former-commit-id: 4182c7aa8b08c80aac0f7a4fc03164c46d8f322c
2023-07-09 14:57:13 +08:00
hiyouga
c812429011 update api to match langchain
Former-commit-id: 84a06318d40fb595f3aa6d1141c107ef7710376c
2023-07-07 20:35:39 +08:00
hiyouga
28ec96bf19 Update README.md
Former-commit-id: 233f20864b69b6483b8fc460df036230c3cbed7d
2023-07-07 12:06:28 +08:00
hiyouga
8b4ef062b7 support InternLM
Former-commit-id: a2f507c56238d7fb2670edbab52d6b275f245e27
2023-07-07 11:02:28 +08:00
hiyouga
50a27509a3 fix rouge score
Former-commit-id: caa00d3ac24c989d56887af9d7ca79244e72714a
2023-07-06 14:28:34 +08:00
hiyouga
28c1381671 update readme
Former-commit-id: 89c623e4bfef760174f013c5de27810cc90e0f6e
2023-07-05 23:03:58 +08:00
hiyouga
22fa516bd5 fix streaming response in API
Former-commit-id: 4abd2485e10e7198b63a396ce5432ac89c9f2d98
2023-07-05 22:42:31 +08:00
hiyouga
bcd7493212 fix freeze tuning
Former-commit-id: e6603977f695b71f6a36640256f6653ff513d783
2023-07-05 21:18:28 +08:00
hiyouga
265dc1b6a0 fix bug in PPO stage
Former-commit-id: a2ba69183b8e72c09242317a34545ab966ea8991
2023-07-05 19:14:10 +08:00
hiyouga
7ba52f5b6e fix compute dtype
Former-commit-id: 8e3540c62d748dcecbcb3a29d57abe665e7b31c8
2023-07-05 15:13:00 +08:00