1190 Commits

Author SHA1 Message Date
hiyouga
8e4ae0aaac add web demo
Former-commit-id: 25ea647e5ac36b497b8e176b123fdee39be3fd30
2023-07-18 17:21:16 +08:00
hiyouga
5ed2a97056 update baichuan template
Former-commit-id: 03520588c39986c98a0515a64993af8c2468b9d0
2023-07-18 16:43:51 +08:00
hiyouga
03eba6f041 fix template
Former-commit-id: 729053c9cea6254165ae9c8fd7809479b12f735c
2023-07-18 16:37:23 +08:00
hiyouga
ec166e736a fix #176
Former-commit-id: 2ae3445b0d28b4ed22ddbb2cfe09089ae0c23fe1
2023-07-18 16:36:24 +08:00
hiyouga
c85a6b83b3 fix webUI, fix #171 #177
Former-commit-id: 3459bb2d35162dbbef79cda05da08a56921aa276
2023-07-18 15:51:48 +08:00
hiyouga
a864a7b395 update webUI, fix #179
Former-commit-id: f9074fed5e22585679661588befcf266a79009f2
2023-07-18 15:35:17 +08:00
hiyouga
fd8c2d4aac tiny fix
Former-commit-id: bcdf5bb55651d639e9f57fd915268137156af9cd
2023-07-18 00:52:31 +08:00
hiyouga
baf2e4e825 a monkey patch for lora_target
Former-commit-id: 622f44a05b49b10571bd189ae3843683117ad77f
v0.1.0
2023-07-18 00:31:40 +08:00
hiyouga
eac7f97337 release v0.1.0
Former-commit-id: 63c8d3a17cb18f0d8a8e37bfa147daf5bdd28ea9
2023-07-18 00:18:25 +08:00
hiyouga
c08ff734a7 fix #175
Former-commit-id: fd557ebb5e3ef2ca330b4d97731af43f4a5a5fc5
2023-07-17 18:07:17 +08:00
hiyouga
e9736b2ba0 fix saving custom code
Former-commit-id: 3f8f40bffd4f61fcc045f5f8a07420f3b46d0f7a
2023-07-16 18:04:41 +08:00
hiyouga
c61de6f669 add custom baichuan-13B code supports left-padding
Former-commit-id: 130ae986d13e4d03ae04d767a80c8863aee33fea
v0.0.9
2023-07-15 22:37:17 +08:00
hiyouga
f8831cb1ea fix callback
Former-commit-id: 477ef5ffd84c78ab1a8bce27714bb4f6e6ca0210
2023-07-15 22:01:43 +08:00
hiyouga
6a0499ef40 update stream_chat
Former-commit-id: e57b2152cf1d5c9e481523e36be4ed09b88e1285
2023-07-15 19:51:02 +08:00
hiyouga
a8deee27f8 create chat model
Former-commit-id: bddf583b2fc099c957a1037418bd8504a837663e
2023-07-15 19:26:20 +08:00
hiyouga
e9fe48150c Update callbacks.py
Former-commit-id: 44ebe58083dc62128fd14df474c11c6e09af43db
2023-07-15 17:39:16 +08:00
hiyouga
51368f3453 Update README.md
Former-commit-id: 72f6dda3d5f1f6529bf4ea68b62b1aab615b29f3
2023-07-15 17:20:39 +08:00
hiyouga
a31a609377 fix callback
Former-commit-id: 065680cd2a410d7ceab10a4a76588df43e286117
2023-07-15 17:18:16 +08:00
hiyouga
6261fb362a modity code structure
Former-commit-id: 0682ed357210897e0b67c4a6eb31a94b3eb929f1
2023-07-15 16:54:28 +08:00
hiyouga
fa06b168ab fix eval and pred loss
Former-commit-id: 2a5a8e0eba279de603c2d25e894b6d2921aaae55
2023-07-14 13:11:57 +08:00
hiyouga
961e6a9ba4 fix pretrain
Former-commit-id: 75b584875fc75c437491a5155ef310248e9b9dd4
2023-07-13 23:41:54 +08:00
hiyouga
316a02696f fix Baichuan-13B
Former-commit-id: 6d9d826b3246349454c68f4d13b862da4de986e2
2023-07-13 23:08:45 +08:00
hoshi-hiyouga
d57e0a7006 Merge pull request #156 from ZhengJun-AI/main
Support for WebNovel dataset

Former-commit-id: f85ec349832705245d98ca869b06b1beca7192b7
2023-07-12 20:11:19 +08:00
zxbsmk
994b21b092 Support for WebNovel dataset
Former-commit-id: 655162f530784bc9374962c02d8b414872f83b2f
2023-07-12 17:29:47 +08:00
hoshi-hiyouga
6ef45d311a Merge pull request #145 from elicassion/patch-1
Fix typo in common.py

Former-commit-id: 3b1f31941027d0b63c48cb8f68865a5993f81c74
2023-07-12 13:50:39 +08:00
Jinghuan Shang
30b2092294 Fix typo in common.py
lastest -> latest

Former-commit-id: a0a82a56765ffbdc2aeaa8174835494459ac914a
2023-07-11 18:03:53 -04:00
hiyouga
8de7a01887 fix sft encode
Former-commit-id: 2369a96a3200593421ae9afb06e08e2ac8010bb2
2023-07-11 19:50:33 +08:00
hiyouga
cc290a41e6 add baichuan template
Former-commit-id: 22273b3f7ce3b4c13e9e3f3677181d1a6a0f9c84
2023-07-11 18:57:50 +08:00
hiyouga
1aa0997391 support Baichuan-13B
Former-commit-id: f3edfe7d42d5513fb4177be61ec4f88f1edffb1e
2023-07-11 16:16:14 +08:00
hiyouga
61988225a8 Update README.md
Former-commit-id: 45a392d3d662f99c7cfed6d3bc6420cc98ed60c3
2023-07-10 23:09:11 +08:00
hiyouga
62e775cb75 Update README.md
Former-commit-id: 6b5eda6e39c1ff8df48418ca0fc734279e1e5abe
2023-07-09 14:57:13 +08:00
hiyouga
bc436066c8 update api to match langchain
Former-commit-id: 0016cf6525b151a6e7262967399d67033569b7eb
2023-07-07 20:35:39 +08:00
hiyouga
9da7840005 Update README.md
Former-commit-id: 3c2b547dab03f3675ec7224f9f558392dc81cac4
2023-07-07 12:06:28 +08:00
hiyouga
113cdaf1cb support InternLM
Former-commit-id: a454ef7d57d9c06302d51464cfe39f6d0c48c5a8
2023-07-07 11:02:28 +08:00
hiyouga
601b1747d1 fix rouge score
Former-commit-id: b84b03a2a5ca72ce0ba71d9a9c3db1a687283fa6
2023-07-06 14:28:34 +08:00
hiyouga
e3b779fcb2 update readme
Former-commit-id: 38b555c1819bb1fed1c17608ed6110d9572db98c
2023-07-05 23:03:58 +08:00
hiyouga
982e76978b fix streaming response in API
Former-commit-id: 72a17ae3b4fac2dc93b04a816f16f863120bc71b
2023-07-05 22:42:31 +08:00
hiyouga
d659907f34 fix freeze tuning
Former-commit-id: e32a1db967da02f502559df59ec6d1ab4554febf
2023-07-05 21:18:28 +08:00
hiyouga
df71d98b37 fix bug in PPO stage
Former-commit-id: a27373128d10b4e483d306100d91a55c0b796488
2023-07-05 19:14:10 +08:00
hiyouga
4de9ef568a fix compute dtype
Former-commit-id: 5aadbb22730d19570b039462c91df443dbb34b5f
2023-07-05 15:13:00 +08:00
hiyouga
f1de82f08e support falcon model #72
Former-commit-id: 72cc3ff0e6de641073de1159196319705f8efe85
2023-07-05 15:00:06 +08:00
hiyouga
4b093996a7 fix bleu score
Former-commit-id: 6874dce4444e6e6ce9d6125275dbf3dfdfb4fb22
2023-07-05 00:11:21 +08:00
hiyouga
e4e36a2d74 set use_cache before saving model
Former-commit-id: a6a0161f32f600f3001188ff4c7929c5f13c2a03
2023-07-04 23:18:20 +08:00
hiyouga
6df5c4ccef fix seq2seq predictions
Former-commit-id: 045316d62f713311bdabdfb56be442238e03a007
2023-07-04 22:56:51 +08:00
hoshi-hiyouga
ecae079e56 Merge pull request #119 from codemayq/main
add the pre-built version of bitsandbytes library for windows user

Former-commit-id: f1f0e2277469976f8666370645a83b2665a267ec
2023-07-03 19:51:46 +08:00
codemayq
77a2b60bc6 add the pre-built version of bitsandbytes library for windows user
Former-commit-id: 1cb8429647972147634433e81e3d8df5bded936a
2023-07-03 13:58:10 +08:00
hiyouga
6a83f4f793 Update auto_gptq.py
Former-commit-id: 84ebfd87692031a6736b86dd8a35f635f14c1c97
2023-07-02 20:56:11 +08:00
hiyouga
2537481c34 add autogptq
Former-commit-id: 43321557c272862d9c6531fc48a4569cfc88e4e7
2023-07-02 20:36:37 +08:00
hiyouga
d720f67e6c fix typo
Former-commit-id: 23c0d36abe881d9be839d5c647841bdef178307b
2023-06-30 10:09:59 +08:00
hiyouga
40ab36456c Update README.md
Former-commit-id: f3891213f50ef3da84d4a06ce71ec0806a7a4866
2023-06-29 19:36:22 +08:00