hiyouga
|
b1986a06b9
|
fix bug in latest gradio
Former-commit-id: 44a962862b4a74e50ef5786c8d5719faaa65f63f
|
2024-04-04 00:55:31 +08:00 |
|
hiyouga
|
43d134ba29
|
fix requires for windows
Former-commit-id: 5e25fae40b7ea9cfa72717efbe3677199ca9608f
|
2024-04-03 21:56:43 +08:00 |
|
hiyouga
|
1348f7d860
|
fix resize vocab at inference #3022
Former-commit-id: c243720b89eec0af2872fa3c7980a0026d893f4d
|
2024-04-03 18:14:24 +08:00 |
|
hiyouga
|
f6530222f7
|
fix #3116
Former-commit-id: b7256aa33d761280751518c20f29f9b8ea3fb025
|
2024-04-03 14:47:59 +08:00 |
|
hiyouga
|
b12176d818
|
simplify readme
Former-commit-id: 0da6ec2d516326fe9c7583ba71cd1778eb838178
|
2024-04-02 20:07:43 +08:00 |
|
hiyouga
|
117b67ea30
|
add moe aux loss control #3085
Former-commit-id: c9187ebc944e2de454ace3304b7d28eabb1b1a81
|
2024-04-02 14:26:31 +08:00 |
|
hiyouga
|
03e20bb5c6
|
fix #3022
Former-commit-id: dac2f617bda9470ac8d85c7e9def09cc04970506
|
2024-04-02 13:58:39 +08:00 |
|
hiyouga
|
9e14501edb
|
set dev version
Former-commit-id: 922ecae89210e5b8d62d78774f123a6d75c525ba
|
2024-04-01 23:24:08 +08:00 |
|
hiyouga
|
1dc963caa6
|
fix #3083
Former-commit-id: ff9a3f73961a362d0ddc22079f80a85465fffda8
|
2024-04-01 22:53:52 +08:00 |
|
hiyouga
|
85726c91ce
|
add qwen1.5 moe
Former-commit-id: 3ea94f0d12cec25ac694a2c4ae8971c356990b61
|
2024-04-01 21:49:40 +08:00 |
|
hiyouga
|
40211db275
|
fix #3077
Former-commit-id: d0340391e8075cff0d84b3ef879c2101b66ca1dc
|
2024-04-01 21:35:18 +08:00 |
|
hiyouga
|
e7f13098c6
|
support infer 4bit model on GPUs #3023
Former-commit-id: 950a9dab9055839990656b2b40956792b253573d
|
2024-04-01 17:34:04 +08:00 |
|
hiyouga
|
61eb3a3d46
|
update webui
Former-commit-id: e96d260917a35ad2068f7b28b4f0b334b808ccc2
|
2024-04-01 16:23:28 +08:00 |
|
hiyouga
|
be0a807e8c
|
fix ORPO loss
Former-commit-id: 5544ddde9087f00f9e20b78d0079f20c2f5d1604
|
2024-04-01 14:42:41 +08:00 |
|
hiyouga
|
52d402e2a9
|
fix IPO and ORPO loss
Former-commit-id: fc27955732aedbb12003faf19b760e2768b228f2
|
2024-04-01 14:37:53 +08:00 |
|
hiyouga
|
c5a46f9113
|
fix plots
Former-commit-id: 81355671296b84d438967463bb2a92934ff31aae
|
2024-03-31 19:43:48 +08:00 |
|
hiyouga
|
00e17a377c
|
use log1p in orpo loss
https://github.com/huggingface/trl/pull/1491
Former-commit-id: 3b15d495264b00a4f8716bafea334778874963d7
|
2024-03-31 19:27:08 +08:00 |
|
hiyouga
|
9abd83adb1
|
update readme
Former-commit-id: 297b01f16ac78cde15a5d85a9a5b82ea20bfaf23
|
2024-03-31 18:46:34 +08:00 |
|
hiyouga
|
1aba442bcd
|
support orpo in webui
Former-commit-id: dd5cc78d4fb18dd0a2e9d57f0f046cfe9f0dc2c9
|
2024-03-31 18:34:59 +08:00 |
|
hiyouga
|
d764cd8736
|
support ORPO
Former-commit-id: f44a4c27e2461cdaa1b16865f597a31033c0e6d9
|
2024-03-31 18:29:50 +08:00 |
|
hiyouga
|
526111a303
|
tiny fix
Former-commit-id: ba4a9b3c01e2f7467fbc5be268f47c0d003caa65
|
2024-03-31 00:10:29 +08:00 |
|
marko1616
|
1f617c6e08
|
fix blank line contains whitespace
Former-commit-id: 7bc3bcc64353d5a1d4870c6a9509b64cff710492
|
2024-03-30 23:46:55 +08:00 |
|
marko1616
|
a6858a36c0
|
Fix Llama model save for full param train
Former-commit-id: ca17b5db4f97c3ec9fe2004877f150e8f51ab4b5
|
2024-03-30 23:45:04 +08:00 |
|
hiyouga
|
6198121923
|
support save args in webui #2807 #3046
some ideas are borrowed from @marko1616
Former-commit-id: b5a062aa2d4a37670007e8b3dae5b6f5b7ffb15c
|
2024-03-30 23:09:12 +08:00 |
|
hiyouga
|
b0efebf853
|
upgrade gradio to 4.21.0
Former-commit-id: 63eecbeb967d849e1d03d8d03fb6421c0ee89257
|
2024-03-30 20:37:08 +08:00 |
|
hiyouga
|
fbd0584391
|
release v0.6.1
Former-commit-id: a59d823f554505b2e649e6e111b9dee8306d3ad8
|
2024-03-29 11:36:08 +08:00 |
|
hiyouga
|
9408366a36
|
fix #2982
Former-commit-id: e5e6a0c50c7a1c0052ed6b459450b9735ff2c9a1
|
2024-03-28 20:22:31 +08:00 |
|
hiyouga
|
14b75a0b93
|
fix #3010
Former-commit-id: a5e823ae75556eaa3b52ce7a887a6e7838a1eb5f
|
2024-03-28 18:31:17 +08:00 |
|
hiyouga
|
59e6ebf039
|
update trainers
Former-commit-id: d0dd6eefed0b86895ed00a7cafb331e5193db645
|
2024-03-28 18:16:27 +08:00 |
|
hoshi-hiyouga
|
dc540dfaa8
|
fix ds optimizer
Former-commit-id: 2675127070a1e7584e71039a11c1ebac54ddd1db
|
2024-03-26 23:39:56 +08:00 |
|
hiyouga
|
a916688723
|
fix bug
Former-commit-id: f513e1415cc3fe87f600318fba855d1286b6d007
|
2024-03-26 17:30:12 +08:00 |
|
hiyouga
|
3336422760
|
fix #2961
Former-commit-id: 616917bb3be7f71073b56ad8c7bc4e164b08b9b5
|
2024-03-26 17:26:14 +08:00 |
|
hiyouga
|
04423b916f
|
release v0.6.0 (real)
Former-commit-id: 34e06bf408ccd21e674f896703f1c7b62e97e1ca
|
2024-03-25 23:37:48 +08:00 |
|
hiyouga
|
bf8d2f8eda
|
tiny fix
Former-commit-id: bf2455e420cf35c6596528f319c1b18408b5519a
|
2024-03-25 23:28:52 +08:00 |
|
hiyouga
|
ebd6bc2604
|
add arg check
Former-commit-id: 86e0d5a5a50ae34307f5176c7c4a6ab9d0c224b9
|
2024-03-25 22:42:58 +08:00 |
|
hiyouga
|
daab85e3e6
|
release v0.6.0
Former-commit-id: 51910d5803eb718e4976da0b3bfcdc5eeeea48eb
|
2024-03-25 22:38:56 +08:00 |
|
hiyouga
|
04e0fe9147
|
tiny fix
Former-commit-id: c39cf3439a3025f703d50ac414c10ef3c8486a1f
|
2024-03-25 21:18:08 +08:00 |
|
marko1616
|
7f99cb1817
|
pass ruff check
Former-commit-id: 8534b069a05121eb041371a6becccf0a1a23f268
|
2024-03-24 16:12:10 +08:00 |
|
marko1616
|
c555b2cce3
|
fix Llama lora merge crash
Former-commit-id: 46f7d8e6b85f73fb0c51c8b08bd9955c3b171d93
|
2024-03-24 03:06:11 +08:00 |
|
marko1616
|
2eba1c6851
|
fix Llama lora merge crash
Former-commit-id: a8bd8e9149ff79a2707fec9c6d006761cfdd0dee
|
2024-03-24 02:55:23 +08:00 |
|
marko1616
|
edeed55664
|
fix Llama lora merge crash
Former-commit-id: c29a2893f58cf7a916ff05b2725fadf1ad2c4c9a
|
2024-03-24 02:44:35 +08:00 |
|
hiyouga
|
92248f9cb2
|
fix #2936
Former-commit-id: 9ae646fbbd809057a9c54fe41e1ae5a07a674556
|
2024-03-24 00:43:21 +08:00 |
|
hiyouga
|
c548ad5e69
|
fix #2928
Former-commit-id: 9558ee87bc7260a6596385aaa375df544862bfa9
|
2024-03-24 00:34:54 +08:00 |
|
hiyouga
|
a57d839e1d
|
fix #2941
Former-commit-id: 3775ab52017f0b610ddd8199cccfb8c001eda507
|
2024-03-24 00:28:44 +08:00 |
|
hiyouga
|
935ee0a023
|
support fsdp + qlora
Former-commit-id: b894bf8e84be689db258021f0638e9ac939abcbc
|
2024-03-21 00:36:06 +08:00 |
|
hiyouga
|
c7af26a9e3
|
fix #2777 #2895
Former-commit-id: 54d5f62d29456a8d9d0c0dd3d0bbfffe48935803
|
2024-03-20 17:59:45 +08:00 |
|
hiyouga
|
d8073488be
|
fix #2346
Former-commit-id: c8888c499b0ac51e2fc86c16e8e91c79400a5993
|
2024-03-20 17:56:33 +08:00 |
|
hiyouga
|
ffdacaa618
|
fix packages
Former-commit-id: 2f9f334a123d43267bfb3dd26aaa1ad285ffe7a5
|
2024-03-17 22:32:03 +08:00 |
|
hiyouga
|
e194efab10
|
fix patcher
Former-commit-id: 6a5ad99c8cbf6b7def0a130306d49e7d1eb4e5a5
|
2024-03-15 19:18:42 +08:00 |
|
hoshi-hiyouga
|
772fc2eac7
|
Merge pull request #2849 from S3Studio/DockerizeSupport
Improve Dockerize support
Former-commit-id: b63cba317266f5ba217de54fda77ec26a4df344d
|
2024-03-15 19:16:02 +08:00 |
|