hiyouga
|
86513f28dc
|
update examples
Former-commit-id: fc7f1cc365ee481b76f9c7e6f1947b49cf131fbf
|
2024-04-02 21:09:25 +08:00 |
|
hiyouga
|
03c538ebb3
|
add zh readme
Former-commit-id: 7765f337c7f0d7b8866beecb990c346700146c67
|
2024-04-02 20:58:45 +08:00 |
|
hiyouga
|
e341fa59fe
|
update examples
Former-commit-id: f22eaeb5bc5329146feb0cc5455fae8ce10380f8
|
2024-04-02 20:51:21 +08:00 |
|
hiyouga
|
9df316931b
|
update examples
Former-commit-id: 31ffbde24dd2e30c3d06331ac4b47d966fc2a191
|
2024-04-02 20:41:49 +08:00 |
|
hiyouga
|
135c4e3512
|
update readme
Former-commit-id: 11a6c1bad65a86b0f3d9c5e5df84d246d7d368df
|
2024-04-02 20:37:37 +08:00 |
|
hiyouga
|
291ac11156
|
update readme
Former-commit-id: 949e5fe63811afb05cc687a2117295d494979b69
|
2024-04-02 20:22:11 +08:00 |
|
hiyouga
|
bf5ffeeae0
|
simplify readme
Former-commit-id: 92dab8a90bdd82a72a06559943467b56dde12c71
|
2024-04-02 20:07:43 +08:00 |
|
hiyouga
|
f4be51f356
|
add moe aux loss control #3085
Former-commit-id: b267aeb53fc49d2eeb0f3fc5ebe55e643f5db377
|
2024-04-02 14:26:31 +08:00 |
|
hiyouga
|
c7104f8fab
|
fix #3022
Former-commit-id: 9ddbe2866a4a4433d7635659a5635d16c59800b1
|
2024-04-02 13:58:39 +08:00 |
|
hiyouga
|
bc3ced05b8
|
Update SECURITY.md
Former-commit-id: a86ae1724114fe9634d8a80f9cccdc948f7766e4
|
2024-04-01 23:30:03 +08:00 |
|
hiyouga
|
ab6476a9a4
|
set dev version
Former-commit-id: dd73a0c2489a69e32afc2131407ee62be7779d8b
|
2024-04-01 23:24:08 +08:00 |
|
hiyouga
|
829cf6458a
|
fix #3083
Former-commit-id: 4a6ca621c09d179561acc5957c8c911a4e44184c
|
2024-04-01 22:53:52 +08:00 |
|
hiyouga
|
8d987b7af7
|
add qwen1.5 moe
Former-commit-id: 54b7d349088a828d32551fde56b3467a82df1b9b
|
2024-04-01 21:49:40 +08:00 |
|
hiyouga
|
34f1de0574
|
fix #3077
Former-commit-id: aee634cd20e6dfdfbe2fbb47ae57f62b2da2bf9a
|
2024-04-01 21:35:18 +08:00 |
|
hiyouga
|
b7468ea0a8
|
support infer 4bit model on GPUs #3023
Former-commit-id: eb259cc5738dfb383e4cc5d32579501c580e11b1
|
2024-04-01 17:34:04 +08:00 |
|
hiyouga
|
cefe7f7bcf
|
update webui
Former-commit-id: d0842f682897cb227cda9e9747f42a7281970463
|
2024-04-01 16:23:28 +08:00 |
|
hiyouga
|
bd52e2b404
|
fix ORPO loss
Former-commit-id: 816d71414617590f95de89a49f38358e597ed121
|
2024-04-01 14:42:41 +08:00 |
|
hiyouga
|
69e1d39832
|
fix IPO and ORPO loss
Former-commit-id: 5b9b40403d59982431a526e337f31d394f8b882b
|
2024-04-01 14:37:53 +08:00 |
|
hiyouga
|
e7ade84bba
|
fix plots
Former-commit-id: 5907216a1cc7a75a43d681ede410c2fba7fb7b92
|
2024-03-31 19:43:48 +08:00 |
|
hiyouga
|
b873dcb09d
|
use log1p in orpo loss
https://github.com/huggingface/trl/pull/1491
Former-commit-id: 68aaa4904b8dfb6cc791fdcee613edc681a8a198
|
2024-03-31 19:27:08 +08:00 |
|
hiyouga
|
ddad9be81d
|
update readme
Former-commit-id: 099db6acc08f9a0da18f642455f29012607a920f
|
2024-03-31 18:46:34 +08:00 |
|
hoshi-hiyouga
|
87f4b220b4
|
Merge pull request #3066 from hiyouga/orpo
support ORPO
Former-commit-id: a81d88b780c4ea36e06e2657d3c237694fced93f
|
2024-03-31 18:42:48 +08:00 |
|
hiyouga
|
35b3516812
|
support orpo in webui
Former-commit-id: 5195add324194d2583db40365522e5e2916592b6
|
2024-03-31 18:34:59 +08:00 |
|
hiyouga
|
2f878bde11
|
support ORPO
Former-commit-id: 17bf8a2c3a7bb5b83071c8659cfd8751e894e692
|
2024-03-31 18:29:50 +08:00 |
|
hiyouga
|
3cf35e57db
|
tiny fix
Former-commit-id: 27776c34741ca0c58ed793bcdf1acd5e4a81fb39
|
2024-03-31 00:10:29 +08:00 |
|
hoshi-hiyouga
|
91067408f5
|
Merge pull request #3057 from marko1616/bugfix/lora-model-merge
Fix Llama model save for full param train
Former-commit-id: de3564ff7065d446fe3081977b5e7afcf9d375e5
|
2024-03-31 00:07:20 +08:00 |
|
marko1616
|
5721074af1
|
fix blank line contains whitespace
Former-commit-id: d9a5134617d494ef13ba73f9c540123e89a8c29c
|
2024-03-30 23:46:55 +08:00 |
|
marko1616
|
67c05c2031
|
Fix Llama model save for full param train
Former-commit-id: eb178eaff390a1dc342cc35ab8c7820d654f3717
|
2024-03-30 23:45:04 +08:00 |
|
hiyouga
|
3bf6dde3a5
|
support save args in webui #2807 #3046
some ideas are borrowed from @marko1616
Former-commit-id: 7a086ed33388551e0f835adf61fac638f96ed188
|
2024-03-30 23:09:12 +08:00 |
|
hoshi-hiyouga
|
1d2958b728
|
Merge pull request #3053 from lealaxy/main
Fix pile dataset download config
Former-commit-id: 257f643a74d37b2e816c4f61ee4f049dfe66b7e0
|
2024-03-30 20:41:43 +08:00 |
|
hiyouga
|
808ad2071f
|
upgrade gradio to 4.21.0
Former-commit-id: 831c5321ac9b5ec91d9cc1dbcc87967dcdc486f5
|
2024-03-30 20:37:08 +08:00 |
|
li.yunhao
|
0330ba2ae6
|
fix pile datset hf hub url
Former-commit-id: 9c2ef9cdf47e16985e07421b0bea414d161e2456
|
2024-03-30 16:06:10 +08:00 |
|
hiyouga
|
d40f6f24a8
|
Update wechat.jpg
Former-commit-id: a0333bb0ceb18cbdbb95b5e67ba0141d27764893
|
2024-03-29 16:55:53 +08:00 |
|
hiyouga
|
fc066cad7f
|
release v0.6.1
Former-commit-id: ca793028c69433eae405009c5ebb790c6c2d40c4
v0.6.1
|
2024-03-29 11:36:08 +08:00 |
|
hiyouga
|
1421db282a
|
update readme
Former-commit-id: c1fe6ce782a5167bdf020c8af96a268a236f61db
|
2024-03-28 22:02:32 +08:00 |
|
hiyouga
|
b265002c19
|
add project
Former-commit-id: 1e43319f9cdf53741b4bf6c61749c409db119388
|
2024-03-28 20:24:27 +08:00 |
|
hiyouga
|
e4f3d583df
|
fix #2982
Former-commit-id: 8d603f8820efd1617557f2bc5d9674143abe7c57
|
2024-03-28 20:22:31 +08:00 |
|
hiyouga
|
a9d5b4b68e
|
update readme
Former-commit-id: 6c94305e4746c9a735ff62a6428e295d1a67da52
|
2024-03-28 18:35:11 +08:00 |
|
hiyouga
|
eac2a5b1d3
|
fix #3010
Former-commit-id: b19c14870d30c57fbea81e9cfa737d762922c54b
|
2024-03-28 18:31:17 +08:00 |
|
hiyouga
|
89c400633a
|
update trainers
Former-commit-id: 8c77b1091296e204dc3c8c1f157c288ca5b236bd
|
2024-03-28 18:16:27 +08:00 |
|
hoshi-hiyouga
|
ae9ad13f2a
|
fix ds optimizer
Former-commit-id: 3bcd41b639899e72bcabc51d59bac8967af19899
|
2024-03-26 23:39:56 +08:00 |
|
hiyouga
|
300437a5e9
|
fix #2981
Former-commit-id: b29d5560f1359a3868d917048aeba1a069ba12a9
|
2024-03-26 17:53:04 +08:00 |
|
hiyouga
|
c311375b50
|
fix bug
Former-commit-id: 3164b4f11b72684c8aa2105037cb36c47b6acfd4
|
2024-03-26 17:30:12 +08:00 |
|
hiyouga
|
ec94e5e876
|
fix #2961
Former-commit-id: 511f6754026fbbf48bd481018015338a6a3ad92f
|
2024-03-26 17:26:14 +08:00 |
|
hiyouga
|
c207b279f2
|
Update wechat.jpg
Former-commit-id: 7ea1a1f5b36a29d1d34217724715e9759c431dfe
|
2024-03-26 16:24:42 +08:00 |
|
hiyouga
|
62312716d9
|
release v0.6.0 (real)
Former-commit-id: ba70aca8fb1275ed3b6af69a7e639303d7201da4
v0.6.0
|
2024-03-25 23:37:48 +08:00 |
|
hiyouga
|
196a33cca4
|
tiny fix
Former-commit-id: 98a42cbdaa4a90dbe5edda1c412c17e628324f52
|
2024-03-25 23:28:52 +08:00 |
|
hiyouga
|
e90c3769e5
|
update readme
Former-commit-id: 7b3d8188f5e4416f326b1dc98ad941020461f67f
|
2024-03-25 23:06:13 +08:00 |
|
hoshi-hiyouga
|
94fb50c52a
|
Merge pull request #2967 from Tsumugii24/main
Update README_zh.md
Former-commit-id: f633ac6646306f448bc77c1e261c98f15421df75
|
2024-03-25 23:02:22 +08:00 |
|
Tsumugii24
|
03c387c543
|
Update README.md
Former-commit-id: 1704599503a4c6921a8e78c2b4b940232ca1ba5d
|
2024-03-25 22:54:38 +08:00 |
|