Commit Graph

1099 Commits

Author SHA1 Message Date
hiyouga
bc3ced05b8 Update SECURITY.md
Former-commit-id: a86ae17241
2024-04-01 23:30:03 +08:00
hiyouga
ab6476a9a4 set dev version
Former-commit-id: dd73a0c248
2024-04-01 23:24:08 +08:00
hiyouga
829cf6458a fix #3083
Former-commit-id: 4a6ca621c0
2024-04-01 22:53:52 +08:00
hiyouga
8d987b7af7 add qwen1.5 moe
Former-commit-id: 54b7d34908
2024-04-01 21:49:40 +08:00
hiyouga
34f1de0574 fix #3077
Former-commit-id: aee634cd20
2024-04-01 21:35:18 +08:00
hiyouga
b7468ea0a8 support infer 4bit model on GPUs #3023
Former-commit-id: eb259cc573
2024-04-01 17:34:04 +08:00
hiyouga
cefe7f7bcf update webui
Former-commit-id: d0842f6828
2024-04-01 16:23:28 +08:00
hiyouga
bd52e2b404 fix ORPO loss
Former-commit-id: 816d714146
2024-04-01 14:42:41 +08:00
hiyouga
69e1d39832 fix IPO and ORPO loss
Former-commit-id: 5b9b40403d
2024-04-01 14:37:53 +08:00
hiyouga
e7ade84bba fix plots
Former-commit-id: 5907216a1c
2024-03-31 19:43:48 +08:00
hiyouga
b873dcb09d use log1p in orpo loss
https://github.com/huggingface/trl/pull/1491

Former-commit-id: 68aaa4904b
2024-03-31 19:27:08 +08:00
hiyouga
ddad9be81d update readme
Former-commit-id: 099db6acc0
2024-03-31 18:46:34 +08:00
hoshi-hiyouga
87f4b220b4 Merge pull request #3066 from hiyouga/orpo
support ORPO

Former-commit-id: a81d88b780
2024-03-31 18:42:48 +08:00
hiyouga
35b3516812 support orpo in webui
Former-commit-id: 5195add324
2024-03-31 18:34:59 +08:00
hiyouga
2f878bde11 support ORPO
Former-commit-id: 17bf8a2c3a
2024-03-31 18:29:50 +08:00
hiyouga
3cf35e57db tiny fix
Former-commit-id: 27776c3474
2024-03-31 00:10:29 +08:00
hoshi-hiyouga
91067408f5 Merge pull request #3057 from marko1616/bugfix/lora-model-merge
Fix Llama model save for full param train

Former-commit-id: de3564ff70
2024-03-31 00:07:20 +08:00
marko1616
5721074af1 fix blank line contains whitespace
Former-commit-id: d9a5134617
2024-03-30 23:46:55 +08:00
marko1616
67c05c2031 Fix Llama model save for full param train
Former-commit-id: eb178eaff3
2024-03-30 23:45:04 +08:00
hiyouga
3bf6dde3a5 support save args in webui #2807 #3046
some ideas are borrowed from @marko1616


Former-commit-id: 7a086ed333
2024-03-30 23:09:12 +08:00
hoshi-hiyouga
1d2958b728 Merge pull request #3053 from lealaxy/main
Fix pile dataset download config

Former-commit-id: 257f643a74
2024-03-30 20:41:43 +08:00
hiyouga
808ad2071f upgrade gradio to 4.21.0
Former-commit-id: 831c5321ac
2024-03-30 20:37:08 +08:00
li.yunhao
0330ba2ae6 fix pile datset hf hub url
Former-commit-id: 9c2ef9cdf4
2024-03-30 16:06:10 +08:00
hiyouga
d40f6f24a8 Update wechat.jpg
Former-commit-id: a0333bb0ce
2024-03-29 16:55:53 +08:00
hiyouga
fc066cad7f release v0.6.1
Former-commit-id: ca793028c6
2024-03-29 11:36:08 +08:00
hiyouga
1421db282a update readme
Former-commit-id: c1fe6ce782
2024-03-28 22:02:32 +08:00
hiyouga
b265002c19 add project
Former-commit-id: 1e43319f9c
2024-03-28 20:24:27 +08:00
hiyouga
e4f3d583df fix #2982
Former-commit-id: 8d603f8820
2024-03-28 20:22:31 +08:00
hiyouga
a9d5b4b68e update readme
Former-commit-id: 6c94305e47
2024-03-28 18:35:11 +08:00
hiyouga
eac2a5b1d3 fix #3010
Former-commit-id: b19c14870d
2024-03-28 18:31:17 +08:00
hiyouga
89c400633a update trainers
Former-commit-id: 8c77b10912
2024-03-28 18:16:27 +08:00
hoshi-hiyouga
ae9ad13f2a fix ds optimizer
Former-commit-id: 3bcd41b639
2024-03-26 23:39:56 +08:00
hiyouga
300437a5e9 fix #2981
Former-commit-id: b29d5560f1
2024-03-26 17:53:04 +08:00
hiyouga
c311375b50 fix bug
Former-commit-id: 3164b4f11b
2024-03-26 17:30:12 +08:00
hiyouga
ec94e5e876 fix #2961
Former-commit-id: 511f675402
2024-03-26 17:26:14 +08:00
hiyouga
c207b279f2 Update wechat.jpg
Former-commit-id: 7ea1a1f5b3
2024-03-26 16:24:42 +08:00
hiyouga
62312716d9 release v0.6.0 (real)
Former-commit-id: ba70aca8fb
2024-03-25 23:37:48 +08:00
hiyouga
196a33cca4 tiny fix
Former-commit-id: 98a42cbdaa
2024-03-25 23:28:52 +08:00
hiyouga
e90c3769e5 update readme
Former-commit-id: 7b3d8188f5
2024-03-25 23:06:13 +08:00
hoshi-hiyouga
94fb50c52a Merge pull request #2967 from Tsumugii24/main
Update README_zh.md

Former-commit-id: f633ac6646
2024-03-25 23:02:22 +08:00
Tsumugii24
03c387c543 Update README.md
Former-commit-id: 1704599503
2024-03-25 22:54:38 +08:00
Tsumugii24
ce932cd472 Update README_zh.md
Former-commit-id: 7aa77a3451
2024-03-25 22:54:26 +08:00
hiyouga
b18749fb01 add arg check
Former-commit-id: 1484f76a95
2024-03-25 22:42:58 +08:00
hiyouga
27151b8c65 release v0.6.0
Former-commit-id: 6f2b563f12
2024-03-25 22:38:56 +08:00
Tsumugii24
ad09c13a22 Update README_zh.md
Former-commit-id: bb4ca1691a
2024-03-25 22:31:03 +08:00
hoshi-hiyouga
195bda3432 Merge pull request #2963 from rkinas/patch-1
Update requirements.txt

Former-commit-id: f33a3dfadc
2024-03-25 21:49:34 +08:00
Remek Kinas
f4ee888dfa Update requirements.txt
Former-commit-id: b02899bf89
2024-03-25 14:30:58 +01:00
hiyouga
2d73831177 tiny fix
Former-commit-id: 558a538724
2024-03-25 21:18:08 +08:00
hoshi-hiyouga
abbbdae903 Merge pull request #2945 from marko1616/bugfix/lora-model-merge
修复了在 transformers > 4.36.2 版本中部分模型合并 Lora 模型时因生成配置校验而导致的崩溃问题

Former-commit-id: 49f9dbb4b1
2024-03-25 13:36:08 +08:00
marko1616
1d0e24549f pass ruff check
Former-commit-id: c8f0d99704
2024-03-24 16:12:10 +08:00