416 Commits

Author SHA1 Message Date
hiyouga
06538a1b1b update readme
Former-commit-id: e83e2fa8971db711c804484b6166af4385721275
2024-04-26 05:49:26 +08:00
hiyouga
70bf2a2247 update readme
Former-commit-id: 27ba1b63ce22d6fc2198c517141051705b2e77f6
2024-04-26 05:44:30 +08:00
hiyouga
fff1fb1232 add olmo 1.7
Former-commit-id: 44a43ee152ba746f79bf7ef38520b29cd6a5cc2b
2024-04-24 05:50:50 +08:00
hiyouga
80c8586534 reenable sdpa and fast tok by default
Former-commit-id: 07737a3d2d026c973ab964f948953d6ce0e1f2a9
2024-04-24 02:18:44 +08:00
hiyouga
1bea1ed868 support phi-3
Former-commit-id: 1a13f0555568c240f9d0bf0d94d95fbd252c07e4
2024-04-24 00:28:53 +08:00
hiyouga
d5d6fb3970 update readme
Former-commit-id: db7f3b9784d21ef5c18a11679ad995bb97d61f7c
2024-04-22 17:09:17 +08:00
hiyouga
381b461eb6 update readme
Former-commit-id: 836ca0558698206bbf4e3b92533ad9f67c9f9864
2024-04-22 00:51:35 +08:00
hiyouga
e842328f05 update readme
Former-commit-id: 34d66a3a85f122f51632802033cb09b5dcfb0d22
2024-04-22 00:42:25 +08:00
hiyouga
d8deb0f99e update readme and examples
Former-commit-id: a1f1fac33b2a727b38e8ba52d68a224814d4848b
2024-04-22 00:37:32 +08:00
hiyouga
c0d8d530dd update readme
Former-commit-id: a83e7587a05e388916a3b9bb6fe42cffcdcf0886
2024-04-22 00:21:01 +08:00
hiyouga
ec81d45d27 fix mod stuff
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
2024-04-21 18:11:10 +08:00
Marco
639297a5ef Added Mixture of Depths
Former-commit-id: 620add7b9f634de1a711f7b87b16050adf735e9b
2024-04-18 20:31:24 +02:00
hoshi-hiyouga
15d17a1e86 support llama3
Former-commit-id: 2aaaede2470a0bb8ce3aabb19c1e11a5f20e36e8
2024-04-19 01:13:50 +08:00
hiyouga
e2e0bbde12 tiny fix
Former-commit-id: 3b43a3b7c5f894064afb1dd2b313962bd851156f
2024-04-18 00:22:17 +08:00
hiyouga
a49dd8b4f3 update readme
Former-commit-id: e2f1c6fc6a08750f1bb149ef13cb027cc4352910
2024-04-17 23:40:49 +08:00
hiyouga
8a369cc084 add mixtral 8x22B models
Former-commit-id: cab0598fd0a7e01ca2b40cb8f556992c0626cba1
2024-04-17 23:35:59 +08:00
hiyouga
8beb7a9239 update readme and gradio version
Former-commit-id: 5d62a51c12061c59b509db8fe367817f4e48f737
2024-04-16 18:09:16 +08:00
hiyouga
0a94fab357 support badam for all stages
Former-commit-id: e3d8fc75eb2cfc54efd35bfd9ad6c4ac5acc458c
2024-04-16 17:44:48 +08:00
hiyouga
01b0913f08 update readme
Former-commit-id: cf52911fed8326dbe3f2781431c25959b175260e
2024-04-16 02:36:54 +08:00
hiyouga
76b41acc10 update readme
Former-commit-id: 6084eb7cf14b04e6262874cc64bbb60cc9f1e384
2024-04-16 02:35:36 +08:00
hiyouga
bd2b758b48 add codegemma
Former-commit-id: 6543f3d4496218f7f90c582cb6aa8c852d716cbf
2024-04-16 00:11:15 +08:00
hiyouga
2dc3343b1c support cohere commandR #3184
Former-commit-id: e0dbac28450a0e1e0b84e1577ef785fc762c0b46
2024-04-15 23:26:42 +08:00
hiyouga
431e9804ee release v0.6.2
Former-commit-id: 9d4c949461d232a959c14859ae7fef191faab711
2024-04-11 20:08:51 +08:00
hiyouga
527cce1eb5 update readme
Former-commit-id: a88fe8c1af5e17c2ac459b225a2e03b2cb013783
2024-04-07 00:48:24 +08:00
hiyouga
a6d347726f fix requires for windows
Former-commit-id: 7f6e4126041f2eaa577426310622a115049fbde7
2024-04-03 21:56:43 +08:00
hiyouga
4b23159f53 update vllm example
Former-commit-id: 49a2dfaf90982079239d116fcfac9ca72a8fc2b5
2024-04-02 22:45:20 +08:00
hiyouga
3b16f97c6c update readme
Former-commit-id: 66b0fe4e964ad4d882935910f5e512666c54c2b2
2024-04-02 22:17:48 +08:00
hiyouga
03c538ebb3 add zh readme
Former-commit-id: 7765f337c7f0d7b8866beecb990c346700146c67
2024-04-02 20:58:45 +08:00
hiyouga
135c4e3512 update readme
Former-commit-id: 11a6c1bad65a86b0f3d9c5e5df84d246d7d368df
2024-04-02 20:37:37 +08:00
hiyouga
291ac11156 update readme
Former-commit-id: 949e5fe63811afb05cc687a2117295d494979b69
2024-04-02 20:22:11 +08:00
hiyouga
bf5ffeeae0 simplify readme
Former-commit-id: 92dab8a90bdd82a72a06559943467b56dde12c71
2024-04-02 20:07:43 +08:00
hiyouga
8d987b7af7 add qwen1.5 moe
Former-commit-id: 54b7d349088a828d32551fde56b3467a82df1b9b
2024-04-01 21:49:40 +08:00
hiyouga
34f1de0574 fix #3077
Former-commit-id: aee634cd20e6dfdfbe2fbb47ae57f62b2da2bf9a
2024-04-01 21:35:18 +08:00
hiyouga
ddad9be81d update readme
Former-commit-id: 099db6acc08f9a0da18f642455f29012607a920f
2024-03-31 18:46:34 +08:00
hiyouga
2f878bde11 support ORPO
Former-commit-id: 17bf8a2c3a7bb5b83071c8659cfd8751e894e692
2024-03-31 18:29:50 +08:00
hiyouga
1421db282a update readme
Former-commit-id: c1fe6ce782a5167bdf020c8af96a268a236f61db
2024-03-28 22:02:32 +08:00
hiyouga
b265002c19 add project
Former-commit-id: 1e43319f9cdf53741b4bf6c61749c409db119388
2024-03-28 20:24:27 +08:00
hiyouga
a9d5b4b68e update readme
Former-commit-id: 6c94305e4746c9a735ff62a6428e295d1a67da52
2024-03-28 18:35:11 +08:00
hiyouga
89c400633a update trainers
Former-commit-id: 8c77b1091296e204dc3c8c1f157c288ca5b236bd
2024-03-28 18:16:27 +08:00
hiyouga
e90c3769e5 update readme
Former-commit-id: 7b3d8188f5e4416f326b1dc98ad941020461f67f
2024-03-25 23:06:13 +08:00
hoshi-hiyouga
94fb50c52a Merge pull request #2967 from Tsumugii24/main
Update README_zh.md

Former-commit-id: f633ac6646306f448bc77c1e261c98f15421df75
2024-03-25 23:02:22 +08:00
Tsumugii24
ce932cd472 Update README_zh.md
Former-commit-id: 7aa77a3451d48214a683b46fa5da41d0fa30d961
2024-03-25 22:54:26 +08:00
hiyouga
27151b8c65 release v0.6.0
Former-commit-id: 6f2b563f125fe51ee32753e58f902a4911ab757c
2024-03-25 22:38:56 +08:00
Tsumugii24
ad09c13a22 Update README_zh.md
Former-commit-id: bb4ca1691a943aef220f03547bbd6acb1e29b31c
2024-03-25 22:31:03 +08:00
hiyouga
58aa576ae5 fix #2941
Former-commit-id: a1c8c98c5fecfc0dd0ed1be33ee8dd2ade05b708
2024-03-24 00:28:44 +08:00
0xez
028a8bc532 Update README_zh.md, fix the release date of the paper
Former-commit-id: be0360303d2e7275e14586dc503a9581f80ce303
2024-03-22 10:41:17 +08:00
hiyouga
63c83f3802 add citation
Former-commit-id: 5eaa50fa01a7172408840255d18bcc0ab43a01fb
2024-03-21 17:04:10 +08:00
hiyouga
0684e315be paper release
Former-commit-id: 0581bfdbc7d6c764e63f8d54271da7663ca354d9
2024-03-21 13:49:17 +08:00
hiyouga
ada7e20eb4 update readme
Former-commit-id: bfe7a9128952bacef93d5478938d3e088bd0480d
2024-03-21 00:48:42 +08:00
hiyouga
7999836fb6 support fsdp + qlora
Former-commit-id: 84082251621e1470b3b5406a56d0a967780a1804
2024-03-21 00:36:06 +08:00