hiyouga
|
1aaee45a94
|
remove rlhf support for chatglm2&3
Former-commit-id: bcbb5b71961b89719bffb0d202c431c82e6067cc
|
2024-07-02 23:03:17 +08:00 |
|
hiyouga
|
6b755749b9
|
upcast logits
Former-commit-id: df61660351c8af30591471807a20869a45bb055a
|
2024-07-02 22:32:05 +08:00 |
|
hiyouga
|
ca106d1f1b
|
improve rlhf
Former-commit-id: e441780e3db256ca09a442ea9254e7ce16898a07
|
2024-07-02 22:23:08 +08:00 |
|
ancv
|
260f55ea47
|
move efficient_packing from data_args to model_args
Former-commit-id: 7b61659c707480bcf8c802c73e10d12ad5b9b965
|
2024-07-02 18:37:55 +07:00 |
|
hoshi-hiyouga
|
5a1f8a7888
|
Merge pull request #4651 from hzhaoy/add-telechat-1b
Add TeleChat-1B
Former-commit-id: 2da64665d3da9dc0084bb782c65e88bac21f45a1
|
2024-07-02 17:56:43 +08:00 |
|
hzhaoy
|
1df3f02aca
|
add TeleChat-1B
Former-commit-id: 1b81b43fc483a21e0c2985b98459ecf5137aa4c4
|
2024-07-02 17:49:04 +08:00 |
|
hiyouga
|
8c3b285da2
|
fix ppo callbacks
Former-commit-id: 54f1c67c2a802b1d8368a6d1837d4c9a729f2695
|
2024-07-02 17:34:56 +08:00 |
|
hoshi-hiyouga
|
9174675ba9
|
Merge branch 'main' into main
Former-commit-id: 7be442f37d53a0c6324728fa1fa8e2c84d7f0fa5
|
2024-07-01 21:01:09 +08:00 |
|
hiyouga
|
14b37e1e03
|
tiny fix
Former-commit-id: 5dd2e5c3323f56420b5845a5ed28bcd9d4da5e41
|
2024-07-01 05:43:17 +08:00 |
|
hiyouga
|
711ffd0aaf
|
tiny fix
Former-commit-id: 19e43c3a9ed771e991cb273d394ab28fb923f868
|
2024-07-01 03:55:20 +08:00 |
|
hiyouga
|
8baf04d772
|
add eval acc
Former-commit-id: 7ffde76fbfb6192e3aac31ccc098f31ce89181ae
|
2024-07-01 03:51:20 +08:00 |
|
hiyouga
|
a43f518389
|
fix #4402 #4617
Deprecate reserved_label_len arg
Former-commit-id: 4b6568984c0be4b31e7aa91b7c0d52b7f7b12b0b
|
2024-07-01 01:19:27 +08:00 |
|
hiyouga
|
35c65ddf8c
|
fix #4398 #4592
Former-commit-id: 8c92d268903c00392c8bd75a731daa1f107d6202
|
2024-06-30 21:28:51 +08:00 |
|
hiyouga
|
f7a4f3d9c0
|
loose gemma2 attention
Former-commit-id: a0b645017a2de3d58b6cbc71bd91ec96fc7a818b
|
2024-06-29 01:42:14 +08:00 |
|
hiyouga
|
6ce0b5891b
|
bf16 by default, gemma2 attns
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
Former-commit-id: da66c32c7be0adc28d2185b23e9f62d56acb961c
|
2024-06-28 06:00:26 +08:00 |
|
hiyouga
|
0bd6bcd95f
|
increase pissa_iter for stability
Former-commit-id: 03f8d9b0fb10ae58e7f68508197330d616957899
|
2024-06-28 03:18:54 +08:00 |
|
hiyouga
|
81094dc09a
|
add Gemma2 models
Former-commit-id: 8fc5a248ecfd6861cb90dac6c14fe89cdeaf8921
|
2024-06-28 01:26:50 +08:00 |
|
hiyouga
|
884a4a33ee
|
refactor pissa, improve llamaboard
Former-commit-id: 619556e46c19718f702c97df5d570a2a4c5fb13a
|
2024-06-28 01:04:24 +08:00 |
|
hoshi-hiyouga
|
bf8855f90b
|
Merge pull request #4580 from hzhaoy/bugfix-deepspeed-pissa
Fix bug when using pissa method with deepspeed
Former-commit-id: f260d458f91d6d2b4ed141f64844cded11d5aaad
|
2024-06-28 00:46:51 +08:00 |
|
hiyouga
|
b588a099db
|
fix #4549
Former-commit-id: c9fdef10de737d1f433209812ef73e29cb60490a
|
2024-06-28 00:41:58 +08:00 |
|
hiyouga
|
9805350811
|
tiny fix
Former-commit-id: c1a78a3a9f8ab9d57577cee37f9c457d60863ba2
|
2024-06-27 20:14:48 +08:00 |
|
faddddeout
|
c8c45d5371
|
Exit the process with the subprocess's return code when utilizing the CLI
Former-commit-id: ab42a4e2501a80fba1704a506bd1209a441570fa
|
2024-06-27 09:58:00 +00:00 |
|
hzhaoy
|
3491525d96
|
fix #4579
Former-commit-id: 0fa298ff6a4febea36ea9f11c7594277a77e6e9b
|
2024-06-27 13:49:57 +08:00 |
|
hiyouga
|
2381fb68a4
|
add quant checks
Former-commit-id: 15bb053e3549739b1a2134640a659b0f35df7de7
|
2024-06-27 01:12:25 +08:00 |
|
hiyouga
|
0bec843f70
|
tiny fix
Former-commit-id: c6747a39dbbdda8decaa104499918bc7ac5f02e4
|
2024-06-27 00:46:41 +08:00 |
|
hiyouga
|
2d6b32c227
|
tiny fix
Former-commit-id: 69dac21ed9f07977b4540eb838a0ef93f3d3abc4
|
2024-06-27 00:36:04 +08:00 |
|
hiyouga
|
28c2c7fba5
|
support HQQ/EETQ #4113
Former-commit-id: b7cb51ddb394f04fe4646b2c297fc8d918c9979e
|
2024-06-27 00:29:42 +08:00 |
|
hiyouga
|
4041aa024b
|
improve autogptq integration
Former-commit-id: d68408c7b123b8ff92014db35cac0b24b414a6f4
|
2024-06-26 22:11:44 +08:00 |
|
hiyouga
|
e823b200cf
|
fix #4458
Former-commit-id: aab14b15268dbe74ded22549dbd3677474868cbb
|
2024-06-26 19:52:35 +08:00 |
|
hiyouga
|
0265a98942
|
fix #4556
Former-commit-id: 81faa9a985c14e83e38f42aedd228edb676b0695
|
2024-06-26 19:43:16 +08:00 |
|
hiyouga
|
f5bf167a6e
|
lint
Former-commit-id: c9e424d2198b5872ce118a6ab4c109bf73be2bee
|
2024-06-25 02:55:50 +08:00 |
|
hiyouga
|
3d1d42030f
|
fix #4432
Former-commit-id: 972a3b469c600bc6528aef3a49b6fdec63d65803
|
2024-06-25 02:34:04 +08:00 |
|
hiyouga
|
8a6405f39e
|
fix #4379
Former-commit-id: 96bedb4b6445a04ff8b97fb2aadace50b2f882df
|
2024-06-25 02:31:44 +08:00 |
|
hiyouga
|
4d2c279083
|
tiny fix about badam
Former-commit-id: 03f49267c7406e36aee35639f86e6e0383897090
|
2024-06-25 01:54:53 +08:00 |
|
hoshi-hiyouga
|
0105689cf4
|
Merge pull request #4352 from Ledzy/main
[Enhancement] Support ZeRO-3 when using BAdam
Former-commit-id: 0dc75275efa7d7540b472783a52ea6aeaa503c0b
|
2024-06-25 01:49:13 +08:00 |
|
hiyouga
|
f9d00ce051
|
tiny fix
Former-commit-id: bb57478366a70a0871af30ab31c890f471e27ff4
|
2024-06-25 01:15:19 +08:00 |
|
hoshi-hiyouga
|
33bf263e4e
|
Merge pull request #4409 from kno10/patch-2
Print help if no arguments given
Former-commit-id: 94ff749773d9f30ee0c98872ace6b7b542fadeda
|
2024-06-24 23:21:31 +08:00 |
|
hoshi-hiyouga
|
c78db25a24
|
Update cli.py
Former-commit-id: 9db6126496ec9e834541823715f700f92b3968c7
|
2024-06-24 23:21:10 +08:00 |
|
hoshi-hiyouga
|
1dcb792c82
|
Merge pull request #4417 from mMrBun/main
Add tool_format parameter to rewrite templates for different function call formats.
Former-commit-id: 8d1460cad5bff5e4626fdd675046021e0a3d1947
|
2024-06-24 23:17:55 +08:00 |
|
hoshi-hiyouga
|
d9529b749e
|
Update template.py
Former-commit-id: d53517bff6f8734221d7df9982f3bdd4d2eb2cab
|
2024-06-24 23:12:59 +08:00 |
|
hoshi-hiyouga
|
70410aedc1
|
Update loader.py
Former-commit-id: afa59d61844595e6b615227e6bfdc0b16c8015dd
|
2024-06-24 23:06:18 +08:00 |
|
hiyouga
|
a27d4bb4be
|
fix #4410
Former-commit-id: f49adc4ab5eade21d7a9e029212f17688ee9b0cf
|
2024-06-24 22:34:31 +08:00 |
|
hoshi-hiyouga
|
bd26f25daa
|
Merge pull request #4446 from stceum/bug-fix
Bug Fix: `off` is parsed as `False` in yaml file
Former-commit-id: 243478a3d6c08f5677ee57871862694561617f64
|
2024-06-24 21:41:28 +08:00 |
|
hoshi-hiyouga
|
1372049120
|
Update parser.py
Former-commit-id: 60e605cd9d399bd04432864ede9c84302890eac8
|
2024-06-24 21:37:42 +08:00 |
|
stceum
|
0bf750ade8
|
Bug Fix: off is parsed as False in yaml file, changed to disabled to avoid this.
Former-commit-id: 171289d8e4c111fdca2b100282b64c74a04a4726
|
2024-06-24 20:39:31 +08:00 |
|
hiyouga
|
83ee461b9a
|
update readme
Former-commit-id: a1477208471039d3578980f929f1ca8c2a07aa96
|
2024-06-24 18:22:12 +08:00 |
|
mMrBun
|
15a104e26d
|
Add tool_format to overwrite tool formatter template
Former-commit-id: af08971ca50443fd5597e5e4412a3aa17214502f
|
2024-06-22 02:13:23 +08:00 |
|
hiyouga
|
c173a1e9ca
|
remove dup template
Former-commit-id: 5fec12203b24608af4d4993f44a657eb5a0348e5
|
2024-06-22 01:31:32 +08:00 |
|
hiyouga
|
c6f5024e41
|
fix api
Former-commit-id: dcbd6d86dfc49f12529b02ec331e3e5c05740061
|
2024-06-22 00:00:38 +08:00 |
|
Erich Schubert
|
a5a75ec20c
|
Print help if no arguments given
Former-commit-id: 08dfb7ec636fd5bfbb30dac9d5fba6e32bfc6728
|
2024-06-21 09:14:21 +02:00 |
|