hoshi-hiyouga
c6bcca4c83
[example] update examples ( #7964 )
2025-05-06 17:24:25 +02:00
hoshi-hiyouga
278df4308d
[parser] support omegaconf ( #7793 )
2025-04-21 23:30:30 +08:00
Qiaolin Yu
30038d9ce7
[inference] support sglang backend ( #7278 )
...
* Mimic SGLang offline Engine
* Add more tests and args
* Pass all current tests
* Clean Code
* fix sample_params
* clean code
* Fix Stream Chat
* change sglang from engine mode to server mode
* fix
* Fix Review Issues
* Use SGLang Built-In Utilities
* Fix test SGLang
* Some Doc Issue
* fix sglang engine
* add readme
---------
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: hiyouga <hiyouga@buaa.edu.cn>
2025-03-15 04:37:58 +08:00
Yaser Afshar
76ebd62ac1
Add missing key to init_kwargs
...
Former-commit-id: 1c8ad22a5f167bf4e1c845e273583e5cb3a0214e
2024-12-17 12:34:05 +00:00
Yaser Afshar
fe4546a7bb
Add trust_remote_code parameter and remove True
...
- Introduced a new model parameter `trust_remote_code`
- Set the default value of `trust_remote_code` to `False`
to enhance security
Former-commit-id: 09437763267bc7081159a6878cee9652a2b1ddac
2024-12-17 12:25:12 +00:00
hiyouga
ba901bc000
update assets
...
Former-commit-id: 7059055e89cc3f8557581d5d5b728a82ab5b0899
2024-12-14 17:36:03 +00:00
hiyouga
235cdcacee
support batch infer in vllm
...
Former-commit-id: 1324d158f954d777f1fbf09f46149c372704b388
2024-12-04 13:50:00 +00:00
hiyouga
f31e7e0dfc
remove visual_inputs, fix qlora
...
Former-commit-id: a025c3df61db154bef13033518903bbf846f4fc8
2024-08-31 00:24:51 +08:00
hiyouga
c883542583
add examples
...
Former-commit-id: e08045a9468986edf1e84001e6043db0ee2e5265
2024-08-30 21:43:19 +08:00
hoshi-hiyouga
f9a4d96194
Update llava1_5.yaml
...
Former-commit-id: f618b80fa2173003b7e960dd20cecbede3db41c9
2024-07-13 20:30:06 +08:00
codingma
1ccc6153c7
1. fix output_dir in llama3_lora_pretrain.yaml
...
2. add llava1_5.yaml for inference
Former-commit-id: 982a1cdd24dfa51535af3e49c7ea80fddc95b0ee
2024-07-13 13:16:22 +08:00
hiyouga
eb21a527a6
update docs
...
Former-commit-id: 34d33e22570338da709b8499830adb06b202095c
2024-05-06 21:47:00 +08:00
hiyouga
289d1f3679
update webui and add CLIs
...
Former-commit-id: 245fe47ece22a4b7822449b126715aaa8ec25aba
2024-05-03 02:58:23 +08:00
hiyouga
eb70328eec
add llava to llamaboard
...
Former-commit-id: cd3a960f81579b4173ae79aa14d075e94651e8ce
2024-04-26 06:41:35 +08:00
hiyouga
ec81d45d27
fix mod stuff
...
Former-commit-id: f58425ab45727f7859583d4b9fda776715e27ff6
2024-04-21 18:11:10 +08:00
hiyouga
e341fa59fe
update examples
...
Former-commit-id: f22eaeb5bc5329146feb0cc5455fae8ce10380f8
2024-04-02 20:51:21 +08:00
hiyouga
bf5ffeeae0
simplify readme
...
Former-commit-id: 92dab8a90bdd82a72a06559943467b56dde12c71
2024-04-02 20:07:43 +08:00
