hiyouga
|
21ff550059
|
pin tokenizers version
Former-commit-id: 2b747737f0be2caeb737fe87dad6bf5902b4a588
|
2024-11-27 05:24:58 +00:00 |
|
hiyouga
|
7631b97e80
|
add marco-o1 and openo1 dataset
Former-commit-id: 51d49e075470951f109bcdde136203f972450c2e
|
2024-11-27 04:20:23 +00:00 |
|
hoshi-hiyouga
|
1a8c913d01
|
Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset
Former-commit-id: d8258ba7e792d5f17ae80d5e8b303e8fa820f162
|
2024-11-27 00:16:15 +08:00 |
|
hoshi-hiyouga
|
d6dd146e23
|
Merge pull request #6151 from hiyouga/hiyouga/fix_mllama
[model] fix mllama cross mask
Former-commit-id: 7e64661c1fc53c4d3d9fd915162b762e403b1991
|
2024-11-27 00:07:54 +08:00 |
|
hiyouga
|
41c1d014a9
|
fix #6149
Former-commit-id: b581b272793314a9602f4dc2fb646a988a6249df
|
2024-11-26 16:03:02 +00:00 |
|
hiyouga
|
9cb232aaad
|
fix mllama cross_mask
Former-commit-id: c33967308bebd99489d28bd5a879525cf304c1f9
|
2024-11-26 15:56:58 +00:00 |
|
hoshi-hiyouga
|
8c0b327edf
|
Merge pull request #6141 from hiyouga/hiyouga-patch-1
[misc] chore: lint
Former-commit-id: ba2b94c68eb08798792be76f95b94b358ce69f44
|
2024-11-25 23:02:11 +08:00 |
|
hoshi-hiyouga
|
e15457cb47
|
lint
Former-commit-id: 57c3cf1f498d5ffafdc8c06e0f8713f8ff77de81
|
2024-11-25 22:55:56 +08:00 |
|
hoshi-hiyouga
|
72b058a439
|
Merge pull request #6140 from hiyouga/hiyouga/fix_mllama
[data] fix mllama plugin
Former-commit-id: b7e220a7d82db26cbe7ced9ed30332418cc4fa20
|
2024-11-25 22:32:07 +08:00 |
|
hoshi-hiyouga
|
675af91ee7
|
fix #6139
Former-commit-id: a4e9552b9ade6ebb22d782f0412003279ddca23c
|
2024-11-25 22:22:06 +08:00 |
|
hoshi-hiyouga
|
d52a6bcdc3
|
Merge pull request #6138 from hiyouga/hiyouga/update_data
[data] update dataset info
Former-commit-id: 3be52ece170ecab91580757129c77c74435ccdbc
|
2024-11-25 21:47:23 +08:00 |
|
hoshi-hiyouga
|
a27b418772
|
update dataset
Former-commit-id: 36233e127e3fd1d6b7c47baffe6a55830bcc0aad
|
2024-11-25 21:47:04 +08:00 |
|
hoshi-hiyouga
|
45854c79a3
|
Merge pull request #6137 from hiyouga/hiyouga/fix_mllama
[model] fix mllama hidden_size
Former-commit-id: 54f1d3f4064b9d37261883e8399c8e7909178857
|
2024-11-25 20:17:33 +08:00 |
|
hoshi-hiyouga
|
a392f999fb
|
fix visual patch
Former-commit-id: ac51fa37cc23518b30a6123e188964dce39be82f
|
2024-11-25 20:06:06 +08:00 |
|
hoshi-hiyouga
|
2b6c30c54c
|
fix #6136
Former-commit-id: b84e5d91a070c473ea820c379bf9b5abbca6df2c
|
2024-11-25 19:43:42 +08:00 |
|
hoshi-hiyouga
|
3c511bc3cc
|
Merge pull request #6127 from hiyouga/hiyouga/dev_version
[misc] set dev version
Former-commit-id: cb0a51031324c9fdf0c1fedf237692a40c2091d9
|
2024-11-25 01:42:29 +08:00 |
|
hiyouga
|
0cefc7d064
|
set dev version
Former-commit-id: a0aea74100a9505664023f6a46fc290e332dfa40
|
2024-11-25 01:36:49 +08:00 |
|
hoshi-hiyouga
|
6c0b7435b8
|
Merge pull request #6124 from hiyouga/hiyouga/release
[release] release v0.9.1
Former-commit-id: f61cdd99fd282612884c92d36e111ad46b4e0d00
|
2024-11-25 00:20:02 +08:00 |
|
hoshi-hiyouga
|
0a6eb73789
|
Merge pull request #6126 from hiyouga/hiyouga/fix_vllm
[inference] fix vllm
Former-commit-id: c5025c3ee6e67e62724cc3f34fbf8aa9968590f5
|
2024-11-25 00:19:54 +08:00 |
|
hoshi-hiyouga
|
b49737837c
|
Merge pull request #6010 from XYZliang/fix-#4316
Increase shm_size to 16GB in docker-compose.yml
Former-commit-id: 73194233f9f1aa8299be1360deb25b753338e168
|
2024-11-25 00:16:42 +08:00 |
|
hoshi-hiyouga
|
83eb232d26
|
Merge pull request #6125 from hiyouga/hiyouga/fix_cli
[cli] remove shell=True in cli
Former-commit-id: cf3ec28baa9a9f1ba342fe3a627e85d8799a1912
|
2024-11-25 00:07:35 +08:00 |
|
hiyouga
|
c9bd9fee0d
|
fix vllm
Former-commit-id: 9ce0e4b07e3733c015137bc93c7e6d53bf25b08e
|
2024-11-25 00:07:24 +08:00 |
|
hiyouga
|
53e27fe374
|
fix cli
Former-commit-id: 9338c287cc15c0cad8d5ddbdadfb6f64d383c034
|
2024-11-24 23:56:21 +08:00 |
|
hiyouga
|
4748ff090c
|
release v0.9.1
Former-commit-id: a134ad42c65dc4d72e3083c932ddfaaa687c513d
|
2024-11-24 23:48:41 +08:00 |
|
hoshi-hiyouga
|
b78421139b
|
Merge pull request #6123 from hiyouga/hiyouga/fix_qwen2vl_vllm
[inference] fix qwen2vl vllm infer
Former-commit-id: 5d886f99e3bd20795d5313dccf9f045d37a0aefc
|
2024-11-24 23:42:11 +08:00 |
|
hiyouga
|
d23aecae42
|
fix qwen2vl vllm infer
Former-commit-id: 3ac98847fdc23129912c8994ed19a8c66fe00b8c
|
2024-11-24 23:27:24 +08:00 |
|
hoshi-hiyouga
|
34bf588a70
|
Merge pull request #6121 from hiyouga/hiyouga/readme
[readme] update readme
Former-commit-id: d603650a671c3a323f29001fd0cc53563d28f3e0
|
2024-11-24 03:28:09 +08:00 |
|
hiyouga
|
8b34300625
|
update readme
Former-commit-id: 48423afe53d6f6de1a257a33019909009626a42e
|
2024-11-23 19:27:18 +00:00 |
|
hoshi-hiyouga
|
e7ff714f74
|
Merge pull request #6120 from hiyouga/hiyouga/fix_ci
[test] fix ci
Former-commit-id: 573a0978b82986ec45aae16637edb6ff4af54a35
|
2024-11-24 03:21:11 +08:00 |
|
hiyouga
|
bcf284653d
|
fix ci
Former-commit-id: 91c672f0147bb6eb998871a42f8a89992af88528
|
2024-11-23 19:13:32 +00:00 |
|
hoshi-hiyouga
|
8951b58176
|
Merge pull request #5555 from marko1616/feat/llama3.2vl
Support llama3.2 vision
Former-commit-id: 8151dc488585d1cec6d4a0c9c6dcd46a6a57e9f0
|
2024-11-24 02:49:07 +08:00 |
|
hiyouga
|
0a4f8145e4
|
add forbidden modules
Former-commit-id: c9f4d051d0eca7515bab201afdef17f1ac1b3cb9
|
2024-11-23 18:34:15 +00:00 |
|
hiyouga
|
cc22c045a7
|
fix inputs
Former-commit-id: 7d535bb8cdf7e81edda81152e63c8cfe6c9dcc9f
|
2024-11-23 18:26:02 +00:00 |
|
marko1616
|
7ad8309e99
|
Linter.
Former-commit-id: 719d124f65ebb18ba0a1212751da9909160fb6f1
|
2024-11-23 16:09:04 +00:00 |
|
marko1616
|
87ecce856b
|
Tiny fix.
Former-commit-id: 4c1cef12d812832eed58b5da562ba083104756d3
|
2024-11-23 16:09:01 +00:00 |
|
marko1616
|
a948755f28
|
Support llama3.2vl.
Former-commit-id: 664229d7d1f7994e1ae68c5d197ab81f081bcd2e
|
2024-11-23 16:07:35 +00:00 |
|
hoshi-hiyouga
|
b393217ad9
|
Merge commit from fork
[patch] Patch remote OS command injection vulnerability
Former-commit-id: 960897b950e29aa440afa45b4deb9d42d2f6e941
|
2024-11-21 22:39:44 +08:00 |
|
hoshi-hiyouga
|
8fda09c195
|
do not split save_cmd ret value
Former-commit-id: 1e312072fb4a9f472e2d3fa7e6b4fb0aec00b566
|
2024-11-21 22:30:23 +08:00 |
|
superboy-zjc
|
153bd60d08
|
[patch] Patch remote OS command injection vulnerability
Former-commit-id: 4678ceea4ce334a8289caf87d86047e67c67c603
|
2024-11-21 01:52:12 -05:00 |
|
hoshi-hiyouga
|
874cdc101b
|
Merge pull request #6078 from wtmlon/support-efficient-tokens-calculation
support effective tokens calculation on sft/dpo
Former-commit-id: d0510e6d49b43c5ffadd8af653c3bdecc1582417
|
2024-11-20 13:43:15 +08:00 |
|
Ting
|
1c8514dc8d
|
code refactor
Former-commit-id: ee3f85aa9677d0aeecb3bc396530d2cd7c50dce5
|
2024-11-19 20:33:18 +08:00 |
|
Ting
|
befe4310f0
|
update
Former-commit-id: 516ed0ea5fed8c74fe3669a7e85dd89b5a0ec3c2
|
2024-11-19 19:12:10 +08:00 |
|
Ting
|
8868bb1ed3
|
update
Former-commit-id: a3e8ca53e654136242197a2da872cc0e5cf67880
|
2024-11-19 19:10:07 +08:00 |
|
Ting
|
a9ae5fe5e5
|
support efficient tokens calculation on sft/dpo
Former-commit-id: b157d5cccdeb42412b8b440d25d5bdfa8a50be68
|
2024-11-19 17:15:47 +08:00 |
|
hoshi-hiyouga
|
7a5ca3c120
|
Merge pull request #6065 from hiyouga/hiyouga-patch-1
[misc] fix dep package version
Former-commit-id: 34a09e6cd1a8b1c2acddf837f1c787978bc526f5
|
2024-11-18 21:13:59 +08:00 |
|
hoshi-hiyouga
|
a86b980dc3
|
fix #6061
Former-commit-id: 4eb0b6763f0a1b3cde89bd5c69760178bb35d303
|
2024-11-18 20:56:44 +08:00 |
|
hoshi-hiyouga
|
f0c8465299
|
Merge pull request #6052 from hiyouga/hiyouga-patch-1
[trainer] fix DPO metrics
Former-commit-id: 94add263fe874d2be1b37110faf5da7a5096df6d
|
2024-11-16 16:20:12 +08:00 |
|
hoshi-hiyouga
|
e7b825121e
|
fix #6050
Former-commit-id: 028ea3d9b4fa4ab74a969ac80e61a449d6c15e74
|
2024-11-16 16:11:16 +08:00 |
|
hoshi-hiyouga
|
3e9b110b24
|
Merge pull request #6046 from hiyouga/hiyouga/add_code_model
[model] add qwen-coder and opencoder
Former-commit-id: 5b485671aee8dd2f775371d0b9ff3d0d043159f3
|
2024-11-15 21:58:03 +08:00 |
|
hiyouga
|
a08f57cae8
|
add qwen-coder and opencoder
Former-commit-id: 9669a42704cd40bdfc76ca278cc6a562549bc27d
|
2024-11-15 21:48:38 +08:00 |
|