Commit Graph

2472 Commits

Author SHA1 Message Date
hiyouga
a9a652eb6f update test template
Former-commit-id: a4ae3ab4ab
2024-07-15 00:49:34 +08:00
hoshi-hiyouga
140b512426 Update parser.py
Former-commit-id: 3d39d74003
2024-07-14 23:04:34 +08:00
hoshi-hiyouga
ddbd848e49 Update README.md
Former-commit-id: 9d64507bd5
2024-07-14 21:27:04 +08:00
hiyouga
2564269826 add gemma test
Former-commit-id: f1d8d29bc3
2024-07-14 18:01:45 +08:00
hiyouga
380c7741f5 fix test
Former-commit-id: 173921419d
2024-07-14 15:44:30 +08:00
hiyouga
dfd2d912cd fix #4699
slow tokenizer for yi models


Former-commit-id: 88a20ba797
2024-07-14 15:34:22 +08:00
hiyouga
12e0e5d0d7 tiny fix
Former-commit-id: d3c01552e0
2024-07-14 10:56:45 +08:00
hiyouga
0b26011181 fix gemma2 attention
Former-commit-id: 2f6af73da2
2024-07-13 23:33:45 +08:00
hiyouga
fb387ae1c3 update workflows
Former-commit-id: 7b19e99ed7
2024-07-13 22:31:15 +08:00
hoshi-hiyouga
e83e36e475 Merge pull request #4781 from hzhaoy/fix-dockerfile-cuda
Fix cuda Dockerfile

Former-commit-id: 5da54deb50
2024-07-13 22:25:32 +08:00
hiyouga
3baf1d1f7e fix #4792
Former-commit-id: 6b48308ef9
2024-07-13 22:07:58 +08:00
hoshi-hiyouga
f616fd61bd Merge pull request #4804 from codemayq/fix-examples
tiny fix of examples

Former-commit-id: 32699a82a6
2024-07-13 20:49:13 +08:00
hoshi-hiyouga
f9a4d96194 Update llava1_5.yaml
Former-commit-id: f618b80fa2
2024-07-13 20:30:06 +08:00
codingma
1ccc6153c7 1. fix output_dir in llama3_lora_pretrain.yaml
2. add llava1_5.yaml for inference


Former-commit-id: 982a1cdd24
2024-07-13 13:16:22 +08:00
hzhaoy
955e01c038 tiny fix
Former-commit-id: 8bab99c582
2024-07-12 00:28:44 +08:00
hzhaoy
93ba3bd5b0 fix #4780
Former-commit-id: 642c6d666f
2024-07-12 00:25:48 +08:00
hzhaoy
b3e4793ded fix #4779
Former-commit-id: a8bf1abf0f
2024-07-12 00:15:15 +08:00
codemayq
0fa59c9b4c update wechat_npu.jpg
Former-commit-id: 67040f149c
2024-07-11 20:03:39 +08:00
hoshi-hiyouga
f85187b4dd Merge pull request #4700 from marko1616/patch-1
Fix Windows command preview

Former-commit-id: 555194e150
2024-07-10 13:51:50 +08:00
hoshi-hiyouga
2528487847 Merge pull request #4746 from yzoaim/fix
fix src/llamafactory/train/callbacks.py

Former-commit-id: 40c3b88b68
2024-07-10 13:32:49 +08:00
hoshi-hiyouga
4edd7c3529 Update callbacks.py
Former-commit-id: 39cd89ce17
2024-07-10 13:32:20 +08:00
-.-
973aac3203 fix src/llamafactory/train/callbacks.py
Former-commit-id: cff89a2e89
2024-07-10 12:05:51 +08:00
hiyouga
a9ce54d143 fix #4731
Former-commit-id: 51942acee8
2024-07-10 11:32:36 +08:00
hiyouga
d7130ec635 fix ppo trainer
Former-commit-id: fb0c400116
2024-07-10 11:05:45 +08:00
hiyouga
aa15ca1719 fix #4742
Former-commit-id: 2f09520c0d
2024-07-09 23:24:24 +08:00
hiyouga
7e9d51fb95 Update wechat.jpg
Former-commit-id: 86b1594823
2024-07-09 09:25:11 +08:00
hoshi-hiyouga
553e517f0f Merge pull request #4706 from T-Atlas/main
chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 563a27dab7
2024-07-07 15:50:38 +08:00
hoshi-hiyouga
7483e187c6 Update packages.py
Former-commit-id: f84b007ebb
2024-07-07 15:48:29 +08:00
Lian Junhong
7ca84e0a09 chore: Update vllm_engine.py to support vllm version >= 0.5.1
Former-commit-id: 322663bf90
2024-07-07 15:08:12 +08:00
hiyouga
f3c105f088 fix #4705
Former-commit-id: a15782cb9f
2024-07-07 13:10:06 +08:00
marko1616
c8205c5163 Update utils.py
In windows mutiline command should like
command --arg1 xxx `
--arg2 xxx `

Former-commit-id: e0562521bb
2024-07-06 20:40:13 +08:00
hiyouga
7fcffb860d add codegeex4, internlm2.5
Former-commit-id: 53b1002fb7
2024-07-06 16:16:47 +08:00
hiyouga
d97bb11821 update pissa example
Former-commit-id: c9bb0757ec
2024-07-06 15:47:32 +08:00
codingma
74f0d02eb8 1. add custom eval dataset support
2. merge load dataset and split dataset function


Former-commit-id: 76f3bbcfc0
2024-07-05 15:52:10 +08:00
hiyouga
8379a39776 fix processors
Former-commit-id: 9f33f1edf5
2024-07-05 08:33:22 +08:00
hiyouga
9aa3403687 fix #4683
Former-commit-id: e43809bced
2024-07-05 00:58:05 +08:00
hiyouga
956e555310 fix #4674
Former-commit-id: ed232311e8
2024-07-05 00:41:03 +08:00
hiyouga
c1262dbf94 Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory
Former-commit-id: 226a9e563f
2024-07-04 14:23:37 +08:00
hiyouga
e17f12fcad fix #4677
Former-commit-id: 1e27e8c776
2024-07-04 14:22:07 +08:00
hoshi-hiyouga
d08456c0ce Merge pull request #4673 from hzhaoy/main
tiny fix

Former-commit-id: 07d96d497c
2024-07-04 10:40:41 +08:00
hzhaoy
6d892dbc23 tiny fix
Former-commit-id: 738df47748
2024-07-04 10:20:28 +08:00
hiyouga
aa14a625e4 update tests
Former-commit-id: 636bb9c1e6
2024-07-04 04:00:12 +08:00
hiyouga
d7657d772d tiny fix
Former-commit-id: 0c699de39d
2024-07-04 03:47:05 +08:00
hiyouga
cbb93a2b47 tiny fix
Former-commit-id: 44747cebd2
2024-07-04 03:02:23 +08:00
hiyouga
4987aa32ba fix data map for packing
Former-commit-id: b5d101e1bf
2024-07-04 03:01:31 +08:00
hiyouga
c15210a312 update wechat
Former-commit-id: b03e4a74ba
2024-07-04 01:55:05 +08:00
hiyouga
7b3c1f29ff fix packing for eager/sdpa attn
Former-commit-id: 6fd6aa4530
2024-07-04 01:52:43 +08:00
hoshi-hiyouga
a38ff842d0 Merge pull request #4224 from chuan298/main
Implement efficient packing without cross-contamination attention

Former-commit-id: 87d9b2d005
2024-07-04 01:18:54 +08:00
hiyouga
bfdaadcc40 update packing
Former-commit-id: cce7083024
2024-07-04 01:10:55 +08:00
hoshi-hiyouga
51c75985b8 Update packing.py
Former-commit-id: a36e8f2dd5
2024-07-03 23:36:01 +08:00