Ronghang Hu
05d9e57fb3
[docs] add a release note and new installation instructions for SAM 2.1 ( #338 )
2024-09-30 09:55:58 -07:00
Ronghang Hu
429a2c7360
minor update README.md
2024-09-28 23:32:25 -07:00
Chay Ryali
3a7889d905
Merge pull request #335 from facebookresearch/sam2.1
...
SAM 2.1
2024-09-28 23:01:29 -07:00
Haitham Khedr
aa9b8722d0
SAM2.1
...
SAM2.1 checkpoints + training code + Demo
2024-09-29 05:49:56 +00:00
Ronghang Hu
7e1596c0b6
open README.md with unicode (to support Hugging Face emoji); fix various typos ( #218 )
...
(close #217 , #66 , #67 , #69 , #91 , #126 , #127 , #145 )
2024-08-14 09:06:25 -07:00
Haitham Khedr
0db838b117
Merge pull request #205 from facebookresearch/haitham/fix_hf_image_predictor
...
Fix HF image predictor
2024-08-12 17:04:04 -07:00
Haitham Khedr
fd5125b97a
accept kwargs in auto_mask_generator
2024-08-13 00:02:36 +00:00
Haitham Khedr
1191677e1e
Fix HF image predictor
2024-08-12 23:41:41 +00:00
Ronghang Hu
dce7b5446f
improving warning message and adding further tips for installation ( #204 )
2024-08-12 11:37:41 -07:00
Ronghang Hu
1034ee2a1a
better support for non-CUDA devices (CPU, MPS) ( #192 )
2024-08-12 10:46:50 -07:00
Chay Ryali
778e112740
Merge pull request #167 from arun477/patch-1
...
remove unused attributes from hieradet.py
2024-08-09 10:31:56 -07:00
Arun
8f607e2de1
Merge branch 'main' into patch-1
2024-08-09 11:14:43 +05:30
Arun
46945a2122
Update hieradet.py
...
ufmt formatting fixed.
2024-08-09 11:14:11 +05:30
Ronghang Hu
d421e0b040
add Colab support to the notebooks; pack config files in sam2_configs package during installation ( #176 )
2024-08-08 11:03:22 -07:00
Arun
102ddb8899
Merge branch 'main' into patch-1
2024-08-08 09:59:47 +05:30
Ronghang Hu
6186d1529a
also catch errors during installation in case CUDAExtension cannot be loaded ( #175 )
...
Previously we only catch build errors in `BuildExtension` in https://github.com/facebookresearch/segment-anything-2/pull/155 . However, in some cases, the `CUDAExtension` instance might not load. So in this PR, we also catch such errors for `CUDAExtension`.
2024-08-07 12:26:11 -07:00
Ronghang Hu
6ecb5ff8d0
Add interface for box prompt in SAM 2 video predictor ( #174 )
...
This PR adds an example to provide box prompt in SAM 2 as inputs to the `add_new_points_or_box` API (renamed from`add_new_points`, which is kept for backward compatibility). If `box` is provided, we add it as the first two points with labels 2 and 3, along with the user-provided points (consistent with how SAM 2 is trained).
The video predictor notebook `notebooks/video_predictor_example.ipynb` is updated to include segmenting from box prompt as an example.
2024-08-07 11:54:30 -07:00
Arun
086daf0641
Merge branch 'main' into patch-1
2024-08-07 21:50:26 +05:30
Haitham Khedr
6ba4c65cb2
Merge pull request #128 from NielsRogge/add_hf
...
Integrate with Hugging Face
2024-08-07 08:54:49 -07:00
Niels
9b58611e24
Address comment
2024-08-07 17:48:12 +02:00
Arun
6ec8560436
Update hieradet.py
...
Not used
head_dim = dim_out // num_heads
self.scale = head_dim**-0.5
F.scaled_dot_product_attention takes care of this automatically.
2024-08-07 11:35:46 +05:30
Niels
43c385c263
Update docstrings
2024-08-06 23:00:26 +02:00
Niels
322aa3e7e5
Revert code snippet
2024-08-06 22:57:07 +02:00
Diego Garcia
511199d7a9
Updated INSTALL.md with CUDA_HOME-related troubleshooting ( #140 )
...
This is referring to https://github.com/facebookresearch/segment-anything-2/issues/137 , which in itself refers to a common problem during installation, mentioned on https://github.com/facebookresearch/segment-anything-2/issues/19 .
Some users may encounter significant trouble installing the project, running into the error `OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.`. Simply adding the `--no-build-isolation` flag to the pip install, e.g. `pip install --no-build-isolation -e .`, usually solves this problem. However, this fix is not mentioned anywhere within the readmes or installation troubleshooting docs. This PR adds this recommendation into the INSTALL.md file under the "My installation failed with `CUDA_HOME environment variable is not set` " section, ensuring that more users are aware of this potential fix.
Examples of users experiencing related difficulties when installing:
https://github.com/facebookresearch/segment-anything-2/issues/19
https://github.com/facebookresearch/segment-anything-2/issues/41
https://github.com/facebookresearch/segment-anything-2/issues/99
https://github.com/facebookresearch/segment-anything-2/issues/133
2024-08-06 13:45:15 -07:00
Niels
8f15c6255a
Format using ufmt
2024-08-06 22:43:35 +02:00
jhj0517
0bac418736
Update INSTALL.md ( #156 )
...
This PR suggests a way to resolve the error of `unsupported Microsoft Visual Studio version!` in INSTALL.md.
Adding `-allow-unsupported-compiler` argument for the `nvcc` worked.
Editing [setup.py](https://github.com/facebookresearch/segment-anything-2/blob/main/setup.py ) is required to add the `-allow-unsupported-compiler` argument for `nvcc`.
```python
def get_extensions():
srcs = ["sam2/csrc/connected_components.cu"]
compile_args = {
"cxx": [],
"nvcc": [
"-DCUDA_HAS_FP16=1",
"-D__CUDA_NO_HALF_OPERATORS__",
"-D__CUDA_NO_HALF_CONVERSIONS__",
"-D__CUDA_NO_HALF2_OPERATORS__",
"-allow-unsupported-compiler" # Add this argument
],
}
ext_modules = [CUDAExtension("sam2._C", srcs, extra_compile_args=compile_args)]
return ext_modules
```
2024-08-06 13:43:12 -07:00
Niels
27a167c004
Update README
2024-08-06 22:41:32 +02:00
Ronghang Hu
6f7e700c37
Make it optional to build CUDA extension for SAM 2; also fallback to all available kernels if Flash Attention fails ( #155 )
...
In this PR, we make it optional to build the SAM 2 CUDA extension, in observation that many users encounter difficulties with the CUDA compilation step.
1. During installation, we catch build errors and print a warning message. We also allow explicitly turning off the CUDA extension building with `SAM2_BUILD_CUDA=0`.
2. At runtime, we catch CUDA kernel errors from connected components and print a warning on skipping the post processing step.
We also fall back to the all available kernels if the Flash Attention kernel fails.
2024-08-06 10:52:01 -07:00
Niels
a36edf1e01
Clean up
2024-08-06 08:34:42 +02:00
Niels
e815f70a38
Address comment
2024-08-06 08:32:36 +02:00
Niels
fbf7e3a664
Add link
2024-08-05 22:12:15 +02:00
Niels
e9503c96fe
Move HF to separate section
2024-08-05 22:10:57 +02:00
Niels
c3393d8b5f
Include original code snippet
2024-08-05 22:08:54 +02:00
Haitham Khedr
0230c5ff93
Merge pull request #152 from haithamkhedr/main
...
Configure a workflow for format checking
2024-08-05 10:02:32 -07:00
Haitham Khedr
5e3d6ca6b5
Merge pull request #1 from haithamkhedr/CI
2024-08-05 09:36:54 -07:00
Haitham Khedr
3b0fd9e4a9
Update workflow
2024-08-05 09:28:28 -07:00
Haitham Khedr
acd3939f88
Add workflow
2024-08-05 09:16:29 -07:00
Niels
841cc1f015
Update docstring
2024-08-05 09:44:03 +02:00
Niels
e93be7f6aa
Update README
2024-08-05 09:43:04 +02:00
Niels
cb48213066
Update links
2024-08-05 09:41:40 +02:00
Niels
6aeee34775
Make huggingface_hub soft dependency
2024-08-05 09:37:53 +02:00
Niels
0c28c630c2
Do not load config from the hub
2024-08-03 14:45:20 +02:00
Niels
3af4e82263
Add model_id_to_filenames
2024-08-03 14:18:23 +02:00
Niels
17b74501fb
Use classmethod
2024-08-03 14:14:12 +02:00
Niels
b72a8a97f0
First draft
2024-08-03 12:57:05 +02:00
Ronghang Hu
57bc94b739
Merge pull request #119 from facebookresearch/ronghanghu/installation_faq
...
[doc] add `INSTALL.md` as an installation FAQ page
2024-08-02 15:07:25 -07:00
Ronghang Hu
b744a3c084
[doc] add INSTALL.md as an installation FAQ page
2024-08-02 22:05:46 +00:00
Haitham Khedr
d1fc9a0686
Merge pull request #116 from facebookresearch/arXiv-paper
...
Update arXiv paper citation
2024-08-02 13:02:08 -07:00
Haitham Khedr
59550d4deb
Update README.md
2024-08-02 12:58:23 -07:00
Haitham Khedr
de4db16676
Update README.md
2024-08-02 12:56:06 -07:00
