423A35C7/pytorch3d
1
0
Fork 0
mirror of https://github.com/facebookresearch/pytorch3d.git synced 2025-08-02 03:42:50 +08:00
Code Issues Packages Projects Releases Wiki Activity
pytorch3d/tests/data
History
Krzysztof Chalupka cb49550486 Add MeshRasterizerOpenGL 
Summary:
Adding MeshRasterizerOpenGL, a faster alternative to MeshRasterizer. The new rasterizer follows the ideas from "Differentiable Surface Rendering via non-Differentiable Sampling".

The new rasterizer 20x faster on a 2M face mesh (try pose optimization on Nefertiti from https://www.cs.cmu.edu/~kmcrane/Projects/ModelRepository/!). The larger the mesh, the larger the speedup.

There are two main disadvantages:
* The new rasterizer works with an OpenGL backend, so requires pycuda.gl and pyopengl installed (though we avoided writing any C++ code, everything is in Python!)
* The new rasterizer is non-differentiable. However, you can still differentiate the rendering function if you use if with the new SplatterPhongShader which we recently added to PyTorch3D (see the original paper cited above).

Reviewed By: patricklabatut, jcjohnson

Differential Revision: D37698816

fbshipit-source-id: 54d120639d3cb001f096237807e54aced0acda25
2022-07-22 15:52:50 -07:00
..
missing_files_obj
Initial commit
2020-01-23 11:53:46 -08:00
missing_usemtl
Importing obj files without usemtl
2022-02-10 09:39:44 -08:00
obj_mtl_no_image
Fix texture atlas for objs which only have material properties
2020-10-07 12:54:01 -07:00
test_marching_cubes_data
Classic Marching Cubes algorithm implementation
2020-12-18 07:25:50 -08:00
cow.glb
Experimental glTF reading
2021-05-26 04:54:19 -07:00
cv_project_points_precomputed.json
Conversion from OpenCV cameras
2021-06-21 05:03:32 -07:00
glb_cow_gray.png
Experimental glTF reading
2021-05-26 04:54:19 -07:00
glb_cow.png
Experimental glTF reading
2021-05-26 04:54:19 -07:00
icp_data.pth
move icp_data.pth to tests/data
2020-11-18 14:07:12 -08:00
objectron_vols_ious.pt
(new) CUDA IoU for 3D boxes
2021-09-29 18:49:09 -07:00
real_boxes.pkl
IOU box3d epsilon fix
2021-10-07 18:42:09 -07:00
room.jpg
CUDA/C++ Rasterizer updates to handle clipped faces
2021-02-08 14:32:39 -08:00
test_blurry_textured_rendering.png
align_corners and padding for TexturesUV
2020-08-25 11:28:40 -07:00
test_bridge_pointcloud.png
coarse rasterization bug fix
2020-04-20 14:54:16 -07:00
test_cow_image_rectangle_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_cow_image_rectangle_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_FoVOrthographicCameras_silhouette.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_FoVPerspectiveCameras_silhouette.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_joinatlas_1_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinatlas_1_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinatlas_2_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinatlas_2_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinatlas_final_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinatlas_final_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joined_spheres_flat.png
Adding join_mesh in pytorch3d.structures.meshes
2020-06-09 08:33:23 -07:00
test_joined_spheres_gouraud.png
Adding join_mesh in pytorch3d.structures.meshes
2020-06-09 08:33:23 -07:00
test_joined_spheres_phong.png
Adding join_mesh in pytorch3d.structures.meshes
2020-06-09 08:33:23 -07:00
test_joined_spheres_splatter.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinuvs0_map.png
amalgamate meshes with texture into a single scene
2020-08-25 11:28:40 -07:00
test_joinuvs0_MeshRasterizer_final.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinuvs0_MeshRasterizerOpenGL_final.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinuvs1_map.png
amalgamate meshes with texture into a single scene
2020-08-25 11:28:40 -07:00
test_joinuvs1_MeshRasterizer_final.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinuvs1_MeshRasterizerOpenGL_final.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinuvs2_map.png
amalgamate meshes with texture into a single scene
2020-08-25 11:28:40 -07:00
test_joinuvs2_MeshRasterizer_final.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinuvs2_MeshRasterizerOpenGL_final.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinverts_final_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_joinverts_final_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_nd_sphere.png
renderer: add support for rendering high dimensional textures for classification/segmentation use cases (#1248)
2022-07-11 21:22:45 -07:00
test_OrthographicCameras_silhouette.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_PerspectiveCameras_silhouette.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_pointcloud_rectangle_image.png
Non Square image rasterization for pointclouds
2020-12-15 14:15:32 -08:00
test_pulsar_simple_pointcloud_sphere_azimuth0.0_fovorthographic.png
Add OpenCV camera conversion; fix bug for camera unified PyTorch3D interface.
2021-07-10 01:06:56 -07:00
test_pulsar_simple_pointcloud_sphere_azimuth0.0_fovperspective.png
pulsar interface unification.
2020-11-03 13:06:35 -08:00
test_pulsar_simple_pointcloud_sphere_azimuth0.0_orthographic.png
Add OpenCV camera conversion; fix bug for camera unified PyTorch3D interface.
2021-07-10 01:06:56 -07:00
test_pulsar_simple_pointcloud_sphere_azimuth0.0_perspective.png
pulsar interface unification.
2020-11-03 13:06:35 -08:00
test_pulsar_simple_pointcloud_sphere_azimuth90.0_fovorthographic.png
Add OpenCV camera conversion; fix bug for camera unified PyTorch3D interface.
2021-07-10 01:06:56 -07:00
test_pulsar_simple_pointcloud_sphere_azimuth90.0_fovperspective.png
pulsar interface unification.
2020-11-03 13:06:35 -08:00
test_pulsar_simple_pointcloud_sphere_azimuth90.0_orthographic.png
Add OpenCV camera conversion; fix bug for camera unified PyTorch3D interface.
2021-07-10 01:06:56 -07:00
test_pulsar_simple_pointcloud_sphere_azimuth90.0_perspective.png
pulsar interface unification.
2020-11-03 13:06:35 -08:00
test_r2n2_render_by_categories_0.png
Test rendering models for R2N2
2020-07-14 14:53:58 -07:00
test_r2n2_render_by_categories_1.png
Test rendering models for R2N2
2020-07-14 14:53:58 -07:00
test_r2n2_render_by_categories_2.png
Test rendering models for R2N2
2020-07-14 14:53:58 -07:00
test_r2n2_render_by_idxs_and_ids_0.png
Test rendering models for R2N2
2020-07-14 14:53:58 -07:00
test_r2n2_render_by_idxs_and_ids_1.png
Test rendering models for R2N2
2020-07-14 14:53:58 -07:00
test_r2n2_render_by_idxs_and_ids_2.png
Test rendering models for R2N2
2020-07-14 14:53:58 -07:00
test_r2n2_render_with_blender_calibrations_0.png
Return R2N2 R,T,K
2020-08-07 13:22:26 -07:00
test_r2n2_render_with_blender_calibrations_1.png
Return R2N2 R,T,K
2020-08-07 13:22:26 -07:00
test_r2n2_render_with_blender_calibrations_2.png
Return R2N2 R,T,K
2020-08-07 13:22:26 -07:00
test_r2n2_render_with_blender_calibrations_3.png
Return R2N2 R,T,K
2020-08-07 13:22:26 -07:00
test_r2n2_voxel_to_mesh_render.png
Return R2N2 voxel coordinates
2020-08-07 13:22:26 -07:00
test_rasterized_sphere_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_rasterized_sphere_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_rasterized_sphere_zoom_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_rasterized_sphere_zoom_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_shapenet_core_render_mixed_by_categories_0.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_mixed_by_categories_1.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_mixed_by_categories_2.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_piano_0.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_piano_1.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_piano_2.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_piano.png
Adding renderer for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_without_sample_nums_0.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_shapenet_core_render_without_sample_nums_1.png
Render objects in a batch by the specified model_ids, categories or idxs for ShapeNetBase
2020-07-14 14:53:58 -07:00
test_simple_pointcloud_sphere.png
coarse rasterization bug fix
2020-04-20 14:54:16 -07:00
test_simple_sphere_batched_flat_FoVPerspectiveCameras_0.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_flat_FoVPerspectiveCameras_1.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_flat_FoVPerspectiveCameras_2.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_flat_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_batched_gouraud_FoVPerspectiveCameras_0.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_gouraud_FoVPerspectiveCameras_1.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_gouraud_FoVPerspectiveCameras_2.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_gouraud_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_batched_phong_FoVPerspectiveCameras_0.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_phong_FoVPerspectiveCameras_1.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_phong_FoVPerspectiveCameras_2.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_phong_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_batched_splatter_FoVPerspectiveCameras_0.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_splatter_FoVPerspectiveCameras_1.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_batched_splatter_FoVPerspectiveCameras_2.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_dark_elevated_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_dark_elevated_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_dark_elevated_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_dark_elevated_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_dark_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_dark_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_dark_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_dark_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_elevated_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_elevated_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_elevated_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_elevated_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_flat_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_elevated_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_elevated_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_elevated_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_elevated_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_gouraud_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_elevated_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_elevated_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_elevated_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_elevated_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_FoVOrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_FoVPerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_OrthographicCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_phong_PerspectiveCameras.png
camera refactoring
2020-08-20 22:22:06 -07:00
test_simple_sphere_light_splatter_elevated_FoVOrthographicCameras.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_light_splatter_elevated_FoVPerspectiveCameras.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_light_splatter_FoVOrthographicCameras.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_light_splatter_FoVPerspectiveCameras.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_outside_zfar_100_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_outside_zfar_100_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_outside_zfar_10000_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_simple_sphere_outside_zfar_10000_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_texture_atlas_8x8_back_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_texture_atlas_8x8_back_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_texture_map_back_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_texture_map_back_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_texture_map_front_MeshRasterizer.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00
test_texture_map_front_MeshRasterizerOpenGL.png
Add MeshRasterizerOpenGL
2022-07-22 15:52:50 -07:00