[slimtensor] Add utility functions to common_shims_slim#16457
[slimtensor] Add utility functions to common_shims_slim#16457meta-codesync[bot] merged 12 commits intogh/gasoonjia/98/basefrom
Conversation
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/16457
Note: Links to docs will display an error until the docs builds have been completed. ❌ 2 New Failures, 3 Unrelated FailuresAs of commit 12449fe with merge base 99348ed ( NEW FAILURES - The following jobs have failed:
FLAKY - The following jobs failed but were likely due to flakiness present on trunk:
BROKEN TRUNK - The following job failed but were present on the merge base:👉 Rebase onto the `viable/strict` branch to avoid these failures
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This PR needs a
|
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) ghstack-source-id: 331923139 Pull Request resolved: #16457
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #16565 * #16551 * #16469 * #16457 * #16455 * #16454 * #16453 * #16452 * #16451 * #16450 * #16449 * #16448 * #16447 * #16446 * __->__ #16724 Copy CUDAGuard and CUDAStreamGuard from cuda/runtime/ to aoti/slim/cuda/ to support slimtensor requirement while get rid of potential circular dependency: - cuda_backend/main_functionalities -> aoti/slimtensor -> cuda_backend/cuda_guard This change: - copy guard.h, guard.cpp and test files from backend/cuda_backend to backend/aoti/slim/cuda/ Differential Revision: [D91056808](https://our.internmc.facebook.com/intern/diff/D91056808/)
…v2 (#16446) Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #16565 * #16551 * #16469 * #16457 * #16455 * #16454 * #16453 * #16452 * #16451 * #16450 * #16449 * #16448 * #16447 * __->__ #16446 * #16724 Add SlimTensor-based implementations of AOTI shim functions for tensor creation: 1. `aoti_torch_create_tensor_from_blob_v2()` - Creates a non-owning SlimTensor that wraps existing memory using the `from_blob()` factory Both functions support CPU and CUDA devices and handle all 7 SlimTensor dtypes. Also add `memory_slim.h` and `memory_slim.cpp` with SlimTensor-based shim implementations for working on new API while not impact the current pipeline. Will use memory_slim.{h/cpp} to replace current memory.{h/cpp} when everything has been set up. Differential Revision: [D90126247](https://our.internmc.facebook.com/intern/diff/D90126247/)
Stack from [ghstack](https://github.com/ezyang/ghstack) (oldest at bottom): * #16565 * #16551 * #16469 * #16457 * #16455 * #16454 * #16453 * #16452 * #16451 * #16450 * #16449 * #16448 * __->__ #16447 * #16446 * #16724 Add SlimTensor-based implementations of AOTI shim functions for tensor creation: `aoti_torch_create_tensor_from_blob_v2()` - Creates a non-owning SlimTensor that wraps existing memory using the `from_blob()` factory Both functions support CPU and CUDA devices and handle all 7 SlimTensor dtypes. Changes: - Add `memory_slim.h` and `memory_slim.cpp` with SlimTensor-based shim implementations - Add `runtime_shims_slim` library target to TARGETS with `CUDA_AVAILABLE=1` preprocessor flag - Add `cuda_shim_slim_cpp_unittest()` function for SlimTensor test targets Differential Revision: [D90126244](https://our.internmc.facebook.com/intern/diff/D90126244/)
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
Add utility functions to the header-only common_shims_slim library: 1. DType constants: - `aoti_torch_dtype_float32()` - Returns 6 (ScalarType::Float) - `aoti_torch_dtype_bfloat16()` - Returns 15 (ScalarType::BFloat16) - `aoti_torch_dtype_int64()` - Returns 4 (ScalarType::Long) - `aoti_torch_dtype_int32()` - Returns 3 (ScalarType::Int) - `aoti_torch_dtype_int16()` - Returns 2 (ScalarType::Short) - `aoti_torch_dtype_int8()` - Returns 1 (ScalarType::Char) - `aoti_torch_dtype_bool()` - Returns 11 (ScalarType::Bool) 2. Device type constants: - `aoti_torch_device_type_cpu()` - Returns 0 (DeviceType::CPU) - `aoti_torch_device_type_cuda()` - Returns 1 (DeviceType::CUDA) 3. Grad mode functions (not supported in ExecuTorch): - `aoti_torch_grad_mode_is_enabled()` - Always returns false - `aoti_torch_grad_mode_set_enabled()` - Returns Ok for false, NotSupported for true Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) [ghstack-poisoned]
7cac9b9
into
gh/gasoonjia/98/base
This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #16457 by @Gasoonjia ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/gasoonjia/98/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/gasoonjia/98/head Merge bot PR base: https://github.com/pytorch/executorch/tree/gh/gasoonjia/97/orig Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/gasoonjia/98/orig Differential Revision: [D90126250](https://our.internmc.facebook.com/intern/diff/D90126250/) @diff-train-skip-merge --------- Co-authored-by: gasoonjia <gasoonjia@icloud.com> Co-authored-by: Gasoonjia <gasoonjia@meta.com>
Stack from ghstack (oldest at bottom):
Add utility functions to the header-only common_shims_slim library:
DType constants:
aoti_torch_dtype_float32()- Returns 6 (ScalarType::Float)aoti_torch_dtype_bfloat16()- Returns 15 (ScalarType::BFloat16)aoti_torch_dtype_int64()- Returns 4 (ScalarType::Long)aoti_torch_dtype_int32()- Returns 3 (ScalarType::Int)aoti_torch_dtype_int16()- Returns 2 (ScalarType::Short)aoti_torch_dtype_int8()- Returns 1 (ScalarType::Char)aoti_torch_dtype_bool()- Returns 11 (ScalarType::Bool)Device type constants:
aoti_torch_device_type_cpu()- Returns 0 (DeviceType::CPU)aoti_torch_device_type_cuda()- Returns 1 (DeviceType::CUDA)Grad mode functions (not supported in ExecuTorch):
aoti_torch_grad_mode_is_enabled()- Always returns falseaoti_torch_grad_mode_set_enabled()- Returns Ok for false, NotSupported for trueDifferential Revision: D90126250