[draft] add all_gather_into_tensor

[mori360]

add all_gather_into_tensor to support nf4tensor better to be used in TorchTune

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/1737

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 9 New Failures

As of commit 183d58a with merge base 217d968 ():

NEW FAILURES - The following jobs have failed:

• PR Label Check / Check PR Labels (gh)
  Process completed with exit code 1.
• Run Regression Tests / test (CPU 2.3, linux.4xlarge, torch==2.3.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1
• Run Regression Tests / test (CPU 2.4, linux.4xlarge, torch==2.4.0 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1
• Run Regression Tests / test (CPU 2.5.1, linux.4xlarge, torch==2.5.1 --index-url https://download.pytorch.org/whl/cpu, cpu) / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1
• Run Regression Tests / test (CUDA 2.3, linux.g5.12xlarge.nvidia.gpu, torch==2.3.0, cuda, 12.1) / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1
• Run Regression Tests / test (CUDA 2.4, linux.g5.12xlarge.nvidia.gpu, torch==2.4.0, cuda, 12.1) / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1
• Run Regression Tests / test (CUDA 2.5.1, linux.g5.12xlarge.nvidia.gpu, torch==2.5.1 --index-url https://download.pytorch... / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1
• Run Regression Tests / test-nightly (CPU Nightly, linux.4xlarge, --pre torch==2.7.0.dev20250122 --index-url https://down... / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1
• Run Regression Tests / test-nightly (CUDA Nightly, linux.g5.12xlarge.nvidia.gpu, --pre torch==2.7.0.dev20250122 --index-... / linux-job (gh)
  test/dtypes/test_nf4.py::TestFSDPOps::test_tensor_view_invalid_input_size1

This comment was automatically generated by Dr. CI and updates every 15 minutes.