Build log truncated.

[2026-06-17T11:25:30.285Z] W0617 11:22:07.152000 341542 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] PASSED [13.9998s] [100%]
[2026-06-17T11:25:30.285Z] 
[2026-06-17T11:25:30.285Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2d1c012dfd7724b.xml -
[2026-06-17T11:25:30.285Z] ============================== 1 passed in 14.04s ==============================
[2026-06-17T11:25:30.285Z] W0617 11:22:21.727000 341889 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-96d9e3a101442588.xml
[2026-06-17T11:25:30.285Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.285Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.285Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.285Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.285Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.285Z] configfile: pytest.ini
[2026-06-17T11:25:30.285Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.285Z] collecting ... collected 1 item
[2026-06-17T11:25:30.285Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.285Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn
[2026-06-17T11:25:30.285Z] 
[2026-06-17T11:25:30.285Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:22:23.203000 341889 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 341973
[2026-06-17T11:25:30.285Z] I0617 11:22:23.204000 341889 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 341974
[2026-06-17T11:25:30.285Z] I0617 11:22:23.205000 341889 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 341975
[2026-06-17T11:25:30.285Z] I0617 11:22:23.206000 341889 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 341976
[2026-06-17T11:25:30.285Z] W0617 11:22:25.819000 341973 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:22:25.890000 341974 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:22:25.902000 341976 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:22:25.922000 341975 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:882: UserWarning: c10d::allreduce_: an autograd kernel was not registered to the Autograd key(s) but we are trying to backprop through it. This may lead to silently incorrect behavior. This behavior is deprecated and will be removed in a future version of PyTorch. If your operator is differentiable, please ensure you have registered an autograd kernel to the correct Autograd key (e.g. DispatchKey::Autograd, DispatchKey::CompositeImplicitAutograd). If your operator is not differentiable, or to squash this warning and use the previous behavior, please register torch::CppFunction::makeFallthrough() to DispatchKey::Autograd. (Triggered internally at /var/lib/jenkins/pytorch/torch/csrc/autograd/autograd_not_implemented_fallback.cpp:76.)
[2026-06-17T11:25:30.285Z]   return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
[2026-06-17T11:25:30.285Z] /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:882: UserWarning: c10d::allreduce_: an autograd kernel was not registered to the Autograd key(s) but we are trying to backprop through it. This may lead to silently incorrect behavior. This behavior is deprecated and will be removed in a future version of PyTorch. If your operator is differentiable, please ensure you have registered an autograd kernel to the correct Autograd key (e.g. DispatchKey::Autograd, DispatchKey::CompositeImplicitAutograd). If your operator is not differentiable, or to squash this warning and use the previous behavior, please register torch::CppFunction::makeFallthrough() to DispatchKey::Autograd. (Triggered internally at /var/lib/jenkins/pytorch/torch/csrc/autograd/autograd_not_implemented_fallback.cpp:76.)
[2026-06-17T11:25:30.285Z]   return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
[2026-06-17T11:25:30.285Z] /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:882: UserWarning: c10d::allreduce_: an autograd kernel was not registered to the Autograd key(s) but we are trying to backprop through it. This may lead to silently incorrect behavior. This behavior is deprecated and will be removed in a future version of PyTorch. If your operator is differentiable, please ensure you have registered an autograd kernel to the correct Autograd key (e.g. DispatchKey::Autograd, DispatchKey::CompositeImplicitAutograd). If your operator is not differentiable, or to squash this warning and use the previous behavior, please register torch::CppFunction::makeFallthrough() to DispatchKey::Autograd. (Triggered internally at /var/lib/jenkins/pytorch/torch/csrc/autograd/autograd_not_implemented_fallback.cpp:76.)
[2026-06-17T11:25:30.285Z]   return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
[2026-06-17T11:25:30.285Z] /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/graph.py:882: UserWarning: c10d::allreduce_: an autograd kernel was not registered to the Autograd key(s) but we are trying to backprop through it. This may lead to silently incorrect behavior. This behavior is deprecated and will be removed in a future version of PyTorch. If your operator is differentiable, please ensure you have registered an autograd kernel to the correct Autograd key (e.g. DispatchKey::Autograd, DispatchKey::CompositeImplicitAutograd). If your operator is not differentiable, or to squash this warning and use the previous behavior, please register torch::CppFunction::makeFallthrough() to DispatchKey::Autograd. (Triggered internally at /var/lib/jenkins/pytorch/torch/csrc/autograd/autograd_not_implemented_fallback.cpp:76.)
[2026-06-17T11:25:30.285Z]   return Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
[2026-06-17T11:25:30.285Z] PASSED [16.1059s] [100%]
[2026-06-17T11:25:30.285Z] 
[2026-06-17T11:25:30.285Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-96d9e3a101442588.xml -
[2026-06-17T11:25:30.285Z] ============================== 1 passed in 16.15s ==============================
[2026-06-17T11:25:30.285Z] W0617 11:22:42.737000 342398 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-245f5e8961fa7da2.xml
[2026-06-17T11:25:30.285Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.285Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.285Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.285Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.285Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.285Z] configfile: pytest.ini
[2026-06-17T11:25:30.285Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.285Z] collecting ... collected 1 item
[2026-06-17T11:25:30.285Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.285Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception
[2026-06-17T11:25:30.285Z] 
[2026-06-17T11:25:30.285Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:22:44.210000 342398 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 342481
[2026-06-17T11:25:30.285Z] I0617 11:22:44.211000 342398 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 342482
[2026-06-17T11:25:30.285Z] I0617 11:22:44.212000 342398 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 342483
[2026-06-17T11:25:30.285Z] I0617 11:22:44.213000 342398 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 342484
[2026-06-17T11:25:30.285Z] W0617 11:22:46.855000 342481 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:22:46.948000 342482 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:22:46.959000 342483 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:22:46.964000 342484 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/distributed/c10d_logger.py:83: UserWarning: barrier(): using the device under current context. You can specify `device_id` in `init_process_group` to mute this warning.
[2026-06-17T11:25:30.285Z]   return func(*args, **kwargs)
[2026-06-17T11:25:30.285Z] PASSED [14.7031s] [100%]
[2026-06-17T11:25:30.285Z] 
[2026-06-17T11:25:30.285Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-245f5e8961fa7da2.xml -
[2026-06-17T11:25:30.285Z] ============================== 1 passed in 14.74s ==============================
[2026-06-17T11:25:30.285Z] W0617 11:23:02.316000 343071 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de11a9b897ccf6cd.xml
[2026-06-17T11:25:30.285Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.285Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.285Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.285Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.285Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.285Z] configfile: pytest.ini
[2026-06-17T11:25:30.285Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.285Z] collecting ... collected 1 item
[2026-06-17T11:25:30.285Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.285Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static
[2026-06-17T11:25:30.285Z] 
[2026-06-17T11:25:30.285Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:23:03.798000 343071 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 343351
[2026-06-17T11:25:30.285Z] I0617 11:23:03.800000 343071 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 343352
[2026-06-17T11:25:30.285Z] I0617 11:23:03.801000 343071 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 343353
[2026-06-17T11:25:30.285Z] I0617 11:23:03.802000 343071 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 343354
[2026-06-17T11:25:30.285Z] W0617 11:23:06.524000 343351 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:23:06.550000 343354 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.285Z] W0617 11:23:06.550000 343353 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:23:06.550000 343352 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] [rank0]:[W617 11:23:16.443360088 reducer.cpp:1528] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[2026-06-17T11:25:30.286Z] [rank3]:[W617 11:23:16.443546237 reducer.cpp:1528] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[2026-06-17T11:25:30.286Z] [rank2]:[W617 11:23:16.443579952 reducer.cpp:1528] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[2026-06-17T11:25:30.286Z] [rank1]:[W617 11:23:16.443848147 reducer.cpp:1528] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[2026-06-17T11:25:30.286Z] PASSED [14.8028s] [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de11a9b897ccf6cd.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 passed in 14.84s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:23:22.078000 343742 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6c00fcf8e81c02ec.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:23:23.566000 343742 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 343807
[2026-06-17T11:25:30.286Z] I0617 11:23:23.568000 343742 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 343808
[2026-06-17T11:25:30.286Z] I0617 11:23:23.569000 343742 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 343809
[2026-06-17T11:25:30.286Z] I0617 11:23:23.570000 343742 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 343810
[2026-06-17T11:25:30.286Z] W0617 11:23:26.108000 343807 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:23:26.236000 343809 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:23:26.248000 343810 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:23:26.250000 343808 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] [rank0]:[W617 11:23:35.786870943 reducer.cpp:1528] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[2026-06-17T11:25:30.286Z] PASSED [15.0068s] [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6c00fcf8e81c02ec.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 passed in 15.03s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:23:41.963000 344190 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d065be59e4fe72a6.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py SKIPPED [0.0005s] (Test requires backend nccl to be one of {'gloo'}) [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d065be59e4fe72a6.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 skipped in 0.02s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:23:46.748000 344305 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-047e580886580cb4.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py SKIPPED [0.0005s] (Test requires backend nccl to be one of {'gloo'}) [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-047e580886580cb4.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 skipped in 0.02s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:23:51.553000 344390 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0633508072838224.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:23:53.034000 344390 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 344472
[2026-06-17T11:25:30.286Z] I0617 11:23:53.035000 344390 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 344473
[2026-06-17T11:25:30.286Z] I0617 11:23:53.036000 344390 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 344474
[2026-06-17T11:25:30.286Z] I0617 11:23:53.037000 344390 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 344475
[2026-06-17T11:25:30.286Z] W0617 11:23:55.667000 344472 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:23:55.691000 344475 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:23:55.778000 344473 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:23:55.785000 344474 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] PASSED [16.0053s] [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0633508072838224.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 passed in 16.04s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:24:12.523000 345264 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9c83f3a23e9cd42.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py SKIPPED [0.0005s] (Nccl does not support CPU tensors) [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9c83f3a23e9cd42.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 skipped in 0.02s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:24:17.309000 345348 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1d026d578205a140.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py SKIPPED [0.0005s] (Nccl does not support CPU tensors) [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1d026d578205a140.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 skipped in 0.02s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:24:22.135000 345431 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e4d42687afbc2178.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:24:23.640000 345431 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 345496
[2026-06-17T11:25:30.286Z] I0617 11:24:23.641000 345431 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 345497
[2026-06-17T11:25:30.286Z] I0617 11:24:23.642000 345431 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 345498
[2026-06-17T11:25:30.286Z] I0617 11:24:23.643000 345431 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 345499
[2026-06-17T11:25:30.286Z] W0617 11:24:26.251000 345496 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:24:26.295000 345498 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:24:26.312000 345497 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:24:26.340000 345499 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:27 345499:345499 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:27 345496:345496 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:27 345498:345498 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:27 345497:345497 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345496:345496 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345497:345497 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345496:345496 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345497:345497 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345499:345499 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345498:345498 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345499:345499 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345498:345498 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345497:345497 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345498:345498 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345496:345496 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345499:345499 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345497:345497 ActivityProfilerController.cpp:415] profiler_startUSDT:2026-06-17 11:24:35 345496:345496 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345499:345499 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345498:345498 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345499:345499 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345496:345496 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345498:345498 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345497:345497 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345496:345496 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345499:345499 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345498:345498 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345497:345497 ActivityProfilerController.cpp:415] profiler_start
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345497:345497 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345496:345496 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345498:345498 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] USDT:2026-06-17 11:24:35 345499:345499 ActivityProfilerController.cpp:455] profiler_stop
[2026-06-17T11:25:30.286Z] PASSED [14.1039s] [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e4d42687afbc2178.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 passed in 14.14s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:24:41.178000 345894 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-240653104f3c9cf3.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py SKIPPED [0.0005s] (NCCL send/recv tested by test_send_recv_nccl) [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-240653104f3c9cf3.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 skipped in 0.02s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:24:45.968000 346011 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4d19d5d187f50855.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py SKIPPED [0.0005s] (nccl does not support DDP on CPU models) [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4d19d5d187f50855.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 skipped in 0.02s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:24:50.737000 346093 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4a54c72b69ac6ac0.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:24:52.220000 346093 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 346180
[2026-06-17T11:25:30.286Z] I0617 11:24:52.221000 346093 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 346181
[2026-06-17T11:25:30.286Z] I0617 11:24:52.222000 346093 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 346182
[2026-06-17T11:25:30.286Z] I0617 11:24:52.223000 346093 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 346183
[2026-06-17T11:25:30.286Z] W0617 11:24:54.792000 346180 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:24:54.851000 346181 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:24:54.928000 346183 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:24:54.966000 346182 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] PASSED [14.3017s] [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4a54c72b69ac6ac0.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 passed in 14.34s ==============================
[2026-06-17T11:25:30.286Z] W0617 11:25:10.055000 346793 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] Test results will be stored in test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1031529d3dab8133.xml
[2026-06-17T11:25:30.286Z] ============================= test session starts ==============================
[2026-06-17T11:25:30.286Z] platform linux -- Python 3.12.13, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python
[2026-06-17T11:25:30.286Z] cachedir: .pytest_cache
[2026-06-17T11:25:30.286Z] hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow]
[2026-06-17T11:25:30.286Z] rootdir: /var/lib/jenkins/pytorch
[2026-06-17T11:25:30.286Z] configfile: pytest.ini
[2026-06-17T11:25:30.286Z] plugins: flakefinder-1.1.0, cpp-2.3.0, subtests-0.13.1, rerunfailures-14.0, xdist-3.3.1, xdoctest-1.3.0, hypothesis-6.56.4, typeguard-4.3.0
[2026-06-17T11:25:30.286Z] collecting ... collected 1 item
[2026-06-17T11:25:30.286Z] stepcurrent: previously run test not found, not skipping.
[2026-06-17T11:25:30.286Z] Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger <- ../../../../opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/distributed/distributed_test.py I0617 11:25:11.548000 346793 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 0 with pid 347008
[2026-06-17T11:25:30.286Z] I0617 11:25:11.550000 346793 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 1 with pid 347009
[2026-06-17T11:25:30.286Z] I0617 11:25:11.551000 346793 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 2 with pid 347010
[2026-06-17T11:25:30.286Z] I0617 11:25:11.552000 346793 site-packages/torch/testing/_internal/common_distributed.py:895] Started process 3 with pid 347011
[2026-06-17T11:25:30.286Z] W0617 11:25:14.208000 347008 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:25:14.274000 347011 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:25:14.279000 347010 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] W0617 11:25:14.282000 347009 site-packages/torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
[2026-06-17T11:25:30.286Z] PASSED [14.1023s] [100%]
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1031529d3dab8133.xml -
[2026-06-17T11:25:30.286Z] ============================== 1 passed in 14.14s ==============================
[2026-06-17T11:25:30.286Z] Traceback (most recent call last):
[2026-06-17T11:25:30.286Z]   File "/var/lib/jenkins/pytorch/test/distributed/test_distributed_spawn.py", line 60, in <module>
[2026-06-17T11:25:30.286Z]     run_tests()
[2026-06-17T11:25:30.286Z]   File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1327, in run_tests
[2026-06-17T11:25:30.286Z]     raise AssertionError(
[2026-06-17T11:25:30.286Z] AssertionError: 2 unit test(s) failed:
[2026-06-17T11:25:30.286Z] 	distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward
[2026-06-17T11:25:30.286Z] 	distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] FINISHED PRINTING LOG FILE of distributed/test_distributed_spawn 1/7 (test/test-reports/distributed.test_distributed_spawn_1.7_78460de09fd37d27_.log)
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] Finished distributed/test_distributed_spawn 1/7 ... [2026-06-17 11:25:28.083374][1653552.912170797], took 10.26min
[2026-06-17T11:25:30.286Z] distributed/test_distributed_spawn 1/7 failed!
[2026-06-17T11:25:30.286Z] Emitting td_test_failure_stats_v2
[2026-06-17T11:25:30.286Z] /var/lib/jenkins/pytorch/tools/stats/upload_metrics.py:140: UserWarning: Not emitting metrics for td_test_failure_stats_v2. Missing repo. Please set the GITHUB_REPOSITORY environment variable to pass in this value.
[2026-06-17T11:25:30.286Z]   warn(f"Not emitting metrics for {metric_name}. {e}")
[2026-06-17T11:25:30.286Z] Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/dist-nccl-init-env/distributed.test_distributed_spawn/distributed.test_distributed_spawn-83b4314a9c098940.xml
[2026-06-17T11:25:30.286Z] Found job id: None
[2026-06-17T11:25:30.286Z] Failed to parse and upload json test reports: Unable to locate credentials
[2026-06-17T11:25:30.286Z] GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading
[2026-06-17T11:25:30.286Z] Uploading artifacts took 0.00 seconds
[2026-06-17T11:25:30.286Z] Traceback (most recent call last):
[2026-06-17T11:25:30.286Z]   File "/var/lib/jenkins/pytorch/test/run_test.py", line 2319, in <module>
[2026-06-17T11:25:30.286Z]     main()
[2026-06-17T11:25:30.286Z]   File "/var/lib/jenkins/pytorch/test/run_test.py", line 2270, in main
[2026-06-17T11:25:30.286Z]     run_tests(
[2026-06-17T11:25:30.286Z]   File "/var/lib/jenkins/pytorch/test/run_test.py", line 2091, in run_tests
[2026-06-17T11:25:30.286Z]     raise RuntimeError(failure.message + keep_going_message)
[2026-06-17T11:25:30.286Z] RuntimeError: distributed/test_distributed_spawn 1/7 failed!
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] Tip: You can keep running tests even on failure by passing --keep-going to run_test.py.
[2026-06-17T11:25:30.286Z] If running on CI, add the 'keep-going' label to your PR and rerun your jobs.
[2026-06-17T11:25:30.286Z] 
[2026-06-17T11:25:30.286Z] real	47m20.141s
[2026-06-17T11:25:30.286Z] user	168m43.791s
[2026-06-17T11:25:30.286Z] sys	50m36.574s
[2026-06-17T11:25:30.286Z] + sccache_epilogue
[2026-06-17T11:25:30.286Z] + echo '::group::Sccache Compilation Log'
[2026-06-17T11:25:30.286Z] + echo '=================== sccache compilation log ==================='
[2026-06-17T11:25:30.286Z] ::group::Sccache Compilation Log
[2026-06-17T11:25:30.286Z] =================== sccache compilation log ===================
[2026-06-17T11:25:30.286Z] + python /var/lib/jenkins/pytorch/.ci/pytorch/print_sccache_log.py /root/sccache_error.log
[2026-06-17T11:25:30.286Z] + echo '=========== If your build fails, please take a look at the log above for possible reasons ==========='
[2026-06-17T11:25:30.286Z] + sccache --show-stats
[2026-06-17T11:25:30.286Z] =========== If your build fails, please take a look at the log above for possible reasons ===========
[2026-06-17T11:25:30.286Z] Compile requests                      2
[2026-06-17T11:25:30.286Z] Compile requests executed             0
[2026-06-17T11:25:30.286Z] Cache hits                            0
[2026-06-17T11:25:30.286Z] Cache misses                          0
[2026-06-17T11:25:30.286Z] Cache hits rate                       -
[2026-06-17T11:25:30.286Z] Cache timeouts                        0
[2026-06-17T11:25:30.286Z] Cache read errors                     0
[2026-06-17T11:25:30.286Z] Forced recaches                       0
[2026-06-17T11:25:30.286Z] Cache write errors                    0
[2026-06-17T11:25:30.286Z] Cache errors                          0
[2026-06-17T11:25:30.286Z] Compilations                          0
[2026-06-17T11:25:30.286Z] Compilation failures                  0
[2026-06-17T11:25:30.286Z] Non-cacheable compilations            0
[2026-06-17T11:25:30.286Z] Non-cacheable calls                   0
[2026-06-17T11:25:30.286Z] Non-compilation calls                 2
[2026-06-17T11:25:30.286Z] Unsupported compiler calls            0
[2026-06-17T11:25:30.286Z] Average cache write               0.000 s
[2026-06-17T11:25:30.286Z] Average compiler                  0.000 s
[2026-06-17T11:25:30.286Z] Average cache read hit            0.000 s
[2026-06-17T11:25:30.286Z] Failed distributed compilations       0
[2026-06-17T11:25:30.286Z] Cache location                  Local disk: "/root/.cache/sccache"
[2026-06-17T11:25:30.286Z] Use direct/preprocessor mode?   yes
[2026-06-17T11:25:30.286Z] Version (client)                0.13.0
[2026-06-17T11:25:30.286Z] Max cache size                       10 GiB
[2026-06-17T11:25:30.286Z] + sccache --stop-server
[2026-06-17T11:25:30.286Z] Stopping sccache server...
[2026-06-17T11:25:30.286Z] Compile requests                      2
[2026-06-17T11:25:30.286Z] Compile requests executed             0
[2026-06-17T11:25:30.286Z] Cache hits                            0
[2026-06-17T11:25:30.286Z] Cache misses                          0
[2026-06-17T11:25:30.286Z] Cache hits rate                       -
[2026-06-17T11:25:30.286Z] Cache timeouts                        0
[2026-06-17T11:25:30.286Z] Cache read errors                     0
[2026-06-17T11:25:30.286Z] Forced recaches                       0
[2026-06-17T11:25:30.286Z] Cache write errors                    0
[2026-06-17T11:25:30.286Z] Cache errors                          0
[2026-06-17T11:25:30.286Z] Compilations                          0
[2026-06-17T11:25:30.286Z] Compilation failures                  0
[2026-06-17T11:25:30.286Z] Non-cacheable compilations            0
[2026-06-17T11:25:30.286Z] Non-cacheable calls                   0
[2026-06-17T11:25:30.286Z] Non-compilation calls                 2
[2026-06-17T11:25:30.286Z] Unsupported compiler calls            0
[2026-06-17T11:25:30.286Z] Average cache write               0.000 s
[2026-06-17T11:25:30.286Z] Average compiler                  0.000 s
[2026-06-17T11:25:30.286Z] Average cache read hit            0.000 s
[2026-06-17T11:25:30.286Z] Failed distributed compilations       0
[2026-06-17T11:25:30.286Z] Cache location                  Local disk: "/root/.cache/sccache"
[2026-06-17T11:25:30.286Z] Use direct/preprocessor mode?   yes
[2026-06-17T11:25:30.286Z] Version (client)                0.13.0
[2026-06-17T11:25:30.286Z] Max cache size                       10 GiB
[2026-06-17T11:25:30.286Z] ::endgroup::
[2026-06-17T11:25:30.286Z] + echo ::endgroup::
[2026-06-17T11:25:30.286Z] + cp -RT test/test-reports /host_workspace/pytorch_reports
[2026-06-17T11:25:30.286Z] + chmod -R 777 /host_workspace/pytorch_log /host_workspace/pytorch_reports
[2026-06-17T11:25:30.286Z] + git clean -fdx
[2026-06-17T11:25:30.503Z] Removing .additional_ci_files/
[2026-06-17T11:25:30.503Z] Removing .pytest_cache/
Output truncated.