Skip to content

test_retinanet onnx #6555

@wyli

Description

@wyli

Describe the bug
Pytorch version: 2.0.1+cu117

[2023-05-25T02:36:28.192Z] ======================================================================
[2023-05-25T02:36:28.192Z] FAIL: test_onnx_3 (tests.test_retinanet.TestRetinaNet)
[2023-05-25T02:36:28.192Z] ----------------------------------------------------------------------
[2023-05-25T02:36:28.192Z] Traceback (most recent call last):
[2023-05-25T02:36:28.192Z]   File "/opt/conda/lib/python3.8/site-packages/parameterized/parameterized.py", line 620, in standalone_func
[2023-05-25T02:36:28.192Z]     return func(*(a + p.args), **p.kwargs, **kw)
[2023-05-25T02:36:28.192Z]   File "/home/jenkins/agent/workspace/MONAI-postmerge/monai_github/tests/test_retinanet.py", line 186, in test_onnx
[2023-05-25T02:36:28.192Z]     test_onnx_save(backbone, data, rtol=2e-3)
[2023-05-25T02:36:28.192Z]   File "/home/jenkins/agent/workspace/MONAI-postmerge/monai_github/tests/utils.py", line 760, in test_onnx_save
[2023-05-25T02:36:28.192Z]     convert_to_onnx(
[2023-05-25T02:36:28.192Z]   File "/home/jenkins/agent/workspace/MONAI-postmerge/monai_github/monai/networks/utils.py", line 700, in convert_to_onnx
[2023-05-25T02:36:28.192Z]     assert_fn(r1.cpu(), convert_to_tensor(r2, dtype=r1.dtype), rtol=rtol, atol=atol)  # type: ignore
[2023-05-25T02:36:28.192Z]   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_comparison.py", line 1511, in assert_close
[2023-05-25T02:36:28.192Z]     raise error_metas[0].to_error(msg)
[2023-05-25T02:36:28.192Z] AssertionError: Tensor-likes are not close!
[2023-05-25T02:36:28.192Z] 
[2023-05-25T02:36:28.192Z] Mismatched elements: 1 / 9 (11.1%)
[2023-05-25T02:36:28.192Z] Greatest absolute difference: 4.26173210144043e-06 at index (2, 1) (up to 0.0 allowed)
[2023-05-25T02:36:28.192Z] Greatest relative difference: 0.01431574732205426 at index (2, 1) (up to 0.002 allowed)
[2023-05-25T02:36:28.192Z] 
[2023-05-25T02:36:28.192Z] ----------------------------------------------------------------------

jenkins/MONAI-postmerge/detail/MONAI-postmerge/1399/pipeline/

still an issue

[2023-06-14T00:11:03.039Z] ======================================================================
[2023-06-14T00:11:03.039Z] FAIL: test_onnx_3 (tests.test_retinanet.TestRetinaNet)
[2023-06-14T00:11:03.039Z] ----------------------------------------------------------------------
[2023-06-14T00:11:03.039Z] Traceback (most recent call last):
[2023-06-14T00:11:03.039Z]   File "/opt/conda/lib/python3.8/site-packages/parameterized/parameterized.py", line 620, in standalone_func
[2023-06-14T00:11:03.039Z]     return func(*(a + p.args), **p.kwargs, **kw)
[2023-06-14T00:11:03.039Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_retinanet.py", line 186, in test_onnx
[2023-06-14T00:11:03.039Z]     test_onnx_save(backbone, data, rtol=2e-3)
[2023-06-14T00:11:03.039Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/utils.py", line 760, in test_onnx_save
[2023-06-14T00:11:03.039Z]     convert_to_onnx(
[2023-06-14T00:11:03.039Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/networks/utils.py", line 700, in convert_to_onnx
[2023-06-14T00:11:03.039Z]     assert_fn(r1.cpu(), convert_to_tensor(r2, dtype=r1.dtype), rtol=rtol, atol=atol)  # type: ignore
[2023-06-14T00:11:03.039Z]   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_comparison.py", line 1344, in assert_close
[2023-06-14T00:11:03.039Z]     assert_equal(
[2023-06-14T00:11:03.039Z]   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_comparison.py", line 1095, in assert_equal
[2023-06-14T00:11:03.039Z]     raise error_metas[0].to_error(msg)
[2023-06-14T00:11:03.039Z] AssertionError: Tensor-likes are not close!
[2023-06-14T00:11:03.039Z] 
[2023-06-14T00:11:03.039Z] Mismatched elements: 1 / 9 (11.1%)
[2023-06-14T00:11:03.039Z] Greatest absolute difference: 1.430511474609375e-06 at index (1, 0) (up to 0.0 allowed)
[2023-06-14T00:11:03.039Z] Greatest relative difference: 0.004467609828741623 at index (1, 0) (up to 0.002 allowed)
[2023-06-14T00:11:03.039Z] 
[2023-06-14T00:11:03.039Z] ----------------------------------------------------------------------

jenkins/pipelines/Monai-pytorch-versions/runs/949

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions