Flaky test test_operator_gpu.test_pooling_versions

[marcoabreu]

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/master/1121/pipeline

======================================================================

FAIL: test_operator_gpu.test_pooling_versions

----------------------------------------------------------------------

Traceback (most recent call last):

  File "/usr/local/lib/python3.5/dist-packages/nose/case.py", line 198, in runTest

    self.test(*self.arg)

  File "/work/mxnet/tests/python/gpu/../unittest/common.py", line 157, in test_new

    orig_test(*args, **kwargs)

  File "/work/mxnet/tests/python/gpu/test_operator_gpu.py", line 933, in test_pooling_versions

    test_2d_pooling('max')

  File "/work/mxnet/tests/python/gpu/test_operator_gpu.py", line 866, in test_2d_pooling

    count_include_pad=count_include_pad)

  File "/work/mxnet/tests/python/gpu/test_operator_gpu.py", line 796, in test_pooling_versions_helper

    check_consistency(sym_list, ctx_list, equal_nan=(not count_include_pad), tol=tol)

  File "/work/mxnet/python/mxnet/test_utils.py", line 1354, in check_consistency

    raise e

  File "/work/mxnet/python/mxnet/test_utils.py", line 1349, in check_consistency

    equal_nan=equal_nan)

  File "/work/mxnet/python/mxnet/test_utils.py", line 493, in assert_almost_equal

    raise AssertionError(msg)

AssertionError: 

Items are not equal:

Error 663.606689 exceeds tolerance rtol=0.001000, atol=0.001000.  Location of maximum error:(1, 0, 9, 0), a=1.920305, b=7.681222

 a: array([[[[ 0.       ,  0.       ,  0.       , ...,  0.       ,

           0.       ,  0.       ],

         [ 0.       ,  0.       ,  0.       , ...,  0.       ,...

 b: array([[[[ 0.       ,  0.       ,  0.       , ...,  0.       ,

           0.       ,  0.       ],

         [ 0.       ,  0.       ,  0.       , ...,  0.       ,...

-------------------- >> begin captured stdout << ---------------------

Train Err: ctx 2 vs ctx 0 at pool_data



--------------------- >> end captured stdout << ----------------------

-------------------- >> begin captured logging << --------------------

common: INFO: Setting test np/mx/python random seeds, use MXNET_TEST_SEED=1582060943 to reproduce.

--------------------- >> end captured logging << ---------------------

[frankfliu]

Thank you for submitting the issue! We are labeling it so MXNet community members can help resolve it.