Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

Flaky test: test_higher_order_grad.test_arctan and test_higher_order_grad.test_arccosh #16739

Description

@haojin2

http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fcentos-cpu/detail/PR-16728/2/pipeline

======================================================================

FAIL: test_higher_order_grad.test_arctan

----------------------------------------------------------------------

Traceback (most recent call last):

  File "/usr/lib/python3.6/site-packages/nose/case.py", line 198, in runTest

    self.test(*self.arg)

  File "/work/mxnet/tests/python/unittest/common.py", line 177, in test_new

    orig_test(*args, **kwargs)

  File "/work/mxnet/tests/python/unittest/test_higher_order_grad.py", line 150, in test_arctan

    check_second_order_unary(array, arctan, grad_grad_op)

  File "/work/mxnet/tests/python/unittest/test_higher_order_grad.py", line 395, in check_second_order_unary

    check_nth_order_unary(x, op, grad_grad_op, 2, rtol, atol)

  File "/work/mxnet/tests/python/unittest/test_higher_order_grad.py", line 465, in check_nth_order_unary

    expected_grad, computed_grad.asnumpy(), rtol=rtol, atol=atol)

  File "/work/mxnet/python/mxnet/test_utils.py", line 627, in assert_almost_equal

    raise AssertionError(msg)

AssertionError: 

Items are not equal:

Error nan exceeds tolerance rtol=1.000000e-05, atol=1.000000e-20 (mismatch 0.037037%).

Location of maximum error: (4, 4, 3, 4), a=-0.00000000, b=nan

 ACTUAL: array([[[[-0.        ,  0.        , -0.00001811,  0.        ,

           0.        ],

         [-0.        , -0.        ,  0.        , -0.        ,...

 DESIRED: array([[[[-0.        ,  0.        , -0.00001811,  0.        ,

           0.        ],

         [-0.        , -0.        ,  0.        , -0.        ,...

-------------------- >> begin captured stdout << ---------------------



*** Maximum errors for vector of size 2700:  rtol=1e-05, atol=1e-20



  1: Error nan  Location of error: (4, 4, 3, 4), a=-0.00000000, b=nan



--------------------- >> end captured stdout << ----------------------

-------------------- >> begin captured logging << --------------------

common: INFO: Setting test np/mx/python random seeds, use MXNET_TEST_SEED=1870133712 to reproduce.

--------------------- >> end captured logging << ---------------------

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions