Skip to content

TestStatelessRecurrentSequential.test_n_step_forward_gpu is flaky #555

@muupan

Description

@muupan
2019-09-17 15:58:06.381228 STDOUT 2012] | chainerrl/tests/links_tests/test_stateless_recurrent_sequential.py .F... [100%]
-- | --
2019-09-17 15:58:06.381228 STDOUT 2012] |  
2019-09-17 15:58:06.381229 STDOUT 2012] | =================================== FAILURES ===================================
2019-09-17 15:58:06.381230 STDOUT 2012] | ___________ TestStatelessRecurrentSequential.test_n_step_forward_gpu ___________
2019-09-17 15:58:06.381230 STDOUT 2012] |  
2019-09-17 15:58:06.381231 STDOUT 2012] | self = <test_stateless_recurrent_sequential.TestStatelessRecurrentSequential testMethod=test_n_step_forward_gpu>
2019-09-17 15:58:06.381232 STDOUT 2012] |  
2019-09-17 15:58:06.381232 STDOUT 2012] | @testing.attr.gpu
2019-09-17 15:58:06.381401 STDOUT 2012] | def test_n_step_forward_gpu(self):
2019-09-17 15:58:06.381470 STDOUT 2012] | >       self._test_n_step_forward(gpu=0)
2019-09-17 15:58:06.381472 STDOUT 2012] |  
2019-09-17 15:58:06.381561 STDOUT 2012] | chainerrl/tests/links_tests/test_stateless_recurrent_sequential.py:156:
2019-09-17 15:58:06.381563 STDOUT 2012] | _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2019-09-17 15:58:06.381565 STDOUT 2012] | chainerrl/tests/links_tests/test_stateless_recurrent_sequential.py:141: in _test_n_step_forward
2019-09-17 15:58:06.381566 STDOUT 2012] | man_seq_out.array, seq_out.array, rtol=1e-5)
2019-09-17 15:58:06.381575 STDOUT 2012] | _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
2019-09-17 15:58:06.381576 STDOUT 2012] |  
2019-09-17 15:58:06.381577 STDOUT 2012] | actual = array([[ 2.2617858e-03,  6.3543685e-02,  4.2259894e-02,  1.5353611e-04,
2019-09-17 15:58:06.381578 STDOUT 2012] | 2.1527605e-03, -2.3726197e-02],
2019-09-17 15:58:06.381580 STDOUT 2012] | ...1.9148204e-01, -4.0073488e-02, -2.4744363e-01, -3.5417024e-03,
2019-09-17 15:58:06.381581 STDOUT 2012] | 9.9237107e-02,  2.0066814e-01]], dtype=float32)
2019-09-17 15:58:06.381668 STDOUT 2012] | desired = array([[ 2.2617877e-03,  6.3543677e-02,  4.2259891e-02,  1.5353378e-04,
2019-09-17 15:58:06.381670 STDOUT 2012] | 2.1527568e-03, -2.3726203e-02],
2019-09-17 15:58:06.381671 STDOUT 2012] | ...1.9148204e-01, -4.0073480e-02, -2.4744360e-01, -3.5416987e-03,
2019-09-17 15:58:06.381672 STDOUT 2012] | 9.9237107e-02,  2.0066817e-01]], dtype=float32)
2019-09-17 15:58:06.381674 STDOUT 2012] | rtol = 1e-05, atol = 0, err_msg = '', verbose = True
2019-09-17 15:58:06.381674 STDOUT 2012] |  
2019-09-17 15:58:06.381677 STDOUT 2012] | def assert_allclose(actual, desired, rtol=1e-7, atol=0, err_msg='',
2019-09-17 15:58:06.381679 STDOUT 2012] | verbose=True):
2019-09-17 15:58:06.381680 STDOUT 2012] | """Raises an AssertionError if objects are not equal up to desired tolerance.
2019-09-17 15:58:06.381681 STDOUT 2012] |  
2019-09-17 15:58:06.381682 STDOUT 2012] | Args:
2019-09-17 15:58:06.381703 STDOUT 2012] | actual(numpy.ndarray or cupy.ndarray): The actual object to check.
2019-09-17 15:58:06.381705 STDOUT 2012] | desired(numpy.ndarray or cupy.ndarray): The desired, expected object.
2019-09-17 15:58:06.381705 STDOUT 2012] | rtol(float): Relative tolerance.
2019-09-17 15:58:06.381768 STDOUT 2012] | atol(float): Absolute tolerance.
2019-09-17 15:58:06.381769 STDOUT 2012] | err_msg(str): The error message to be printed in case of failure.
2019-09-17 15:58:06.381770 STDOUT 2012] | verbose(bool): If ``True``, the conflicting
2019-09-17 15:58:06.381771 STDOUT 2012] | values are appended to the error message.
2019-09-17 15:58:06.381773 STDOUT 2012] |  
2019-09-17 15:58:06.381774 STDOUT 2012] | .. seealso:: :func:`numpy.testing.assert_allclose`
2019-09-17 15:58:06.381854 STDOUT 2012] |  
2019-09-17 15:58:06.381855 STDOUT 2012] | """  # NOQA
2019-09-17 15:58:06.381856 STDOUT 2012] | numpy.testing.assert_allclose(
2019-09-17 15:58:06.381857 STDOUT 2012] | cupy.asnumpy(actual), cupy.asnumpy(desired),
2019-09-17 15:58:06.381858 STDOUT 2012] | >           rtol=rtol, atol=atol, err_msg=err_msg, verbose=verbose)
2019-09-17 15:58:06.381860 STDOUT 2012] | E       AssertionError:
2019-09-17 15:58:06.381861 STDOUT 2012] | E       Not equal to tolerance rtol=1e-05, atol=0
2019-09-17 15:58:06.381862 STDOUT 2012] | E
2019-09-17 15:58:06.381891 STDOUT 2012] | E       Mismatch: 5.56%
2019-09-17 15:58:06.716341 STDOUT 2012] | E       Max absolute difference: 2.9802322e-08
2019-09-17 15:58:06.716346 STDOUT 2012] | E       Max relative difference: 1.5164783e-05
2019-09-17 15:58:06.716347 STDOUT 2012] | E        x: array([[ 2.261786e-03,  6.354368e-02,  4.225989e-02,  1.535361e-04,
2019-09-17 15:58:06.716349 STDOUT 2012] | E                2.152761e-03, -2.372620e-02],
2019-09-17 15:58:06.716350 STDOUT 2012] | E              [-1.342301e-02, -8.628035e-02,  2.457377e-02,  2.508903e-02,...
2019-09-17 15:58:06.716351 STDOUT 2012] | E        y: array([[ 2.261788e-03,  6.354368e-02,  4.225989e-02,  1.535338e-04,
2019-09-17 15:58:06.716353 STDOUT 2012] | E                2.152757e-03, -2.372620e-02],
2019-09-17 15:58:06.716354 STDOUT 2012] | E              [-1.342301e-02, -8.628035e-02,  2.457377e-02,  2.508903e-02,...
2019-09-17 15:58:06.716355 STDOUT 2012] |  
2019-09-17 15:58:06.716356 STDOUT 2012] | usr/local/lib/python3.5/dist-packages/cupy/testing/array.py:26: AssertionError


Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions