Skip to content

[BUG] ci: windows 2016, error in test_str_leak #2501

Open

Description

@EricCousineau-TRI

Observation

In this job on master: https://github.com/pybind/pybind11/runs/1128209634#step:17:33

      @pytest.mark.xfail("env.PYPY")
      def test_str_leak():
...
          pytest.gc_collect()
  >       assert getrefcount(fmt) == start
  E       AssertionError: assert 10 == 11
  E        +  where 10 = <built-in function getrefcount>('f4')

Speculation

It looks like there may be an ABI mismatch? (e.g. pybind11s ABI shim is out of date for this version or something?)

     C:\hostedtoolcache\windows\Python\3.7.9\x86\lib\importlib\_bootstrap.py:219: RuntimeWarning: numpy.ufunc size changed, may indicate binary incompatibility. Expected 112 from C header, got 124 from PyObject

Activity

  1. changed the title [-][BUG] ci: windows 2016, mismatch on numpy ABI, error in `test_str_leak`[/-] [+][BUG] ci: windows 2016, error in `test_str_leak`[/+] on Sep 17, 2020
  2. EricCousineau-TRI commented on Sep 17, 2020

    @EricCousineau-TRI
    CollaboratorAuthor

    Per Slack convo w/ @henryiii, re-running here:
    https://github.com/pybind/pybind11/runs/1128520718

    EDIT: Appears to be flaky :(
    Subsequent run passed: https://github.com/pybind/pybind11/runs/1128520718#step:17:1

  3. henryiii commented on Sep 18, 2020

    @henryiii
    Collaborator

    Possibly a 1:100-1:1,000 chance of happening, as I think it hasn't changed in a while, and this is possibly the first time we've seen it.

  4. added
    ci flakeKnown CI issues. Failures on CI should be recorded in an issue, but not block PRs.
    on Sep 18, 2020
  5. EricCousineau-TRI commented on Sep 18, 2020

    @EricCousineau-TRI
    CollaboratorAuthor

    (Marked as flake, but we should still record them)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    ci flakeKnown CI issues. Failures on CI should be recorded in an issue, but not block PRs.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions