Skip to content

CI/TST: Mark test_basic_series_frame_alignment for python engine as flaky #51219

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Feb 10, 2023

Conversation

mroeschke
Copy link
Member

@mroeschke mroeschke added CI Continuous Integration Unreliable Test Unit tests that occasionally fail labels Feb 7, 2023
@jbrockmendel
Copy link
Member

Bummer. Does pytest have a marker to mark something as flaky rather than non-strict xfail? Im thinking something like "if it fails re-run up to N times and pass if it passes any time"

@phofl
Copy link
Member

phofl commented Feb 8, 2023

Looks like there is a plugin

https://github.com/pytest-dev/pytest-rerunfailures

No idea if this is maintained well enough though

@mroeschke
Copy link
Member Author

I can explore that plugin in a follow up PR. I think we have a few tests that are flaky like this

@mroeschke mroeschke added this to the 2.0 milestone Feb 10, 2023
@phofl
Copy link
Member

phofl commented Feb 10, 2023

Sounds good! Thx

@phofl phofl merged commit 35d76e9 into pandas-dev:main Feb 10, 2023
@phofl
Copy link
Member

phofl commented Feb 10, 2023

thx @mroeschke

@mroeschke mroeschke deleted the ci/flaky branch February 10, 2023 17:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration Unreliable Test Unit tests that occasionally fail
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants