Skip to content

TST: test_is_list_like_recursion segfaults sometimes? #38214

Closed
@twoertwein

Description

@twoertwein
  • I have checked that this issue has not already been reported.

  • I have confirmed this bug exists on the latest version of pandas.

  • (optional) I have confirmed this bug exists on the master branch of pandas.


Code Sample, a copy-pastable example

pytest pandas/tests/dtypes/test_inference.py  # succeeds
pytest pandas/tests  # fails during test_inference 
pandas/tests/dtypes/test_generic.py ..                                   [ 25%]
pandas/tests/dtypes/test_inference.py .................................. [ 25%]
..............................................Fatal Python error: Segmentation fault

Thread 0x00007f56c7fff700 (most recent call first):
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 576 in _handle_results
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

Thread 0x00007f56e4ff9700 (most recent call first):
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 528 in _handle_tasks
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

Thread 0x00007f56e57fa700 (most recent call first):
  File "~/local/lib/python3.8/selectors.py", line 415 in select
  File "~/local/lib/python3.8/multiprocessing/connection.py", line 931 in wait
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 499 in _wait_for_updates
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 519 in _handle_workers
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

Thread 0x00007f56e5ffb700 (most recent call first):
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 114 in worker
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

[...]

Thread 0x00007f57d95f5700 (most recent call first):
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 114 in worker
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

Current thread 0x00007f5883dd3740 (most recent call first):
  File "~/git/pandas/pandas/tests/dtypes/test_inference.py", line 131 in foo
  File "~/git/pandas/pandas/tests/dtypes/test_inference.py", line 132 in foo
  File "~/git/pandas/pandas/tests/dtypes/test_inference.py", line 132 in foo
  File "~/git/pandas/pandas/tests/dtypes/test_inference.py", line 132 in foo
  File "~/git/pandas/pandas/tests/dtypes/test_inference.py", line 132 in foo
  File "~/git/pandas/pandas/tests/dtypes/test_inference.py", line 132 in foo
 [....]


That is probably not caused by something recent. I didn't run the entire test-suite in the past.

Maybe I just have a broken setup, ignoring test_inference leads to the next segfault (running test_json.py on its own works again):

pytest pandas/tests/extension/json/test_json.py  # succeeds
pytest --ignore=pandas/tests/dtypes/test_inference.py pandas/tests  # fails during test_json 
pandas/tests/extension/json/test_json.py ............................... [ 32%]
...x..........sFatal Python error: Segmentation fault

Thread 0x00007fc0197fa700 (most recent call first):
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 576 in _handle_results
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

Thread 0x00007fc019ffb700 (most recent call first):
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 528 in _handle_tasks
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

Thread 0x00007fc01a7fc700 (most recent call first):
  File "~/local/lib/python3.8/selectors.py", line 415 in select
  File "~/local/lib/python3.8/multiprocessing/connection.py", line 931 in wait
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 499 in _wait_for_updates
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 519 in _handle_workers
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

Thread 0x00007fc01affd700 (most recent call first):
  File "~/local/lib/python3.8/multiprocessing/pool.py", line 114 in worker
  File "~/local/lib/python3.8/threading.py", line 870 in run
  File "~/local/lib/python3.8/threading.py", line 932 in _bootstrap_inner
  File "~/local/lib/python3.8/threading.py", line 890 in _bootstrap

[...]

Current thread 0x00007fc1c0977740 (most recent call first):
  File "~/git/pandas/pandas/core/indexes/base.py", line 5888 in maybe_extract_name
  File "~/git/pandas/pandas/core/series.py", line 237 in __init__
  File "~/git/pandas/pandas/core/construction.py", line 666 in create_series_with_explicit_dtype
  File "~/git/pandas/pandas/core/series.py", line 382 in _init_dict
  File "~/git/pandas/pandas/core/series.py", line 289 in __init__
  File "~/git/pandas/pandas/core/construction.py", line 666 in create_series_with_explicit_dtype
  File "~/git/pandas/pandas/core/series.py", line 382 in _init_dict
  File "~/git/pandas/pandas/core/series.py", line 289 in __init__
  File "~/git/pandas/pandas/core/construction.py", line 666 in create_series_with_explicit_dtype
  File "~/git/pandas/pandas/core/series.py", line 382 in _init_dict
  File "~/git/pandas/pandas/core/series.py", line 289 in __init__
[...]

Output of pd.show_versions()

INSTALLED VERSIONS

commit : c2018c1
python : 3.8.6.final.0
python-bits : 64
OS : Linux
OS-release : 3.10.0-693.5.2.el7.x86_64
Version : #1 SMP Fri Oct 20 20:32:50 UTC 2017
machine : x86_64
processor : x86_64
byteorder : little
LC_ALL : None
LANG : en_US.UTF-8
LOCALE : en_US.UTF-8

pandas : 1.2.0.dev0+1400.gc2018c1
numpy : 1.19.4
pytz : 2020.4
dateutil : 2.8.1
pip : 20.2.1
setuptools : 49.2.1
Cython : 0.29.21
pytest : 6.1.1
hypothesis : 5.37.1
sphinx : None
blosc : None
feather : None
xlsxwriter : 1.3.7
lxml.etree : None
html5lib : None
pymysql : None
psycopg2 : None
jinja2 : 2.11.2
IPython : 7.19.0
pandas_datareader: None
bs4 : None
bottleneck : None
fsspec : 0.8.3
fastparquet : 0.4.1
gcsfs : 0.7.1
matplotlib : 3.3.3
numexpr : 2.7.1
odfpy : None
openpyxl : 3.0.5
pandas_gbq : None
pyarrow : 2.0.0
pyxlsb : None
s3fs : 0.5.1
scipy : 1.5.4
sqlalchemy : None
tables : 3.6.1
tabulate : 0.8.7
xarray : None
xlrd : 1.2.0
xlwt : 1.3.0
numba : 0.51.2

Metadata

Metadata

Assignees

No one assigned

    Labels

    BugNeeds TriageIssue that has not been reviewed by a pandas team member

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions