BUG: AttributeError: 'bool' object has no attribute 'to_numpy' in "mask_missing" method of core/missing.py

[rainnnnny]

Pandas version checks

• I have checked that this issue has not already been reported.

• I have confirmed this bug exists on the latest version of pandas.

• I have confirmed this bug exists on the main branch of pandas.

Reproducible Example

import pandas
import numpy
from qpython.qcollection import qlist

res = pandas.Series(data=qlist([True, True, False, False], qtype=1, adjust_dtype=False)).replace(False, numpy.NaN)

Issue Description

new_mask = arr == x

this expected to get an array-like object with bool elements, like [False, False, True, ...] , but when arr being an special array-like object, like the qlist object in example , the expression returns a single False, which is a bool object, thus we'll get the exception shown above

Expected Behavior

returns an array-like object instead of a bool object

Installed Versions

1.4.1

[simonjayhawkins]

Thanks @rainnnnny for the report.

labelling as constructor issue as I believe that the pd.Series constructor should be converting/materializing array-likes passed as data into standard numpy arrays for the in-memory storage and not storing the Qlist object directly.

>>> res._mgr.array
QList([ True,  True, False, False])

as a workaround

pandas.Series(
    data=np.asarray(qlist([True, True, False, False], qtype=1, adjust_dtype=False))
).replace(False, numpy.NaN)

gives

0    True
1    True
2     NaN
3     NaN
dtype: object

If there is a reason that you would want to retain the QList object in memory, should investigate creating an Extension Array https://pandas.pydata.org/pandas-docs/dev/development/extending.html#extensionarray

[bcmyguest1]

import pandas as pd
# case 1
df = pd.DataFrame({"d":[pd.NA]})
df.replace('',pd.NA) # throws the same error
# case 2
df = pd.DataFrame({"d":[None]})
df.replace('',pd.NA) # works fine

FYI this is not only related to QList.

new_mask ends up being [[False]] in case 2, but False in case 1.

[simonjayhawkins]

FYI this is not only related to QList.

Thanks @bcmyguest1 for this example.

It does raise a warning FutureWarning: elementwise comparison failed; returning scalar instead, but in the future will perform elementwise comparison, so I guess this issue will resolve itself in a future pandas.

However, this example did work in pandas 1.3.5, so labelling as regression pending further investigation.

import pandas as pd

# case 1
df = pd.DataFrame({"d": [pd.NA]})
print(df.replace("", pd.NA))

      d
0  <NA>

Note: the FutureWarning was also given in pandas 1.3.5, but I think that it should probably have been suppressed.

[simonjayhawkins]

However, this example did work in pandas 1.3.5, so labelling as regression pending further investigation.

first bad commit: [b2d54d9] BUG: IntegerArray/FloatingArray ufunc with 'out' kwd (#45122)

cc @jbrockmendel