DOC: Add PyArrow user guide #51371
DOC: Add PyArrow user guide #51371
Conversation
doc/source/user_guide/pyarrow.rst
Outdated
| df | ||
|
|
||
| If you already have an :external+pyarrow:py:class:`pyarrow.Array` or :external+pyarrow:py:class:`pyarrow.ChunkedArray`, | ||
| you can pass it into :class:`.arrays.ArrowExtensionArray` to construct the associated :class:`Series`, :class:`Index:` |
There was a problem hiding this comment.
| you can pass it into :class:`.arrays.ArrowExtensionArray` to construct the associated :class:`Series`, :class:`Index:` | |
| you can pass it into :class:`.arrays.ArrowExtensionArray` to construct the associated :class:`Series`, :class:`Index` |
doc/source/user_guide/pyarrow.rst
Outdated
| df | ||
|
|
||
| By default, these functions, and all other IO reader functions, return NumPy-backed data. These readers can return | ||
| PyArrow-backed data by specifying ``use_nullable_dtypes`` with the global configuration option ``"mode.dtype_backend"`` |
There was a problem hiding this comment.
Could you reference the global option to set use_nullable_dtypesas well?
There was a problem hiding this comment.
I find this sentence a bit confusing, seems like we're first suggesting to use mode.dtype_backend='use_nullable_dtypes'. Maybe we can write it like by specifying the parameter use nullable_dtypes *and* the global configuration ..., or something else that helps understand this better.
There was a problem hiding this comment.
Added a section about the global option and clarified that the parameter and global option need to be used together
doc/source/user_guide/pyarrow.rst
Outdated
| df | ||
|
|
||
| By default, these functions, and all other IO reader functions, return NumPy-backed data. These readers can return | ||
| PyArrow-backed data by specifying ``use_nullable_dtypes`` with the global configuration option ``"mode.dtype_backend"`` |
There was a problem hiding this comment.
I find this sentence a bit confusing, seems like we're first suggesting to use mode.dtype_backend='use_nullable_dtypes'. Maybe we can write it like by specifying the parameter use nullable_dtypes *and* the global configuration ..., or something else that helps understand this better.
doc/source/user_guide/pyarrow.rst
Outdated
| .. ipython:: python | ||
|
|
||
| pd.set_option("mode.dtype_backend", "pyarrow") | ||
| pd.options.mode.nullable_dtypes = True |
There was a problem hiding this comment.
I think this has side effect, I guess we need to reset to False after this chapter is over (ci failure seems to be caused by this)
There was a problem hiding this comment.
Will convert to a code block instead
No description provided.