Skip to content

PERF: Optimize _categorical_convert CSV parser when categories are known ahead of time #17743

New issue
New issue
Open
Open
PERF: Optimize _categorical_convert CSV parser when categories are known ahead of time#17743
Labels
CategoricalCategorical Data TypeIO CSVread_csv, to_csvPerformanceMemory or execution speed performance
@TomAugspurger

Description

@TomAugspurger
TomAugspurger
opened on Oct 2, 2017

We should be able to speed up

pandas/pandas/_libs/parsers.pyx

Line 1612 in 2310faa

cdef _categorical_convert(parser_t *parser, int64_t col,
when the users passes a CategoricalDtype.

xref #17643

Metadata

Metadata

Assignees

No one assigned

    Labels

    CategoricalCategorical Data TypeIO CSVread_csv, to_csvPerformanceMemory or execution speed performance

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions