Skip to content

Eval bug: std::regex to split the text #13691

Open
@luoyexuge

Description

@luoyexuge

Name and Version

In the file lama.cpp/src/unicode.cpp, the function std::vectorstd::string unicode_regex_split(const std::string & text, const std::vectorstd::string & regex_exprs) calls the static function static std::vector<size_t> unicode_regex_split_stl(const std::string & text, const std::string & regex_expr, const std::vector<size_t> & offsets). When running in a low-version GCC 4.8.5 environment, it reports an error indicating that regular expressions are not supported.

Operating systems

Linux

GGML backends

CPU

Hardware

Qwen model

Models

No response

Problem description & steps to reproduce

Qwen mode

First Bad Commit

No response

Relevant log output

Qwen

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions