Skip to content

✨[Feature] Collection IO end to end support for TRT engine #1293

Closed
@bowang007

Description

@bowang007

Is your feature request related to a problem? Please describe.

Currently Torch-TensorRT is relying on Partitioning to support Tuple/List grouped inputs, which means for some models with Tuple/List input/output, they are not supported end to end. This could also affect performance. So, we should try to implement a change where when we go to construct the inputs to the engine we on the fly group them to be in the form of the graph input so that conversion can work end to end.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions