Skip to content

✨[Feature] Support cases where LowerGraph() introduces input whose values are stored in Param  #1190

Closed
@bowang007

Description

@bowang007

Is your feature request related to a problem? Please describe.
#1024
There are some models that LowerGraph() might introduce new input to the entire graph after lowering, which may cause the missing value error. As what is happening here #922 (comment) and here: #922 (comment).

Describe the solution you'd like
For now, in most cases it fails at the shape analysis phase since Torch-TensorRT cannot find the value for the missing input. We could introduce a pass to modify the graph and substitute the input by some constant or we can just add some mechanism to use the values from Params directly.

In the future Torch-TensorRT could handle these cases.

Metadata

Metadata

Labels

bugSomething isn't workingcomponent: loweringIssues re: The lowering / preprocessing passesfeature requestNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions