Skip to content

💡 [REQUEST] - How to use TorchServe Large Model Inference: walk through an example #2341

Open
@sekyondaMeta

Description

@sekyondaMeta

🚀 Descirbe the improvement or the new tutorial

Create a new tutorial showing a walk through example of TorchServe Large Model Inference

Additional context

You can find some content to use here:
https://github.com/pytorch/serve/blob/master/docs/large_model_inference.md
https://github.com/pytorch/serve/tree/master/examples/large_models/Huggingface_pippy

cc @msaroufim @agunapal @svekars @carljparker @NicolasHug @kit1980 @subramen

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions