Add Packaged Model #

By adding a packaged model to HPE Machine Learning Inferencing Software, you create a versioned pointer to a model stored in a specified registry or Persistant Volume Claim (PVC). Access to reading and pulling the model’s files is controlled by the registry’s assigned keys.

Registry Options #

The following model types and registry options are supported:

Model Type	Registries
Bento Archive	S3
Custom	OpenLLM (HuggingFace), PVC, S3, None
NIM	NGC, PVC
OpenLLM	OpenLLM (HuggingFace), S3

Options #

From Registry (UI)

Learn how to add a packaged model from a registry for your inference service using the UI.

From Registry (CLI)

Learn how to add a packaged model from a registry for your inference service using the …

From Registry (API)

Learn how to add a packaged model from a registry for your inference service using the …

From PVC (UI)

Learn how to add a packaged model from a PVC for your inference service using the UI.

From PVC (CLI)

Learn how to add a packaged model from a PVC for your inference service using the CLI.

From PVC (API)

Learn how to add a packaged model from a PVC for your inference service using the API.