Add Packaged Model #
By adding a packaged model to HPE Machine Learning Inferencing Software, you create a versioned pointer to a model stored in a specified registry or Persistant Volume Claim (PVC). Access to reading and pulling the model’s files is controlled by the registry’s assigned keys.
Registry Options #
The following model types and registry options are supported:
| Model Type | Registries |
|---|---|
| Bento Archive | S3, PFS |
| Custom | OpenLLM (HuggingFace), PVC, S3, PFS, None |
| NIM | NGC, PVC |
| OpenLLM | OpenLLM (HuggingFace), S3, PFS |