Parallelism Spec PPS

Spec

This is a top-level attribute of the pipeline spec.

{
  "pipeline": {...},
  "transform": {...},
  "parallelismSpec": {
    "constant": int
  },
  ...
}

Behavior

HPE Machine Learning Data Management starts the number of workers that you specify. For example, set "constant":10 to use 10 workers.

  • The default value is 1

When to Use

warning icon Warning
Because spouts and services are designed to be single instances, do not modify the default parallism_spec value for these pipelines.