The Parallel Wrapper stage is a stage wrapper that allows you to parallelize the execution of multiple stages. The stages specified inside this wrapper will be executed at the same time, in parallel.
Take into account, all stages specified inside this wrapper will receive the same intermediate and final, and there will be no communication between each other
ParallelWrapperStage Properties
| Property | Description | Default | Type | Required |
|---|---|---|---|---|
| type | Stage class name | - | string | Yes |
| enable | Enable stage for execution | true | boolean | No |
| name | Name for this specific stage | "parallel" | string | No |
| save_to_intermediate | If true, the result of the stage will be stored in the intermediate instead of the final section | false | boolean | No |
| ui_only | Section specific for UI configuration that affects the process of the stage | object | No | |
| halt_on_exception | Indicates if the pipeline should be interrupted in case of an exception | false | boolean | No |
| stages | List of stages to parallelize | - | array | Yes |
| timeout | Argument in seconds to impose a limit on how long you're willing to wait for each task to complete | - | integer | No |
Example Configuration
_parallel = ParallelWrapperStage(
name='parallel',
stages=[
_search1,
_search2
],
timeout=30
)
Overview
Content Tools