The Parallel Wrapper stage is a stage wrapper that allows you to parallelize the execution of multiple stages. The stages specified inside this wrapper will be executed at the same time, in parallel.
Note |
---|
Take into account, all stages specified inside this wrapper will receive the same intermediate and final, and there will be no communication between each other |
ParallelWrapperStage Properties
Property | Description | Default | Type | Required |
---|
type | Stage class name | - | string | Yes |
enable | Enable stage for execution | true | boolean | No |
name | Name for this specific stage | "parallel" | string | No |
save_to_intermediate | If true, the result of the stage will be stored in the intermediate instead of the final section | false | boolean | No |
ui_only | Section specific for UI configuration that affects the process of the stage | object | No |
|
halt_on_exception | Indicates if the pipeline should be interrupted in case of an exception | false | boolean | No |
stages | List of stages to parallelize | - | array | Yes |
timeout | Argument in seconds to impose a limit on how long you're willing to wait for each task to complete | - | integer | No |
Example Configuration
Code Block |
---|
|
_parallel = ParallelWrapperStage(
name='parallel',
stages=[
_search1,
_search2
],
timeout=30
) |