Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Parallel Wrapper stage is a stage wrapper that allows you to parallelize the execution of multiple stages. The stages specified inside this wrapper will be executed at the same time, in parallel. powerful feature in GAIA API that enables you to execute multiple stages simultaneously, in parallel. By utilizing this wrapper, you can improve the overall efficiency and speed of your search pipeline.

When using the Parallel Wrapper, you need to specify the stages that you want to execute in parallel. These stages will receive the same intermediate and final data, and they will operate independently without any communication between each other. This means that the stages inside the wrapper will not share information or interact during their execution.

It's important to note that the Parallel Wrapper is designed to enhance performance by parallelizing the execution of stages. However, keep in mind that the behavior and outcome of each stage may still depend on the data and configurations specific to that stage.

Note

Take into account, all stages specified inside this wrapper will receive the same intermediate and final, and there will be no communication between each other

...

Properties

PropertyDescriptionDefaultTypeRequired
typeStage class name-stringYes
enableEnable stage for executiontruebooleanNo
nameName for this specific stage"parallel"stringNo
save_to_intermediateIf true, the result of the stage will be stored in the intermediate instead of the final sectionfalsebooleanNo
ui_onlySection specific for UI configuration that affects the process of the stageobjectNo
halt_on_exceptionIndicates if the pipeline should be interrupted in case of an exceptionfalsebooleanNo
stagesList of stages to parallelize-arrayYes
timeoutArgument in seconds to impose a limit on how long you're willing to wait for each task to complete-integerNo

...