Skip to content
This repository has been archived by the owner on Dec 13, 2023. It is now read-only.

Permissive task capability #3866

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Commits on Nov 27, 2023

  1. Permissive task capability

    Why:
    We need idempotent forked tasks, meaning all tasks get
    executed, but any failures are still detected upon join.
    Feature request Netflix#3861
    
    What:
    Introduced the concept of Permissive tasks.
    A Permissive task is similar to a Simple task. The
    difference is, it permits the other tasks to continue -
    in case a Permissive task failed.
    Result is:
    1. Forked Permissive tasks will let each other
    be evaluated, until all the forked tasks had terminated.
    Only then, the join task should fail. In case of Permissive
    optional tasks, the join will not fail.
    2. Permissive sequential tasks will let subsequent tasks
    continue. While at the end, the workflow will fail in case
    a permissive task had failed. The workflow would not fail
    in case of Permissive optional task failure.
    
    Testing done: PermissiveTaskMapperTest added,
    TestDeciderOutcomes.testPermissive() added,
    WorkflowAndTaskConfigurationSpec
    "Test simple workflow which has a permissive task" and
    "Test simple workflow which has a permissive optional task added"
    that cover retry, ForkJoinSpec
    "Test a simple workflow with fork join permissive failure flow"
    added.
    In addition, performed e2e tests locally running a Conductor instance.
    Did build a docker image with the code changes made, started it locally,
    and started a SampleWorker to poll 3 tasks in parallel.
    Verified e2e scenarios of task_def_permissive, task_def_permissive_optional,
    task_def_simple.json, task_def_simple_optional.json, each joining on
    6 forked tasks, then running simple task 7 after join.
    ivakoleva committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    6883859 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d51ab62 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. Configuration menu
    Copy the full SHA
    af53c50 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. Configuration menu
    Copy the full SHA
    14d08fe View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. Configuration menu
    Copy the full SHA
    ad9690a View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. Configuration menu
    Copy the full SHA
    9de273b View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2023

  1. Configuration menu
    Copy the full SHA
    5c6c418 View commit details
    Browse the repository at this point in the history