Code

Add Cb streaming#641

Code

Closed

Wovchena wants to merge 32 commits intoopenvinotoolkit:releases/2024/3openvinotoolkit/openvino.genai:releases/2024/3from Wovchena:cb-streamingWovchena/openvino.genai-public:cb-streamingCopy head branch name to clipboard

+326-49

Commits

Commits on Jul 10, 2024

• Add ContinuousBatchingPipeline constructor similar to LLMPipeline

  Show description for d2ccfe0
  Wovchena

  committed
  d2ccfe0

Commits on Jul 11, 2024

• Use CB as backend

  Wovchena

  committed
  ab0f43c

• Update bindings

  Wovchena

  committed
  05cf5d3

• comma

  Wovchena

  committed
  96fcf77

• Merge branch 'add-ContinuousBatchingPipeline-constructor-similar-to-LLMPipeline' into use-CB-as-backend

  Wovchena

  committed
  e5c2631

• Merge branch 'master' into add-ContinuousBatchingPipeline-constructor-similar-to-LLMPipeline

  Wovchena

  committed
  967da3a

• Merge branch 'add-ContinuousBatchingPipeline-constructor-similar-to-LLMPipeline' into use-CB-as-backend

  Wovchena

  committed
  c13d623

• pass

  Wovchena

  committed
  e278a14

• conflict

  Wovchena

  committed
  47fa22c

• conflict

  Wovchena

  committed
  2094ba6

• clean

  Wovchena

  committed
  78361a9

• verify status

  Wovchena

  committed
  691fefc

• conflict

  Wovchena

  committed
  1825328

• args

  Wovchena

  committed
  6a3275e

• test

  Wovchena

  committed
  a5f2cd6

• tests

  Wovchena

  committed
  771fc29

• tests

  Wovchena

  committed
  5c615bf

Commits on Jul 12, 2024

• test

  Wovchena

  committed
  3afc16d

• remove caching

  Wovchena

  committed
  67f4717

• Clear beam search info.

  popovaan

  committed
  d26723f

• Merge remote-tracking branch 'popovaan/clear_beam_info' into use-CB-as-backend

  Wovchena

  committed
  c28a023

Commits on Jul 15, 2024

• -am cache

  Wovchena

  committed
  d223d68

• updte

  Wovchena

  committed
  238ea8b

• Revert "Merge remote-tracking branch 'popovaan/clear_beam_info' into use-CB-as-backend"

  Show description for 5a4c878
  Wovchena

  committed
  5a4c878

• revert spelling

  Wovchena

  committed
  cf35f19

• relax abs_tol

  Wovchena

  committed
  12061af

• Merge branch 'releases/2024/3' into use-CB-as-backend

  Wovchena

  authored
  cad13dc

• Merge branch 'releases/2024/3' into use-CB-as-backend

  Wovchena

  committed
  0ffdd6f

• lru_cache

  Wovchena

  committed
  6d7a468

Commits on Jul 16, 2024

• Merge branch 'releases/2024/3' into cb-streaming

  Wovchena

  committed
  036111c

• Add CB streaming

  Wovchena

  committed
  c6d345a

Commits on Jul 17, 2024

• use StreamerVariant

  Wovchena

  committed
  bc56ca6