Code

Accept buffer in LLMPipeline ctor#1262

Code

Merged

andrei-kochin merged 22 commits intoopenvinotoolkit:releases/2024/5openvinotoolkit/openvino.genai:releases/2024/5from pavel-esir:add_new_ctorspavel-esir/openvino.genai:add_new_ctorsCopy head branch name to clipboardDec 5, 2024

+688-169

Commits

Commits on Nov 27, 2024

• initial

  pavel-esir

  committed
  624d9f5

• use string and ov::Tensor instead of a raw buffer

  pavel-esir

  committed
  9ed8f6e

Commits on Nov 28, 2024

• continuous batching ctor with model from buffer

  pavel-esir

  committed
  dd69db2

• revert chat sample

  pavel-esir

  committed
  3856770

• add CTOR with model_str and ov::Tensor buffers to NPU/StaticLLMPipeline

  pavel-esir

  committed
  2cdf0d3

Commits on Nov 29, 2024

• fix win build, fix chat template patching

  pavel-esir

  committed
  5b73eb4

• fix speculative decoding

  pavel-esir

  committed
  0f45144

• improve TokenizerImpl

  pavel-esir

  committed
  cb7f55e

• fix typos

  pavel-esir

  committed
  add6268

Commits on Dec 2, 2024

• add encryption sample

  pavel-esir

  committed
  ef736e6

• apply comments 1

  pavel-esir

  committed
  44aede3

Commits on Dec 3, 2024

• Merge remote-tracking branch 'upstream/releases/2024/5' into add_new_ctors

  pavel-esir

  committed
  a7081c4

• fix chat_sample and tests

  pavel-esir

  committed
  ab64515

• remove stale todos, fix github actions yml

  pavel-esir

  committed
  380966d

Commits on Dec 4, 2024

• fix path greedy_causal_lm -> text_generation

  pavel-esir

  committed
  4b7c4c2

• update encrypted_model_causal_lm sample, made model_desr setable from LLMPipeline ctor

  pavel-esir

  committed
  0fc3bbe

• Merge remote-tracking branch 'upstream/releases/2024/5' into add_new_ctors

  pavel-esir

  committed
  62ba450

• add ctor with Properties

  pavel-esir

  committed
  4a45257

• fix "Yoda style" if statements, some other corrections

  pavel-esir

  committed
  2457b89

• simplify a bit TokenizerImpl construction

  pavel-esir

  committed
  9befd0c

• fix plugin_config -> properties for NPY

  pavel-esir

  committed
  bbe1b7b

• Merge remote-tracking branch 'upstream/releases/2024/5' into add_new_ctors

  pavel-esir

  committed
  c05febe