Code

Merge releases/2024/3 into master#720

Code

Merged

Wovchena merged 60 commits intoopenvinotoolkit:masteropenvinotoolkit/openvino.genai:masterfrom Wovchena:merge-releases/2024/3-into-masterWovchena/openvino.genai-public:merge-releases/2024/3-into-masterCopy head branch name to clipboardAug 1, 2024

+1,619-225

Commits

Commits on Jul 15, 2024

• Workaround (openvinotoolkit#618)

  Show description for e4637b3
  Wovchena

  authored
  e4637b3

• Revert to python3

  Wovchena

  committed
  423c8e3

• Revert to python3 (openvinotoolkit#622)

  akladiev

  authored
  8ad336c

• Fix cmake Python var name (openvinotoolkit#624)

  Wovchena

  authored
  1b1b2f0

• Add ContinuousBatchingPipeline constructor similar to LLMPipeline (openvinotoolkit#604)

  Show description for 70b74ad
  Wovchena

  authored
  70b74ad

• Clear beam search info when generate() is finished. (openvinotoolkit#630)

  Show description for f0c2677
  popovaan

  authored
  f0c2677

Commits on Jul 16, 2024

• Update nncf_utils.py (openvinotoolkit#616) (openvinotoolkit#633)

  Show description for 73badf6
  KodiaqQ

  authored
  73badf6

• Workaround cmake packaging (openvinotoolkit#634)

  Show description for 25655e3
  Wovchena

  authored
  25655e3

• Save licensing_genai into docs to align with OpenVINO (openvinotoolkit#637)

  Wovchena

  authored
  754f6d7

• Update submodule (openvinotoolkit#638)

  Wovchena

  authored
  e5247e0

Commits on Jul 17, 2024

• Add Llama3 (openvinotoolkit#620)

  Show description for 2d1fa3b
  

  Wovchena

  and

  yatarkan

  authored
  2d1fa3b

• nightly->rc1 (openvinotoolkit#621)

  Wovchena

  authored
  489a87d

• Add OpenVINOGenAITargets to core_genai_dev COMPONENT (openvinotoolkit#642)

  Show description for 67f0467
  Wovchena

  authored
  67f0467

Commits on Jul 22, 2024

• Apply todo, initialize detokenizer's cache (openvinotoolkit#647)

  Wovchena

  authored
  1969160

• Cherry-pick static LLM pipeline changes (openvinotoolkit#654)

  Show description for 0e0f6a9
  

  TolyaTalamanov

  and

  pavel-esir

  authored
  0e0f6a9

• [Continuous batching] Replace standard max_element call with custom loop for greedy sampling (openvinotoolkit#607)

  Show description for cb100cb
  

  mzegla

  authored and

  pavel-esir

  committed
  cb100cb

• wip

  pavel-esir

  committed
  f0e4190

• add detokenization metric; refactor split to perf_conter & perf_metrics

  pavel-esir

  committed
  7cab496

• refactor structure, add python sample

  pavel-esir

  committed
  bb1113c

• Cherry-pick custom max_element loop (openvinotoolkit#662)

  Show description for 7bf42f1
  mzegla

  authored
  7bf42f1

• add more preicise durations

  pavel-esir

  committed
  0a8f0d9

• Add note for pybind ov::Tensor issue (openvinotoolkit#659)

  as-suvorov

  authored
  bad01b9

• [OV 24.3]Fix multinomial sample CMakeList (openvinotoolkit#658)

  Show description for cb0da0a
  sammysun0711

  authored
  cb0da0a

Commits on Jul 23, 2024

• add Readme for tests (openvinotoolkit#664)

  Show description for bc92248
  

  pavel-esir

  and

  Wovchena

  authored
  bc92248

• add cpp Readme, ensured correct batch processing, add PerfMetrics to Readme

  pavel-esir

  committed
  90320f4

• use MeanStdPair

  pavel-esir

  committed
  aeec730

Commits on Jul 24, 2024

• [2024.3] Fix symbol encode error (openvinotoolkit#629)

  Show description for 56eeafc
  yatarkan

  authored
  56eeafc

• [release branch] Add infer request queue for tokenizers and allow for optional plugin_config in tokenizer (openvinotoolkit#669)

  Show description for 8934a0e
  dkalinowski

  authored
  8934a0e

• Add max_new_tokens to every generate call in src/README.md (openvinotoolkit#670)

  Show description for 12f8e44
  pavel-esir

  authored
  12f8e44

• Add CB naive chat (openvinotoolkit#644)

  Show description for f9e45e1
  

  Wovchena

  and

  popovaan

  authored
  f9e45e1

• return back py::object -> AnyMap (openvinotoolkit#679)

  Show description for 03590c5
  pavel-esir

  authored
  03590c5

• Update openvino_tokenizers (openvinotoolkit#680)

  Wovchena

  authored
  53945f7

• Allow dev and rc tokenizers (openvinotoolkit#681)

  Wovchena

  authored
  a769b33

Commits on Jul 25, 2024

• Fix chat templates with slices, add tokenizer config for mistralai/Mistral-7B-Instruct-v0.1 (openvinotoolkit#648)

  yatarkan

  authored
  e449ffe

Commits on Jul 26, 2024

• Prefix caching. (openvinotoolkit#675)

  Show description for 406393f
  popovaan

  authored
  406393f

• Merge remote-tracking branch 'upstream/releases/2024/3' into add_perf_counters

  pavel-esir

  committed
  c45aed5

• resolve conflicts

  pavel-esir

  committed
  be2fdaf

• apply comments

  pavel-esir

  committed
  b00bcd8

• uset getter and cache evaluate results

  pavel-esir

  committed
  60e7188

• update Readme's

  pavel-esir

  committed
  e553ef5

• StaticLLMPipeline dangling models hotfix (openvinotoolkit#693)

  TolyaTalamanov

  authored
  3bfbab5

• add generation time metrics (openvinotoolkit#613)

  Show description for 102f00a
  andrei-kochin

  authored
  102f00a

Commits on Jul 29, 2024

• Remove Dockerfile (openvinotoolkit#700)

  Show description for 06c57b7
  mzegla

  authored
  06c57b7

Commits on Jul 30, 2024

• StaticLLMPipeline - align u4 zero points (openvinotoolkit#705)

  TolyaTalamanov

  authored
  e286469

Commits on Jul 31, 2024

• Disable broken test (openvinotoolkit#707)

  Wovchena

  authored
  2a80828

• update optimum commit for releases/2024/3 (openvinotoolkit#711)

  eaidova

  authored
  d89cdcb

• change commit for optimum

  eaidova

  committed
  2428a3a

• Merge branch 'releases/2024/3' into ea/upd_opt_commit

  eaidova

  authored
  1473e7f

• change commit for optimum (openvinotoolkit#714)

  andrei-kochin

  authored
  8cb12b2

• Add perf metric docstrings (openvinotoolkit#713)

  Show description for 2f778f3
  pavel-esir

  authored
  2f778f3

• rc1->rc2 (openvinotoolkit#695)

  Wovchena

  authored
  2dc6b64

• Docs for version compatibility (openvinotoolkit#692)

  Show description for 3bfdd3f
  

  yatarkan

  and

  Wovchena

  authored
  3bfdd3f

• Merge branch 'releases/2024/3' into merge-releases/2024/3-into-master

  Wovchena

  committed
  a9d6541

• coorect after git merge conflict resolution

  Wovchena

  committed
  e76f9f9

• coorect after git merge conflict resolution

  Wovchena

  committed
  9a0b7e9

• coorect after git merge conflict resolution

  Wovchena

  committed
  a88cfc8

• coorect after git merge conflict resolution

  Wovchena

  committed
  2311f6e

Commits on Aug 1, 2024

• cache_size

  Wovchena

  committed
  45937bc

• skip

  Wovchena

  committed
  4962039

• Correct links and typos

  Wovchena

  committed
  b5f21dc