Code

check windows on precommit#453

Code

Closed

pavel-esir wants to merge 108 commits intoopenvinotoolkit:masteropenvinotoolkit/openvino.genai:masterfrom pavel-esir:generate_pipeline_latestpavel-esir/openvino.genai:generate_pipeline_latestCopy head branch name to clipboard

+2,962-390

Commits

Commits on Apr 17, 2024

• initial generate

  pavel-esir

  committed
  ba91fde

• LLM pipeline

  pavel-esir

  committed
  9d85a0e

• Added calculating for several batches

  pavel-esir

  committed
  b21c6c1

• Greedy search works

  pavel-esir

  committed
  e52e90d

• rename to GenerationConfig

  pavel-esir

  committed
  745a804

• Add fluent interface

  pavel-esir

  committed
  8895ed0

• Update text_generation/causal_lm/cpp/generate_pipeline/generate_pipeline.hpp

  pavel-esir

  committed
  b24977d

• cosmetic changes in main

  pavel-esir

  committed
  c933ca0

• greedy search with batches and left padding works

  pavel-esir

  committed
  c43e901

• combine LLModel with LLMPipeline

  pavel-esir

  committed
  5a914f6

• wip: enable calling tokenize/detokenize for LLMPipeline

  pavel-esir

  committed
  c1e0c9d

• add callback to generate

  pavel-esir

  committed
  8d66353

• cleanup generate_sample.cpp

  pavel-esir

  committed
  fa12da7

• add speculative decoding

  pavel-esir

  committed
  5ceb9d5

Commits on Apr 19, 2024

• separate Tokenizer

  pavel-esir

  committed
  a5083c7

Commits on Apr 23, 2024

• wip

  pavel-esir

  committed
  7692160

• add apply_chat_template

  pavel-esir

  committed
  964a5e8

Commits on Apr 24, 2024

• add start/stop conversation

  pavel-esir

  committed
  d3f6339

Commits on Apr 26, 2024

• use text in streamer instead of raw tokens

  pavel-esir

  committed
  3776433

• fix difference between accumulating conversation as text and keeping history in KV cache

  pavel-esir

  committed
  e57aa4c

• cleanup

  pavel-esir

  committed
  d0c1341

• add Jinja2cpp submodule

  pavel-esir

  committed
  8dcea1f

Commits on May 2, 2024

• add ov namespace

  pavel-esir

  committed
  754a462

• return scores for batched outputs

  pavel-esir

  committed
  9b19c6f

Commits on May 3, 2024

• add AnyMap

  pavel-esir

  committed
  9bf6caa

• Merge remote-tracking branch 'upstream/master' into generate_pipeline

  pavel-esir

  committed
  39fd73c

• cleanup

  pavel-esir

  committed
  63d8f6d

Commits on May 6, 2024

• before moving to pimpl

  pavel-esir

  committed
  a833760

• move to separate include & src

  pavel-esir

  committed
  1681654

• pimpl implementation

  pavel-esir

  committed
  9fe73c6

• temporary disable jinja2cpp

  pavel-esir

  committed
  053708f

Commits on May 7, 2024

• add python api draft, hide implementations from user & refactor implementation

  pavel-esir

  committed
  bd6849a

• extract decoding methods to separate files

  pavel-esir

  committed
  62c471e

• extended python api, added python api test

  pavel-esir

  committed
  f1d54f4

Commits on May 8, 2024

• remove call method

  pavel-esir

  committed
  3c82e11

• init

  Wovchena

  committed
  5543cee

• add_subdirectory

  Wovchena

  committed
  abb8835

• add files

  Wovchena

  committed
  0998abc

• add __init__.py

  Wovchena

  committed
  15492c4

• removed set_streamer

  pavel-esir

  committed
  005d3fb

• use std::optional

  pavel-esir

  committed
  cc44bc8

• started to add Readme docs

  pavel-esir

  committed
  d8cab05

• reoder Readme

  pavel-esir

  committed
  2535394

Commits on May 9, 2024

• rm generate_pipeline/python

  Wovchena

  committed
  95c1bfb

• update Readme; cleanup LLMPipeline and add docstring

  pavel-esir

  committed
  4510f71

• refactor folder structure

  pavel-esir

  committed
  507bc49

Commits on May 10, 2024

• cleanup generation_config and ov::Tokenizer

  pavel-esir

  committed
  af747d4

• move includes to a separate openvino/genai folder

  pavel-esir

  committed
  c6620d9

• Merge branch 'generate_pipeline' into package

  Wovchena

  committed
  59c3e0b

• align names

  Wovchena

  committed
  be84345

• Dont modify text_generation/causal_lm/cpp/CMakeLists.txt

  Wovchena

  committed
  bced64a

• rm -r text_generation/causal_lm/cpp/generate_pipeline/python-bindings/

  Wovchena

  committed
  f4e82b6

• fix build

  Wovchena

  committed
  5b2b0ca

• add tokenizers only once

  Wovchena

  committed
  0dd8f59

• change cmake.source-dir

  Wovchena

  committed
  23638ff

• restore openvino/genai inits

  Wovchena

  committed
  d8c5349

• Integrate JinjaCpp

  ilya-lavrenov

  committed
  24faefe

• install genai lib

  Wovchena

  committed
  598dda3

• Merge pull request #2 from ilya-lavrenov/jinja-integration-pavel

  Show description for f274b93
  pavel-esir

  authored
  f274b93

• import openvino for win and lin

  Wovchena

  committed
  02d0eae

• Merge branch 'generate_pipeline' into package

  Wovchena

  committed
  e6695f3

• put the line back

  Wovchena

  committed
  a27c5a7

• Added cmake build type before project clause

  ilya-lavrenov

  committed
  0849c41

• one line properties

  Wovchena

  committed
  34cddff

• Merge pull request #3 from ilya-lavrenov/cmake-build-type

  Show description for 023cf1e
  pavel-esir

  authored
  023cf1e

• Export API symbols

  ilya-lavrenov

  committed
  6a5d750

• Merge pull request #4 from ilya-lavrenov/generate_pipeline

  Show description for 27f385e
  pavel-esir

  authored
  27f385e

• Merge branch 'generate_pipeline' into package

  Wovchena

  committed
  a9332f0

• rename

  Wovchena

  committed
  9ef488c

• add .github/workflows/genai_lib.yml

  Wovchena

  committed
  4fad7d5

• on: pull_request

  Wovchena

  committed
  51e03a2

• spelling

  Wovchena

  committed
  e23a7bb

• install openvino

  Wovchena

  committed
  fc5b753

• add syntacis sugar for geenrate, optimize value passing by reference

  Show description for 09f8806
  pavel-esir

  committed
  09f8806

Commits on May 11, 2024

• remove speculative decoding

  pavel-esir

  committed
  af22a8a

Commits on May 13, 2024

• update

  Wovchena

  committed
  e7db7e8

• add rpath

  Wovchena

  committed
  f279363

• add rpath to libopenvino.so

  Wovchena

  committed
  83d77c8

• py_generate_pipeline

  Wovchena

  committed
  167f924

• reorder tokenizer.cpp, add comments to BaseStreamer

  pavel-esir

  committed
  a111a3f

• install centos7

  Wovchena

  committed
  813d80a

• install nightly

  Wovchena

  committed
  6227b65

• Merge branch 'generate_pipeline' into package

  Wovchena

  committed
  74fc107

• propagate _GLIBCXX_USE_CXX11_ABI

  Wovchena

  committed
  9b83a7e

• Populate python with the libraries to allow skipping wheel installation

  Wovchena

  committed
  2d15752

• run setupvars

  Wovchena

  committed
  8025554

• update .gitignore, install numpy

  Wovchena

  committed
  2b14286

• quotes

  Wovchena

  committed
  1c11bc7

• fix PYTHONPATH

  Wovchena

  committed
  e7fce82

• fix PYTHONPATH

  Wovchena

  committed
  64608d1

• quotes

  Wovchena

  committed
  43b87c7

Commits on May 14, 2024

• reorder vars

  Wovchena

  committed
  fef9674

• openvino.genai-

  Wovchena

  committed
  b21286c

• Merge pull request #1 from Wovchena/package

  Show description for d393f89
  pavel-esir

  authored
  d393f89

• Merge branch 'master' into generate_pipeline

  pavel-esir

  authored
  2b8954d

• Update CMakeLists.txt

  pavel-esir

  authored
  11e872b

• move group beam searcher to src

  pavel-esir

  committed
  442dcbf

Commits on May 15, 2024

• Update .gitignore (#5)

  Show description for 53d534e
  Wovchena

  authored
  53d534e

• Merge remote-tracking branch 'origin/generate_pipeline' into generate_pipeline_latest

  pavel-esir

  committed
  dcb4b86

• fixed difference between old greddy sample and generate

  pavel-esir

  committed
  72c045e

• tokenizer minor fixes

  pavel-esir

  committed
  11fbaa2

• apply comments

  pavel-esir

  committed
  264e99f

• remove accidentally added test_cpp_samples.py

  pavel-esir

  committed
  11032b4

• fix build

  pavel-esir

  committed
  7d0c80b

• fix causal_lm comparison error

  pavel-esir

  committed
  2e3cd73

• fix different outputs

  pavel-esir

  committed
  e7fa974

Commits on May 16, 2024

• add tests

  pavel-esir

  committed
  93be036

Commits on May 17, 2024

• check windows on precommit

  pavel-esir

  committed
  ce81ba1