Code

Outlines guided generation#1539

Code

Merged

Narsil merged 34 commits intomainhuggingface/text-generation-inference:mainfrom outlines-guided-generationhuggingface/text-generation-inference:outlines-guided-generationCopy head branch name to clipboardFeb 15, 2024

+1,660-53

Commits

Commits on Feb 14, 2024

• feat: first draft constraining generation via outlines

  drbh

  committed
  b013cb4

• feat: support simple grammars via outlines

  drbh

  committed
  0245506

• feat: support JSON schemas

  drbh

  committed
  066d3d4

• fix: update all NextTokenChoosers

  drbh

  committed
  56e919e

• feat: support other models and add fsm caching

  drbh

  committed
  8fd2664

• feat: support grammars in batch

  drbh

  committed
  ff6e8d9

• fix: update grammar states after filter

  drbh

  committed
  a1c630d

• fix: prefer grammar as logit processor

  drbh

  committed
  f1d43f2

• fix: remove small unneeded changes

  drbh

  committed
  ffc2288

• fix: adjust protos and router

  drbh

  committed
  8413cc4

• fix: adjust docs

  drbh

  committed
  518ebfb

• fix: re update docs

  drbh

  committed
  565f246

• fix: resolve typos and docs

  drbh

  committed
  74a586b

• feat: add grammar tests and typo tweaks

  drbh

  committed
  f94fc83

• feat: address syntactically comments

  drbh

  committed
  a28ba72

• feat: remove states from proto and simplify logit processor

  drbh

  committed
  13e07b8

• feat: improve grammar init

  drbh

  committed
  d0d7cd9

• feat: improve grammar advance logic to avoid blocking GPU

  drbh

  committed
  8f14019

• feat: advance grammars in all models

  drbh

  committed
  91a114a

• feat: add --grammar-support cli flag and validation error

  drbh

  committed
  fe787d1

• fix: update docs

  drbh

  committed
  8f1651f

• fix: add grammar_support to validation tests

  drbh

  committed
  95e577b

• feat: add grammar_support to test launcher

  drbh

  committed
  5ba1bac

• fix: adjust client and conftest for grammar

  drbh

  committed
  d39e45a

• feat: fix advance_grammar sig, add comment and move advance call

  drbh

  committed
  3df37fa

• feat: improve client typing and update tests

  drbh

  committed
  8b9430f

• feat: include grammar type in request, avoid alloc and improve proto types

  drbh

  committed
  d849641

• fix: adjust type typo

  drbh

  committed
  8b13c47

• fix: adjust next type typo

  drbh

  committed
  3974e4d

• fix: add missing grammar type typo

  drbh

  committed
  be78354

• fix: remove unnecessary code, avoid copies and make deser safer

  drbh

  committed
  f0cdd9c

• feat: prefer disable grammar

  drbh

  committed
  63c52fb

• feat: support spectulative decoding grammar advances

  drbh

  committed
  c791187

• fix: add disable_grammar_support to docker_launcher args

  drbh

  committed
  12c7aae