Code

Lag llama#24803

Code

Closed

kashif wants to merge 71 commits intohuggingface:mainhuggingface/transformers:mainfrom kashif:lag-llamakashif/transformers:lag-llamaCopy head branch name to clipboard

+2,533-4

Commits

Commits on Jul 11, 2023

• initial lagllama

  kashif

  committed
  471f818

  Copy full SHA for 471f818

Commits on Jul 13, 2023

• added configuration and prepeare inputs

  kashif

  committed
  0e7a3f2

  Copy full SHA for 0e7a3f2

• Merge branch 'main' into lag-llama

  kashif

  authored
  d5b7f58

  Copy full SHA for d5b7f58

• fix copies

  kashif

  committed
  75c2634

  Copy full SHA for 75c2634

Commits on Jul 16, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  657c6df

  Copy full SHA for 657c6df

• make fix-copies

  kashif

  committed
  e25a132

  Copy full SHA for e25a132

• add linear and ntk scaling embeddings

  kashif

  committed
  a1401b7

  Copy full SHA for a1401b7

• added rope_scaling configuration

  kashif

  committed
  cb79030

  Copy full SHA for cb79030

• updated docs

  kashif

  committed
  b70c90f

  Copy full SHA for b70c90f

• fix typo

  kashif

  committed
  e4d7eb3

  Copy full SHA for e4d7eb3

Commits on Jul 17, 2023

• saner hyperparams for forecasting

  kashif

  committed
  8609fc0

  Copy full SHA for 8609fc0

• fix docstring

  kashif

  committed
  6f7fec9

  Copy full SHA for 6f7fec9

• use BaseTSModelOutputWithPast

  kashif

  committed
  d5cd861

  Copy full SHA for d5cd861

• CausalTSOutputWithPast

  kashif

  committed
  db9c454

  Copy full SHA for db9c454

Commits on Jul 18, 2023

• fix imports

  kashif

  committed
  c387d8f

  Copy full SHA for c387d8f

• use lagged_sequence_values method

  kashif

  committed
  e28f373

  Copy full SHA for e28f373

Commits on Jul 23, 2023

• add past_observed_values as an optional arg

  kashif

  committed
  4ff29a2

  Copy full SHA for 4ff29a2

Commits on Jul 25, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  8faf062

  Copy full SHA for 8faf062

• fix typo

  kashif

  committed
  28bec13

  Copy full SHA for 28bec13

• Merge branch 'main' into lag-llama

  kashif

  committed
  152e6b1

  Copy full SHA for 152e6b1

• add num_key_value_heads and pretraining_tp config

  kashif

  committed
  c1f1c2e

  Copy full SHA for c1f1c2e

• add output_distribution and fix loss

  kashif

  committed
  94e2906

  Copy full SHA for 94e2906

• add weighted_average

  kashif

  committed
  98f8d37

  Copy full SHA for 98f8d37

• make style

  kashif

  committed
  a2b5fb4

  Copy full SHA for a2b5fb4

Commits on Aug 3, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  7d4c129

  Copy full SHA for 7d4c129

• make fix-copies

  kashif

  committed
  9ec3834

  Copy full SHA for 9ec3834

Commits on Aug 17, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  9536776

  Copy full SHA for 9536776

Commits on Aug 18, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  877e7e5

  Copy full SHA for 877e7e5

• fix order

  kashif

  committed
  71b8132

  Copy full SHA for 71b8132

Commits on Sep 4, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  4221d80

  Copy full SHA for 4221d80

• make fix-copies

  kashif

  committed
  4edef63

  Copy full SHA for 4edef63

• initial prepare_inputs_for_generation

  kashif

  committed
  569c558

  Copy full SHA for 569c558

• add rope_theta

  kashif

  committed
  f3f4345

  Copy full SHA for f3f4345

Commits on Sep 7, 2023

• initial generate

  kashif

  committed
  adab02c

  Copy full SHA for adab02c

• initial generation

  kashif

  committed
  93c42a3

  Copy full SHA for 93c42a3

Commits on Oct 6, 2023

• Merge branch 'main' into lag-llama

  kashif

  authored
  54051a4

  Copy full SHA for 54051a4

Commits on Nov 10, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  1783142

  Copy full SHA for 1783142

• fix-copies

  kashif

  committed
  f4dfb6a

  Copy full SHA for f4dfb6a

• undo changes in readme

  kashif

  committed
  5688872

  Copy full SHA for 5688872

• undo

  kashif

  committed
  cad316e

  Copy full SHA for cad316e

• more undo

  kashif

  committed
  e14a4e8

  Copy full SHA for e14a4e8

• undo

  kashif

  committed
  2851146

  Copy full SHA for 2851146

• undo doc changes

  kashif

  committed
  23e2ab3

  Copy full SHA for 23e2ab3

• add attention_bias config

  kashif

  committed
  5576607

  Copy full SHA for 5576607

• prediction_length fix

  kashif

  committed
  677ab9c

  Copy full SHA for 677ab9c

• Merge branch 'main' into lag-llama

  kashif

  authored
  bd2356d

  Copy full SHA for bd2356d

• fix-copies

  kashif

  committed
  eb763a7

  Copy full SHA for eb763a7

Commits on Nov 12, 2023

• fix prepare_inputs_for_generation

  kashif

  committed
  a779c7f

  Copy full SHA for a779c7f

• refactored

  kashif

  committed
  b94da47

  Copy full SHA for b94da47

• past_observed_values is required

  kashif

  committed
  3fb57dc

  Copy full SHA for 3fb57dc

• don't pass loc and scale when past_values is none

  kashif

  committed
  b63b677

  Copy full SHA for b63b677

Commits on Nov 13, 2023

• doc string

  kashif

  committed
  d69381b

  Copy full SHA for d69381b

• Merge branch 'main' into lag-llama

  kashif

  committed
  85c2cee

  Copy full SHA for 85c2cee

• Merge branch 'main' into lag-llama

  kashif

  committed
  fcbb59c

  Copy full SHA for fcbb59c

Commits on Nov 14, 2023

• fix-copies

  kashif

  committed
  d8dbf1e

  Copy full SHA for d8dbf1e

• add attention_dropout

  kashif

  committed
  f1c6803

  Copy full SHA for f1c6803

• use scaled_past_target

  kashif

  committed
  59c3593

  Copy full SHA for 59c3593

Commits on Nov 23, 2023

• Merge branch 'main' into lag-llama

  kashif

  committed
  3bd1890

  Copy full SHA for 3bd1890

• fix copies

  kashif

  committed
  2773c4a

  Copy full SHA for 2773c4a

Commits on Feb 5, 2024

• Merge branch 'main' into lag-llama

  kashif

  committed
  a0a4920

  Copy full SHA for a0a4920

Commits on Feb 6, 2024

• fix copies

  kashif

  committed
  7ee201c

  Copy full SHA for 7ee201c

• Merge branch 'main' into lag-llama

  kashif

  committed
  6acff0d

  Copy full SHA for 6acff0d

• fix-copies

  kashif

  committed
  d025cb4

  Copy full SHA for d025cb4

• fix init

  kashif

  committed
  dde4ced

  Copy full SHA for dde4ced

• add layer_idx

  kashif

  committed
  a45fb2c

  Copy full SHA for a45fb2c

• add support for time_features

  kashif

  committed
  3935adf

  Copy full SHA for 3935adf

• add robust scaler

  kashif

  committed
  4ef64c0

  Copy full SHA for 4ef64c0

• remove from CausalLM

  kashif

  committed
  68e1a82

  Copy full SHA for 68e1a82

• lags start from 0

  kashif

  committed
  e06f23b

  Copy full SHA for e06f23b

• more verbose

  kashif

  committed
  f6322f3

  Copy full SHA for f6322f3

• fix past_time_features shape

  kashif

  committed
  c67df1a

  Copy full SHA for c67df1a