Code

FSDP utils cleanup#854

Code

Open

kylesayrs wants to merge 38 commits intomainvllm-project/llm-compressor:mainfrom kylesayrs/fsdp-wrapper-namevllm-project/llm-compressor:kylesayrs/fsdp-wrapper-nameCopy head branch name to clipboard

+11-7

Commits

Commits on Nov 21, 2024

• use existing constant, clarify comment

  Show description for 8a9e89d
  kylesayrs

  committed
  8a9e89d

• fix fwd func call (#845)

  Show description for 202ac48
  

  dsikka

  authored and

  kylesayrs

  committed
  202ac48

• always import from accelerate since it is a dependency

  Show description for 12e2436
  kylesayrs

  committed
  12e2436

• [Bugfix] Use weight parameter of linear layer (#836)

  Show description for 04df6ef
  kylesayrs

  committed
  04df6ef

• [Bugfix] Rename files to remove colons (#846)

  Show description for 9107190
  

  6 peoplecommitted
  9107190

• cover all 3.9-3.12 in commit testing (#864)

  Show description for 4b8cfcb
  

  2 peopleauthored and

  kylesayrs

  committed
  4b8cfcb

• Add marlin-24 recipe/configs for e2e testing (#866)

  Show description for 58cba1b
  

  dsikka

  authored and

  kylesayrs

  committed
  58cba1b

• [Bugfix] onload during sparsity calculation (#862)

  Show description for 885fd74
  

  kylesayrs

  and

  dsikka

  committed
  885fd74

• Fix HFTrainer overloads (#869)

  Show description for f967197
  

  kylesayrs

  and

  dsikka

  committed
  f967197

• Support Model Offloading Tied Tensors Patch (#872)

  Show description for d9ad3c2
  kylesayrs

  committed
  d9ad3c2

• add advice about dealing with non-invertable hessians (#875)

  Show description for 5d9b7eb
  kylesayrs

  committed
  5d9b7eb

• seed commit workflow (#877)

  Show description for 4a9d3dd
  

  2 peopleauthored and

  kylesayrs

  committed
  4a9d3dd

• [Observer Restructure]: Add Observers; Add calibration and frozen steps to QuantizationModifier (#837)

  Show description for ef9472c
  

  dsikka

  and

  kylesayrs

  committed
  ef9472c

• Bugfix get observer from name (#883)

  Show description for 28eff47
  

  rahul-tuli

  authored and

  kylesayrs

  committed
  28eff47

• BugFix: Fix Sparsity Reload Testing (#882)

  Show description for 59779f5
  

  dsikka

  authored and

  kylesayrs

  committed
  59779f5

• Use custom unique test names for e2e tests (#892)

  Show description for 44e196f
  

  dbarbuzzi

  authored and

  kylesayrs

  committed
  44e196f

• Revert "Use custom unique test names for e2e tests (#892)" (#893)

  Show description for dba61ec
  

  dsikka

  authored and

  kylesayrs

  committed
  dba61ec

• Move config["testconfig_path"] assignment (#895)

  Show description for 4e126b3
  

  2 peopleauthored and

  kylesayrs

  committed
  4e126b3

• cap accelerate version to avoid bug (#897)

  Show description for e962e33
  kylesayrs

  committed
  e962e33

• Fix observing offloaded weight (#896)

  Show description for f8777c7
  

  kylesayrs

  and

  dsikka

  committed
  f8777c7

• Update image in README.md (#861)

  Show description for 9c168f7
  

  2 peopleauthored and

  kylesayrs

  committed
  9c168f7

• update accelerate version (#899)

  Show description for 5f6f568
  kylesayrs

  committed
  5f6f568

• [GPTQ] Iterative Parameter Updating (#863)

  Show description for fa61cf6
  

  13 peoplecommitted
  fa61cf6

• Small fixes for release (#901)

  Show description for 7142da0
  

  dsikka

  authored and

  kylesayrs

  committed
  7142da0

• use smaller portion of dataset (#902)

  Show description for c82b22c
  

  dsikka

  authored and

  kylesayrs

  committed
  c82b22c

• Update example to not fail hessian inversion (#904)

  Show description for f45c29e
  

  2 peopleauthored and

  kylesayrs

  committed
  f45c29e

• bump version (#907)

  Show description for 8ef26cc
  

  dsikka

  authored and

  kylesayrs

  committed
  8ef26cc

• add default mappings (#906)

  Show description for 65d9db2
  kylesayrs

  committed
  65d9db2

• [SparseAutoModelForCausalLM Deprecation] Feature change (#881)

  Show description for 4b4c52e
  

  3 peoplecommitted
  4b4c52e

• correct typo (#888)

  Show description for 4c75089
  kylesayrs

  committed
  4c75089

• Explicit defaults for QuantizationModifier targets (#889)

  Show description for f47b5f5
  

  14 peoplecommitted
  f47b5f5

• [SparseAutoModelForCausalLM Deprecation] Update examples (#880)

  Show description for 372957e
  

  3 peopleauthored and

  kylesayrs

  committed
  372957e

• Support pack_quantized format for nonuniform mixed-precision (#913)

  Show description for cdb6231
  

  mgoin

  authored and

  kylesayrs

  committed
  cdb6231

• actually make the test useful (#920)

  Show description for 50e881f
  

  dsikka

  and

  kylesayrs

  committed
  50e881f

• revert summon_full_params_context

  Show description for 10dc0fe
  kylesayrs

  committed
  10dc0fe

• Merge remote-tracking branch 'origin' into kylesayrs/fsdp-wrapper-name

  kylesayrs

  committed
  5416d6f

Commits on Nov 24, 2024

• Merge branch 'main' into kylesayrs/fsdp-wrapper-name

  kylesayrs

  authored
  99dbb65

Commits on Nov 27, 2024

• Merge branch 'main' into kylesayrs/fsdp-wrapper-name

  kylesayrs

  authored
  e3739c2