Code

QAS Demo - Flower Model#273

Code

Merged

krmaffey merged 61 commits intomlte-team:mastermlte-team/mlte:masterfrom sebastian-echeverria:feature-new-propertiessebastian-echeverria/mlte:feature-new-propertiesCopy head branch name to clipboardOct 18, 2023

+45,205-18

Commits

Commits on Jul 12, 2023

• Started playing with Fairness property and demo

  sei-secheverria

  committed
  e6675b2

• Merge branch 'feature-simple-props' into feature-new-properties

  Show description for 32c7626
  sei-secheverria

  committed
  32c7626

• Updating fairness and adding robustness

  sei-secheverria

  committed
  d5d25ed

• Started adding robustness. Measurement and validation not defined yet.

  sei-secheverria

  committed
  b8cfcb6

Commits on Jul 28, 2023

• Started playing with Fairness property and demo

  sei-secheverria

  committed
  0a63e71

• Updating fairness and adding robustness

  sei-secheverria

  committed
  75385ad

• Started adding robustness. Measurement and validation not defined yet.

  sei-secheverria

  committed
  18522df

• Simplified check

  sei-secheverria

  committed
  cf7acac

• Format fix

  sei-secheverria

  committed
  278efc6

Commits on Aug 11, 2023

• Bug fix, and new ExternalMeasurement signature fix.

  sei-secheverria

  committed
  01ce766

Commits on Aug 14, 2023

• Added remaining robustness code, still need to tweak tests

  sei-secheverria

  committed
  c0669e9

Commits on Aug 15, 2023

• Merge branch 'feature-new-properties' of github.com:sebastian-echeverria/mlte into feature-new-properties

  Show description for 57fb615
  sebastian-echeverria

  committed
  57fb615

Commits on Aug 16, 2023

• MInor fixes, addeed tests for all robustness blur cases

  sei-secheverria

  committed
  211a9b6

• Some explanations, typo fixes

  sei-secheverria

  committed
  05f4d37

• Added tests for Robustness, with Array and Ranksum values, and proper pvalue condition

  sei-secheverria

  committed
  5c222d8

Commits on Sep 8, 2023

• Merge branch 'bug/missing-values' into feature-new-properties

  Show description for 104c637
  sebastian-echeverria

  committed
  104c637

• Updating to new structure

  sebastian-echeverria

  committed
  1119ab4

• Improving imports, spacing, linting errors

  sebastian-echeverria

  committed
  107d2a5

• Making accuracy derive from array, and making array item id derive from position.

  sebastian-echeverria

  committed
  4623def

• Adding force true to ensure demo can be run multiple times.

  sebastian-echeverria

  committed
  34bb237

• Changing default name and starting updating report notebook for demo2

  sebastian-echeverria

  committed
  0ac02fb

• Simplifications, demo fixes, properties export consistency

  sebastian-echeverria

  committed
  a21eb72

• Adding method to print validated spec results

  sebastian-echeverria

  committed
  200d152

• More details printed

  sebastian-echeverria

  committed
  128f2a7

• Formatting

  sebastian-echeverria

  committed
  e7a1bdc

Commits on Sep 11, 2023

• Minor demo 2 improvements

  sebastian-echeverria

  committed
  22b7f31

• Merge branch 'master' into feature-new-properties

  sebastian-echeverria

  committed
  47740d9

• More improvements for demo-2, now with second test.

  sebastian-echeverria

  committed
  37fe4d2

• Finished passing Robustness notebook to using MLTE. Still need to analyze

  sebastian-echeverria

  committed
  2bd7252

• Minor formatting

  sebastian-echeverria

  committed
  786e560

Commits on Sep 13, 2023

• Added initial definitions for Fairness and Robustness

  sebastian-echeverria

  committed
  ccd64b2

• Minor formatting

  sebastian-echeverria

  committed
  fed0d95

• Merge branch 'mlte-team:master' into feature-new-properties

  sebastian-echeverria

  authored
  95c2070

Commits on Sep 20, 2023

• Initial performance measurements addition to demo2

  sebastian-echeverria

  committed
  c080e0a

• Test data

  sebastian-echeverria

  committed
  ce05d2c

• Merge branch 'master' into feature-new-properties

  sebastian-echeverria

  committed
  65dcb9d

• Fixed formatting and tensorflow dep version to avoid dependency conflicts

  sebastian-echeverria

  committed
  4c7286f

Commits on Sep 25, 2023

• Integrated interpretability into demo2; also added Interpretability as a property

  sebastian-echeverria

  committed
  a5d93ad

• Updated demo2 report to validate/add new properties

  sebastian-echeverria

  committed
  514c44d

• Formatting

  sebastian-echeverria

  committed
  ca06979

• Updated demo 2 with explicit QAS mentions

  sebastian-echeverria

  committed
  c7b9c8c

• Merge branch 'feature/extending-properties' into feature-new-properties

  Show description for d7c546e
  sebastian-echeverria

  committed
  d7c546e

Commits on Sep 26, 2023

• Updating to use extended properties, and to organize new properties and values better

  sebastian-echeverria

  committed
  1c67159

• Merge branch 'feature/extending-properties' into feature-new-properties

  sebastian-echeverria

  committed
  c2e6ce2

• Moved functions and TF dependency to separate file

  sebastian-echeverria

  committed
  3c10e30

Commits on Sep 27, 2023

• Fixed demo tensorflow requirements and added notes related to that

  sebastian-echeverria

  committed
  1394919

• Started adding report code form previous demo, but it is not working yet

  sebastian-echeverria

  committed
  106f18f

• Added script to download model

  sebastian-echeverria

  committed
  043f5cc

• Updated definitions for Fairness, Interpretability and Robustness.

  sebastian-echeverria

  committed
  38fd26d

Commits on Oct 2, 2023

• Merge branch 'master' into feature-new-properties

  Show description for be25c7e
  sebastian-echeverria

  committed
  be25c7e

Commits on Oct 3, 2023

• Merge branch 'feature/simpler-properties' into feature-new-properties

  sebastian-echeverria

  committed
  ee8d5fb

• Adapting to new Property constructor

  sebastian-echeverria

  committed
  77de18c

Commits on Oct 4, 2023

• Internal reformatting

  sebastian-echeverria

  committed
  1c5c687

• Merge branch 'master' into feature-new-properties

  sebastian-echeverria

  committed
  828479a

Commits on Oct 6, 2023

• Merge branch 'master' into feature-new-properties

  sebastian-echeverria

  committed
  c3f2e30

Commits on Oct 11, 2023

• Merge branch 'master' into feature-new-properties

  sebastian-echeverria

  committed
  3e93466

• Minor upadates to demo-2 data, changed flower image to PD one.

  sebastian-echeverria

  committed
  00af2c4

• Added updated report generation

  sebastian-echeverria

  committed
  2335705

• Notes to indicate that for Robustness and Fairness we are not running the model interactively, but using saved results

  sebastian-echeverria

  committed
  8bf65d4

Commits on Oct 18, 2023

• Restructured demo folders

  sebastian-echeverria

  committed
  d14d696

• Fixed make for new demo structure

  sebastian-echeverria

  committed
  f265227