Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Different auc with the result #6

Open
Hiramdu opened this issue Dec 14, 2021 · 1 comment
Open

Different auc with the result #6

Hiramdu opened this issue Dec 14, 2021 · 1 comment

Comments

@Hiramdu
Copy link

Hiramdu commented Dec 14, 2021

Hi I run demo:
python evaluate.py --target-variable='income' --train-data-path=./data/adult_processed_train.csv --test-data-path=./data/adult_processed_test.csv --normalize-data dp-wgan --enable-privacy --sigma=0.8 --target-epsilon=8

But I get very low auc:
AUC scores of downstream classifiers on test data :
LR: 0.3407119900995038
Random Forest: 0.2610576777879843
Neural Network: 0.3578788366713348
GaussianNB: 0.49315881768882325
GradientBoostingClassifier: 0.2606982987000339

May I know how to run the code to get your listed result?

@Hiramdu
Copy link
Author

Hiramdu commented Dec 14, 2021

Another demo on diabete data:
AUC scores of downstream classifiers on test data :

LR: 0.5467898193760263

Random Forest: 0.39399288451012593

Neural Network: 0.5228927203065135

GaussianNB: 0.4653694581280788

GradientBoostingClassifier: 0.5630377668308703

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant