Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add MCC to BinaryClassificationEvaluator #3051

Merged
merged 6 commits into from
Nov 20, 2024

Conversation

JINO-ROHIT
Copy link
Contributor

This PR links #3027 and adds the Matthews correlation coefficient.

Who can review?
@tomaarsen

logger.info(f"Accuracy with {name}: {acc * 100:.2f}\t(Threshold: {acc_threshold:.4f})")
logger.info(f"F1 with {name}: {f1 * 100:.2f}\t(Threshold: {f1_threshold:.4f})")
logger.info(f"Precision with {name}: {precision * 100:.2f}")
logger.info(f"Recall with {name}: {recall * 100:.2f}")
logger.info(f"Average Precision with {name}: {ap * 100:.2f}\n")
logger.info(f"Matthews Correlation with {name}: {mcc:.4f}\n")
Copy link

@reissaavedra reissaavedra Nov 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @JINO-ROHIT ,
I think you could also add this output to the docstring of the BinaryClassificationEvaluator class.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done!

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good suggestion!

@JINO-ROHIT
Copy link
Contributor Author

@tomaarsen gentle ping to have a look

@tomaarsen tomaarsen requested a review from Copilot November 20, 2024 12:34

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 1 out of 1 changed files in this pull request and generated no suggestions.

@tomaarsen
Copy link
Collaborator

Hello!

I had a quick look and made some small nitpicks, all related to the logs/docstring. Beyond that, it looks solid to me. Well done, thanks for this @JINO-ROHIT, and thanks for the review @reissaavedra

I'll merge this once the tests go green.

  • Tom Aarsen

@tomaarsen tomaarsen merged commit 7ffbb4b into UKPLab:master Nov 20, 2024
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants