Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update phishing-model-card.md #1437

Merged
merged 1 commit into from
Dec 14, 2023
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 13 additions & 41 deletions models/model-cards/phishing-model-card.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ limitations under the License.
# Model Overview

## Description:
* Phishing detection is a binary classifier differentiating between phishing/spam and benign emails and SMS messages. <br>
* Phishing detection is a binary classifier differentiating between phishing/spam and benign emails and SMS messages. This model is for demonstration purposes and not for production usage. <br>

## References(s):
* https://archive.ics.uci.edu/ml/datasets/SMS+Spam+Collection <br>
Expand Down Expand Up @@ -114,24 +114,15 @@ limitations under the License.

**Test Hardware:** <br>

* Other <br>
* DGX (V100) <br>

## Ethical Considerations:
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. For more detailed information on ethical considerations for this model, please see the Model Card++ Explainability, Bias, Safety & Security, and Privacy Subcards below. Please report security vulnerabilities or NVIDIA AI Concerns [here](https://www.nvidia.com/en-us/support/submit-security-vulnerability/).

# Subcards

## Model Card ++ Bias Subcard

### What is the gender balance of the model validation data?

* Not Applicable

### What is the racial/ethnicity balance of the model validation data?

* Not Applicable

### What is the age balance of the model validation data?

* Not Applicable

### What is the language balance of the model validation data?

* English
Expand All @@ -140,26 +131,6 @@ limitations under the License.

* UK

### What is the educational background balance of the model validation data?

* Not Applicable

### What is the accent balance of the model validation data?

* Not Applicable

### What is the face/key point balance of the model validation data?

* Not Applicable

### What is the skin/tone balance of the model validation data?

* Not Applicable

### What is the religion balance of the model validation data?

* Not Applicable

### Individuals from the following adversely impacted (protected classes) groups participate in model design and testing.

* Not Applicable
Expand Down Expand Up @@ -193,6 +164,10 @@ limitations under the License.
### List the technical limitations of the model.
* For different email/SMS types and content, different models need to be trained.

### Has this been verified to have met prescribed NVIDIA standards?

* Yes

### What performance metrics were used to affirm the model's performance?
* F1

Expand All @@ -210,7 +185,7 @@ limitations under the License.
### Is the model used in an application with physical safety impact?
* No

### Describe physical safety impact (if present).
### Describe life-critical impact (if present).
* None

### Was model and dataset assessed for vulnerability for potential form of attack?
Expand All @@ -223,9 +198,6 @@ limitations under the License.
### Name use case restrictions for the model.
* This pretrained model's use case is restricted to testing the Morpheus pipeline and may not be suitable for other applications.

### Has this been verified to have met prescribed quality standards?
* No

### Name target quality Key Performance Indicators (KPIs) for which this has been tested.
* N/A

Expand All @@ -246,12 +218,12 @@ limitations under the License.


### Generatable or reverse engineerable personally-identifiable information (PII)?
* Neither
* None

### Was consent obtained for any PII used?
### Protected classes used to create this model? (The following were used in model the model's training:)
* N/A

### Protected classes used to create this model? (The following were used in model the model's training:)
### Was consent obtained for any PII used?
* N/A

### How often is dataset reviewed?
Expand Down