Skip to content

Commit

Permalink
Update measuring.rst
Browse files Browse the repository at this point in the history
Feedback Updates
  • Loading branch information
blackwidow0616 authored Feb 13, 2024
1 parent a3c8443 commit 177bcc4
Showing 1 changed file with 22 additions and 31 deletions.
53 changes: 22 additions & 31 deletions docs/measuring.rst
Original file line number Diff line number Diff line change
@@ -1,57 +1,41 @@
Measuring Threat-Informed Defense
==================================

Now that Threat-Informed Defense has been defined, its importance emphasized, and the three main dimensions have been covered, there are three key questions: What specific
activities do I need to become Threat-Informed? How Threat-Informed is my security program now? What are the next steps I need to take to improve my level of Threat-Informed
Defense?

All of these questions lead to a need to measure Threat-Informed Defense, something that has not been done before. In Appendix A, the three Dimensions of Threat-Informed
Defense are further decomposed into an initial set of components, with measures for each component from least-to-most threat-informed. In the sections that follow the
methodology to leverage those components to assess a security program are explained. The methodology is then applied to an exemplar organization for demonstration purposes.
Now that Threat-Informed Defense has been defined, its importance emphasized, and the three main dimensions have been covered, there are three key questions: What specific activities do I need to become Threat-Informed? How Threat-Informed is my security program now? What are the next steps I need to take to improve my level of Threat-Informed Defense?

Each of these questions lead to a need to measure Threat-Informed Defense, something that has not been done before. In Appendix A, the three Dimensions of Threat-Informed Defense are further decomposed into an initial set of components, with measures for each component from least-to-most threat-informed. In the sections that follow the methodology to leverage those components to assess a security program are explained. The methodology is then applied to an exemplar organization for demonstration purposes.

Methodology
-----------

To ensure consistency, the following steps were developed to approach Threat-Informed Defense measurement:
To ensure consistency, the following steps were developed to approach Threat-Informed Defense measurement:

* Each of the Threat-Informed Defense Dimensions is decomposed into five key components.
* For each of those components, five discrete levels of maturity, from least to most threat-informed, were developed.
* Within a Threat-Informed Defense Dimension (e.g. CTI), all of its subordinate components are weighted equally.
* At the Threat-Informed Defense Dimensions level, the Dimensions themselves are weighted.
* Each of the Threat-Informed Defense Dimensions is decomposed into five key components.
* For each of those components, five discrete levels of maturity, from least to most threat-informed, were developed.
* Within a Threat-Informed Defense Dimension (e.g. CTI), all of its subordinate components are weighted equally.
* At the Threat-Informed Defense Dimensions level, the Dimensions themselves are weighted.


See Appendix A for the defined key components and maturity levels for all three dimensions of Threat-Informed Defense. These component and maturity levels form the basis for
the assessment and scoring further described below.
See Appendix A for the defined key components and maturity levels for all three dimensions of Threat-Informed Defense. These component and maturity levels form the basis for the assessment and scoring further described below.


Weighting and Scoring
---------------------

This scoring system consists of three parts. Each of the three dimensions has five components, and each component has five levels. Scoring is accomplished primarily at the
“level” portion of the framework.
This scoring system consists of three parts. Each of the three dimensions has five components, and each component has five levels. Scoring is accomplished primarily at the “level” portion of the framework.

Each level has a number of points associated with it, which are “earned” if the organization satisfies the requirements of that level. These points are cumulative, so if an
organization satisfies the requirements of level 1 or 2, they earn 1 point each; satisfying level 3 or 4 earns 2 points each; satisfying both level 1 and 4 earns 3 points
(1+2=3 points) for that component. The score for each component can therefore range from 0 to 6. The score for a Dimension is the average of the scores for every component in
that dimension. This results in Dimension scores that also range from 0 to 6.
Each level has a number of points associated with it, which are “earned” if the organization satisfies the requirements of that level. These points are cumulative, so if an organization satisfies the requirements of level 1 or 2, they earn 1 point each; satisfying level 3 or 4 earns 2 points each; satisfying both level 1 and 4 earns 3 points (1+2=3 points) for that component. The score for each component can therefore range from 0 to 6. The score for a Dimension is the average of the scores for every component in that dimension. This results in Dimension scores that also range from 0 to 6.


Overall Threat-Informed Defense Scoring
----------------------------------------

The total score for an organization is currently computed as a weighted sum of the Dimension scores. The logic behind this cumulative score is that taking defensive action is
the most important component to a Threat-Informed Defense. The importance of CTI is greater than that of test and evaluation based on the experience of the Center and its
Participants. This final formula is not meant to be extremely precise, but rather reflects the “best engineering judgment” of the M3TID team and Participants. As with most
other frameworks and maturity models, each organization can, and should, tune and tailor this formula based on their needs and constraints.
The total score for an organization is currently computed as a weighted sum of the Dimension scores. The logic behind this cumulative score is that taking defensive action is the most important component to a Threat-Informed Defense. The importance of CTI is greater than that of test and evaluation based on the experience of the Center and its Participants. This final formula is not meant to be extremely precise, but rather reflects the “best engineering judgment” of the M3TID team and Participants. As with most other frameworks and maturity models, each organization can, and should, tune and tailor this formula based on their needs and constraints.


Example Scoring
---------------

As a notional example of implementing this assessment and scoring approach, imagine a fictitious Company A. Company A has invested in their security program and met a minimum
acceptable level of compliance with their industry standard. They are beginning their approach to implement Threat-Informed Defense, but are doing so unevenly. Based on their
current investments, the bullets below describe their current state of Threat-Informed Defense in each Dimension:
As a notional example of implementing this assessment and scoring approach, imagine a fictitious Company A. Company A has invested in their security program and met a minimum acceptable level of compliance with their industry standard. They are beginning their approach to implement Threat-Informed Defense but are doing so unevenly. Based on their current investments, the bullets below describe their current state of Threat-Informed Defense in each Dimension:

Company A: In-house implementation of a nascent threat-informed defense.

Expand Down Expand Up @@ -84,6 +68,13 @@ the Results tab of that calculator.
Kiviat Diagram: Comparison of all Key TID Components


After an organization conducts this initial assessment and understands the current status of their threat informed defensive program, the scoring and associated visualizations
highlight opportunities to improve their program. The section that follows will describe approaches to improving threat-informed defense maturity once an initial baseline is
understood.
After an organization conducts this initial assessment and understands the current status of their threat informed defensive program, the scoring and associated visualizations
highlight opportunities to improve their program. The section that follows will describe approaches to improving threat-informed defense maturity once an initial baseline is
understood.



Scoring Spreadsheet
--------------------

Attached here is the scoring spreadsheet to download for self-evaluation: `M3TIDScoring <https://github.com/center-for-threat-informed-defense/m3tid>`__

0 comments on commit 177bcc4

Please sign in to comment.