Assessment Scoring Summary

Assessment Ranges

Deliverable 1 100% 100%

Deliverable 2 87% 87%

Deliverable 3 61% 61%

Deliverable 4 59%
59% 59%

Deliverable 5 58% 58%

Deliverable 6 71% 71%

Deliverable 7 78% 78%

Deliverable 8 38% 38%

Meets or Exceeds Expectations

Requires Major Rework

Requires Minor Rework

Unacceptable
90% -100%

66% - 89%

36% - 65%

0% - 35%
Key: Assessment Ranges for the Deliverables

©2010 The MITRE Corporation. All rights reserved.

 Consolidated Assessment

{Deliverable Name}

Assessment by Factor
Meets or Exceeds Requires Minor Requires Major
Unacceptable
Expectations Rework Rework

Factor Weights Number of Adjusted

100% 75% 50% 25%
Std N/A* Adj'd Reviewers Total
55%
Accurate technical content 55% 55% 55.00% 0.00% 0.00% 0.00% 1

Accuracy 20% 20.0% 1 0 0 0 1

Transferability 10% 10.0% 1 0 0 0 1
Completeness 10% 10.0% 1 0 0 0 1
Relevancy 5% 5.0% 1 0 0 0
Quality of figures in support of technical content 5% 5.0% 1 0 0 0 1
Relevant security related information 5% 5.0% 1 0 0 0 1
Scope 20% 20% 20.00% 0.00% 0.00% 0.00% 1 20%
Defined boundaries of subject 10% 10.0% 1 0 0 0 1
Not too broad and not too narrow 10% 10.0% 1 0 0 0 1
Integration 15% 15% 15.00% 0.00% 0.00% 0.00% 1 15%
Consistent with Modernization objectives and initiatives 5% 5.0% 1 0 0 0 1
Consistent with other documentation 5% 5.0% 1 0 0 0 1
Demonstrates dependencies, interactions, and synergies 5% 5.0% 1 0 0 0 1
Readability 10% 10% 10.00% 0.00% 0.00% 0.00% 1 10%
Grammar and Punctuation 3% 3.0% 1 0 0 0 1
Word Choice 3% 3.0% 1 0 0 0 1
Format 2% 2.0% 1 0 0 0 1
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 1 0 0 0 1

Assessment Plot 100%

Key: Assessment Ranges for the Entire Deliverable

100%

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
 Consolidated Assessment

{Deliverable Name}

Assessment by Factor
Meets or Exceeds Requires Minor Requires Major
Unacceptable
Expectations Rework Rework

Factor Weights Number of Adjusted

100% 75% 50% 25%
Std N/A* Adj'd Reviewers Total
48%
Accurate technical content 55% 55% 55.00% 41.25% 0.00% 0.00% 2

Accuracy 20% 20.0% 1 1 0 0 2

Transferability 10% 10.0% 1 1 0 0 2
Completeness 10% 10.0% 1 1 0 0
Relevancy 5% 5.0% 1 1 0 0 2
Quality of figures in support of technical content 5% 5.0% 1 1 0 0 2
Relevant security related information 5% 5.0% 1 1 0 0 2
Scope 20% 20% 20.00% 15.00% 0.00% 0.00% 2 17%
Defined boundaries of subject 10% 10.0% 1 1 0 0 2
Not too broad and not too narrow 10% 10.0% 1 1 0 0 2
Integration 15% 15% 15.00% 11.25% 0.00% 0.00% 2 13%
Consistent with Modernization objectives and initiatives 5% 5.0% 1 1 0 0 2
Consistent with other documentation 5% 5.0% 1 1 0 0 2
Demonstrates dependencies, interactions, and synergies 5% 5.0% 1 1 0 0 2
Readability 10% 10% 10.00% 7.50% 0.00% 0.00% 2 9%
Grammar and Punctuation 3% 3.0% 1 1 0 0 2
Word Choice 3% 3.0% 1 1 0 0 2
Format 2% 2.0% 1 1 0 0 2
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 1 1 0 0 2

Assessment Plot 87%

Key: Assessment Ranges for the Entire Deliverable

87%

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
 Consolidated Assessment

{Deliverable Name}

Assessment by Factor
Meets or Exceeds Requires Minor Requires Major
Unacceptable
Expectations Rework Rework

Factor Weights Number of Adjusted

100% 75% 50% 25%
Std N/A* Adj'd Reviewers Total
34%
Accurate technical content 55% 55% 0.00% 41.25% 27.50% 0.00% 2

Accuracy 20% 20.0% 0 1 1 0 2

Transferability 10% 10.0% 0 1 1 0 2
Completeness 10% 10.0% 0 1 1 0
Relevancy 5% 5.0% 0 1 1 0 2
Quality of figures in support of technical content 5% 5.0% 0 1 1 0 2
Relevant security related information 5% 5.0% 0 1 1 0 2
Scope 20% 20% 0.00% 15.00% 10.00% 0.00% 2 12%
Defined boundaries of subject 10% 10.0% 0 1 1 0 2
Not too broad and not too narrow 10% 10.0% 0 1 1 0 2
Integration 15% 15% 0.00% 11.25% 7.50% 0.00% 2 9%
Consistent with Modernization objectives and initiatives 5% 5.0% 0 1 1 0 2
Consistent with other documentation 5% 5.0% 0 1 1 0 2
Demonstrates dependencies, interactions, and synergies 5% 5.0% 0 1 1 0 2
Readability 10% 10% 0.00% 7.50% 5.00% 0.00% 2 6%
Grammar and Punctuation 3% 3.0% 0 1 1 0 2
Word Choice 3% 3.0% 0 1 1 0 2
Format 2% 2.0% 0 1 1 0 2
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 0 1 1 0 2

Assessment Plot 61%

Key: Assessment Ranges for the Entire Deliverable

61%

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
 Consolidated Assessment

{Deliverable Name}

Assessment by Factor
Meets or Exceeds Requires Minor Requires Major
Unacceptable
Expectations Rework Rework

Factor Weights Number of Adjusted

100% 75% 50% 25%
Std N/A* Adj'd Reviewers Total
32%
Accurate technical content 55% 55% 55.00% 0.00% 27.50% 13.75% 3

Accuracy 20% 20.0% 1 0 1 1 3

Transferability 10% 10.0% 1 0 1 1 3
Completeness 10% 10.0% 1 0 1 1
Relevancy 5% 5.0% 1 0 1 1 3
Quality of figures in support of technical content 5% 5.0% 1 0 1 1 3
Relevant security related information 5% 5.0% 1 0 1 1 3
Scope 20% 20% 20.00% 0.00% 10.00% 5.00% 3 12%
Defined boundaries of subject 10% 10.0% 1 0 1 1 3
Not too broad and not too narrow 10% 10.0% 1 0 1 1 3
Integration 15% 15% 15.00% 0.00% 7.50% 3.75% 3 9%
Consistent with Modernization objectives and initiatives 5% 5.0% 1 0 1 1 3
Consistent with other documentation 5% 5.0% 1 0 1 1 3
Demonstrates dependencies, interactions, and synergies 5% 5.0% 1 0 1 1 3
Readability 10% 10% 10.00% 0.00% 5.00% 2.50% 3 6%
Grammar and Punctuation 3% 3.0% 1 0 1 1 3
Word Choice 3% 3.0% 1 0 1 1 3
Format 2% 2.0% 1 0 1 1 3
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 1 0 1 1 3

Assessment Plot 59%

Key: Assessment Ranges for the Entire Deliverable

59%

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
 Consolidated Assessment

{Deliverable Name}

Assessment by Factor
Meets or Exceeds Requires Minor Requires Major
Unacceptable
Expectations Rework Rework

Factor Weights Number of Adjusted

100% 75% 50% 25%
Std N/A* Adj'd Reviewers Total
33%
Accurate technical content 55% 55% 0.00% 41.25% 22.50% 2.50% 2

Accuracy 20% 20.0% 0 1 1 0 2

Transferability 10% 10.0% 0 1 1 0 2
Completeness 10% 10.0% 0 1 1 0
Relevancy 5% 5.0% 0 1 1 0 2
Quality of figures in support of technical content 5% 5.0% 0 1 0 1 2
Relevant security related information 5% 5.0% 0 1 0 1 2
Scope 20% 20% 0.00% 7.50% 10.00% 2.50% 2 10%
Defined boundaries of subject 10% 10.0% 0 1 1 0 2
Not too broad and not too narrow 10% 10.0% 0 0 1 1 2
Integration 15% 15% 0.00% 11.25% 7.50% 0.00% 2 9%
Consistent with Modernization objectives and initiatives 5% 5.0% 0 1 1 0 2
Consistent with other documentation 5% 5.0% 0 1 1 0 2
Demonstrates dependencies, interactions, and synergies 5% 5.0% 0 1 1 0 2
Readability 10% 10% 7.50% 5.00% 0.00% 2 6%
Grammar and Punctuation 3% 3.0% 0 1 1 0 2
Word Choice 3% 3.0% 0 1 1 0 2
Format 2% 2.0% 0 1 1 0 2
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 0 1 1 0 2

Assessment Plot 58%

Key: Assessment Ranges for the Entire Deliverable

58%

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
 Consolidated Assessment

{Deliverable Name}

Assessm
Meets or Exceeds
Expectations

Factor Weights
100%
Std N/A* Adj'd

Accurate technical content 55% 55% 45.00%

Accuracy 20% 20.0% 1

Transferability 10% 10.0% 1
Completeness 10% 10.0% 1
Relevancy 5% 5.0% 1
Quality of figures in support of technical content 5% 5.0% 0
Relevant security related information 5% 5.0% 0
Scope 20% 20% 0.00%
Defined boundaries of subject 10% 10.0% 0
Not too broad and not too narrow 10% 10.0% 0
Integration 15% 15% 0.00%
Consistent with Modernization objectives and initiatives 5% 5.0% 0
Consistent with other documentation 5% 5.0% 0
Demonstrates dependencies, interactions, and synergies 5% 5.0% 0
Readability 10% 10%
Grammar and Punctuation 3% 3.0% 0
Word Choice 3% 3.0% 0
Format 2% 2.0% 0
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 0

Assessment Plot

Key: Assessment Ranges for the Entire Deliverable

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
ed Assessment

able Name}

Assessment by Factor
Requires Minor Requires Major
Unacceptable
Rework Rework

Number of Adjusted
75% 50% 25%
Reviewers Total
46%
41.25% 5.00% 0.00% 2

1 0 0 2
1 0 0 2
1 0 0
1 0 0 2
1 1 0 2
1 1 0 2
7.50% 10.00% 2.50% 2 10%
1 1 0 2
0 1 1 2
11.25% 7.50% 0.00% 2 9%
1 1 0 2
1 1 0 2
1 1 0 2
7.50% 5.00% 0.00% 2 6%
1 1 0 2
1 1 0 2
1 1 0 2
1 1 0 2

71%

71%

hat are not applicable.

 Consolidated Assessment

{Deliverable Name}

Assessm
Meets or Exceeds
Expectations

Factor Weights
100%
Std N/A* Adj'd

Accurate technical content 55% 55% 115.00%

Accuracy 20% 20.0% 2

Transferability 10% 10.0% 2
Completeness 10% 10.0% 2
Relevancy 5% 5.0% 2
Quality of figures in support of technical content 5% 5.0% 2
Relevant security related information 5% 5.0% 3
Scope 20% 20% 10.00%
Defined boundaries of subject 10% 10.0% 0
Not too broad and not too narrow 10% 10.0% 1
Integration 15% 15% 0.00%
Consistent with Modernization objectives and initiatives 5% 5.0% 0
Consistent with other documentation 5% 5.0% 0
Demonstrates dependencies, interactions, and synergies 5% 5.0% 0
Readability 10% 10%
Grammar and Punctuation 3% 3.0% 0
Word Choice 3% 3.0% 0
Format 2% 2.0% 0
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 0

Assessment Plot

Key: Assessment Ranges for the Entire Deliverable

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
ed Assessment

able Name}

Assessment by Factor
Requires Minor Requires Major
Unacceptable
Rework Rework

Number of Adjusted
75% 50% 25%
Reviewers Total
51%
37.50% 0.00% 0.00% 3

1 0 0 3
1 0 0 3
1 0 0
1 0 0 3
1 0 0 3
0 0 0 3
22.50% 10.00% 2.50% 4 11%
1 2 0 3
2 0 1 4
18.75% 10.00% 0.00% 3 10%
2 1 0 3
1 2 0 3
2 1 0 3
12.00% 7.00% 0.00% 3 6%
2 1 0 3
2 1 0 3
1 2 0 3
1 2 0 3

78%

78%

hat are not applicable.

 Consolidated Assessment

{Deliverable Name}

Assessm
Meets or Exceeds
Expectations

Factor Weights
100%
Std N/A* Adj'd

Accurate technical content 55% 55% 0.00%

Accuracy 20% 20.0% 0

Transferability 10% 10.0% 0
Completeness 10% 10.0% 0
Relevancy 5% 5.0% 0
Quality of figures in support of technical content 5% 5.0% 0
Relevant security related information 5% 5.0% 0
Scope 20% 20% 0.00%
Defined boundaries of subject 10% 10.0% 0
Not too broad and not too narrow 10% 10.0% 0
Integration 15% 15% 0.00%
Consistent with Modernization objectives and initiatives 5% 5.0% 0
Consistent with other documentation 5% 5.0% 0
Demonstrates dependencies, interactions, and synergies 5% 5.0% 0
Readability 10% 10% 0.00%
Grammar and Punctuation 3% 3.0% 0
Word Choice 3% 3.0% 0
Format 2% 2.0% 0
Use of diagrams, figures, and tables to clarify concepts 2% 2.0% 0

Assessment Plot

Key: Assessment Ranges for the Entire Deliverable

* Factor is not applicable if an "X" is entered. Standard weight is adjusted to account for factors that are not applicable.
ed Assessment

able Name}

Assessment by Factor
Requires Minor Requires Major
Unacceptable
Rework Rework

Number of Adjusted
75% 50% 25%
Reviewers Total
21%
0.00% 27.50% 13.75% 2

0 1 1 2
0 1 1 2
0 1 1
0 1 1 2
0 1 1 2
0 1 1 2
0.00% 10.00% 5.00% 2 7%
0 1 1 2
0 1 1 2
0.00% 7.50% 3.75% 2 6%
0 1 1 2
0 1 1 2
0 1 1 2
0.00% 5.00% 2.50% 2 4%
0 1 1 2
0 1 1 2
0 1 1 2
0 1 1 2

38%

38%

hat are not applicable.

Quantitative Quality Assessment Methodology - Summary Assessment Form
Instructions and Helpful Hints
To Copy Summary for each Deliverable from individual File
1 From file for the Deliverable's assessment
Go to "Consolidated Doc Asmt" tab
Unprotect that tab
Copy cells for one category (e.g. Accuracy) including each of the rows in that category and all the columns over to, but not
including, the Total column
For example, column B through column I (Unacceptable header).
2 In this overall file
Go to the tab for the Deliverable
Paste Special, Values Only into the same section in this sheet that was copied from in the detail file
3 Repeat steps 1& 2 until finished pasting values in.
4 If steps 1-3 do not work, manually key in the data.
5 Verify totals and that bar graph has correct value and is displaying correctly.
If the bar graph is not correct then:
Right-click on the bar
Choose "Select Data" and then
In the "Chart Data Range", click on the cell with the Total value for the assessment and then save

Assessment Summary Sheet

1 Enter name for each Deliverable in order of the tabs in the file.
2 Verify bar graphs and total amounts match amounts from each of the tabs. Total Amount should reference total amount on
Deliverable's tab (around cell L26)
3 Remove any rows that are not necessary

To Copy Page into PowerPoint

While in Excel:
Unprotect the page
Highlight the area to go into PowerPoint
Copy

In PowerPoint - on slide page:

Home Tab - Open Paste and select Paste Special
Choose Bitmap from the list and click OK
Size the Graphic:
Right click on graphic
Choose Size and Position
Uncheck "Lock Aspect Ratio"
Set Height to 64% and Width to 78%
Quantitative Quality Assessment Methodology - Summary Assessment Form
Instructions and Helpful Hints
Close

To Set Print Area for Charts

Go to Print then Print Preview
Open Page Setup
Set Orientation to Landscape
Set Scaling to "Fit to 1 Page"
To set the Print Area
Go to Page Layout Ribbon
Highlight area to print
Open Print Area
Choose Set Print Area

To change the Assessment Criteria

Unprotect the sheet - see above
Insert or add the row in the desired category
Adjust the Standard Weights
Copy the formula from another "Wgt" entry into the "Wgt" cell for a new entry
Adjust the formulas on the summary criteria's line for each criteria range (e.g. "Unacceptable") to either add the score for the new detail
criteria or remove the deleted criteria's score
Note: these cells are using a white font so that the results don't show and confuse the user.
Example: If adding a criteria under "Accurate technical content", adjust the formulas on that summary row.
Formula looks like: ($E8*F8+ $E9*F9 + $E10*F10 + $E11*F11 + $E12*F12 + $E13*F13)*F$5
Test that revised formula is working on all columns by entering "1" in each row of the category for one criteria range at a time.
Example: Put all '1' under "Meets or exceeds expectations" only and ensure that the total adds up to the "Wgt" percentage.
Then put all "0" (if on Consolidated sheet) or blanks in that column and do the same for the next column. Ensure that the
total adds up to the "Requires Minor Rework" percentage (75%) times the "Wgt" amount
Continue for all 4 criteria range columns.
Make the same changes for all reviewer worksheets and the consolidated doc assmt sheet.
NOTE: In this file, make the changes to the first Deliverable's tab and then replace the other Deliverables' tab per the instructions below.
Quantitative Quality Assessment Methodology - Summary Assessment Form
Instructions and Helpful Hints
To add a deliverable tab or replace a deliverable tab
Insert the sheet
Go to another Deliverable tab and copy all
Copy onto new, blank sheet
Change Deliverable Name on new sheet
Change sheet's tab name
Change reference for horizontal graph on the new sheet.
Click into graphic.
At top of ribbon, choose Chart Tools - Design. It should be available if you properly clicked into the graphic.
Choose Select Data from Data tab
Clear the entry. Click the tab for the new Deliverable. Click into total amount/% for the Deliverable (around cell L26)
Fix graphic for Key: Assessment Ranges for the Entire Deliverable if it is not sized to match the horizontal bar graph
Delete color coded graphic for Assessment Ranges
Go back to tab from which you copied the content for the page and copy just the Assessment ranges picture.
Paste the Assessment ranges picture onto the new tab and then drag it into position.
Change the pointer on the Assessment Summary page to the new tab
If there is a row for the Deliverable already on the Assessment Summary page:
Go to the Assessment Summary page and click into the total % cell for the new page.
Clear the entry
While in the entry, press the equal sign (=) then click into the Deliverable's tab and click into the total amount/percentage for
that Deliverable (around cell L26) and then press Enter