Joint Technical Coordinating Group for

Munitions Effectiveness

Test
Test Data
Data Supporting
Supporting Training
Training and
and Combat
Combat
Operations
Operations

Ronald A. Thompson NDIA Testing and Training Conference

410 278-2062 Omni Rosen Hotel, Orlando FL
Ront@amsaa.army.mil 20 August 2002

A SOLUTION TO THE WEAPONEERING PUZZLE

Joint Munitions Effectiveness

1
 Presentation Overview

Introduction to the JTCG/ME

• Charter and Mission

• Organization
• Weapons Effectiveness Estimation
• Products
• Users and User Requirements Generation

JTCG/ME Testing and Training Initiatives

• Integration Challenges
• A current initiative
• Advanced Joint Effectiveness Model
• Joint Live Fire Testing
• Credible Training & Combat Ops Support

Conclusion
• Additional Challenges
• Responsiveness to Changing Warfare

Joint Munitions Effectiveness

2

JTCG/ME CHARTER
DEPARTMENT OF THE ARMY
HQS US ARMY MATERIEL COMMAND
WASHINGTON DC, 20315
DEPARTMENT OF THE AIR FORCE
HQS AIR FORCE LOGISTICS COMMAND
WRIGHT-PATTERSON AFB, OHIO 43433
CHARTER
FOR
JOINT AMC/NMC/AFLC/AFSC
COMMANDERS
JTCG/ME
DATE: 10 Dec 1968
Joint Service Authenticated Products
Charter and Mission
Prepare and Publish
Joint Munitions Effectiveness
DEPARTMENT OF THE NAVY
Manuals (JMEMs) for
HQS NAVAL MATERIEL COMMAND
WASHINGTON, DC, 20300 Fielded Systems
DEPARTMENT OF THE AIR FORCE
HQS AIR FORCE SYSTEMS COMMAND
ANDREWS AFB, WASHINGTON, DC, 20331
Develop, Maintain and Update
Databases
• Weapon Effectiveness
• Weapon Characteristics
• Delivery Accuracy
• Reliability
• Vulnerability
Standardize Methodologies
Reconcile Gaps and
Inaccuracies in the
Data Then Published by the
Services on Air-to-Surface
Non-nuclear Weapons Conduct Special
Studies/Activities
• Joint Live Fire (JLF)
• Data Collection Efforts
from Operational Employment
• JMEM Seminars
Joint Munitions Effectiveness
3
 Organization
Director JTCG/ME Steering Committee
Operational Test JTCG/ME Army Materiel Command Mr. David Shaffer (Chair)
& Evaluation Air Force Materiel Command Dr. Mike Caluda
Steering
Committee Naval Materiel Establishment Mr. Danny Brunson
DOT&E/LFT&E OSD J-8 Brig Gen Stephen M. Goldfein
Oversight
and U.S. Marine Corps Dr. Alfred Brandstein
Funding Program Office Defense Intelligence Agency Mr. Jim Hempstead
APG, MD Def Threat Reduction Agency Dr. Leon Wittwer

Air-to-Surface Surface-to-Surface Anti-Air Vulnerability

Eglin AFB, FL APG, MD China Lake, CA Dahlgren, VA
Operational Users
Working Group OUWG OUWG
(OUWG)
Joint Technical
JMEM Coordinating Group on
Publication Production
Offices of Primary Management Contractor -
Aircraft Survivability

Responsibility Office - Tinker Oklahoma

Army - MG J. R. Snider (AMC) AFB State
University
Navy - RADM D. G. Bowler (N70) Joint Live Fire (JLF)
Munitions Effectiveness
Air Force - Dr. Mike Caluda (AFMC)
Joint Munitions Effectiveness
4
 JMEM Weapons Effects Process
Weapons Delivery Target
Characteristics Accuracy Vulnerability
• Warhead • Aiming/MPI Error Target Model Sensitivity To:
• Guidance Methods • Target Location Error • Penetration
• Direct/Indirect Hits • Precision/Ballistic Error • Fragments
• Fuze Functioning • Acquisition • Blast
• Reliability • Effects of Threat Environment • Fire and Explosion

+
• Precision/Ballistic Errors and Countermeasures

Operational Weapon Target-Weapon

Encounter Interaction
Conditions Effectiveness Analysis

Paper WEB Based

Diskettes CD-ROMs
Products Products
Joint Munitions Effectiveness
5
 JMEM Development Process
~ 2 year process
Intelligence Target Geometric Vulnerability Effectiveness PD or EFD
Collection/ Model Data Indices or Lethal Calculation/
Production Development Development Areas Generation Estimation
Command identified • BRL-CAD • AJEM or COVART Joint MAE • WinJMEM/TARCOM
targets ~ 660 (Ground targets) (Air targets) • General Full Spray • ARTQUIK/SAMSITE
• FASTGEN • AJEM MUVES S-2 • SWAMAE • BAM
• Ground (Air targets) (Surface Mobile) • BAS
• Ship • STMG • MEVA-GF • CDM
• Aircraft (Infrastructure) (Ground fixed)
• Infrastructure • ORCA
Effectiveness
• Personnel (Personnel)
Program

Weapon
Characteristics
and
Support … Delivery Accuracy
• NGIC
• MSIC
• NAIC Delivery Accuracy
• ONI • Aiming/MPI Error
• DOT&E/TSO • Fragmentation Specific weapon • TLE
• FMECA • Precision/Ballistic Error
• Blast and
• Kill definition • Acquisition
• Shaped Charge Specific target • Effects of Threat
• FALT trees Environment
• EFP Interaction
• Component data and Countermeasures
• Fire
Joint Munitions Effectiveness
6
 JTCG/ME Integrated CD-ROM Products
Joint Anti-Air Combat Effectiveness (J-ACE)
Air Superiority v2.0
• Air-to-Air Weapons … Surface-to-Air
Threat (Red-on-Blue v2.0)
• Interactive “Compute” Module
• Air-launched Missile Fly-out Simulation
• Probability of Kill Data
JMEM/AS Weaponeering
System (JAWS) v2.2.1 Operational
Tools/
• Air-to-Surface Weapon Systems
Methodology
• Pre-calculated data and
Embedded Methodologies
Physical/
• Operational Tools … Bridges and
Functional
Buildings
Characteristics
• Vulnerability Data, Effectiveness
Indices and Pre-calculated Single
Shot Probability of Damage
JMEM/SS Weapons Effectiveness System (JWES) v2.0
Indirect Fire Systems
• Pre-calculated Effectiveness
Data and Operational Tools …
Red-on-Blue … Navy Ship-to-Shore
• Number of Rounds Required to
Achieve Desired Damage Level
Air Defense v1.0
• Land-Based Surface-to-Air Weapons
• Interactive “Compute” Module
• Calculates Intercept Points for User-
Selected Engagement Conditions
• Probability of Kill Data
Special Operations Target
Effectiveness/ Vulnerability and
Vulnerability Weaponeering Manual v2.0
Data • Special Operations Mission
Planners and Operators
• Single Shot PK and Number of
Training/ Rounds Required to Achieve
Tutorials Desired Kill Level
Direct Fire Systems
• Pre-calculated Effectiveness
Data and Operational Tools … Red-on-Blue
• Vulnerability Data, Probability of Kill,
Probability of Hit, and Number of
Rounds Required to Achieve Desired
Damage Level
Joint Munitions Effectiveness
7
 JMEM/AIR-TO-SURFACE WEAPONEERING SYSTEM (JAWS)

EMBEDDED MODULES
JAWS JAWS is a single source AND TOOLS
FEATURES for air-to-surface
weaponeering and target
vulnerability • Windows Automated
• Interactive Browser Weaponeering Program
(WINJMEM)
• Weapons
• Target Complex (TARCOM)
Characteristics Computer Program
• Target Vulnerability • Target Vulnerability Data
Access Program (TVDAP)
• Risk Estimates for
Friendly Troops • Penetration and Cratering
(PC-EFFECTS)
• Target Acquisition
• Joint Smart Weapons Module
• Weaponeering Guide (JSWM)

• Delivery Accuracy • Bridge Analysis System (BAS)

• Paveway Munitions Planning
• Weaponeering Tool (PMPT)
• Lookups • Collateral Damage Module
(CDM)
• Programs
• Building Analysis Module (BAM)
• Interactive Training
• GAU-8 Gun Method

Joint Munitions Effectiveness

8
 JMEM/SURFACE-TO-SURFACE WEAPONS EFFECTIVENESS
SYSTEMS (JWES)

JWES is a single source for

JWES surface-to-surface
EMBEDDED MODULES
FEATURES weaponeering and target AND TOOLS
vulnerability

• Interactive Browser • Effectiveness Guide

• Military Operations • Surface to Air Missile Site
in Urban Terrain (SAMSITE)
(MOUT)
• Simplified Artillery Projectile
• Weaponeering Effectiveness Model
• World Artillery and (ARTQUIK)
Mortar Systems • Fraction of Target
(WAMS) – Indirect Incapacitation (FBAR)
Fire
• Passive Vehicle Target
• World Infantry and Model (PVTM)
Tank Systems
(WITS) – Direct Fire

Joint Munitions Effectiveness

9
 JOINT ANTIAIR COMBAT EFFECTIVENESS:
AIR SUPERIORITY (J-ACE: AS) & AIR DEFENSE (J-ACE: AD)

J-ACE:AS and J-ACE:AD are

J-ACE:AS and sources of information on antiair
J-ACE:AD and air defense weapon EMBEDDED
FEATURES effectiveness against air targets MODELS

• Interactive Browser (Both)

• Joint Antiair Model
• Weapon and Target (JAAM) – J-ACE: AS
Characteristics
• Gun Computer-Aided
• Weaponeering Joint Munitions
• Antiair Missile Effectiveness Manual
System Effectiveness (GunCAJ) – J-ACE: AS
(J-ACE: AS)
• Joint Services Endgame
• Antiair Gun Weapon Model (JSEM) – J-ACE: AD
System Effectiveness
(J-ACE: AS)
• Air Defense Weapon
System Effectiveness
(J-ACE: AD)

Joint Munitions Effectiveness

10
 SPECIAL OPERATIONS TARGET VULNERABILITY AND
WEAPONEERING MANUAL (SOM)

SOM is used for special

operations forces in planning
SOM attacks against selected targets EMBEDDED
FEATURES FEATURES

• Pre-calculated
• Critical Target Elements
values - document
• Weapons Effectiveness is browsable in
Information html

Joint Munitions Effectiveness

11
 JTCG/ME Products
Models
• Advanced Joint
Effectiveness Model (AJEM)
• Joint Services Endgame Model CD-ROMs Operational Tools
(JSEM)
• ORCA • JAWS • WINJMEM
• COVART/FASTGEN • JACE-AS • Target Complex (TARCOM)
• BEAMS • JACE-AD • PC-Effects
• PENCRV3D • JWES • Bridge Analysis System (BAS)
• Matrix Evaluator • Special Operations • Building Analysis Method (BAM)
• Fortran Stickbomb • Joint Anti-Air Model (JAAM)
• GFSM/GFSP • Joint Smart Weapons Module
• Complex Target (JSWM)
• Bridge • Collateral Damage Module (CDM)
• Attack Assess Comp Program Databases • Hard Target Analysis
Databases
• Paveway Munitions Planning
•• JPIAS
JPIAS Tools (PMPT)
Service/Agency Owned Models •• CVAA
CVAA
•• Air
Air Target
Target Geometry
Geometry Service/Agency Owned
• Surface Mobile Target Methodology •• Ground
Ground Target
Target Geometry
Geometry Operational Tools
(PDAM, MUVES/S2,COVART) •• Visualization Tool
Visualization Tool
• FATEPEN •• Ground
Ground Target
Target Acquisition
Acquisition • Fraction of Target Incapacitation
• GENESIS •• Data
Data Review
Review (FBAR)
• Advanced Survivability Assess •• Data
Data Generation
Generation • ARTQUIK
Program (ASAP) •• TVDMS
TVDMS • Passive Vehicle Target Model
• Munitions Effectiveness Assessment (PVTM)
(MEA) • Surface-to-Air Missile Site
• MEVA-GF/MEVA-MOUT (SAMSITE)
• SURFAC
• SUBVEM
Joint Munitions Effectiveness
12
 JMEM Users
DoD/Joint/Service
Warfighters Planners
• Operational Weaponeering • Mission Area Analysis
• Mission Planning • Requirement Studies
• Tactics Development • Procurement Planning
• War Gaming/Training (Ammunition/Equipment)
Service Acquisition
Communities
• Performance Assessment
• Analysis of Alternatives (AOA)
• Improved/Enhanced Design
• Survivability Enhancement

Unified Combatant Commands, Army/ Joint Staff (J8/J2), OSD, JWAC, BMDO, PEO/SPO/PMs, Analytical Organizations,
Navy/Air Force/USMC Operators/Units DTRA, DIA, Service Service T&E Commands/Agencies, Service
and Weaponeers, Service Schools Major Commands and Agencies Labs/RDECs, Academia, DoD Contractors

Weaponeering/Target List Development (KAOC, CAOC)

Collateral Damage Assessment (JWAC)
Battle Damage Assessment (DIA)
Mission Planning Support (AFATDS, CMSA ...)
Capabilities-Based Munitions Requirements (DoD)
Muntions Effectiveness Assessment (DTRA)
JAWS v2.2 (Attack) Air Force/Navy/Joint Targeting Schools
was released JEFX/NTC FTX
in support of
Operation Enduring Performance Assessments (JSOW, SFW, BAT ...)
Freedom Counterproliferation ATD

Broad User Base … Supports Critical Warfighting Needs

Joint Munitions Effectiveness
13
 Requirements Generation Process
Institutionalize integrated requirements build process (Combatant Commands,
Services, and Operational Users Working Groups (OUWGs))
• Living Documentation
• Continuously update and validate requirements … top down/bottom up
• Visible and accessible to support program build and monitor progress

Combatant Commands J-8, J-2, Users and

Joint Staff (J-8)
and Services Program Office
Annual Requirements • Generate/Modify Top Down Requirements
Data Call Requirements Integration
• Review and validate priorities • Establish 1 to N list

WGs and OUWGs

• Semi-Annual
• Generate/Modify Bottom Up Program Office, WGs and
Requirements OSU Requirements
Assessment
User • Determine resource
Feedback requirements/timeline
Program Build JPIAS
Living
Project Data Sheet Requirements
Drives Program
Development Build Process Document

Joint Munitions Effectiveness

14
 Integration Challenges…

• DOT&E supports decisions on • Application support must be

weapon system Acquisition throughout the weapon life cycle
(to SECDEF, USD (AT&L), and must account for changes in:
Congress) • Weapon Capability
• JTCG/ME supports decision on • Threat
weapon system Application • Application Objectives
(to warfighters in planning, training • JMEM must be distributed to & in
and combat operations) convenient format for the warfighter
Can a Testing and Training task
help to meet this challenge???
• JMEM developed using models • The test community does not
• Credibility is that of the models focus on modeling
• Model “testing” is required • The modeling community does
(expensive, complex, slow) not focus on testing
• Part of a Verification, Validation • Both need to better focus on
and Accreditation (VV&A) process warfighter support through JMEM

Joint Munitions Effectiveness

15
 Advanced Joint Effectiveness Model (AJEM)

Credibility of JTCG
Models is
Key to Continued
Warfighter Support!

• Provides a single DoD standard tool for evaluating:

ü Vulnerability of aircraft, missiles & ground-mobile targets
ü Lethality and Effectiveness of munitions
• Facilitates Coordinated Joint Service Vulnerability and Lethality Methodology:
ü Research and Development
ü Verification, Validation and Accreditation (VV&A)
ü Estimates
www.ajem.com

Joint Munitions Effectiveness

16
 Joint Live Fire

JLF established objectives …

1. Gather empirical data on the vulnerability of front-line U. S. systems to foreign
weapons and the lethality of U. S. weapons against foreign systems,

2. Provide insight into design changes necessary to reduce vulnerabilities and

improve lethalities of U. S. weapons systems,

3. Enhance the database available for battle damage assessment and repair,

4. Validate current vulnerability and lethality methodologies.

JLF Future Emphasis …

V/L Methodology Validation
(JMEM Oriented Projects)
Support Acquisition Upgrades
Other previously established
objectives…
Joint Munitions Effectiveness
17
 JTCG, AJEM, JLF and Warfighter Support

• Credible V/L methodology is the bridge between JTCG and JLF

• Ensure V/L models predict actual results

• Restructure JLF testing to support V/L model validation

Ø Pre-shot predictions and post-shot analysis
Ø Component tests may be required Integration
Ø RED-on-BLUE and BLUE-on-RED Supports Life
Cycle Weapon
• Use credible models to develop credible JMEM
System
Evaluation for the
• Accreditation will be an ongoing effort
Warfighter
Ø Broader application
Ø Higher resolution/confidence

The key to good testing is a close tie between a test and the
development of a method used in a model, improvement to a model,
or validation between a model prediction and the test results
Joint Munitions Effectiveness
18
 Integration Supporting Warfighter
Training and Combat Operations

JMEM Development Process

~ 2 year process
Intelligence Target Geometric Vulnerability Effectiveness PD or EFD
Collection/ Model Data Indices or Lethal Calculation/
Production Development Development Areas Generation Estimation
Command identified • BRL-CAD • AJEM or COVART Joint MAE • WinJMEM/TARCOM
targets ~ 660 (Ground targets) (Air targets) • General Full Spray • ARTQUIK/SAMSITE
• FASTGEN • AJEM MUVES S-2 • SWAMAE • BAM
• Ground (Air targets) (Surface Mobile) • BAS
• Ship • CDM
• STMG • MEVA-GF
• Aircraft (Infrastructure) (Ground fixed)
• Infrastructure • ORCA
Effectiveness
• Personnel (Personnel)
Program

Weapon
Characteristics
and
Support … Delivery Accuracy
• NGIC
• MSIC
• NAIC Delivery Accuracy
• ONI
-190 -150 -110 -70 - 3 0 10 50 90 130 170

• Aiming/MPI Error
• DOT&E/TSO • Fragmentation Specific weapon • TLE
• FMECA • Precision/Ballistic Error
• Blast and • Acquisition
• Kill definition
• Shaped Charge Specific target • Effects of Threat
• FALT trees Environment
• EFP Interaction
• Component data and Countermeasures
• Fire
Joint Munitions Effectiveness
18

Credible Credible Data for

JLF Test Model Joint V/L Training, Planning
Results VV&A Model and Combat Operations
Joint Munitions Effectiveness
19
 JTCG/ME Program Challenges
Data Generation and
Documentation
• Data Shortfalls for Critical
Weapon/Target Pairings
• DoD 5000.2R … Require JMEM
production at IOC … Methodology
coordinated with JTCG/ME …
Impact on Developmental Systems?
• Acquisition reforms impact on
leveraging Service data
• Strategy to capture data below ACAT 1
Product Configuration
Management & Maintenance
• Services Shifting Responsibility
• Increasing percent of budget …
less discretionary funds
• Making Significant Progress …
“Procedures for Accreditation of
Software by the JTCG/ME”
• Focusing on Most Critical Areas
Growing requirements continue to exceed available resources
Product Generation and
Distribution
JTCG/ME Product and
Information Access System
• Consistent with JV2020 Goals
• Key to Responsiveness
• Technology Provides Opportunity
Joint Munitions Effectiveness
Methodology and
Tool Standardization
• Collateral Damage Assessment
• Bridge Analysis System
• Building Analysis Module
• Hardened Target Module
• Smart Weapons
• Target Acquisition
• V/L and Endgame Model
• Target Oriented JMEMs
Emerging User Requirements
• Training
• Developmental Systems
• Data for Joint Studies
• Counter Proliferation
• Non-lethal Weapons
• Information Operations
• Directed Energy Weapons
20
 JMEM Responsive to Changing
Warfare Environment
Increased Weapon Systems Complexity
• Precision Guided Munitions – in ODS 9%, Kosovo
35%, Afghanistan ~70% of expended munitions by Integrated Planning for Joint/
Combatant Commands Coalition Operations
• Available inventory constrains operational use …
each item critical • Coalition Operations becoming the norm … no longer US only
• All weather capability needed … increased use of GPS …
• Must have buy-in and participation of all nations
multi-mode terminal seekers
• Non-kinetic capabilities increasingly employed … DE, IO, etc. • Strengthening the exercise program is key to success

Requires methodology/data for newly fielded

and developmental systems Requires availability of tools to planning cells …
integration into Mission Planning Systems

Demanding Operational Environment ... Evolving Target Set

• Hard and Deeply Buried
• 24 hour, all weather, precision engagement, restricted air-space, great
distances from launch point to target, extraordinary concerns for collateral
damage and loss of life • WMD

• Reduced planning timelines … shortened targeting cycle • MOUT

• Information flow is critical • Physical Infrastructure

• Networks … Information Systems

Methodology requires … shorter product cycle times ...
WEB based distribution • … functional & physical effects
Requires accurate methodologies …
Current Operations effects based capability

Significant cost to
replace
expended inventory
Timely, accurate and complete JMEMs are critical …
Small Investment High Payoff
Joint Munitions Effectiveness
21