| Challenges in Developing a Performance Measurement System for the Global Virtual Environment |
DEC 2006 |
18 pages |
| Authors:
Antoinette M. Portrey; Loren B. Keck; Brian T. Schreiber; LOCKHEED MARTIN SYSTEMS MANAGEMENT MESA AZ
|
 | The Air Force Research Laboratory, Warfighter Readiness Research Division, is continuously researching technologies to measure and track performance of knowledge and skills from an individual level to the command and control (C2) level, within both high fidelity distributed simulation environments and live training environments. This program initially developed a performance measurement system, the Performance Effectiveness Tracking System (PETS), which successfully captured the objective data necessary for Mission Essential Competency (MEC) ... |
|
| Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study. Volume 4. Participant Utility and Effectiveness Opinions and Ratings |
JUL 2006 |
66 pages |
| Authors:
Brian T. Schreiber; Leah Rowe; Jr. Bennett Winston; LUMIR RESEARCH INST GRAYSLAKE IL
|
| The work in this report focuses on the user acceptance of the Air Force Research Laboratory, Human Effectiveness Directorate, Warfighter Readiness Research Division (AFRL/HEA) Distributed Mission Operations (DMO) training research site which contains four high-fidelity F-16 simulators, an Airborne Warning and Control System (AWACS) simulator, a threat generation system, and a full complement of brief/debrief technologies. The 327 F-16 pilots and the 49 AWACS users based their opinions on experiences ... |
|
| Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study. Volume 3. Real-Time and Blind Expert Subjective Assessments of Learning |
JUL 2006 |
32 pages |
| Authors:
Brian T. Schreiber; Sara E. Gehr; Jr. Bennett Winston; LUMIR RESEARCH INST GRAYSLAKE IL
|
| The current work documented in this report is the subject matter expert (SME) rating data from a large study examining the within-simulator learning benefits of Distributed Mission Operations (DMO) training as described in AFRL-HE-AZ-TR-2006-0015 Vol I, Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study: Summary Report. That study examined 76 participating F-16 four-ship teams in week-long DMO training exercises and compared beginning-of-week to end-of-week performance on mirror-image air combat scenarios. ... |
|
| Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study. Volume 5. Using the Pathfinder Methodology to Assess Pilot Knowledge Structure Changes |
JUL 2006 |
30 pages |
| Authors:
Brian T. Schreiber; Pam DiSalvo; William A. Stock; Jr. Bennett Winston; LUMIR RESEARCH INST GRAYSLAKE IL
|
| To provide an indirect assessment of learning for the overall Distributed Mission Operations (DMO) Within Simulator Training Effectiveness Baseline Study as described in Volume I, Summary Report, of AFRL-HE-AZ-TR-2006-0015, the current work examined pilots who participated in a Pathfinder data collection methodology both before and after five days of DMO training. The Pathfinder methodology is a qualitative/quantitative method that can be used to assess if the pilots' underlying knowledge structures ... |
|
| Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study. Volume 1. Summary Report |
JUL 2006 |
36 pages |
| Authors:
Brian T. Schreiber; Jr. Bennett Winston; LUMIR RESEARCH INST GRAYSLAKE IL
|
| Distributed Mission Operations (DMO) training consists of multiplayer networked environments enabling warfighting training on higher-order individual and team-oriented skills. Surprisingly, only sparse DMO training effectiveness literature can be found and very few studies contain objective data. The dataset used in this research represents the largest DMO effectiveness dataset known to exist today (76 teams/384 pilots on over 3,000 engagements), containing 33 months' worth of multi-faceted DMO data, including objective data ... |
|
| Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study. Volume 2. Metric Development and Objectively Quantifying the Degree of Learning |
JUL 2006 |
42 pages |
| Authors:
Brian T. Schreiber; William A. Stock; Jr. Bennett Winston; LUMIR RESEARCH INST GRAYSLAKE IL
|
| The current work reports only the objective data from AFRL-HE-AZ-TR-2006-0015, Volume I, Distributed Mission Operations Within-Simulator Training Effectiveness: Summary Report, but here we expand the reporting of objective data both in depth and breadth. We examined F-16 pilots participating in week-long Distributed Mission Operation (DMO) training exercises and compared extensive computer-collected data between beginning-of-week and end-of-week pilot performance on mirror-image scenarios. The DMO research environment in Mesa, AZ consisted of ... |
|
| AOC Embedded Performance Measurement and Assessment |
JUN 2006 |
30 pages |
| Authors:
William Stock; Brian T. Schreiber; Todd Denning; Don Cain; L3 COMMUNICATIONS MESA AZ
|
| This report contains a review of relevant team assessment literature for potential methods/tools/measures not already known to researchers at the Air Force Research Laboratory, Human Effectiveness Directorate, Warfighter Readiness Research Division (AFRL/HEA); an in-depth feasibility analysis of embedded measurement for the Attack Coordinator position in the Aerospace Operations Center (AOC); and an overview of a modeling approach (e.g., MicroSaint) to measuring performance of the AOC. Each of these efforts is ... |
|
| Evaluating Mission Training Fidelity Requirements: Examining Key Issues in Deployability and Trainability |
JUN 2006 |
33 pages |
| Authors:
Brian T. Schreiber; Jr. Bennett Winston; Robert Rickard; Jeffry Bell; Michael France; David Greschke; LUMIR RESEARCH INST GRAYSLAKE IL
|
| Due to infrequent training while deployed, warfighters skills can decay, thus creating a training gap. Deployed training has historically been hindered by restrictions to live-fly training opportunities due to factors such as ops-tempo, airspace/range restrictions, security issues, alert requirements, and wartime rules of engagement. In order to maintain high proficiency and readiness levels, changes are needed in standard training programs while warfighters are deployed. The United States Air Force's Distributed ... |
|
Reports by Author
