Completion Isn’t Capability: How Competency Data Cuts Training Time

11 May 2027
Adaptive Edge Theatre
Capability at pace

When missions, threats, equipment, techniques, and tactics change faster than curricula, training organizations need to assess what their people know and can do, quickly and citing evidence. This requires both training models and training data to be mapped to capabilities, as well as more granular training data than course completions. In addition, new content is added after incidents and upgrades, old content is rarely removed, and the information needed to fix this is typically locked in notes, review documents and separate systems. As a result, two basic questions are hard to answer: which of today’s mission essential tasks are not being trained well enough, and which training is no longer needed? Artificial intelligence (AI) is the current answer of choice, but when AI uses unorganized, unstructured documents and data, its answers can fluctuate, rely on out of date documents, or even hallucinate, and cannot be easily traced back to authoritative sources. This paper presents a practical, repeatable approach to closing that gap. First, training documents are converted into structured data that links each job task to its learning objectives and to the content and assessments that support them, following the AIA/ASD S6000T standard for training analysis. Second, the knowledge and skills behind each task are grouped into measurable competencies. Next, the curriculum is mapped to every element that supports a mission-essential task, revealing both content that supports no task and tasks that have no training. Finally, performance data from tests, simulators, live exercises, and on-the-job evaluations is collected through the Experience API (xAPI) and compared with the required proficiency level for each competency. Across operational deployments, this approach has reduced duplicated content, improved alignment with current mission requirements, cut training time by 20% and provided a 20x return on investment. Because gaps are ranked by their impact on the mission, organizations can fix specific problems instead of retraining everyone. The same structured data also gives AI a trusted foundation, so recommendations can be verified and validated. The lesson for defense training is that staying ahead of the threat depends less on adding more training than on adapting it quickly and with authority.

Chairperson
Jean-Yves Donnart
Jean-Yves Donnart, Advanced Studies Project Manager - Thales AVS France - Training & Simulation
Speakers
Brooke Shields
Brooke Shields, Director of Operations - Eduworks Corporation
Fritz Ray
Fritz Ray, CEO - Eduworks Corporation
Tim Welch
Tim Welch, Program Managers - Eduworks Corporation