Abstract:
This applied research study contributes to the understanding of the application of the Kirkpatrick Model to the Joint Special Operations University’s (JSOU) educational programs. This study examined the rationale for evaluating training and education programs, the four essential elements of the Kirkpatrick Model, the industry application of the Kirkpatrick Model and compares and contrasts the Kirkpatrick Model with the other leading evaluation program, Phillips Return on Investment (ROI) Model. The Kirkpatrick Method, along with its hybrid associate, the Phillips ROI Model, is the standard for evaluating most government and private industry training programs, as evidenced by numerous industry and government documents that reference Kirkpatrick and ROI as the models to emulate. Though initially designed for evaluating training programs, the Kirkpatrick Model can be readily adapted to higher education, thus providing stakeholders vital information to better assess the value of the education provided. Adaptation of the Kirkpatrick Model in higher education helps to not only clarify criteria for what should be taught but also the assessment of what is being taught concerning desired educational outcomes.
Prior to academic year (AY) 2018, JSOU relied almost exclusively on the Kirkpatrick Model’s Level 1 surveys to ascertain the effectiveness of JSOU’s mission. This research evaluates how full implementation of the Kirkpatrick Model at JSOU can provide leadership of an open adaptive system with more relevant information that aids in determining the effectiveness of JSOU in performing its mission. A case study approach was utilized with AY 2018 JSOU data on hand. All four levels of the Kirkpatrick Model of evaluating the effectiveness of training and education programs ii were used to evaluate JSOU’s AY 2018. The data analysis was reviewed within the context of the singularity of this specific academic year at JSOU. Both qualitative and quantitative data were analyzed so that the complexities of a real-life situation would be studied from multiple perspectives. The data showed a quantitatively minor correlation between the Kirkpatrick Model’s Level 1 surveys and JSOU’s Level 3 surveys. Qualitatively, JSOU was shown to have an effective process to ensure students were being tested for the desired teaching outcomes (Level 2). Level 4 evaluation was also qualitatively conducted by reviewing surveys and interviews of Special Operations Forces (SOF) senior leaders from JSOU’s 2020 Strategic Vision Project. This mixed methods approach, utilizing all four levels of the Kirkpatrick Model, yielded an overall assumption that JSOU is meeting the SOF unique education needs of its primary customer, the United States Special Operations Command (USSOCOM).
Keyword 1: Kirkpatrick
Keyword 2: Military
Keyword 3: Special Operations
Keyword 4: Education
Keyword 5: Training
Keyword 6: Evaluation