NDM Tools

Through its scientific and applied endeavors, the NDM community has generated many tools, including methods, models, guidance, and research supports. Some of the tools are available as Courses.

 

This list is not intended to be comprehensive. The NDMA is seeking ideas and resources for developing this tool box – send recommendations and/or links for other NDM tools to: info@naturalisticdecisionmaking.org.


These NDM community members contributed to the list: Cindy Dominguez, Julie Gore, Robert Hoffman, Devorah Klein, Gary Klein, Laura Militello, Brian Moon, Emilie Roth, Jan Maarten Schraagen, and Neelam Naikar. Adam Zaremsky added the short descriptors and references.

Table of Contents

Articles citing use of CTA

TitleLead AuthorYearGistSpecific MethodsDomainSubDomainApplicationFull referenceLink to Online
Source
Paywall
A cognitive-task analysis informed central venous catheter placement curriculumMaura E. Sullivan2012Cognitive task analysis conducted with six SMEs to capture the underlying knowledge and skill experts use to place a central venous catheter. This effort informed the development and implementation of curriculum to teach and assess competency in central line placement.Not identifiedHealth CareInterventional radiologist OR general surgeonTrainingSullivan, M., Sullivan, M., Baker, C., Talving, P., & Inaba, K. (2012). A cognitive-task analysis informed central venous catheter placement curriculum. MedEdPORTAL, 8. https://doi.org/10.15766/mep_2374-8265.9135.https://www.mededportal.org/doi/10.15766/mep_2374-8265.9135No
Understanding the cognitive demands, skills, and assessment approaches for endotracheal intubation: Cognitive task analysisTaylor Kunkes2021Proper airway management, specifically endotracheal intubation, is an essential skill for hospital personnel and rescue services to learn. This research effort applied cognitive task analysis to endotracheal intubation to capture the task and training requirements from the perspective of multiple medical specialties.Hierarchical task analysisHealth CareAnesthesiologists, emergency medicine physicians, and paramedicsTrainingKunkes, T., Makled, B., Norfleet, J., Schwaitzberg, S., & Cavuoto, L. (2021). Understanding the cognitive demands, skills, and assessment approaches for endotracheal intubation: Cognitive task analysis. JMIR Perioperative Medicine, 5, 1-12. https://doi.org/10.2196/34522. https://periop.jmir.org/2022/1/e34522No
The use of cognitive task analysis to reveal the instructional limitations of experts in the teaching of procedural skills.Maura E. Sullivan2014Cognitive task analysis conducted to investigate the percentage of knowledge experts omit when teaching a cricothyrotomy to determine the percentage of additional knowledge gained during a cognitive task analysis interview. Researchers recorded three trauma surgeons teaching an open cricothyrotomy procedure and then use cognitive task analysis methods to interview each expert for the same procedure to capture the percent of steps omitted while describing a procedure.Clark’s Concepts, Process, and Principles (CPP) approachHealth CareTrauma surgeonsTrainingSullivan, M., Yates, K. A., Inaba, K., Lam, L., & Clark, R. E. (2014). The use of cognitive task analysis to reveal the instructional limitations of experts in the teaching of procedural skills. Academic Medicine, 89(5), 811-816. DOI: 10.1097/ACM.0000000000000224. https://journals.lww.com/academicmedicine/Fulltext/2014/05000/The_Use_of_Cognitive_Task_Analysis_to_Reveal_the.33.aspx?casa_token=VjnV560WISAAAAAA:t_ZY3MhBR-3PlMtH3UtWvy0AIGpkK62ud_TaPBYJQhUhkCrHKdEDkw_w903FAsaxaz4Vom33ztWGxstDA0ZWAeUNo
A cognitive task analysis of coordination in a distributed tactical team: Implications for expertise acquisitionKelly Neville2003Cognitive task analysis conducted to examine expertise and experience related differences associated with achieving coordination in large distributed teams. Researchers elicited experiences from 12 naval flight officers with varying levels of experience using knowledge elicitation sessions.CDMMilitaryNaval flight officers (radar operators, air control officers, combat information center officers, & instructor combat information center officers)Training/Technology designNeville, K., Fowlkes, J. E., Walwanis Nelson, M. M., Bergondy-Wilhelm, M. L. (2003). A cognitive task analysis of coordination in a distributed tactical team: Implications for expertise acquisition. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 47(3), 359-363. https://doi.org/10.1177/154193120304700323. https://journals.sagepub.com/doi/10.1177/154193120304700323?icid=int.sj-abstract.similar-articles.3No
Cognitive task analysis and intelligent computer-based training systems: Lessons learned from coached practice environments in Air Force avionicsSandra Katz1997Cognitive task analysis conducted to inform the instructional content and approach of three training systems for Air Force aircraft maintenance as well as how the results are leveraged as features of one of the three training systems. Researchers describe the types of information that a cognitive task analysis can provide to developers of coached practice environments and illustrate the efficiency of this training across novices and master technicians.Precursor (goal), Action, Result, Interpretation (PARI)MilitaryManual avionics test station technicians Training/Technology designKatz, S. N., Hall, E., & Lesgold, A. (1997). Cognitive task analysis and intelligent computer-based training systems: Lessons learned from coached practice environments in Air Force avionics (ED411309). ERIC. https://eric.ed.gov/?id=ED411309. https://eric.ed.gov/?id=ED411309No
Cognitive task analysis of the battalion level visualization process.Dennis K. Leedom2007Cognitive task analysis conducted to identify important skill areas associate with visualization at the battalion level of command to inform instructional design. Researchers interviewed 25 military officers to investigate their real-world experiences with visualizing the battlefield.Not identifiedMilitaryBattalion operations officer; Executive officersTrainingLeedom, D. K., McElroy, W., Shadrick, S. B., Lickteig, C., Pokorny, R. A., Haynes, J. A., & Bell, J. (2007). Cognitive task analysis of the battalion level visualization process (Report No. ADA474884). Evidence Based Research Inc. https://apps.dtic.mil/sti/citations/ADA474884.https://apps.dtic.mil/sti/citations/ADA474884No
Forecasters' cognitive task analysis and mental workload analysis of issuing probabilistic hazard information (PHI) during FACETs PHI prototype experiment.Joseph J. J. James2020Cognitive task analysis conducted with nine national weather service forecasters to evaluate the probabilistic hazard information (PHI) object ability to communicate accurate and timely information regarding specific meteorological threats.Hierarchical task analysisGovernment (weather)National weather service forecastersTechnology design/Interface designJames, J. J., Ling, C., Karstens, C. D., Correia, J., Calhoun, K., Meyer, T., & LaDue, D. (2020). Forecasters' cognitive task analysis and mental workload analysis of issuing probabilistic hazard information (PHI) during FACETs PHI prototype experiment. Weather and Forecasting, 38, 1505-1521. https://doi.org/10.1175/WAF-D-19-0194.1.https://journals.ametsoc.org/configurable/content/journals$002fwefo$002f35$002f4$002fwafD190194.xml?t:ac=journals%24002fwefo%24002f35%24002f4%24002fwafD190194.xmlNo
Training surgeons to perform arthroscopic all-inside meniscal repair: A randomized controlled trial evaluating the effectiveness of a novel cognitive task analysis teaching tool, Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA)Urvi Karamchandani2021There are currently no standardized techniques for training residents in all-inside meniscal repair of meniscal tears. Researchers interviewed three knee surgeons to inform the design and eventual evaluation of a digital cognitive task analysis teaching tool to standardize this procedure. Modified Delphi techniqueHealth CareOrthopedic surgeonsTrainingKaramchandani, U., Bhattacharyya, R., Patel, R., Oussedik, S., Bhattacharya, R., & Gupte, C. (2021). Training surgeons to perform arthroscopic all-inside meniscal repair: A randomized controlled trial evaluating the effectiveness of a novel cognitive task analysis teaching tool, Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA). American Journal of Sports Medicine, 49(9), 2341-2350. doi: 10.1177/03635465211021652. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8283189/.No
Primary care physicians' use of an electronic medical record system: A cognitive task analysisAviv Shackak2009Cognitive task analysis conducted to describe physicians' patterns of using an electronic medical record; reveal underlying cognitive elements, possible errors, and influences on patient-doctor communication; and understand the role of expertise in incorporating EMRs into clinical practice. Researchers conducted interviews/observations with 25 primary care physicians to capture the benefits and risks associated with using an electronic medical record.ACTAHealth CarePhysiciansTechnology designShackak, A., Hadas-Dayagi, M., Zix, A., & Reis, S. (2009). Primary care physicians' use of an electronic medical record system: A cognitive task analysis. Journal of General Internal Medicine, 24(3), 341-348. doi: 10.1007/s11606-008-0892-6.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2642564/No
Cognitive task analysis of expertise in air traffic control.Thomas L. Seamster1993Cognitive task analysis conducted with 18 air traffic controllers to analyze the knowledge structures, mental models, skills, and strategies of en route controllers to provide an understanding of the key cognitive components of an air traffic controller's job. Not identifiedCommercial AviationAir traffic controllersTrainingSeamster, T. L., Redding, R. E., Cannon, J. R., Ryder, J. M., & Purcell, J. A. (1993). Cognitive task analysis of expertise in air traffic control. International Journal of Aviation Psychology, 3(4), 257-283. https://doi.org/10.1207/s15327108ijap0304_2. https://www.tandfonline.com/doi/abs/10.1207/s15327108ijap0304_2Yes
Achieving cyber defense situational awareness: A cognitive task analysis of information assurance analysts.Anita D' Amico2005Cognitive task analysis conducted to investigate the workflow, decision processes, and cognitive demands of information assurance analysts. Researchers interviewed or conducted observations with 41 information assurance analysts to understand the processes, skills, and tools these experts use to achieve situation awareness as well as the cognitive challenges that impede situation awareness.*Bootstrap methods*Government (cyber)Information assurance analystsTechnology design/Interface designD'Amico, A., Whitley, K., Tesone, D., O'Brien, B., & Roth, E. (2005). Achieving cyber defense situational awareness: A cognitive task analysis of information assurance analysts. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(3), 229-233. https://doi.org/10.1177/154193120504900304.https://journals.sagepub.com/doi/10.1177/154193120504900304No
Cognitive task analysis and innovation of training: The case of structured troubleshootingAlma Schaafstal2000 This article uses the results of preliminary cognitive task analysis observational studies in which researchers observed technicians problem-solving malfunctions in a radar system and a general purpose computer system. These preliminary studies informed the development of a streamlined method of training, Structured Troubleshooting.*Bootstrap methods*MilitaryTechniciansTrainingSchaafstal, A., Schraagen, J. M., & van Berl, M. (2000). Cognitive task analysis and innovation of training: The case of structured troubleshooting. Human Factors, 42(1), 75–86. https://doi.org/10.1518/001872000779656570. https://journals.sagepub.com/doi/abs/10.1518/001872000779656570No
Critical care physician cognitive task analysis: An exploratory studyJames C. Fackler2009Cognitive task analysis conducted to analyze key cognitive activities in critical care medicine and assess the usefulness of cognitive task analysis as an analytic tool for organizational design. Researchers interviewed 14 members of two intensive care units as well as conducted observations of the ICU staff to capture the cognitive activities associated with critical care.CDMHealth CarePhysiciansTechnology designFackler, J. C., Watts, C., Grome, A., Miller, T., Crandall, B., & Pronovost, P. (2009). Critical care physician cognitive task analysis: An exploratory study. Critical Care, 13, 1-8. https://doi.org/10.1186/cc7740. https://link.springer.com/article/10.1186/cc7740#citeasNo
A cognitive task analysis with implications for designing simulation-based performance assessment.Robert J. Mislevy1999Cognitive task analysis conducted to capture the knowledge hygienists use when assessing patients, planning treatments, and monitoring progress; and elicit behaviors that manifest this knowledge. Researchers interviewed 31 subjects 11 of which were experts, used to draw implications for designing the proposed assessment tool.Not identifiedHealth CareDental Hygienist Training/Technology designMislevy, R. J., Steinberg, L. S., Breyer, F. J., Almond, R. G., & Johnson, L. (1999). A cognitive task analysis with implications for designing simulation-based performance assessment. Computers in Human Behavior, 15(4), 335-374. https://doi.org/10.1016/S0747-5632(99)00027-8.https://files.eric.ed.gov/fulltext/ED428124.pdfNo
Using cognitive task analysis to investigate the contribution of informal education to developing cyber security expertise.Michael Champion2014Cognitive task analysis conducted, following administration of an online survey, to explore respondents' interaction with the cyber security field. Researchers interviewed 10 individuals with experience in the cyber security industry to capture education as well as informal activities of highly skilled and expert cyber security professionals.Not identifiedCyber security/Information Technology TrainingChampion, M., Jariwala, S., Ward., P., & Cooke, N. J. (2014). Using cognitive task analysis to investigate the contribution of informal education to developing cyber security expertise. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 310-314. http://dx.doi.org/10.1177/1541931214581064.https://www.researchgate.net/publication/271728349_Using_Cognitive_Task_Analysis_to_Investigate_the_Contribution_of_Informal_Education_to_Developing_Cyber_Security_ExpertiseNo
The use of cognitive task analysis to improve instructional descriptions of procedures.Richard E. Clark2012Cognitive task analysis conducted in tandem with free recall and free recall with simulation to determine which method more accurately and completely captured descriptions of the procedure for inserting a femoral artery shunt. Researchers interviewed 10 expert trauma surgeons to elicit descriptions of how to perform an emergency shunt procedure.CPP Health CareTrauma surgeonsTrainingClark, R. E., Pugh, C. M., Yates, K. E., Inaba, K., Green, D. J., & Sullivan, M. E. (2012). The use of cognitive task analysis to improve instructional descriptions of procedures. Journal of Surgical Research, 173, 37-42. https://doi.org/10.1016/j.jss.2011.09.003.https://www.researchgate.net/profile/Kenneth-Yates/publication/51813870_The_Use_of_Cognitive_Task_Analysis_to_Improve_Instructional_Descriptions_of_Procedures/links/611ed71c1e95fe241ae30a1a/The-Use-of-Cognitive-Task-Analysis-to-Improve-Instructional-Descriptions-of-Procedures.pdfNo
Using cognitive task analysis to identify critical decisions in the laparoscopic environment.Curtis Craig2012Cognitive task analysis conducted to identify the critical decisions surgeons need to make regarding laparoscopic surgery, the information these decisions are based on, the strategies employed by surgeons to reach their objectives, and the difficulties experienced by novices. Researchers interviewed eight expert surgeons to capture the critical decisions made during a variety of laparoscopic procedures and identify their implications for training.CDMHealth CareSurgeonsTrainingCraig, C., Klein, M. I., Griswold, J., Gaitonde, K., McGill, T., & Halldorsson, A. (2012). Using cognitive task analysis to identify critical decisions in the laparoscopic environment. Human Factors, 54(6), 1025–1039. https://doi.org/10.1177/0018720812448393.https://journals.sagepub.com/doi/full/10.1177/0018720812448393No
Assessing the teaching of procedural skills: Can cognitive task analysis add to our traditional teaching methods?Maura E. Sullivan2008Cognitive task analysis conducted to determine if cognitive task analysis could capture steps and decision points that are not articulated during traditional teaching of a colonoscopy. Researchers videotaped SMEs teaching a colonoscopy, followed by a free recall session, and then a series of structured cognitive task analysis interviews to capture decisions that experts make during a colonoscopy procedure and highlight the difficult cognitive portions of the task.Not identifiedHealth CareColorectal surgeonsTrainingSullivan, M. E., Ortega, A., Wasserberg, N., Kaufman, H., Nyquist, J., & Clark, R. (2008). Assessing the teaching of procedural skills: Can cognitive task analysis add to our traditional teaching methods? American Journal of Surgery, 195, 20-23. https://doi.org/10.1016/j.amjsurg.2007.08.051.http://publishingimages.s3.amazonaws.com/eZineImages/PracticePerfect/729/Sullivan-assessing-the-teaching.pdfNo
The use of a cognitive task analysis-based multimedia program to teach surgical decision making in flexor tendon repair.Kali R. Luker2008Cognitive task analysis conducted to compare the surgical knowledge of residents before and after receiving a cognitive task analysis-based multimedia teaching module. Researchers interviewed three surgeons experienced in flexor tendon repair to document the technique for the procedure as well as the indications, contradictions, complications, and pitfalls related to flexor tendon repair that informed a new protocol.Not identifiedHealth CareSurgeonsTrainingLuker, K. R., Sullivan, M. E., Peyre, S. E., Sherman, R. & Grunwald, T. (2008). The use of a cognitive task analysis-based multimedia program to teach surgical decision making in flexor tendon repair. American Journal of Surgery, 195, 11-15. https://doi.org/10.1016/j.amjsurg.2007.08.052https://www.sciencedirect.com/science/article/abs/pii/S0002961007008367Yes
Using cognitive task analysis to facilitate the integration of decision support systems into the neonatal intensive care unit. Gordon D. Baxter2005Cognitive task analysis conducted to identify the contextual factors within a neonatal intensive care unit that would affect the successful integration of the FLORENCE expert system designed to support staff in making decisions when treating babies with respiratory distress syndrome. Researchers interviewed 4 experts with 20+ years of experience and 4 personnel with fewer than 5 years experience to identify issues that could inform the development and deployment of the FLORENCE system.CDMHealth CareConsultants; Registrars, Senior nurses; and SHOsTechnology designBaxter, G. D., Monk, A. F., Tan, K., Dear, P. R. F., & Newell, S. J. (2005). Using cognitive task analysis to facilitate the integration of decision support systems into the neonatal intensive care unit. Artificial Intelligence in Medicine, 35(3), 243-257. https://doi.org/10.1016/j.artmed.2005.01.004.https://www.academia.edu/download/47373770/j.artmed.2005.01.00420160720-20579-ii2bwc.pdfNo
A multi-phase network situational awareness cognitive task analysis.Robert F. Erbacher2010Cognitive task analysis conducted to capture the processes, goals, concerns, and the data and metadata that network analysts analyze. Researchers interviewed six network managers and analysts to identify and requirements and challenges of the work to inform the generation of six scenarios used to elicit feedback from the experts as to their workflow and needs with respect to potential visualization activities.Not identifiedCyber security/Information TechnologyNetwork managers; Network analystsTechnology design/Interface designErbacher, R. F., Frincke, D. A., Wong, P. C., Moody, S., & Fink, G. (2010). A multi-phase network situational awareness cognitive task analysis. Information Visualization, 9(3), 204–219. https://doi.org/10.1057/ivs.2010.5https://journals.sagepub.com/doi/10.1057/ivs.2010.5Yes
Utilization of a cognitive task analysis for laparoscopic appendectomy to identify differentiated intraoperative teaching objectives.Douglas S. Smink2012Cognitive task analysis conducted to enable experts to articulate operative steps and cognitive decisions during an laparoscopic appendectomy, a complex procedure, to identify key teaching principles to guide intraoperative instruction. Researchers interviewed three expert surgeons with experience in this procedure to generate a list of operative steps and decision points and then identify intraoperative teaching objectives for junior and senior residents.CDMHealth CareSurgeonsTrainingSmink, D. S., Peyre, S. E., Soybel, D. I., Tavakkolizadeh, A., Vernon, A. H., & Anastakis, D. J. (2012). Utilization of a cognitive task analysis for laparoscopic appendectomy to identify differentiated intraoperative teaching objectives. American Journal of Surgery, 203(4), 540-545. https://doi.org/10.1016/j.amjsurg.2011.11.002.https://www.sciencedirect.com/science/article/abs/pii/S0002961012000074Yes
Physical and cognitive task analysis in interventional radiology.Sheena Johnson2006Cognitive task analysis conducted to identify, describe, and detail the cognitive thought processes, decision-making, and physical actions involved in the preparation and successful performance of core interventional radiology procedures. Researchers conducted observations to five common interventional radiology procedures as well as conducted individual interviews with consultant interventional radiologists.Not identifiedHealth CareInterventional radiologistsTrainingJohnson, S., Healey, A., Evans, J., Murphy, M., Crawshaw, M., & Gould, D. (2006). Physical and cognitive task analysis in interventional radiology. Clinical Radiology, 61(1), 97–103. doi:10.1016/j.crad.2005.09.003
10.1016/j.crad.2005.09.003
https://www.sciencedirect.com/science/article/abs/pii/S0009926005002825Yes
A cognitive task analysis of information management strategies in a computerized provider order entry environmentCharlene R. Weir2007Cognitive task analysis conducted to explore the information management strategies that clinicians use in the process of adapting to a computerized provider order entry (CPOE) system. Researchers conducted observations and interviews with 88 primary-care clinicians to identify key information management goals, strategies, and tasks.Goal-directed task analysisHealth CarePrimary-care cliniciansKnowledge managementWeir, C. R., Nebeker, J. J. R., Hicken, B. L., Campo, R., Drews, F., & Lebar, B. (2007). A cognitive task analysis of information management strategies in a computerized provider order entry environment. Journal of the American Medical Informatics Association, 14, 65-75. https://doi.org/10.1197/jamia.M2231. https://academic.oup.com/jamia/article/14/1/65/747704No
The effectiveness of a cognitive task analysis informed curriculum to increase self-efficacy and improve performance for an open cricothyrotomyJulia Campbell2011Cognitive task analysis conducted to explore the effects of cognitive task analysis-informed curriculum to increase surgical skills performance and self-efficacy beliefs for medical students and postgraduate surgical residents learning how to perform an open cricothyrotomy. Researchers conducted interviews with six trauma surgeons to generate a list of major tasks associated with the procedure, analyzed the gold standard cognitive task analysis to identify critical decision points, and used this information to generate the curriculum overview and step-by-step actions and decisions required for the procedure.CPPHealth CareMedical StudentsTrainingCampbell, J., Tirapelle, L., Yates, K., Clark, R., Inaba, K., Green, D., Plurad, D., Lam, L., Tang, A., Cestero, R., & Sullivan, M. (2011). The effectiveness of a cognitive task analysis informed curriculum to increase self-efficacy and improve performance for an open cricothyrotomy. Journal of Surgical Education, 68(5), 403-407. https://doi.org/10.1016/j.jsurg.2011.05.007.https://apps.dtic.mil/sti/pdfs/ADA575280.pdfNo
The use of cognitive task analysis to improve the learning of percutaneous tracheostomy placementMaura E. Sullivan2007Cognitive task analysis conducted to determine the effectiveness of these methods to develop curriculum to teach the behavioral skills and the cognitive strategies of a percutaneous tracheostomy (PT) placement. Researchers interviewed three experts to generate a task diagram, videotapes them performing a PT to gain insight into the decisions made during the procedure, formulated a cognitive requirements table, and then developed a curriculum that described PT placement step-by-step.Not identifiedHealth CareMedical StudentsTrainingSullivan, M. E., Brown, C. V. R., Peyre, S. E., Salim, A., Martin, M., Towfigh, S., & Grunwald, T. (2007). The use of cognitive task analysis to improve the learning of percutaneous tracheostomy placement. American Journal of Surgery, 193, 96-99. https://doi.org/10.1016/j.amjsurg.2006.09.005.https://www.sciencedirect.com/science/article/abs/pii/S0002961006006416Yes
Investigating cognitive task difficulties and expert skills in e-learning storyboards using a cognitive task analysis techniqueNor'ain M. Yusoff2012Cognitive task analysis conducted to explore problem aspects of the cognitive task and the skills required of subject matter experts by applying the Applied Cognitive Task Analysis (ACTA) approach from the experts point of view. Researchers conducted the four phases of the ACTA methodology including with three SMEs: Task Diagram interviews to capture a broad overview of the task, knowledge audits to understand the skills, events, and strategies used, Simulations that address the difficult and challenging elements of the task, and a Cognitive Demand table to integrate the data from the previous four phases ACTAEducationDesignersTrainingYusoff, N. M. & Salim, S. S. (2012). Investigating cognitive task difficulties and expert skills in e-learning storyboards using a cognitive task analysis technique. Computers and Education, 58, 652-665. https://doi.org/10.1016/j.compedu.2011.09.009.https://www.sciencedirect.com/science/article/abs/pii/S0360131511002260Yes
Designing simulator-based training: An approach integrating cognitive task analysis and four component instructional designIrene M. Tjiam2012Cognitive task analysis integrated with instructional design conducted to inform the design of simulator-based skill training for a nephrostomy procedure. Researchers asked four urologists to complete questionnaires to identify the main steps of the procedure before conducting semi-structured interviews with eight different urologists to capture the automatic and non-automatic substeps of a nephrostomy procedure.Not identifiedHealth CareUrologistTraining/Technology designTjiam, I. M., Schout, B. M. A., Hendrikx, A. J. M., Scherpbier, A. J. M., Witjes, J. A., & Van Merrienboer, J. J. G. (2012). Designing simulator-based training: An approach integrating cognitive task analysis and four component instructional design. Medical Teacher, 34(10), 698-707. https://doi.org/10.3109/0142159X.2012.687480.https://www.tandfonline.com/doi/pdf/10.3109/0142159X.2012.687480No
Cognitive task analysis for developing unmanned aerial vehicle wilderness search supportJulie A. Adams2009Cognitive task analysis conducted to understand the human-based wilderness search and rescue (WiSAR) response, viewed as a system, in order to determine how to develop UAV capabilities and incorporate the UAC into the response while mitigating the disruptive behaviors found during field trials. Researchers interviewed two Incident Commanders and one moderately experienced search volunteer from a country search and rescue division to inform the design decisions for the UAV autonomous algorithms, operator control interface, and necessary human roles and responsibilities.Goal-directed task analysisSearch and RescueIncident CommandersTechnology design/Interface designAdams, J. A., Humphrey, C. M., Goodrich, M. A., Cooper, J. L., Morse, B. S., Engh, C. & Rasmussen, N. (2009). Cognitive task analysis for developing unmanned aerial vehicle wilderness search support. Journal of Cognitive Engineering and Decision Making, 3, 1-26. https://doi.org/10.1518/155534309X431926.https://www.researchgate.net/profile/Michael-Goodrich-2/publication/228644247_Cognitive_Task_Analysis_for_Developing_Unmanned_Aerial_Vehicle_Wilderness_Search_Support/links/0c96051ba2c2ece334000000/Cognitive-Task-Analysis-for-Developing-Unmanned-Aerial-Vehicle-Wilderness-Search-Support.pdfNo
Integrated studies on the use of cognitive task analysis to capture surgical expertise for central venous catheter placement and open cricothyrotomy.Kenneth Yates2012Cognitive task analysis conducted for two surgical procedures to determine: the extent the experts omitted critical information, the number of experts required to capture the optimal amount of information, and the effectiveness of a CTA-informed curriculum. Researchers conducted interviews with six physicians for a central venous catheter placement and open cricothyrotomy to inform the information put into training aids by capturing key decisions and procedural steps.Not identifiedHealth CarePhysiciansTrainingYates, K., Sullivan, M., & Clark, R. (2012). Integrated studies on the use of cognitive task analysis to capture surgical expertise for central venous catheter placement and open cricothyrotomy. American Journal of Surgery, 203, 76-80. https://doi.org/10.1016/j.amjsurg.2011.07.011.https://www.sciencedirect.com/science/article/abs/pii/S0002961011006180Yes
Cognitive task analyses for decision centered design and training.David O' Hare1998Three cognitive task analysis conducted to obtain information from expert white-water rafting guides and general aviation pilots, and to redesign the VDU display requirements for ambulance dispatchers. These three case studies are intended to demonstrate the utility of CDM to cognitive task analysis and provide guidance to practitioners applying CTA techniques.CDM 1: Raft Guides. 2: General Aviation Pilots. 3: DispatchersTraining/Technology design/Interface designO'Hare, D., Wiggins, M., Williams, A., & Wong, W. (1998). Cognitive task analyses for decision centered design and training. Ergonomics, 41(11), 1698-1718. https://doi.org/10.1080/001401398186144.https://www.researchgate.net/profile/David-Ohare/publication/13466280_Cognitive_Task_Analyses_for_Decision_Centred_Design_and_Training/links/02e7e525313e793a52000000/Cognitive-Task-Analyses-for-Decision-Centred-Design-and-Training.pdfNo
Using cognitive task analysis to develop simulation-based training for medical tasks.Jan Cannon-Bowers2013Cognitive task analysis conducted to generate training requirements, performance metrics, scenario requirements, and simulator/simulation requirements for medical tasks including cricothyroidotomy and hemorrhage control tasks. Researchers asked nine instructors to complete a think-aloud protocol while doing a procedure on an HPS and to imagine doing the procedure in a combat simulation. Finally, the participants were interviewed using specific probes to elicit critical cues for performance as well as asked questioned regarding the existing simulator and its differences from live tissue.CDMHealth CareMilitary Training Command Instructors Training/Technology designCannon-Bowers, J., Bowers, C., Stout, R., Ricci, K., & Hildabrand, A. (2013). Using cognitive task analysis to develop simulation-based training for medical tasks. Military Medicine, 178(10), 15-21. https://doi.org/10.7205/MILMED-D-13-00211.https://academic.oup.com/milmed/article/178/suppl_10/15/4344773No
Provider management strategies of abnormal test result alerts: A cognitive task analysis.Sylvia J. Hysong2010Cognitive task analysis conducted to evaluate how primary care providers manage alerts related to critical diagnostic test results on their EMR screens, and compare alert-management strategies of providers with high versus low rates of timely follow-up of results. Researchers interviewed 28 primary care providers regarding how they manage alerts, with a specific emphasis on the strategies used to filter alerts, reduce unnecessary alerts, and sort alerts for easier processing.Not identifiedHealth CarePrimary-care cliniciansTraining/Technology design/ Knowledge managementHysong, S. J., Sawhney, M. K., Wilson, L., Sittig, D. F., Espadas, D., Davis, T., Singh, H. (2010). Provider management strategies of abnormal test result alerts: A cognitive task analysis. Journal of the American Medical Informatics Association, 17, 71–77. https://doi.org/10.1197/jamia.M3200. https://academic.oup.com/jamia/article/17/1/71/705272. No
Translating expertise into effective instruction: The impacts of cognitive task analysis (CTA) on lab report quality and student retention in the biological sciencesDavid F. Feldon2010Cognitive task analysis conducted to test the effectiveness of CTA-based instruction for teaching undergraduate biology students to engage in the scientific process. Researchers interviewed three university biology faculty regarding the way he/she approached the scientific process.Not identifiedEducationBiology professorsTrainingFeldon, D. F., Timmerman, B. C., Stowe, K. A., & Showman, R. (2010). Translating expertise into effective instruction: The impacts of cognitive task analysis (CTA) on lab report quality and student retention in the biological sciences. Journal of Research in Science Teaching, 47(10), 1165-1185. https://doi.org/10.1002/tea.20382.https://onlinelibrary.wiley.com/doi/abs/10.1002/tea.20382Yes
Cognitive task analysis of unmanned aircraft systems pilotsDamon Larcel2021Cognitive task analysis conducted to define and examine a sampling of the cognitive task requirements of operating a civilian UAS including tasks such as communication, search and rescue mission planning, coping with equipment malfunction, and developing situational awareness of their environment. Researchers interviewed 16 journeymen and expert pilots to identify key cognitive considerations, insights, and examples of where pilots used their expertise to solve operational problems.ACTAMilitaryUnmanned aircraft system pilotsTrainingLarcel, D. & Andrews, D. H. (2021). Cognitive task analysis of unmanned aircraft system pilots. International Journal of Aerospace Psychology, 31(4), 319-342. http://dx.doi.org.wrs.idm.oclc.org/10.1080/24721840.2021.1895797.https://www-tandfonline-com.wrs.idm.oclc.org/doi/full/10.1080/24721840.2021.1895797No
Development and evaluation of a virtual reality training system based on a cognitive task analysis: The case of a CNC tool length offsettingDimitris Nathanael2016Cognitive task analysis conducted to examine whether this methodology is effective in developing virtual reality training systems (VRTS) for a specific machining task. Researchers conducted observations of and interviews with four expert machinists of a task execution to inform the development and calibration of the VRTS system.Not identifiedManufacturingMachinistsTraining/Technology designNathanael, D., Mosialos, S., Vosniakos, G. C., & Tsagkas, V. (2016). Development and evaluation of a virtual reality training system based on a cognitive task analysis: The case of a CNC tool length offsetting. Human Factors and Ergonomics in Manufacturing and Service Industries, 26, 52-67. http://dx.doi.org.wrs.idm.oclc.org/10.1002/hfm.20613https://onlinelibrary-wiley-com.wrs.idm.oclc.org/doi/10.1002/hfm.20613No
Leveraging the critical decision method to develop simulation-based training for early recognition of sepsisMary D. Patterson2016Cognitive task analysis conducted to understand differences in how novices and experts notice and interpret clinical cues and to develop simulations that replicate clinical cues to facilitate acquisition of expertise. Researchers conducted 14 interviews including novices, trainees, and experts to assess experience-based differences in sepsis recognition.CDMHealth CarePhysiciansTrainingPatterson, M. D., Militello, L. G., Bunger, A., Taylor, R. G., Wheeler, D. S., Klein, G., & Geis, G. L. (2016). Leveraging the critical decision method to develop simulation-based training for early recognition of sepsis. Journal of Cognitive Engineering and Decision Making, 10(1), 36–56. https://doi.org/10.1177/1555343416629520. https://www.researchgate.net/publication/296471869_Leveraging_the_Critical_Decision_Method_to_Develop_Simulation-Based_Training_for_Early_Recognition_of_SepsisNo
A cognitive modeling approach to decision support tool design for anesthesia provider crisis management.Noa Segall2013Cognitive task analysis conducted in tandem with a hierarchical task analysis to identify anesthesia provider procedures in detecting, diagnosing, and rating a critical incident and eliciting goals, decisions, and information requirements. Researchers interviewed three anesthesiologists to inform the design and validation of a crisis management decision support tool.Hierarchical task analysis; GOMS; Goal-directed task analysisHealth CareAnesthesiologists Technology design/Interface designSegall, N., Kaber, D. B., Taekman, J. M., Wright, M. C. (2013). A cognitive modeling approach to decision support tool design for anesthesia provider crisis management. International Journal of Human-Computer Interaction, 29(2), 55-66. https://doi.org/10.1080/10447318.2012.681220https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8510443/No
Choice and consequence: A naturalistic analysis of least-worst decision-making in critical incidentsNeil Shortland2020Cognitive task analysis conducted to explore the psychological processes of making (or not making) least-worst decisions in high consequence situations. Researchers interviewed 27 current or veteran service members of the U.S. armed forces to identify exogenous or external factors such as resources as well as endogenous factors or features of a incident itself that affect the decision making process.CDMMilitaryCurrent/former U.S. Armed Forces membersShortland, N., Alison, L., Thompson, L., Barrett-Pink, C., & Swan, L. (2020). Choice and consequence: A naturalistic analysis of least-worst decision-making in critical incidents. Memory and Cognition, 48, 1334–1345. https://doi.org/10.3758/s13421-020-01056-y.https://link.springer.com/article/10.3758/s13421-020-01056-y#citeasNo
Using cognitive task analysis to explore issues in the procurement of intelligent decision support systemsRobert R. Hoffman2009Cognitive task analysis conducted to study the work domain of IT systems development to reveal specific challenges with regard to human-centering, and ways in which principles, methods, and tools of ergonomics, might help the developers of IT systems better address the human and social aspects of cognitive work. Researchers interviewed software and systems engineers to understand the challenges and barriers to the procurement and development of usable, useful, and understandable IT for sociotechnical systems.CDMInformation TechnologySoftware engineers; Systems engineersTechnology designHoffman, R.R., Neville, K. & Fowlkes, J. (2009). Using cognitive task analysis to explore issues in the procurement of intelligent decision support systems. Cognition, Technology, and Work, 11, 57–70. https://doi.org/10.1007/s10111-008-0120-5.https://link.springer.com/article/10.1007/s10111-008-0120-5#citeasYes
Assessing antibiotic prescribing in nurse practitioners: Applied cognitive task analysisNataly Martini2022Cognitive task analysis conducted to identify the cognitive demands of antibiotic prescribing complexity and to explore the cognitive strategies that new nurse practitioners use when prescribing antibiotics. Researchers interviewed five nurse practitioners to identify areas where professional development courses and treatment resources can be targeted to support antibiotic prescribing.ACTAHealth CareNurse practitionersTrainingMartini, N., Choong, J. W., Cruz, P. D. D., Lau, H., Lim, H., Liu, R., Lim, A. G., & Marshall, D. (2022). Assessing antibiotic prescribing in nurse practitioners: Applied cognitive task analysis. International Journal of Nursing Studies Advances, 4, 1-12. https://doi-org.wrs.idm.oclc.org/10.1016/j.ijnsa.2022.100101.https://www.sciencedirect.com/science/article/pii/S2666142X22000406#:~:text=The%20Applied%20Cognitive%20Task%20Analysis%20Framework%20is%20a,and%20strategies%20that%20influence%20NP%20antibiotic%20prescribing%20practice.No
Patient decision-making personas: An application of a patient-centered cognitive analysisRichard J. Holden2020Cognitive task analysis conducted to develop personas distinguishing different patient approaches to self-care decision making by applying patient-centered cognitive task analysis to study patients naturalistic decision making. Researchers interviewed 24 patients with chronic heart failure to understand the cognitive work or "patient work" associated with chronical illness which includes effortful activities such as recommended self-care (medications, diet, etc.) avoiding certain behaviors (tobacco use), monitoring and managing symptoms, etc. Not identifiedHealth CarePatientsTechnology designHolden, R. J., Daley, C. N., Mickelson, R. S., Bolchini, D., Toscos, T., Cornet, V. P., Miller, A., & Mirro, M. J. (2020). Patient decision-making personas: An application of a patient-centered cognitive analysis. Applied Ergonomics, 87, 1-11. https://doi-org.wrs.idm.oclc.org/10.1016/j.apergo.2020.103107.https://www.sciencedirect.com/science/article/abs/pii/S0003687020300685Yes
Using hierarchical and cognitive task analysis to develop an assessment checklist for ultrasound-guided fascia iliaca nerve block (UGFINB) procedures.M. Dashti2022Cognitive task analysis conducted in tandem with hierarchical task analysis to elucidate expert knowledge, build a procedural model, and understand the cognitive processes involved during the performance of UGFINB procedures. Researchers interviewed 10 emergency physicians.Not identifiedHealth CareEmergency physiciansTrainingDashti, M., Goldsmith, A., Dias, R., Ebnali, M., & Dobiesz, V. (2022). Using hierarchical and cognitive task analysis to develop an assessment checklist for ultrasound-guided fascia iliaca nerve block procedures. Annals of Emergency Medicine, 80(4; 355, Suppl.), S152-S153. https://doi-org.wrs.idm.oclc.org/10.1016/j.annemergmed.2022.08.384.https://www.annemergmed.com/article/S0196-0644(22)00973-8/fulltextNo
Interdisciplinary cognitive task analysis: A strategy to develop a comprehensive endoscopic retrograde cholangiopancreatography protocol for use in fellowship trainingErin Canopy2015Cognitive task analysis conducted to identify the steps and decision points for an endoscopic retrograde cholangiopancreatography procedure. Researchers interviewed seven experts to develop and then refine a procedural step and cognitive decision point protocol.Not identifiedHealth CareGastroenterologists; surgeonsTrainingCanopy, E., Evans, M., Boehler, M., Roberts, N., Sanfey, H., & Mellinger, J. (2015). Interdisciplinary cognitive task analysis: A strategy to develop a comprehensive endoscopic retrograde cholangiopancreatography protocol for use in fellowship training. American Journal of Surgery, 210(4), 710-714. https://doi-org.wrs.idm.oclc.org/10.1016/j.amjsurg.2015.05.006.https://www.sciencedirect.com/science/article/abs/pii/S0002961015003566Yes
Overcoming personnel shortages in resource limited settings: Open appendectomy cognitive task analysisManisha Bhatia2021Cognitive task analysis conducted to define operative steps and cognitive decisions for open appendectomy. Researchers interviewed 11 general surgeons to inform a framework that can guide intraoperative instruction and the development of simulated models for open appendectomy.Not identifiedHealth CareGeneral surgeonsTrainingBhatia, M., Rogers, A., Levy, J., Gillio, A., Stefanidis, D., Sankaranarayanan, G., Saruni, I. S., & Hunter-Squires, J. (2021). Overcoming personnel shortages in resource limited settings: Open appendectomy cognitive task analysis. Journal of the American College of Surgeons, 233(5; Suppl. 1), S229. https://doi-org.wrs.idm.oclc.org/10.1016/j.jamcollsurg.2021.07.473.https://www-sciencedirect-com.wrs.idm.oclc.org/science/article/pii/S107275152100987XNo
Cognitive task analysis of power grid monitorsDavid Close2009Cognitive task analysis conducted to capture information on three desks within power utilities. Researchers interviewed 12 operators to collect information intended to improve operator performance, direct training and simulation strategies, and improve data visualization strategiesNot identifiedUtility PowerPower system monitorsTrainingClose, D., Babski-Reeves, K., Younan, N., & Schulz, N. (2009). Cognitive task analysis of power grid monitors. Proceedings of the Human Factors and Ergonomics Society, 53(4), 304-308. http://dx.doi.org/10.1518/107118109X12524441080867. https://www.researchgate.net/publication/241483373_Cognitive_task_analysis_of_power_grid_monitorsNo
Critiquing as a cognitive task analysis (CTA) methodologyJanet E. Miller2001Cognitive task analysis conducted to walk through a novice's process on a task in order to serve as a probe for elicitation of expert commentary. Researchers conducted critiquing interviews with six experts used to inform training and design for intelligence analysis.Not identifiedMilitaryIntelligence analystsTraining/Technology designMiller, J. E., Patterson, E. S., & Woods, D. D. (2001). Critiquing as a cognitive task analysis (CTA) methodology. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 45(4), 518–522. http://dx.doi.org/10.1177/154193120104500453https://www.researchgate.net/publication/2398401_Critiquing_as_a_Cognitive_Task_Analysis_CTA_MethodologyNo
Cognitive task analysis of data mining processes in bioinformatics researchJiao Ma2004Cognitive task analysis conducted to analyze the data mining processes used by bioinformatics researchers. Researchers interviewed five experts in applying data mining techniques to obtain a surface-level understanding of the cognitive elements of the task as well as understand the skills, contexts in which they are applied, and the strategies for applying them.ACTAHealth CareBioinformatics researchersMa, J. & Drury, C. G. (2004). Cognitive task analysis of data mining processes in bioinformatics research. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 48(5), https://journals.sagepub.com/doi/10.1177/154193120404800533?icid=int.sj-abstract.similar-articles.2Yes
A cognitive task analysis of NICU nurses' patient assessment skills.Laura Militello1995Cognitive task analysis conducted to elicit knowledge from neonatal intensive care unit nurses regarding the assessment of infants at risk for necrotizing enterocolitis. Researcher interviewed 19 NICU nurses including both highly experienced and less experienced nurses to extract information surrounding assessment of NEC from each incident so that comparisons could be made across incidents, hospitals, experience level, and over time. CDMHealth CareNeonatal Intensive Care Unit nursesTrainingMilitello, L. (1995). A cognitive task analysis of NICU nurses' patient assessment skills. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(11), 733-737. https://doi.org/10.1177/154193129503901104.https://journals.sagepub.com/doi/10.1177/154193129503901104Yes
Cognitive task analysis methods in envisioned tactical command decision makingNicolette M. McGeorge2019Cognitive task analysis conducted to understand tactical command decision making needs for the purpose of designing collaborative decision support information displays. Researchers interviewed 25 experts with experience as army commanders to identify the nature of the tasks that commanders must complete and the dynamic complexity involved in making tactical decisions.CDMMilitaryArmy commandersTechnology design/Interface designMcGeorge, N. M., Kane, S., & Muller, C. (2019). Cognitive task analysis methods in envisioned tactical command decision making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63, 262-266. https://doi.org/10.1177/1071181319631407.https://journals.sagepub.com/doi/10.1177/1071181319631407Yes
Eject, eject, eject! Conducting a cognitive task analysis to assess parachute descent training simulatorsCayla A. Hartley2022Cognitive task analysis conducted to identify the tasks, knowledge, skills, and abilities required for successful parachute descent procedures training, create performance metrics, and evaluate parachute descent training simulators on their ability to train the required KSAs. Researchers interviewed 10 experts to inform an iterative design process for an emerging training simulator and improve training design and implementation.CPP; CDMMilitaryNavy parachute descent instructors; professional skydiver; pilotTraining/Technology designHartley, C. A., Hurley, K. J., Morganson, V. J., Kass, S. J., Atkinson, B. F. W., & Pierce, M. B. (2022). Eject, eject, eject! Conducting a cognitive task analysis to assess parachute descent training simulators. Ergonomics in Design. https://doi.org/10.1177/10648046221124786.https://journals.sagepub.com/doi/abs/10.1177/10648046221124786Yes
Team briefings in the gynecological operating room: A cognitive task analysisEmily A. Hildebrand2014Cognitive task analysis conducted to better understand the informational needs of teams and individual team members with regards to briefings in gynecological surgery. Researchers interviewed 13 members of a large medical team to inform the development of a team briefing model for surgical teamsACTAHealth CareSurgeons; Surgical residents; Anesthesiologists; Nurse anesthetists; Surgical assistants; Scrub technicians; Circulating nursesHildebrand, E. A., Branaghan, R. J., Hallbeck, M. S., & Blocker, R. C. (2014). Team briefings in the gynecological operating room: A cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 753-757. https://doi.org/10.1177/1541931214581137.https://www.researchgate.net/publication/271728382_Team_Briefings_in_the_Gynecological_Operating_Room_A_Cognitive_Task_AnalysisNo
Combining cognitive task analysis and participatory design methods to elicit and represent task flows.Elizabeth L. Papautsky2020Cognitive task analysis conducted in tandem with participatory design methods to develop task flows and demonstrating for a submarine watch team's use of an updated imaging system to maintain the ship's safety by forming and maintaining a picture of the external environment. Researchers interviewed experienced submarine watch standers to elicit an overview of the task and identify the cognitively and/or perceptually challenging steps.ACTAMilitarySubmarine watch standersTrainingPapautsky, E. L., Strouse, R., & Dominguez, C. (2020). Combining cognitive task analysis and participatory design methods to elicit and represent task flows. Journal of cognitive engineering and decision making, 14(4), 288-301. https://doi.org/10.1177/1555343420976014. https://journals.sagepub.com/doi/10.1177/1555343420976014Yes
Development of a hybrid reality display for welders through applied cognitive task analysisWill Seidelman2014Cognitive task analysis conducted to identify the needs of expert welders, specifically in regards to the identification of important sensory cues useful when monitoring the welding process in real-time. Researchers interviewed four professional welders to provide requirements for a display development team in identifying critical cues that welders rely on to perform optimally when actively monitoring a weld.ACTAManufacturingWeldersTechnology design/Interface designSeidelman, W., Lee, M., Kent, T. M., Carswell, C. M., Fu, B., & Yang, R. (2014). Development of a hybrid reality display for welders through applied cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 1174-1178. http://dx.doi.org/10.1177/1541931214581245. https://www.researchgate.net/publication/271728420_Development_of_a_Hybrid_Reality_Display_for_Welders_through_Applied_Cognitive_Task_AnalysisNo
Integration of cognitive task analysis and design thinking for autonomous helicopter displays.Elizabeth L. Papautsky2015Cognitive task analysis conducted to develop interfaces for an operator controlling an autonomous helicopter. Researchers interviewed 27 SMEs with experience in UAS flight operations, helicopter resupply, military ground forces, and marine airspace control to generate requirements for human-system interface design.CDMMilitaryHelicopter pilots; UAS pilots; Marine instructorsInterface designPapautsky, E. L., Dominguez, C., Strouse, R., & Moon, B. (2015). Integration of cognitive task analysis and design thinking for autonomous helicopter displays. Journal of Cognitive Engineering and Decision Making, 9(4), 283-294. http://dx.doi.org/10.1177/1555343415602624.https://www.researchgate.net/publication/283169856_Integration_of_Cognitive_Task_Analysis_and_Design_Thinking_for_Autonomous_Helicopter_DisplaysNo
Use of critical analysis method to conduct a cognitive task analysis of intelligence analysts.Susan G. Hutchins2003Cognitive task analysis conducted to capture data that will provide input to support development of a model of the Intelligence analysts processes, biases and analytic strategies. Researchers interviewed 10 military officer students to provide input for building models of the intelligence analyst and associated processesACTA; CDMMilitaryIntelligence analystsTrainingHutchins, S. G., Pirolli, P., & Card, S. (2003). Use of critical analysis method to conduct a cognitive task analysis of intelligence analysts. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 47(3), https://doi.org/10.1177/154193120304700348.https://journals.sagepub.com/doi/10.1177/154193120304700348Yes
Swift trust in ad hoc teams: A cognitive task analysis of intelligence operators in multi-domain command and controlAugust Capiola2020Cognitive task analysis conducted to investigate the antecedents to quickly-formed trust in fast-paced, time-constrained contexts. Researchers interviewed 11 intelligence operators that generated implications for teams operating in high-risk distributed contexts.ACTAMilitary Intelligence operatorsCapiola, A., Baxter, H. C., Pfahler, M. D., Calhoun, C. S., & Bobko, P. (2020). Swift trust in ad hoc teams: A cognitive task analysis of intelligence operators in multi-domain command and control. Journal of Cognitive Engineering and Decision Making, 14(3), 218-241. https://doi.org/10.1177/1555343420943460.https://journals.sagepub.com/doi/abs/10.1177/1555343420943460Yes
Cognitive and collaborative demands of freight conductor activities results and implications of a cognitive task analysisHadar Rosenhand2011Cognitive task analysis conducted to examine the cognitive and collaborative demands placed on conductors and the knowledge and skills that experienced conductors have developed that enable them to operate safely and efficiently. Researchers interviewed 17 conductors and/or locomotive engineers to provide insight for future training methods and accelerate building conductor expertise.Not identifiedTransportationRailroad conductors; Locomotive engineersTrainingRosenhand, H., Roth, E., & Multer, J. (2011). Cognitive and collaborative demands of freight conductor activities results and implications of a cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 55, 1884-1888. https://railroads.dot.gov/elibrary/cognitive-and-collaborative-demands-freight-conductor-activities-results-and-implicationsNo
Developing a simulated uninhabited aerial vehicle (UAV) task based on cognitive task analysis: Task analysis results and preliminary simulator performance data.Leo Gugerty1999Cognitive task analysis conducted to develop a synthetic task (simulator) that represents the key cognitive demands of the UAV task. Researchers interviewed seven air vehicle operators (AVO) and twelve operators familiar with mission planning and payload operators tasks to inform the development of the synthetic (simulator) task.Not identifiedMilitaryAir vehicle operators; operatorsTrainingGugerty, L., DeBoom, D., Walker, R., & Burns, J. (1999). Developing a simulated uninhabited aerial vehicle (UAV) task based on cognitive task analysis: Task analysis results and preliminary simulator performance data. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43, 86-90. https://doi.org/10.1177/154193129904300118https://journals.sagepub.com/doi/10.1177/154193129904300118?icid=int.sj-abstract.similar-articles.7Yes
Understanding how train dispatchers manage and control trains: A cognitive task analysis of a distributed team planning taskEmilie M. Roth1999Cognitive task analysis conducted to examine how experienced railroad dispatchers manage track use. Researchers interviewed experienced train dispatchers that produced implications for communications technologies and dispatcher training.Not identifiedTransportationTrain dispatchersTraining/Technology designRoth, E. M., Malsch, N., Multer, J., & Coplen, M. (1999). Understanding how train dispatchers manage and control trains: A cognitive task analysis of a distributed team planning task. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43(3), https://railroads.dot.gov/elibrary/understanding-how-railroad-dispatchers-manage-and-control-trains-cognitive-task-analysisNo
Application of cognitive task analysis in user requirements definition and prototype designDavid E. Kancler2005Cognitive task analysis conducted to capture where the process of aircraft maintenance troubleshooting is inadequate or breaks down. Researchers interviewed 22 military maintenance technicians that informed design recommendations for graphical system representations, electronic technical orders, electronic wiring diagrams, and access to other information sources.CDMMilitaryMaintenance techniciansTechnology design/Interface designKancler, D. E., Gorman, M. E., McWesler, M., Bachmann, S., Stimson, D., Curtis, C., Randall, C., & Tidball, B. (2005). Application of cognitive task analysis in user requirements definition and prototype design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(23), 2045-2049.https://apps.dtic.mil/sti/pdfs/ADA441401.pdfNo
Assessing decision support needs of those in mental health crisis utilizing cognitive task analysis.Amanda J. Johnson2020Cognitive task analysis conducted to inform the design of a decision support-based mobile application that supports individuals during mental health crises. Researchers interviewed 24 individuals who personnally experienced a mental health crisis or doctoral level mental health professionals to capture cognitive support requirements for the mobile application..Not identifiedHealth CareMental health professionals; PatientsTechnology designJohnson, A. J., Bisantz, A. M., Reynolds, A. L., & Meier, S. T. (2020). Assessing decision support needs of those in mental health crisis utilizing cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 9, 46-46. https://doi.org/10.1177/2327857920091022https://journals.sagepub.com/doi/abs/10.1177/2327857920091022No
Designing colorectal cancer screening decision support: A cognitive engineering enterpriseLaura G. Militello2016Cognitive task analysis conducted to identify cognitive requirements for and inform the design of a modular software application to support physicians in managing and tracking colorectal cancer screening. Researchers conducted observations across four health care sites as well as interviewed four primary care providers documenting barriers to CRC screening, identifying key cognitive support requirements that drive decision making, to understand commonalities and differences in CRC screening work flow, and to explore strategies for reducing barriers to CRC testing.ACTA; CDMHealth CarePrimary-care physiciansTechnology designMilitello, L. G., Saleem, J. J., Borders, M. R., Sushereba, C. E., Haverkamp, D., Wolf, S. P., & Doebbeling, B. N. (2016). Designing colorectal cancer screening decision support: A cognitive engineering enterprise. Journal of Cognitive Engineering and Decision Making, 10, 74-90. https://doi.org/10.1177/1555343416630875.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4784691/No
The application of naturalistic decision-making techniques to explore cue use in rugby league playmakersDavid Johnston2016Cognitive task analysis conducted to inform training incentives by investigating the decision processes engaged by rugby league playmakers, such as whether players of varying ability could be differentiated in relation to a key decision process.ACTA; Concept MappingSportsRugby league playersTrainingJohnston, D. & Morrison, B. W. (2016). The application of naturalistic decision-making techniques to explore cue use in rugby league playmakers. Journal of Cognitive Engineering and Decision Making, 10(4), 391-410. https://doi.org/10.1177/1555343416662181https://journals.sagepub.com/doi/10.1177/1555343416662181No
Trialling the SMART approach: Identifying and assessing sense-makingB. L. William Wong2013Cognitive task analysis conducted to capture expert librarians sense making processes when faced with an ill-defined discovery problem using the INVISQUE system. In addition, this study was intended to assess the SMART probes used to elicit expert sensemaking processes. Researchers conducted interviews with six librarians which indicated that further efforts are needed to improve SMART probes neccesitating a stronger emphasis of cognitive task analysis methods to interpret the findings related to expert librarian sense making processes.CDM LibrariansWong, B. L. W., Kodagoda, N., Roony, C., Attfield, S., & Choudhury, T. (2013). Trialling the SMART approach: Identifying and assessing sense-making. Proceedings of the Human Factors and Ergonomics Society, 57, 215-219. https://doi.org/10.1177/1541931213571048.https://www.researchgate.net/publication/273296997_Trialling_the_SMART_Approach_Identifying_and_Assessing_Sense-makingNo
Using goal directed task analysis with Army brigade officer teamsCheryl A. Bolstad2002Cognitive task analysis conducted to obtain an accurate depiction of the situation awareness requirements and key goals of brigade officers. Researchers interviewed 12 brigade officers to draft goal hierarchies that were then analyzed to identify shared information requirements.Goal-directed task analysisMilitaryIntelligence officer; Training officer; Logistics officer; Brigade engineerTechnology designBolstad, C. A., Riley, J. M., Jones, D. G., & Endsley, M. R. (2002). Using goal directed task analysis with Army brigade officer teams. Proceedings of the Human Factors and Ergonomics Society, 46(3), 472-476. https://doi.org/10.1177/154193120204600354https://www.researchgate.net/publication/255662887_Using_Goal_Directed_Task_Analysis_with_Army_Brigade_Officer_TeamsNo
Providing a foundation for interpretable autonomous agents through elicitation and modeling of criminal investigation pathwaysSam Hepenstal2020Cognitive task analysis conducted to understand how criminal intelligence analysts question data as they sought to retrieve information to advance their investigations, specifically how questions lead to insights that triggered subsequent inquiries. Researchers interviewed four criminal intelligence analysts to generate an event tree simplified into a graph that serves as a foundation for transparant artificial intelligence autonomous investigations.CDMCriminal JusticeIntelligence analystsTechnology designHepenstal, S., Zhang, L., Kodogoda, N., & Wong, B. L. W. (2020). Providing a foundation for interpretable autonomous agents through elicitation and modeling of criminal investigation pathways. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 64, 239-243. https://doi.org/10.1177/1071181320641057https://eprints.mdx.ac.uk/32174/1/Hepenstal-AA-HFES2020.pdf. No
Human performance in spaceM. Ephimia Morphew2016Cognitive task analysis conducted to identify the cognitive and performance challenges associated with operating both the shuttle and station remote manipulator systems (RMSs). Researchers interviewed six experts including RMS trainers and a veteran shuttle astronaut to identify the demands associated with information processing, decision making, problem solving, cognitive workload, judgement, situation assessment, short- and long-term memory, and attentional focuisng involving RMS operations.CDMGovernmentRMS trainers; Shuttle astronautMorphew, M. E., Balmer, D. V., & Khoury, G. J. (2016). Human performance in space. Ergonomics in Design, 9(4), 6-11. https://doi.org/10.1177/106480460100900403.https://journals.sagepub.com/doi/10.1177/106480460100900403Yes
A case study of source triangulation: Using artifacts as knowledge elicitation tools in healthcare space designElizabeth L. Papautsky2015Cognitive task analysis conducted to triangulate the needs, goals, and design requirements from various stakeholder groups for the design of a clinical workspace. Researchers interviewed 26 stakeholders including the design team and frontline neonatal intensive care unit care providers to elicit different perspectives on design goals and develop representative definitions of the design goals for use in evaluation and refinement of the design plan.CDMHealth CareDesign team; Architect; Information systems specialists; NICU clinical directors; Frontline NICU care providersPapautsky, E. L., Crandall, B., Grome, A., & Greenberg, J. M. (2015). A case study of source triangulation: Using artifacts as knowledge elicitation tools in healthcare space design. Journal of Cognitive Engineering and Decision Making, 9(4), 347-358. https://doi.org/10.1177/1555343415613720.https://journals.sagepub.com/doi/abs/10.1177/1555343415613720Yes
Adaptive flexibility: Examining the role of expertise in the decision making of authorized firearms officers during armed confrontationLaura Boulton2016Cognitive task analysis conducted to identifying the exemplifying characteristics of expert decisional processes involved in decision making of british firearms officers during armed confrontations. Researchers interviewed 23 firearms officers to identify the implications for the acceleration of authorized firearms officers expertise acquisition to bridge the gap in a lack of available qualified operational force commanders.CDMCriminal JusticeFirearms officersTrainingBoulton, L. & Cole, J. (2016). Adaptive flexibility: Examining the role of expertise in the decision making of authorized firearms officers during armed confrontation. Journal of Cognitive Engineering and Decision Making, 10(3), 291-308. https://doi.org/10.1177/1555343416646684https://journals.sagepub.com/doi/10.1177/1555343416646684Yes
A descriptive model of computer code trustworthinessGene M. Alarcon2017Cognitive task analysis conducted to explore how programmers assess code trustworthiness when asked to reuse existing computer code. Researchers interviewed 14 programmers to identify factors that influence trustworthiness judgments that are necessary to understand to streamline the code writing process.ACTAInformation TechnologyProgrammersAlarcon, G. M., Militello, L. G., Ryan, P., Jessup, S. A., Calhoun, C. S., & Lyons, J. B. (2017). A descriptive model of computer code trustworthiness. Journal of Cognitive Engineering and Decision Making, 11(2), 107-121. https://doi.org/10.1177/1555343416657236https://journals.sagepub.com/doi/10.1177/1555343416657236No
Evaluation of cognitive skill degradation in flight planningKatherine M. Volz2020Cognitive task analysis conducted to understand the demands on the cognitive skills needed during planning a flight, what aspects of flight planning are susceptible to errors, and the cognitive skills required. Researchers interviewed six SMEs including two pilots, three flight instructors, and one general aviation pilot to understand what cognitive skill may degrade over time.ACTACommercial AviationPilots; Flight instructorsVolz, K. M. & Dorneich, M. C. (2020). Evaluation of cognitive skill degradation in flight planning. Journal of Cognitive Engineering and Decision Making, 14(4), 263-287. https://doi.org/10.1177/1555343420962897.https://journals.sagepub.com/doi/abs/10.1177/1555343420962897?journalCode=edmaYes
A study of the perceptions of the labour market by human resource managers in the UK hotel industry: A cognitive approachJulie Gore2000Cognitive task analysis conducted to explore the degree to which human resource managers' perceptions of the labour market inhabit the wider complete role of being an HR manager in a hotel. Researchers interviewed five human resource professionals.ACTAHospitalityHuman resource managersGore, J. & Riley, M. (2000). A study of the perceptions of the labour market by human resource managers in the UK hotel industry: A cognitive approach. Tourism and Hospitality Research, 2(3), 232-241. https://doi.org/10.1177/146735840000200304.https://journals.sagepub.com/doi/10.1177/146735840000200304Yes
Cognitive tools for assessment and learning in a high information flow environmentSusanne P. Lajoie1998Cognitive task analysis conducted to identify the cognitive components of clinical decision making of "expert" surgical nurses. Researchers interviewed three senior nurses to inform the design of a simulation-based intelligent tutoring system (ITS) intended for nurses working in a surgical intensive care unit (SICU).PARI Health CareNursesTrainingLajoie, S. P., Azevedo, R., & Fleiszer, D. M. (1998). Cognitive tools for assessment and learning in a high information flow environment. Journal of Educational Computing Research, 18(3), 205-235. https://doi.org/10.2190/LTRW-BR1G-B75L-3F65.https://www.researchgate.net/publication/275624350_Cognitive_Tools_for_Assessment_and_Learning_in_a_High_Information_Flow_EnvironmentNo
Design of a cognitive model-based decision support tool for anesthesiology crisis management.N. Segall2006Cognitive task analysis conducted to inform the design of a decision support tool intended to alert anesthetists to developing crises. Researchers interviewed six experienced anesthesiologists to identify procedures for detecting, diagnosing, and treating a critical incident; to elicit goals, decisions, and information requirements during crisis management procedures; code natural language information; and prototype and interface.Hierarchical task analysis; GOMS; Goal-directed task analysisHealth CareAnesthesiologists Technology design/Interface designSegall, N. & Kaber, D. B. (2006). Design of a cognitive model-based decision support tool for anesthesiology crisis management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(11), 1175-1179. https://doi.org/10.1177/154193120605001113.https://journals.sagepub.com/doi/abs/10.1177/154193120605001113?journalCode=proeYes
Staying in the zone: The cognitive components associated with offshore drillers' situation awarenessRuby C. Roberts2014Cognitive task analysis conducted to identify the underlying cognitive components associated with offshore drillers' development and maintenance of SA. Researchers interviewed 18 drilling personnel to develop a preliminary framework of the cognitive components associated with offshore drillers' developing and maintaining SA during well control.CDM Drillers; Tool pushers; Drilling superintendentRoberts, R. C., Flin, R., & Cleland, J. (2014). Staying in the zone: The cognitive components associated with offshore drillers' situation awareness. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 270-274. https://doi.org/10.1177/1541931214581056https://core.ac.uk/download/pdf/287597103.pdfNo
Examination of anesthetic practitioners' decisions for the design of a cognitive tool for airway managementR. Schnittker2016Cognitive task analysis conducted to examine the decisions made by anesthesia providers in emergency and routine clinical situations relating to airway management. Researchers interviewed 13 anesthesiologists and anesthesia assistants to form the basis for design requirements for a cognitive aid for airway management.CDMHealth CareAnesthesiologistsTechnology designSchnittker, R., Marshall, S. D., Horberry, T., Young, K., & Lintern, G. (2016). Examination of anesthetic practitioners' decisions for the design of a cognitive tool for airway management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 60, 1765-1769. https://doi.org/10.1177/1541931213601404.https://journals.sagepub.com/doi/10.1177/1541931213601404Yes
Eliciting knowledge from helicopter pilots: Recommendations for revising the ACTA method for helicopter landing tasksDev Minotra2017Cognitive task analysis conducted to better understand pilot performance in landing maneuvers. Researchers interviewed three pilots to generate a high-level description of the approach and landing task for a helicopter, elicit information about the pilots knowledge and specific instances of expertise, and capture perceptual skills and mental models of the pilots.ACTA; CDMMilitaryPilots Technology designMinotra, D. & Feigh, K. (2017). Eliciting knowledge from helicopter pilots: Recommendations for revising the ACTA method for helicopter landing tasks. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61, 242-246. https://doi.org/10.1177/1541931213601544.https://journals.sagepub.com/doi/abs/10.1177/1541931213601544Yes
Understanding preferences in experience-based choiceClaire McAndrew2013Cognitive task analysis conducted to understand decision makers', specifically financial day traders preferences. Researchers interviewed eight day traders to identify cognitive demands organized according to Prospect theory's pattern of choice.ACTA Financial day tradersMcAndrew, C. & Gore, J. (2013). Understanding preferences in experience-based choice. Journal of Cognitive Engineering and Decision Making, 7(2), 179-197. https://doi.org/10.1177/1555343412463922.https://journals.sagepub.com/doi/10.1177/1555343412463922No
The impact of a meta-informed on decision-making in intelligence operationsJonathan Pfautz2005Cognitive task analysis conducted to understand the influence of meta-information on decision-making in a military intelligence operations environment. Researchers interviewed military intelligence personnel to inform efforts to develop displays and computational support tools.Not identifiedMilitaryIntelligence analystsTechnology design/Interface designPfautz, J., Fouse, A., Fichtl, T., Roth, E., Bisantz, A., & Madden, S. (2005). The impact of a meta-informed on decision-making in intelligence operations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49, 214-218. https://doi.org/10.1177/154193120504900301https://journals.sagepub.com/doi/10.1177/154193120504900301Yes
Fostering shared situation awareness and on-track safety across distributed teams in railroad operationsEmilie M. Roth2005Cognitive task analysis conducted to document cognitively challenging aspects of the current work to anticipate potential impacts of new technologies on roadway worker performance as well as provide guidance for their design and introduction. Researchers conducted interviews and observations with 26 passenger and freight railroad personnel to describe the informal strategies that roadway workers, dispatchers, and train crews develop to facilitate work and enhance on-track safety.Not identifiedTransportationTrackmen; Signalmen; DispatchersTechnology designRoth, E. M. & Multer, J. (2005). Fostering shared situation awareness and on-track safety across distributed teams in railroad operations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(3), 529-533. https://doi.org/10.1177/154193120504900367.https://journals.sagepub.com/doi/10.1177/154193120504900367Yes
Features of problem detectionGary Klein1999Cognitive task analysis conducted to evaluate and revise an initial model of problem detection by capturing how wildland firefighters detect dangers in an already dangerous setting. Researchers interviewed five wildland firefighters to develop a description of problem detection.CDM Wildland fightersKlein, G., Pliske, R. M., Crandall, B., & Woods, D. (1999). Features of problem detection. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43(3), 133-137. https://doi.org/10.1177/154193129904300301.https://journals.sagepub.com/doi/abs/10.1177/154193129904300301?journalCode=proeYes
Everyday expertise: Cognitive demands in diabetes self-managementKatherine D. Lippa2008Cognitive task analysis conducted to assess the relationship between decision making and successful diabetes self-management. Researchers interviewed 18 patients to examine problem detection, functional relationships, problem-solving strategies, and types of knowledge used to make self-management decisions.Not identifiedHealth CarePatientsLippa, K. D., Klein, H. A., & Shalin, V. L. (2008). Everyday expertise: Cognitive demands in diabetes self-management. Human Factors, 50, 112-120. https://doi.org/10.1518/001872008X250601.https://www.researchgate.net/publication/5497487_Everyday_Expertise_Cognitive_Demands_in_Diabetes_Self-ManagementNo
Methods for gathering and analyzing information seeking behavior in electronic resource discovery systemsHanna Stelmaszewska2010Cognitive task analysis conducted to identify and understand what students and researchers do when searching for scholarly material using various electronic resource discovery systems as well as presents a visual representation of the process of information seeking developed during data analysis that allowed the patterns of activities to emerge and show the relationship between different actions. Researchers conducted interviews and observations with 34 students.CDMEducationStudentsStelmaszewska, H., Wong, B. L. W., & Sanderson, P. M. (2010). Methods for gathering and analyzing information seeking behavior in electronic resource discovery systems. Proceedings of the Human Factors and Ergonomics Society, 54(11), 807-811. https://doi.org/10.1177/154193121005401115. https://www.researchgate.net/publication/267788798_Methods_for_gathering_and_analyzing_information_seeking_behaviour_in_electronic_resource_discovery_systemsNo
Electronic checklists in the context of B-2 pilot decision makingAndrea E. Snead2004Cognitive task analysis conducted to explore the use of paper checklists and other reference materials during flight, particularly during emergency procedures. Researchers interviewed six B-2 pilots, developing a depiction of a typical decision flow during an advisory/caution/warning event and generating a list of recommendations to assist designers with designing electronic checklists for military aircraft.CDMMilitaryPilotsTechnology designSnead, A. E., Militello, L. G., & Ritter, J. A. (2004). Electronic checklists in the context of B-2 pilot decision making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 48(3), 640-644. https://doi.org/10.1177/154193120404800378.https://journals.sagepub.com/doi/abs/10.1177/154193120404800378?journalCode=proeYes
Designing automated aids for patient monitoring systems in intensive care unitsHuiyang Li2013Cognitive task analysis conducted to investigate the challenges faced by care givers in using patient monitoring systems, specifically focusing on the needs for automation support in patient monitoring tasks. Researchers conducted observations with four NICU personnel and conducted interviews with five other SMEs to inform the design of two automation aids in support of CRG (cardiorespirography) trends retrieval (information integration) and alarm limits adjusting (a decision making task).Not identifiedHealth CarePhysicians; Nurses; TechniciansTechnology designLi, H., Ku, M., Schumacher, R., & Seagull, J. (2013). Designing automated aids for patient monitoring systems in intensive care units. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2, 69-76. https://doi.org/10.1177/2327857913021014.https://journals.sagepub.com/doi/abs/10.1177/2327857913021014?journalCode=hcsaYes
Incorporation of the ACTA method for bone defect interpretation trainingJack Marzullo2022Cognitive task analysis conducted to establish additional insight on diagnostic imagery analysis, to guide development of training procedures for bone deficit detection. Researchers interviewed five experts.ACTAHealth CareTraining/Technology designMarzullo, J., Farahani, A., Fendley, M., & Caldorera-Moore, M. (2022). Incorporation of the ACTA method for bone defect interpretation training. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 66, 412-416. https://doi.org/10.1177/1071181322661348.https://journals.sagepub.com/doi/abs/10.1177/1071181322661348Yes
Barriers and facilitators of common ground in critical care teamsAnna McHugh2006Cognitive task analysis conducted to investigate collaboration in the critical care environment. Researchers interviewed 20 intensive care unit personnel and identified several factors that contribute to the breakdown of common ground within the critical care team as well as strategies that can be used to facilitate and support maintenance of common ground.CDMHealth CarePhysicians; Fellows; Residents; Clinical pharmacologist; Nurse practitionerMcHugh, A., Crandall, B., & Miller, T. (2006). Barriers and facilitators of common ground in critical care teams. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(10), 934-938. https://doi.org/10.1177/154193120605001029.https://journals.sagepub.com/doi/10.1177/154193120605001029Yes
The good stranger frame for police and military activitiesGary Klein2014Cognitive task analysis conducted to understand how police officers and military personnel interact with civilians in a way that increases good will and reduces antagonism. Researchers interviewed 17 police officers and 24 warfighters, identifying five factors used to model the way "Good strangers" approach encounters with civilians.CDMMilitaryPolice officers; WarfightersTrainingKlein, G., Klein, H. A., Lande, B., Borders, J., & Whitaker, J. C. (2014). The good stranger frame for police and military activities. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 275-279. https://doi.org/10.1177/1541931214581057https://www.researchgate.net/publication/271728350_The_Good_Stranger_Frame_for_Police_and_Military_ActivitiesNo
Internet searching by ear: Decision flow diagrams for sightless internet usersMegan G. Gorman2004Cognitive task analysis conducted to better understand strategies that sighted and sightless users rely on to navigate the web. Researchers interviewed 18 internet users to provide web designers a better understanding of what information sightless users rely on to navigate the web, how they make sense of the information, and the strategies they used to locate key information in the verbal stream of a screen reader.ACTAInformation Technology Interface designGorman, M. G., Militello, L. G., Swierenga, S. J., & Walker, J. L. (2004). Internet searching by ear: Decision flow diagrams for sightless internet users. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 48(2), 243-247. https://doi.org/10.1177/154193120404800204https://journals.sagepub.com/doi/abs/10.1177/154193120404800204?journalCode=proeYes
From managing the car to managing the road: The development of driving skillsHelen A. Klein1998Cognitive task analysis conducted to study experience linked differences in complex cognitive and regional abilities. Researchers interviewed 18 inexperienced and 17 experienced drivers to capture how the participant's understanding of the driving task as well as changes in that understanding with driving experience.Not identified DriversTrainingKlein, H. A., Vincent, E. J., & Isaacson, J. J. (1998). From managing the car to managing the road: The development of driving skills. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(17), 1271-1275. https://doi.org/10.1177/154193129804201720.https://journals.sagepub.com/doi/abs/10.1177/154193129804201720?journalCode=proeYes
The role of monitor technicians in enhancing alarm responseBeth Crandall2013Cognitive task analysis conducted to examine the monitor technician roles from a human factors perspective, with a particular focus on the monitor technicians coordination and communication with nurses and respiratory therapists. Researchers interviewed three MTs, three RNs, and two RTs to capture safety concerns associated with alarm/alert responses and provide recommendations for improving the alarm and alert response.Not identifiedHealth CareMonitor technicians; Nurses; Respiratory therapistsTraining/Technology design/Interface designCrandall, B., Papautsky, E. L., Grome, A., Dressman, K., Greenberg, J., & Geiser, M. (2013). The role of monitor technicians in enhancing alarm response. Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, 2, 116-122. https://doi.org/10.1177/2327857913021023https://journals.sagepub.com/doi/abs/10.1177/2327857913021023?journalCode=hcsaYes
Chronic disease management: Improving continuity of care with human factors engineeringLaura L. Gosbee2010Cognitive task analysis conducted to identify and characterize the critical decision making tasks confronting food allergy patients. Researchers conducted interviews with patients, their families, nurse educators, allergists, school nurses, food manufacturers, and food allergy advocacy groups to identify implications for more supportive resources for patients to manage a disease.Not identifiedHealth CareTraining/Technology designGosbee, L. L. (2010). Chronic disease management: Improving continuity of care with human factors engineering. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54(10), 919-923. https://doi.org/10.1177/154193121005401224https://journals.sagepub.com/doi/10.1177/154193121005401224Yes
Situation awareness in HRI with collaborating remotely piloted vehiclesJennifer M. Riley2005Cognitive task analysis conducted to examine the situation awareness needs in the context of a collaborative military task involving deployment of a single UAV that is coordinating with multiple UGVs to identify "safe lines" for advancing troops. Researchers used goal-directed task analysis to identify the SA requirements for control and tasking of the unmanned systems.Goal-directed task analysisMilitaryUAS PilotsRiley, J. M. & Endsley, M. R. (2005). Situation awareness in HRI with collaborating remotely piloted vehicles. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(3). 407-411. https://doi.org/10.1177/154193120504900341.https://www.researchgate.net/publication/255610258_Situation_Awareness_in_Hri_with_Collaborating_Remotely_Piloted_VehiclesNo
Helicopter pilots' tasks, subjective workload, and the role of external visual cues during shipboard landingMartin Tusl2020Cognitive task analysis conducted to obtain a detailed description of the helicopter shipboard landing procedure, and to identify relevant factors that affect pilots' workload, performance, and safety. Researchers interviewed ten helicopter pilots with implications for improving external visual cues intended to reduce pilot workload and improve overall safety of the task.ACTAMilitaryHelicopter pilots Technology design/Interface designTusl, M., Rainieri, G., Fraboni, F., DeAngelis, M., Depolo, M., Pietrantoni, L., & Pingitore, A. (2020). Helicopter pilots' tasks, subjective workload, and the role of external visual cues during shipboard landing. Journal of Cognitive Engineering and Decision Making, 14(3), 242-257. https://doi.org/10.1177/1555343420948720https://journals.sagepub.com/doi/full/10.1177/1555343420948720No
Development and validation of a virtual reality simulator: Human factors input to interventional radiology trainingSheena Johnson2011Cognitive task analysis conducted to establish the key competencies of the Seldinger procedure to inform simulator design and identify performance measure to be incorporated into the simulator. Researchers interviewed 15 SMEs who provided an outline of the procedure.Not identifiedHealth CareInterventional radiologists; Vascular surgeonsTraining/Technology designJohnson, S. J., Guediri, S. M., Kilkenny, C., & Clough, P. J. (2011). Development and validation of a virtual reality simulator: Human factors input to interventional radiology training. Human Factors, 53(6), 612-625. https://doi.org/10.1177/0018720811425042.https://journals.sagepub.com/doi/abs/10.1177/0018720811425042Yes
Understanding decision requirements for selection of assistive technologyYao Ding2015Cognitive task analysis conducted to reveal the underlying cognitive processes and decision requirements, and identify potential decision aids in support of selecting computer access solutions. Researchers interviewed six consumers with a disability* and five clinicians to identify design requirements to better support consumer needs as well as design implications to support clinicians during the selection process.Not identifiedHealth CareTechnology design/Interface designDing, Y., Chourasia, A., Anson, D., Atkins, T., & Vanderheiden, G. (2015). Understanding decision requirements for selection of assistive technology. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 160-164. https://doi.org/10.1177/1541931215591033.https://www.researchgate.net/publication/283542215_Understanding_Decision_Requirements_for_Selection_of_Assistive_TechnologyNo
How analysts think: A preliminary study of human needs and demands for AI-based conversational agentsSam Hepenstal2019Cognitive task analysis conducted to identify the intentions of intelligence analysts when retrieving information during live investigations. Researchers interviewed four intelligence analysts to identify implications for designing conversational agents (artificial intelligence) intentions.CDMCriminal JusticeIntelligence analystsTechnology designHepenstal, S., Wong, B. L. W., Zhang, L., & Kodogoda, N. (2019). How analysts think: A preliminary study of human needs and demands for AI-based conversational agents. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63, 178-182. https://doi.org/10.1177/1071181319631333.https://journals.sagepub.com/doi/abs/10.1177/1071181319631333No
Exploring decision pathways in challenging airway management episodesRaphaela Schnittker2017Cognitive task analysis conducted to identify the cognitive pathways underlying decisions in challenging airway management situations. Researchers interviewed 12 anesthesiologists and four anesthetic nurses to inform requirements for a decision support tool.CDMHealth CareAnesthesiologists; Anesthetic nursesTechnology designSchnittker, R., Marshall, S. D., Horberry, T., Young, K., & Lintern, G. (2017). Exploring decision pathways in challenging airway management episodes. Journal of Cognitive Engineering and Decision Making, 11(4), 353-370. https://doi.org/10.1177/1555343417716843.https://journals.sagepub.com/doi/10.1177/1555343417716843Yes
Critical decision method interviews to understand the initial treatment planning process in foster care Connor Wurst2022Cognitive task analysis conducted to understand the decision-making involved in balancing assessment tasks, and the barriers to using assessment to inform treatment. Researchers interviewed three care coordinators and two clinicians to develop interventions to improve the workflow process and drive better outcomes for youth in foster care.CDM Wurst, C., Chen, H-Y. W., Sage, M., Joseph, K., Maggiulli, L. (2022). Critical decision method interviews to understand the initial treatment planning process in foster care. Proceedings of the Human Factors Society Annual Meeting, 66, 1060-1064. https://doi.org/10.1177/1071181322661439.https://journals.sagepub.com/doi/10.1177/1071181322661439Yes
Intensive care decision-making: Identifying the challenges and generating solutions to improve inter-specialty referrals to critical careNicola Power2018Cognitive task analysis conducted to explore intensive care unit referral and admission decision-making. Researchers interviewed nine ICU consultants and six non-ICU consultants to identify core challenges, and possible solutions, to ICCU referral decisionsCDMHealth Care ICU consultantsPower, N., Plummer, N. R., Baldwin, J., James, F. R., & Laha, S. (2018). Intensive care decision-making: Identifying the challenges and generating solutions to improve inter-specialty referrals to critical care. Journal of the Intensive Care Society, 19(4), 287-298. https://doi.org/10.1177/1751143718758933https://journals.sagepub.com/doi/10.1177/1751143718758933No
Use of cognitive task analysis to understand decision making for management of blunt abdominal trauma in childrenT. Ahluwalia2018Cognitive task analysis conducted to outline expert clinical decision making process for the management of pediatric blunt abdominal injury.Not identifiedHealth CareTrainingAhluwalia, T., Toy, S., & Kennedy, C. (2018). Use of cognitive task analysis to understand decision making for management of blunt abdominal trauma in children. Annals of Emergency Medicine, 72(4; suppl.), S19. https://doi.org/10.1016/j.annemergmed.2018.08.044. https://doi.org/10.1016/j.annemergmed.2018.08.044No
Cognitive analyses of a paper medical record and electronic medical record on the documentation of two nursing tasks: Patient education and adherence assessment of insulin administration.Susan Marie Rinkus2002Cognitive task analysis conducted to generate comparative data between the paper medical record and the electronic medical record (eRecord) on the nursing documentation of selected tasks.Time-space; Hierarchical task analysis; GOMS; Distributed task analysis; Work flow analysisHealth CareNurseTechnology designRinkus, S. M. & Chitwood, A. (2002). Cognitive analyses of a paper medical record and electronic medical record on the documentation of two nursing tasks: Patient education and adherence assessment of insulin administration. Proceedings of the AMIA Annual Symposium, 657–661. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2244390/. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2244390/No
Eliciting and understanding primary care and specialist mental models of cirrhosis care: A cognitive task analysis studyTanya Barber2021Cognitive task analysis conducted to compare and identify differences in the mental models of cirrhosis care held by primary and specialty care physicians and nurse practitioners that may be addressed to improve coordination and transitions. Researchers interviewed 8 family physicians, 9 specialists, and 2 nurse practitioners to identify the challenges of cirrhosis care which included factors such as complexity of illness, lack of care coordination, clarity in roles and responsibilities, etc.Knowledge auditHealth CareFamily physicians; Specialty care physicians; Nurse practitionersOrganizational designBarber, T., Toon, L., Tandon, P., & Green, L. A. (2021). Eliciting and understanding primary care and specialist mental models of cirrhosis care: A cognitive task analysis study. Canadian Journal of Gastroenterology and Hepatology, 2021, 1-9. https://doi.org/10.1155/2021/5582297https://www.hindawi.com/journals/cjgh/2021/5582297/No
Cognitive task analysis of the laparoscopic totally extraperitoneal (TEP) inguinal hernia repair: Efficiency, slow-down moments and teaching principlesBenjamin Zendejas2011Cognitive task analysis conducted to discern the key cognitive and technical teaching principles. Researchers interviewed five expert laparoscopic totally extraperitoneal (TEP) surgeon to identify strategies to improve efficiency, discover critical operative cues and outline key teaching principles for the TEP repair to inform training. Not identifiedHealth CareSurgeonsTrainingZendejas, B., Peyre, S. E., Smink, D., Swain, J. M., Ramshaw, B., Smith, D., Ferzli, G., Farley, D. R. (2011). Cognitive task analysis of the laparoscopic totally extraperitoneal (TEP) inguinal hernia repair: Efficiency, slow-down moments and teaching principles. Journal of the American College of Surgeons, 213(3; Suppl.), S127. https://doi.org/10.1016/j.jamcollsurg.2011.06.304https://www.sciencedirect.com/science/article/abs/pii/S1072751511007149Yes
Developing decision support for cybersecurity threat and incident managersRick Van Der Kleij2022Cognitive task analysis conducted in tandem with cognitive work analysis to develop decision support for cybersecurity threat and incident managers in the financial sector. Researchers interviewed ten cyber defense center professionals from three different financial institutions to identify the main difficulties for cybersecurity threat and incident managers.ACTACyber security IT security; Programming; Digital forensics; and intelligence personnelTechnology design/Interface designKleij, R. V., Schraagen, J. M., Cadet, B., & Young, H. (2022). Developing decision support for cybersecurity threat and incident managers. Computer & Security, 113, 1-15. https://doi.org/10.1016/j.cose.2021.102535https://www.sciencedirect.com/science/article/pii/S016740482100359X#:~:text=The%20following%20seven%20process%20steps,the%20urgency%20for%20further%20investigations.Yes
Risk-based decision-making support model for offshore dynamic positioning operationsSandra Hogenboom2021Cognitive task analysis conducted to analyze how the different operational settings influence the role and decision-making of the dynamic positioning system. Researchers interviewed 12 SMEs to evaluate the current role of the dynamic positioning operators, in light of the dynamic positioning system and different operations to inform the design of the DP system and training.ACTA Dynamic positioning operatorsTraining/Technology designHogenboom, S., Vinnem, J. E., Utne, I. B., & Kongsvik, T. (2021). Risk-based decision-making support model for offshore dynamic positioning operations. Safety Science, 140, 1-14. https://doi.org/10.1016/j.ssci.2021.105280.https://www.sciencedirect.com/science/article/pii/S0925753521001259No
Do surgeons and gastroenterologists describe endoscopic retrograde cholangiopancreatography differently? A qualitative studyMargaret L. Boehler2016Cognitive task analysis conducted to explore the approach that surgeons and gastroenterologists use to train fellows to perform an endoscopic retrograde cholangiopancreatography (ERCP) as well as explain the differences in their respective training methods. Researchers interviewed seven gastroenterologists and four surgeons.Not identifiedHealth CareSurgeons; GastroenterologistsBoehler, M. L., Roberts, N., Sanfey, H., & Mellinger, J. (2016). Do surgeons and gastroenterologists describe endoscopic retrograde cholangiopancreatography differently? A qualitative study. Journal of Surgical Education, 73, 66-72. https://doi.org/10.1016/j.jsurg.2015.07.015https://www.sciencedirect.com/science/article/abs/pii/S1931720415002020Yes
The cognitive process of wildland fire chainsaw troubleshooting: Structure, content, and trainingElliot Nauert2019Cognitive task analysis conducted to examine the troubleshooting process of an expert wildland fire sawyer. Researcher interviewed one SME to highlight areas where training and job aids may be improved to support wildland firefighters in chainsaw troubleshooting.ACTAFirefightingFirefightersTraining/Technology design/Interface designNauert, E. & Gillan, D. (2019). The cognitive process of wildland fire chainsaw troubleshooting: Structure, content, and training. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63, 1676-1680. https://doi.org/10.1177/1071181319631536.https://journals.sagepub.com/doi/abs/10.1177/1071181319631536No
Expert knowledge elicitation in the firefighting domain and the implications for training novices.Justin Okoli2022Cognitive task analysis conducted to elicit the tacitly held knowledge and intuitive thought processes used while managing a range of complex, non-routine fire incidents. Researcher interviewed 31 experienced firefighters and identified a range of training needs as well as practical implications for transferring expert knowledge into learning tasks that could aid the cognitive development of novices.CDMFirefightingFirefightersTrainingOkoli, J. (2020). Expert knowledge elicitation in the firefighting domain and the implications for training novices. International Journal of Disaster Resilience in the Built Environment, 11(4), 577-578. http://dx.doi.org/10.1108/IJDRBE-09-2020-086https://www.emerald.com/insight/content/doi/10.1108/IJDRBE-09-2020-086/full/htmlNo
Identifying option awareness requirements for public health crisis decision makingMark S. Pfaff2015Cognitive task analysis conducted to uncover cognitive requirements for achieving option awareness, in addition to situation awareness, in complex and emergent decision-making scenarios. Researcher interviewed five SMEs and identified implications for the design of systems supporting decision making under high complexity and uncertainty as well as for training to accelerate the growth of novices into expert decision makers.ACTAHealth CarePublic health personnelTraining/Technology design/Interface designPfaff, M. S. (2015). Identifying option awareness requirements for public health crisis decision making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 548-552. https://doi.org/10.1177/1541931215591119.https://journals.sagepub.com/doi/10.1177/1541931215591119No
The art of effective handoff communication among medical and surgery residentsNicholas A. Rattray2021Cognitive task analysis conducted to understand resident physician handoffs with a focus on the moment-by-moment behaviors that constitute a transfer of duties, rights, and responsibilities known as end-of-shift handoff or handover. Researchers conducted observations of handoffs and/or interviewed 35 residents to inform more effective training of communication practices.CDMHealth CareResidentsTrainingRattray, N. A., Flanagan, M. E., Militello, L. G., Barach, P., & Frankel, R. M. (2021). The art of effective handoff communication among medical and surgery residents. Journal of Cognitive Engineering and Decision Making, 15(2-3). https://doi.org/10.1177/15553434211018296.https://www.researchgate.net/publication/352320052_The_Art_of_Effective_Handoff_Communication_Among_Medical_and_Surgery_ResidentsNo
Using SMEs during initial development of small UAS concept of operationsDavid E. Kancler2012Cognitive task analysis conducted to collect information and identify system specifications and requirements to better understand current small unmanned aircraft systems (SUAS) missions, capabilities, and expected payload (e.g., sensor or weapon) employments. Researchers interviewed nine experts within the UAS community including researchers and operators to inform the development of a concept of operations for use among government, state, and private sectors.CDM; Knowledge auditMilitaryUAS operators; UAS researchersKancler, D. E. & Malek, D. A. (2012). Using SMEs during initial development of small UAS concept of operations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 56, 2339-2343. https://doi.org/10.1177/1071181312561434.https://journals.sagepub.com/doi/abs/10.1177/1071181312561434?journalCode=proeYes
A multi-site cognitive task analysis for biomedical query mediationGregory W. Hruby2016Cognitive task analysis conducted to characterize the biomedical query mediation (BQM) processes for electronic health record data retrieval and develop a generic BQM process model. Researchers interviewed 11 data analysts to develop the BQM model and inform the standardization of the BQM process towards improved communication efficiency and accuracy.Not identifiedHealth CareData analystsHruby, G. W., Rasmussen, L. V., Hanauer, D., Patel, V. L., Cimino, J. J., & Weng, C. (2016). A multi-site cognitive task analysis for biomedical query mediation. International Journal of Medical Informatics, 93, 74-84. https://doi.org/10.1016/j.ijmedinf.2016.06.006. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4957698/No
Cognitive demands and mental workload: A filed study of the mining control room operators.Mostafa Mohammadian2022Cognitive task analysis conducted to investigate the cognitive demands and mental workload as well as the relationship between them among mining control room operators. Researchers interviewed six control room managers and eight control room operators to inform the reallocation of working-memory and problem-solving tasks to computer systems.Hierarchical task analysis; Concept mapping Geological miningControl room managers; Control room operators Organizational designMohammadian, M., Parsaei, H., Mokarami, H., & Kazemi, R. (2022). Cognitive demands and mental workload: A filed study of the mining control room operators. Heliyon, 8(2), 1-6. https://doi.org/10.1016/j.heliyon.2022.e08860.https://www.cell.com/heliyon/fulltext/S2405-8440(22)00148-7?_returnURL=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2405844022001487%3Fshowall%3DtrueNo
Development of a clinical interface for a novel newborn resuscitation device: Human factors approach to understanding cognitive user requirementsLaura Pickup2019Cognitive task analysis conducted to understand the requirements of the interface design for a novel medical device using a human factors approach. Researchers conducted simulation interviews with two SMEs in order to enable product developers to understand the preferred requirements of the user interface design for the device.ACTAHealth CareInterface designPickup, L., Lang, A., Shipley, L., Henry, C., Carpenter, J., McCartney, D., Butler, M., Hayes-Gill, B., & Sharkey, D. (2019). Development of a clinical interface for a novel newborn resuscitation device: Human factors approach to understanding cognitive user requirements. JMIR Human Factors, 6(2), 1-13. https://doi.org/10.2196/12055.https://humanfactors.jmir.org/2019/2/e12055No
A task analysis toward characterizing cyber-cognitive situation awareness (CCSA) in cyber defense analystsRobert S. Gutzwiller2016Cognitive task analysis conducted to determine the goals and identify key elements that information analysts must attend to during operations to guide their decision-making. Researchers interviewed seven cyber analysts to identify implications for new technologies such as automation of defensive capabilities and cyber visualizations.Knowledge audit; Concept mappingCyber securityCyber analystsGutzwiller, R. S., Hunt, S. M., & Lange, D. S. (2016). A task analysis toward characterizing cyber-cognitive situation awareness (CCSA) in cyber defense analysts. IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support. https://doi.org/10.1109/COGSIMA.2016.7497780.https://www.researchgate.net/profile/Robert-Gutzwiller/publication/291346566_Task_Analysis_toward_Characterizing_Cyber-Cognitive_Situation_Awareness_CCSA_in_Cyber_Defense_Analysts/links/59e63636a6fdcc0e88248117/Task-Analysis-toward-Characterizing-Cyber-Cognitive-Situation-Awareness-CCSA-in-Cyber-Defense-Analysts.pdfNo
Characterizing novice-expert differences in Macrocognition: An exploratory study of cognitive work in the emergency department.Christiane C. Schubert2013Cognitive task analysis conducted to elicit and document descriptions of emergency physician expertise, to characterize differences between novice and expert physicians, and to identify areas in which novices' skill and knowledge gaps are most pronounced. Researchers interviewed five interns and six attending physicians to inform the development of training protocols that facilitate the development of expertise in graduate medical educationsCDMHealth CarePhysicians; SurgeonsTrainingSchubert, C. C., Denmark, T. K., Crandall, B., Grome, A., & Pappas, J. (2013). Characterizing novice-expert differences in Macrocognition: An exploratory study of cognitive work in the emergency department. Annals of Emergency Medicine, 61, 96-109. https://doi.org/10.1016/j.annemergmed.2012.08.034.https://www.annemergmed.com/article/S0196-0644(12)01501-6/fulltextYes
Exceptional global leadership as cognitive expertise in the domain of global changeJoyce Osland2013Cognitive task analysis conducted in tandem with content analysis to identify how exceptional global leaders conceptualize their work contexts, approach their work, and develop their expertise. Researchers interviewed 20 individuals with experience in leadership roles including CEOs and VPs.ACTABusinessCEOs; COOs; EVP; VPs; Director of HR; Director of salesOsland, J., & Oddou, G., Bird, A., Osland, A. (2013). Exceptional global leadership as cognitive expertise in the domain of global change. European Journal of International Management, 7(5), 517-534. https://doi.org/10.1504/EJIM.2013.056475.https://www.researchgate.net/publication/264835844_Exceptional_global_leadership_as_cognitive_expertise_in_the_domain_of_global_changeNo
Sustaining "meaningful use" of health information technology in low-resource practicesLee A. Green2015Cognitive task analysis conducted as one of two projects to identify barriers to maintenance of meaningful use of EHRs in priority primary care practices.ACTAHealth CareGreen, L. A., Potworowski, G., Day, A., May-Gentile, R., Vibbert, D., Maki, B., & Kiesel, L. (2015). Sustaining "meaningful use" of health information technology in low-resource practices. Annals of Family Medicine, 13, 17-22. https://doi.org/10.1370/afm.1740.https://www.annfammed.org/content/13/1/17.shortNo
A description of nurses' decision-making in managing electrocardiographic monitor alarms.Priscilla K. Gazarian2014Cognitive task analysis conducted to explore nurses decision-making related to continuous ECG monitoring and the associated alarms. Researchers interviewed eight registered nurses to inform the development of learning experiences and inform policies to guide practice.CDMHealth CareRegistered nursesTrainingGazarian, P. K., Carrier, N., Cohen, R., Schram, H., & Shiromani, S. (2014). A description of nurses' decision-making in managing electrocardiographic monitor alarms. Journal of Clinical Nursing, 24(1-2), 151-159. https://doi.org/10.1111/jocn.12625. https://onlinelibrary.wiley.com/doi/abs/10.1111/jocn.12625Yes
Nurse manager cognitive decision-making amidst stress and work complexityMaria R. Shirey2012Cognitive task analysis conducted to provide insight into nurse manager cognitive decision-making amidst stress and work complexity. Researchers interviewed 21 nurse managers to identify implications for coaching and mentoring.CDMHealth CareNurse managersTrainingShirey, M. R., Ebright, P. R., & McDaniel, A. M. (2012). Nurse manager cognitive decision-making amidst stress and work complexity. Journal of Nursing Management, 21, 17-30. https://doi.org/10.1111/j.1365-2834.2012.01380.x.https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1365-2834.2012.01380.xNo
Strategies prescribers and pharmacists use to identify and mitigate adverse drug reactions in inpatient and outpatient care: A cognitive task analysis at a US veterans affairs medical center.Khoa A. Nguyen2021Cognitive task analysis conducted to develop a descriptive model of the cognitive processes used to identify and resolve adverse drug reactions from the perspectives of healthcare providers in order to inform future informatics efforts. Researchers interviewed ten physicians and ten pharmacists.CDMHealth CarePhysicians and PharmacistsNguyen, K. A., Militello, L. G., Ifeachor, A., Arthur, K. J., Glassman, P. A., Zillich, A. J., Weiner, M., Russ-Jara, A. L. (2021). Strategies prescribers and pharmacists use to identify and mitigate adverse drug reactions in inpatient and outpatient care: A cognitive task analysis at a US veterans affairs medical center. BMJ Open, 12, 1-9. https://doi.org/10.1136%2Fbmjopen-2021-052401.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8862429/No
Care coordination strategies and barriers during medication safety incidents: A qualitative, cognitive task analysisAlissa L. Russ-Jara2021Cognitive task analysis conducted to identify strategies that hospital and outpatient healthcare professionals use, and barriers encountered when they coordinate care during a medication safety incident involving an adverse drug reaction, drug-drug interactions, or drug-renal concern. Researchers conducted 12 interviewes with SMEs including physicians and pharmacists with implications for future efforts to enhance electronic health record designs for care coordination and to provide more formal guidance recaeding communication modalities.CDMHealth CarePhysicians and PharmacistsTraining/Technology designRuss-Jara, A. L., Luckhurts, C. L., Dismore, R. A., Arthur, K. J., Ifeachor, A. P., Militello, L. G., Glassman, P. A., Zillich, A. J., & Weiner, M. (2021). Care coordination strategies and barriers during medication safety incidents: A qualitative, cognitive task analysis. Journal of General Internal Medicine, 36(8), 2212-2220. https://doi.org/10.1007/s11606-020-06386-w.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8342616/No
Expert intraoperative judgement and decision-making: Defining the cognitive competencies for safe laparoscopic cholecystectomy.Amin Madani2015Cognitive task analysis conducted to define and characterize higher-order cognitive competencies required to safely perform a laparascopic cholecystectomy. Researchers interviewed ten surgeons to develop a framework that serves as the basis for instructional design, assessment tools, and quality-control metrics to prevent injuries and promote a culture of patient safety.Hierarchical task analysisHealth CareSurgeonsTrainingMadani, A., Watanabe, Y., Feldman, L. S., Vassiliou, M. C., Barkun, J. S., Fried, G. M., & Aggarwal, R. (2015). Expert intraoperative judgement and decision-making: Defining the cognitive competencies for safe laparoscopic cholecystectomy. Journal of the American College of Surgeon, 221(5), 931-940. https://doi.org/10.1016/j.jamcollsurg.2015.07.450.https://journals.lww.com/journalacs/Abstract/2015/11000/Expert_Intraoperative_Judgment_and.4.aspxYes
Comparative cognitive task analyses of experimental science and instructional laboratory coursesCarl Wieman2015This article describes a "self-CTA" conducted by a physicist to capture the cognitive activities associated with doing experimental research. The findings of this research is intended to inform the design of instructional activities.Not identifiedEducationPhysicistTrainingWieman, C. (2015). Comparative cognitive task analyses of experimental science and instructional laboratory courses. The Physics Teacher, 53(6), 349-351. https://doi.org/10.1119/1.4928349.https://cwsei.ubc.ca/sites/default/files/cwsei/outcomes/SEIresearch/Wieman_CTA_PT2015.pdfNo

Articles describing how to do CTA

TitleLead AuthorYearGistMethodsDomainSubDomainApplicationFull referenceLink to PDFPaywall
Cognitive task analysis-based training: A meta-analysis of studies.Colby Tofel-Grehl2013This research effort examines the overall effectiveness of cognitive task analysis across studies, domains, and practitioners in relation to other means of identifying and representing instructional content. CDM; PARIMilitary, Government, Academic/university, Health Care, Industry TrainingTofel-Grehl, C. & Feldon, D. F. (2013). Cognitive task analysis-based training: A meta-analysis of studies. Journal of Cognitive Engineering and Decision Making, 7(3), 293-304. https://doi.org/10.1177/1555343412474821. https://journals.sagepub.com/doi/10.1177/1555343412474821No
The use of cognitive task analysis in clinical and health services research: A systematic reviewLizzie Swaby2022This research effort offers a systematic review of the use of cognitive task analysis methods in understanding expert clinical decision-making.CDM; Hierarchical task analysis; task knowledge structures; Think-aloud exercises; Team knowledge audit; Timeline analysis; Systematic Human Error Reduction and Prediction Approach (SHERPA); CPPHealth CareClinicians Swaby, L., Shu, P., Hind, D., & Sutherland, K. (2022). The use of cognitive task analysis in clinical and health services research: A systematic review. Pilot Feasibility Studies, 8, 1-10. https://doi.org/10.1186/s40814-022-01002-6. https://pilotfeasibilitystudies.biomedcentral.com/articles/10.1186/s40814-022-01002-6#citeasNo
Cognitive task analysis: Bringing Olympic athlete style training to surgical education.Laura R. Wingfield2014This research effort provides an overview of evidence on cognitive task analysis as a surgical training method and determine if cognitive task analysis improves surgeon performance in both technical and non-technical skills. Health CareResidents, Medical students, Surgeons, and Surgical InternsTrainingWingfield, L. R., Kulendran, M., Chow, A., Nehme, J., & Purkayastha, S. (2014). Cognitive task analysis: Bringing Olympic athlete style training to surgical education. Surgical Innovation, 22(4), 406-417. https://doi.org/10.1177/1553350614556364.https://journals.sagepub.com/doi/10.1177/1553350614556364No
Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis.Robert R. Hoffman1998This research effort explores the critical decision method as an approach to cognitive task analysis. The authors offer insight into the theory and origins of the critical decision method and discuss many different applications of this method.CDM Hoffman, R. R., Crandall, B., & Shadbolt, N. (1998). Use of the Critical Decision Method to Elicit Expert Knowledge: A Case Study in the Methodology of Cognitive Task Analysis. Human Factors, 40(2), 254–276. https://doi.org/10.1518/001872098779480442https://journals.sagepub.com/doi/abs/10.1518/001872098779480442No
The cognitive task analysis methods for job and task design: Review and appraisal.June Wei2007 This research effort reviews current research on cognitive task analysis methodology for job or task design and analysis. In addition, the authors describe a validated human-centered information processing model for cognitive task performance developed based on this review of the literature. Organizational designWei, J. & Salvendy, G. (2007). The cognitive task analysis methods for job and task design: Review and appraisal. Behavior and Information Technology, 23(4), 273-299. https://doi.org/10.1080/01449290410001673036. https://www.tandfonline.com/doi/full/10.1080/01449290410001673036?scroll=top&needAccess=true&role=tabYes
Applied cognitive task analysis (ACTA): A practitioner's toolkit for understanding cognitive task demands.Laura G. Militello1998This article proposes a streamlined method of cognitive task analysis, ACTA, which consists of three interview methods for extracting the cognitive demands and skills required for a task. This cognitive task analysis method also supports representing the information into a form that more easily translates to applied products such as interface recommendations.ACTA Militello, L. G. & Hutton, R. J. B. (1998). Applied cognitive task analysis (ACTA): A practitioner's toolkit for understanding cognitive task demands. Ergonomics, 41(11), 1618-1641. https://doi.org/10.1080/001401398186108.https://www.academia.edu/download/6172042/10.1.1.89.4503.pdfNo
Cognitive simulation as a tool for cognitive task analysis.Emilie M. Roth1992This article proposes the use of cognitive simulations that represent models of human cognitive activities to clarify cognitive demands as part of a cognitive task analysis.Cognitive Environment Simulation (CES)Nuclear Power Roth, E. M., Woods, D. D., & Pople, H. E., Jr. (1992). Cognitive simulation as a tool for cognitive task analysis. Ergonomics, 35(10), 1163-1198. https://doi.org/10.1080/00140139208967389. https://www.researchgate.net/publication/21638297_Cognitive_Simulation_as_a_Tool_for_Cognitive_Tasks_AnalysisNo
A comparison of two tools for cognitive task analysis: Concept mapping and the critical decision method.Marvin L. Thordsen1991This article offers a description and comparison of two cognitive task analysis knowledge elicitation methods: concept mapping and the critical decision method. The author defines each method individually and then discusses the use of both techniques in tandem to effectively generate recommendations for training and display design.CDM; Concept mapping Thordsen, M. L. (1991). A comparison of two tools for cognitive task analysis: Concept mapping and the critical decision method.. Proceedings of the Human Factors Society Annual Meeting, 35(5), 283–285. https://doi.org/10.1177/154193129103500509.https://journals.sagepub.com/doi/abs/10.1177/154193129103500509No
Integrating cognitive task analysis into instructional systems developmentJoan M. Ryder1993This article reviews developments in cognitive task analysis and the Integrated Task Analysis Model (ITAM) which is a framework for integrating cognitive and behavioral task methods into the instructional systems development model.CDM Training/Technology designRyder, J. M. & Redding, R. E. (1993). Integrating cognitive task analysis into instructional systems development. Educational Technology Research and Development, 41(2), 75-96. https://doi.org/10.1007/BF02297312.https://link.springer.com/article/10.1007/BF02297312#citeasYes
Using cognitive task analysis to define human interface requirements for first-of-a-kind systems.Emilie M. Roth1995This article presents a cognitive task analysis technique used in the design of new person-machine interfaces for first-of-a-kind advanced process control plants. Protocol analysis Interface designRoth, E. M. & Mumaw, R. J. (1995). Using cognitive task analysis to define human interface requirements for first-of-a-kind systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(9), 520-524. https://doi.org/10.1177/154193129503900918. https://journals.sagepub.com/doi/abs/10.1177/154193129503900918No
Protocols for cognitive task analysisRobert R. Hoffman2005This report presents guidance, including sample forms and instructions for conducting a variety of cognitive task analysis and cognitive field research methods including both knowledge elicitation and knowledge modeling procedures with a proven track record of utility in service of expertise studies and the design of new technologies.Protocol analysis; CDM; Work patterns observations; and Goal-directed task analysis Technology designHoffman, R. R. (2005). Protocols for cognitive task analysis (Report No. ADA475456). Florida Institute for Human and Machine Cognition Inc. https://apps.dtic.mil/sti/citations/ADA475456.https://apps.dtic.mil/sti/citations/ADA475456No
Uncovering the requirements of cognitive workEmilie M. Roth2008This article provides an overview of cognitive task analysis and cognitive work analysis methods as well as how they can be used to inform system analysis and design. ACTA; Goal-directed task analysis; Critical incident analysis; Concept mapping; Psychological scaling; Cognitive field observation; CDM Training/Technology design/Interface DesignRoth, E. M. (2008). Uncovering the requirements of cognitive work. Journal of the Human Factors and Ergonomics Society, 50(3), 475-480. https://doi.org/10.1518/001872008X288556.https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=9114ebf6d26566ddc88487923f061734545159f6No
A procedural guide to cognitive task analysis: The PARI methodologyEllen P. Hall1995This report describes the cognitive task analysis technique Precursor, Action, Result, and Interpretation (PARI) methodologyPARI; GOMS Hall, E. P., Gott, S. E., & Pokorny, R. A. (1995). A procedural guide to cognitive task analysis: The PARI methodology (Report No. ADA303654). Armstrong Lab Brooks Air Force Base Human Resources Directorate. https://apps.dtic.mil/sti/citations/ADA303654.https://apps.dtic.mil/sti/citations/ADA303654No
Using cognitive task analysis to train orthopedic surgeons: Is it time to think differently? A systematic reviewKaram Ahmad2020This report offers a systematic review to analyze whether cognitive task analysis is beneficial to train novice surgeons in common orthopedic and trauma procedures.Health CareSurgeonsTrainingAhmad, K., Bhattacharyya, R., & Gupte, C. (2020). Using cognitive task analysis to train orthopedic surgeons: Is it time to think differently? A systematic review. Annals of Medicine and Surgery, 59, 131-137. https://doi-org.wrs.idm.oclc.org/10.1016/j.amsu.2020.09.031.https://www-sciencedirect-com.wrs.idm.oclc.org/science/article/pii/S2049080120303368No
Cognitive task analysis for trainingRichard E. Clark1996This article provides a comprehensive overview of cognitive task analysis and its utility in the changing world of work. Furthermore, the authors offer a description of several cognitive task analysis methods including GOMS and PARI as well as lists many of the practical issues and considerations associated with conducting cognitive task analysis.GOMS; PARI TrainingClark, R. E. & Estes, F. (1996). Cognitive task analysis for training. International Journal of Educational Research, 25(5), 403-417. https://doi.org/10.1016/S0883-0355(97)81235-9.https://www.researchgate.net/profile/Richard-Clark-27/publication/222502995_Cognitive_task_analysis/links/5ceb37eea6fdccc9ddd22824/Cognitive-task-analysis.pdfNo
The value added by cognitive task analysisGary Klein1995This article describes the cognitive task analysis methodology. Specifically, it describes the five common steps of cognitive task analysis as well as some applications.ACTA Klein, G. (1995). The value added by cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society, 39(9), 530-533. https://doi.org/10.1177/154193129503900920https://journals.sagepub.com/doi/10.1177/154193129503900920Yes
Comparing, merging, and adapting methods of cognitive task analysisRobert R. Hoffman2009This article offers a comprehensive discussion of the types of cognitive task analysis methods combined or merged, discusses rationale for selecting CTA methods, etc. Hoffman, R. R., Adams, J. A., Bisantz, A., Donmex, B., Kaber, D., & Roth, E. (2009). Comparing, merging, and adapting methods of cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 53(4), 187-191. https://doi.org/10.1177/154193120905300406.https://journals.sagepub.com/doi/abs/10.1177/154193120905300406Yes
Tailoring cognitive task analysis (CTA) methods for use in health careLaura Militello2014This article reflects on strategies for tailoring cognitive task analysis methods for use in healthcare settings, highlights challenges to conducting CTA in healthcare settings, and highlights important contributions of CTA in addressing challenging issues in healthcare.CDMHealth CareMilitello, L., Dominquez, C., Ebright, P., Moon, B., Russ, A., & Weir, C. (2014). Tailoring cognitive task analysis (CTA) methods for use in healthcare. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 758-762. https://doi.org/10.1177/1541931214581138https://journals.sagepub.com/doi/10.1177/1541931214581138Yes
Taking cognitive task analysis into the field: Bridging the gap from research to applicationRichard E. Redding1990This article discusses the potential of cognitive task analysis as well as the practicality problem including how these methods can receive widespread application among training practitioners and how to transition theory and research into mainstream training development programs TrainingRedding, R. E. (1990). Taking cognitive task analysis into the field: Bridging the gap from research to application. Proceedings of the Human Factors Society Annual Meeting, 34(18), 1304-1308. https://doi.org/10.1177/154193129003401801https://journals.sagepub.com/doi/10.1177/154193129003401801Yes
Critical decision method for eliciting knowledgeGary Klein1989A critical decision method for modeling tasks in naturalistic environments characterized by high time pressure, high information content, and changing conditions. Additionally, this work describes the theoretical background for this methodology, the instruments and procedures for implementation, and candidate applications of this method.CDM Klein, G. A., Calderwood, R., & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19(3), 462-472. doi: 10.1109/21.31053.https://ieeexplore.ieee.org/abstract/document/31053/authors#authorsYes
Efficient cognitive task analysis: Using experts' critiques to acquire expertise.Robert A. Pokorny1998Conducting cognitive task analysis may be difficult and time consuming. As such, the author proposes tasking experts with reviewing and critiquing samples of worker performance which has two benefits: describing knowledge that is applicable to good performance, and specifying knowledge that distinguishes poor performers from better performers. Pokorny, R. A. (1998). Efficient cognitive task analysis: Using experts’ critiques to acquire expertise. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(23), 1607–1607. https://doi.org/10.1177/154193129804202316https://journals.sagepub.com/doi/10.1177/154193129804202316?icid=int.sj-abstract.similar-articles.3No
Analyzing the cognitive demands of problem solving environments: An approach to cognitive task analysisEmilie M. Roth1990This article describes an approach to cognitive task analysis utilizing two analyses: a model of the cognitive environment and a performance model. The authors describe the former as focused on building a description of the cognitive demands of the world that any intelligent agent deals with, and the latter as an empirical investigation of how practitioners respond to task demands. Roth, E. M. & Woods, D. D. (1990). Analyzing the cognitive demands of problem solving environments: An approach to cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society, 34(8), 1314-1317. https://doi.org/10.1177/154193129003401803https://journals.sagepub.com/doi/abs/10.1177/154193129003401803?journalCode=probYes
The development of cognitive task analysis methods to aid interface designM. Ephimia Morphew1998This article illustrates how the application of cognitive task analysis methods and decision-centered design can be used to uncover and aid the cognitive processes involved with operating complex systems, and in turn, enhance human performance in complex systems. Interface designMorphew, M. E., Thordsen, M. L., & Klein, G. (1998). The development of cognitive task analysis methods to aid interface design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(3), 305-309. https://doi.org/10.1177/154193129804200326. https://journals.sagepub.com/doi/abs/10.1177/154193129804200326Yes
Using a knowledge elicitation method to specify the business model of a human factors organizationJan M. Schraagen2009This article illustrates the use of concept mapping as a novel method of cognitive task analysis to structure knowledge elicitation interviews with a group of a human factors specialists whose goal was to describe the business model of the department.Concept mapping Schraagen, J. M., DeVen, J. V., Hoffman, R. R., & Moon, B. M. (2009). Using a knowledge elicitation method to specify the business model of a human factors organization. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 53(4), 309-313.https://www.researchgate.net/publication/249956297_Using_a_Knowledge_Elicitation_Method_to_Specify_the_Business_Model_of_a_Human_Factors_OrganizationNo
Team CTA applications and methodologiesDavid Klinger1998This article describes the Team CTA methodology for gathering information about the way a team makes decisions and the way it manages itself. Klinger, D. & Thordsen, M. (1998). Team CTA applications and methodologies. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(3), 206-209. https://doi.org/10.1177/154193129804200305.https://journals.sagepub.com/doi/abs/10.1177/154193129804200305Yes
An empirical comparison of methods for eliciting and modeling expert knowledgeRobert R. Hoffman2002This article discusses the application of a variety of cognitive task analysis methods and cognitive field research to support a complete process from knowledge elicitation to leverage point identification and then to system prototyping. Researchers also offer an empirical comparison and evaluation of the CTA methods.Military Naval weather forecastersHoffman, R. R., Coffey, J. W., Carnot, M. J., & Novak, J. D. (2002). An empirical comparison of methods for eliciting and modeling expert knowledge. Proceedings of the Human Factors and Ergonomics Society Annual meeting, 46(3), 482-486. https://doi.org/10.1177/154193120204600356.https://journals.sagepub.com/doi/10.1177/154193120204600356Yes
Cognitive task analysis using complementary elicitation methodsSallie E. Gordon1995This article describes a complementary method of knowledge elicitation for cognitive task analysis that relies on the successive use of document analysis, interviews, task observation, and induction based on review of task performance. Gordon, S. E. (1995). Cognitive task analysis using complementary elicitation methods. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(9), 525-529. https://doi.org/10.1177/154193129503900919.https://journals.sagepub.com/doi/abs/10.1177/154193129503900919Yes
Using cognitive task analysis to build a cognitive modelGary Klein2000This article discusses how cognitive task analysis methods can be used to build cognitive models, particularly models that are useful in applied projects, such as system development efforts, rather than basic research efforts where the model is the intended output. Klein, G. (2000). Using cognitive task analysis to build a cognitive model. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 44(6), 596-599. https://doi.org/10.1177/154193120004400614https://journals.sagepub.com/doi/abs/10.1177/154193120004400614?journalCode=proeYes
Using cognitive task analysis to facilitate collaboration in development of simulator to accelerate surgical trainingTiffany Grunwald2004This article describes the use of cognitive task analysis as well as a framework with which to look at a surgical procedure and develop technology that will complement the educational and cognitive goals of the user.Health CareTechnology designGrunwald, T., Clark, D., Fisher, S. S., McLaughlin, M., Narayanan, S., & Piepol, D. (2004). Using cognitive task analysis to facilitate collaboration in development of simulator to accelerate surgical training. Studies in Health Technology and Informatics, 98, 114-120.https://www.researchgate.net/publication/8183272_Using_cognitive_task_analysis_to_facilitate_collaboration_in_development_of_simulator_to_accelerate_surgical_trainingNo
Leveling up: Using the tracer method to address training needs for esports players.Kaitlyn M. Roose2021This article describes the "Tracer Method" which combines the critical decision method with eye tracking to map multiple types of decision making activities to visual search behaviors to improve acquisition of expertise. Researchers collected eye tracking data for and conducted interviews with 25 experienced esports players to: a) identify critical decisions from a competitive game across a group of players to provide a range of training decisions and b) demonstrate the usefulness of the Tracer Method in an esport context with implications for the application to other domains.CDMEsportsProfessional esports playersTrainingRoose, K. M. & Veinott, E. S. (2021). Leveling up: Using the tracer method to address training needs for esports players. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 64, 1780-1784. https://doi.org/10.1177/1071181320641430.https://journals.sagepub.com/doi/abs/10.1177/1071181320641430Yes
The critical decision audit: Blending the critical decision method & the knowledge auditJoseph Borders2017This article proposes a hybrid cognitive task analysis approach that merges the critical decision method and the knowledge audit to streamline the collection of critical incidents and uncover characteristics of expertise. Borders, J. & Klein, G. (2017). The critical decision audit: Blending the critical decision method & the knowledge audit. Proceedings of the Bi-Annual International Conference on Naturalistic Decision Making, 33-39.https://www.researchgate.net/profile/Julie-Gore/publication/320146441_Naturalistic_Decision_Making_and_Uncertainty_Proceedings_of_the_13th_Bi-Annual_Naturalistic_Decision_Making_Conference_University_of_Bath_UK/links/59d0aeb30f7e9b4fd7f9fcbf/Naturalistic-Decision-Making-and-Uncertainty-Proceedings-of-the-13th-Bi-Annual-Naturalistic-Decision-Making-Conference-University-of-Bath-UK.pdf#page=44No