NDM Tools
Through its scientific and applied endeavors, the NDM community has generated many tools, including methods, models, guidance, and research supports. Some of the tools are available as Courses.
This list is not intended to be comprehensive. The NDMA is seeking ideas and resources for developing this tool box – send recommendations and/or links for other NDM tools to: info@naturalisticdecisionmaking.org.
These NDM community members contributed to the list: Cindy Dominguez, Julie Gore, Robert Hoffman, Devorah Klein, Gary Klein, Laura Militello, Brian Moon, Emilie Roth, Jan Maarten Schraagen, and Neelam Naikar. Adam Zaremsky added the short descriptors and references.
Table of Contents
Articles citing use of CTA
Title | Lead Author | Year | Gist | Specific Methods | Domain | SubDomain | Application | Full reference | Link to Online Source | Paywall |
---|---|---|---|---|---|---|---|---|---|---|
A cognitive-task analysis informed central venous catheter placement curriculum | Maura E. Sullivan | 2012 | Cognitive task analysis conducted with six SMEs to capture the underlying knowledge and skill experts use to place a central venous catheter. This effort informed the development and implementation of curriculum to teach and assess competency in central line placement. | Not identified | Health Care | Interventional radiologist OR general surgeon | Training | Sullivan, M., Sullivan, M., Baker, C., Talving, P., & Inaba, K. (2012). A cognitive-task analysis informed central venous catheter placement curriculum. MedEdPORTAL, 8. https://doi.org/10.15766/mep_2374-8265.9135. | https://www.mededportal.org/doi/10.15766/mep_2374-8265.9135 | No |
Understanding the cognitive demands, skills, and assessment approaches for endotracheal intubation: Cognitive task analysis | Taylor Kunkes | 2021 | Proper airway management, specifically endotracheal intubation, is an essential skill for hospital personnel and rescue services to learn. This research effort applied cognitive task analysis to endotracheal intubation to capture the task and training requirements from the perspective of multiple medical specialties. | Hierarchical task analysis | Health Care | Anesthesiologists, emergency medicine physicians, and paramedics | Training | Kunkes, T., Makled, B., Norfleet, J., Schwaitzberg, S., & Cavuoto, L. (2021). Understanding the cognitive demands, skills, and assessment approaches for endotracheal intubation: Cognitive task analysis. JMIR Perioperative Medicine, 5, 1-12. https://doi.org/10.2196/34522. | https://periop.jmir.org/2022/1/e34522 | No |
The use of cognitive task analysis to reveal the instructional limitations of experts in the teaching of procedural skills. | Maura E. Sullivan | 2014 | Cognitive task analysis conducted to investigate the percentage of knowledge experts omit when teaching a cricothyrotomy to determine the percentage of additional knowledge gained during a cognitive task analysis interview. Researchers recorded three trauma surgeons teaching an open cricothyrotomy procedure and then use cognitive task analysis methods to interview each expert for the same procedure to capture the percent of steps omitted while describing a procedure. | Clark’s Concepts, Process, and Principles (CPP) approach | Health Care | Trauma surgeons | Training | Sullivan, M., Yates, K. A., Inaba, K., Lam, L., & Clark, R. E. (2014). The use of cognitive task analysis to reveal the instructional limitations of experts in the teaching of procedural skills. Academic Medicine, 89(5), 811-816. DOI: 10.1097/ACM.0000000000000224. | https://journals.lww.com/academicmedicine/Fulltext/2014/05000/The_Use_of_Cognitive_Task_Analysis_to_Reveal_the.33.aspx?casa_token=VjnV560WISAAAAAA:t_ZY3MhBR-3PlMtH3UtWvy0AIGpkK62ud_TaPBYJQhUhkCrHKdEDkw_w903FAsaxaz4Vom33ztWGxstDA0ZWAeU | No |
A cognitive task analysis of coordination in a distributed tactical team: Implications for expertise acquisition | Kelly Neville | 2003 | Cognitive task analysis conducted to examine expertise and experience related differences associated with achieving coordination in large distributed teams. Researchers elicited experiences from 12 naval flight officers with varying levels of experience using knowledge elicitation sessions. | CDM | Military | Naval flight officers (radar operators, air control officers, combat information center officers, & instructor combat information center officers) | Training/Technology design | Neville, K., Fowlkes, J. E., Walwanis Nelson, M. M., Bergondy-Wilhelm, M. L. (2003). A cognitive task analysis of coordination in a distributed tactical team: Implications for expertise acquisition. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 47(3), 359-363. https://doi.org/10.1177/154193120304700323. | https://journals.sagepub.com/doi/10.1177/154193120304700323?icid=int.sj-abstract.similar-articles.3 | No |
Cognitive task analysis and intelligent computer-based training systems: Lessons learned from coached practice environments in Air Force avionics | Sandra Katz | 1997 | Cognitive task analysis conducted to inform the instructional content and approach of three training systems for Air Force aircraft maintenance as well as how the results are leveraged as features of one of the three training systems. Researchers describe the types of information that a cognitive task analysis can provide to developers of coached practice environments and illustrate the efficiency of this training across novices and master technicians. | Precursor (goal), Action, Result, Interpretation (PARI) | Military | Manual avionics test station technicians | Training/Technology design | Katz, S. N., Hall, E., & Lesgold, A. (1997). Cognitive task analysis and intelligent computer-based training systems: Lessons learned from coached practice environments in Air Force avionics (ED411309). ERIC. https://eric.ed.gov/?id=ED411309. | https://eric.ed.gov/?id=ED411309 | No |
Cognitive task analysis of the battalion level visualization process. | Dennis K. Leedom | 2007 | Cognitive task analysis conducted to identify important skill areas associate with visualization at the battalion level of command to inform instructional design. Researchers interviewed 25 military officers to investigate their real-world experiences with visualizing the battlefield. | Not identified | Military | Battalion operations officer; Executive officers | Training | Leedom, D. K., McElroy, W., Shadrick, S. B., Lickteig, C., Pokorny, R. A., Haynes, J. A., & Bell, J. (2007). Cognitive task analysis of the battalion level visualization process (Report No. ADA474884). Evidence Based Research Inc. https://apps.dtic.mil/sti/citations/ADA474884. | https://apps.dtic.mil/sti/citations/ADA474884 | No |
Forecasters' cognitive task analysis and mental workload analysis of issuing probabilistic hazard information (PHI) during FACETs PHI prototype experiment. | Joseph J. J. James | 2020 | Cognitive task analysis conducted with nine national weather service forecasters to evaluate the probabilistic hazard information (PHI) object ability to communicate accurate and timely information regarding specific meteorological threats. | Hierarchical task analysis | Government (weather) | National weather service forecasters | Technology design/Interface design | James, J. J., Ling, C., Karstens, C. D., Correia, J., Calhoun, K., Meyer, T., & LaDue, D. (2020). Forecasters' cognitive task analysis and mental workload analysis of issuing probabilistic hazard information (PHI) during FACETs PHI prototype experiment. Weather and Forecasting, 38, 1505-1521. https://doi.org/10.1175/WAF-D-19-0194.1. | https://journals.ametsoc.org/configurable/content/journals$002fwefo$002f35$002f4$002fwafD190194.xml?t:ac=journals%24002fwefo%24002f35%24002f4%24002fwafD190194.xml | No |
Training surgeons to perform arthroscopic all-inside meniscal repair: A randomized controlled trial evaluating the effectiveness of a novel cognitive task analysis teaching tool, Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA) | Urvi Karamchandani | 2021 | There are currently no standardized techniques for training residents in all-inside meniscal repair of meniscal tears. Researchers interviewed three knee surgeons to inform the design and eventual evaluation of a digital cognitive task analysis teaching tool to standardize this procedure. | Modified Delphi technique | Health Care | Orthopedic surgeons | Training | Karamchandani, U., Bhattacharyya, R., Patel, R., Oussedik, S., Bhattacharya, R., & Gupte, C. (2021). Training surgeons to perform arthroscopic all-inside meniscal repair: A randomized controlled trial evaluating the effectiveness of a novel cognitive task analysis teaching tool, Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA). American Journal of Sports Medicine, 49(9), 2341-2350. doi: 10.1177/03635465211021652. | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8283189/. | No |
Primary care physicians' use of an electronic medical record system: A cognitive task analysis | Aviv Shackak | 2009 | Cognitive task analysis conducted to describe physicians' patterns of using an electronic medical record; reveal underlying cognitive elements, possible errors, and influences on patient-doctor communication; and understand the role of expertise in incorporating EMRs into clinical practice. Researchers conducted interviews/observations with 25 primary care physicians to capture the benefits and risks associated with using an electronic medical record. | ACTA | Health Care | Physicians | Technology design | Shackak, A., Hadas-Dayagi, M., Zix, A., & Reis, S. (2009). Primary care physicians' use of an electronic medical record system: A cognitive task analysis. Journal of General Internal Medicine, 24(3), 341-348. doi: 10.1007/s11606-008-0892-6. | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2642564/ | No |
Cognitive task analysis of expertise in air traffic control. | Thomas L. Seamster | 1993 | Cognitive task analysis conducted with 18 air traffic controllers to analyze the knowledge structures, mental models, skills, and strategies of en route controllers to provide an understanding of the key cognitive components of an air traffic controller's job. | Not identified | Commercial Aviation | Air traffic controllers | Training | Seamster, T. L., Redding, R. E., Cannon, J. R., Ryder, J. M., & Purcell, J. A. (1993). Cognitive task analysis of expertise in air traffic control. International Journal of Aviation Psychology, 3(4), 257-283. https://doi.org/10.1207/s15327108ijap0304_2. | https://www.tandfonline.com/doi/abs/10.1207/s15327108ijap0304_2 | Yes |
Achieving cyber defense situational awareness: A cognitive task analysis of information assurance analysts. | Anita D' Amico | 2005 | Cognitive task analysis conducted to investigate the workflow, decision processes, and cognitive demands of information assurance analysts. Researchers interviewed or conducted observations with 41 information assurance analysts to understand the processes, skills, and tools these experts use to achieve situation awareness as well as the cognitive challenges that impede situation awareness. | *Bootstrap methods* | Government (cyber) | Information assurance analysts | Technology design/Interface design | D'Amico, A., Whitley, K., Tesone, D., O'Brien, B., & Roth, E. (2005). Achieving cyber defense situational awareness: A cognitive task analysis of information assurance analysts. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(3), 229-233. https://doi.org/10.1177/154193120504900304. | https://journals.sagepub.com/doi/10.1177/154193120504900304 | No |
Cognitive task analysis and innovation of training: The case of structured troubleshooting | Alma Schaafstal | 2000 | This article uses the results of preliminary cognitive task analysis observational studies in which researchers observed technicians problem-solving malfunctions in a radar system and a general purpose computer system. These preliminary studies informed the development of a streamlined method of training, Structured Troubleshooting. | *Bootstrap methods* | Military | Technicians | Training | Schaafstal, A., Schraagen, J. M., & van Berl, M. (2000). Cognitive task analysis and innovation of training: The case of structured troubleshooting. Human Factors, 42(1), 75–86. https://doi.org/10.1518/001872000779656570. | https://journals.sagepub.com/doi/abs/10.1518/001872000779656570 | No |
Critical care physician cognitive task analysis: An exploratory study | James C. Fackler | 2009 | Cognitive task analysis conducted to analyze key cognitive activities in critical care medicine and assess the usefulness of cognitive task analysis as an analytic tool for organizational design. Researchers interviewed 14 members of two intensive care units as well as conducted observations of the ICU staff to capture the cognitive activities associated with critical care. | CDM | Health Care | Physicians | Technology design | Fackler, J. C., Watts, C., Grome, A., Miller, T., Crandall, B., & Pronovost, P. (2009). Critical care physician cognitive task analysis: An exploratory study. Critical Care, 13, 1-8. https://doi.org/10.1186/cc7740. | https://link.springer.com/article/10.1186/cc7740#citeas | No |
A cognitive task analysis with implications for designing simulation-based performance assessment. | Robert J. Mislevy | 1999 | Cognitive task analysis conducted to capture the knowledge hygienists use when assessing patients, planning treatments, and monitoring progress; and elicit behaviors that manifest this knowledge. Researchers interviewed 31 subjects 11 of which were experts, used to draw implications for designing the proposed assessment tool. | Not identified | Health Care | Dental Hygienist | Training/Technology design | Mislevy, R. J., Steinberg, L. S., Breyer, F. J., Almond, R. G., & Johnson, L. (1999). A cognitive task analysis with implications for designing simulation-based performance assessment. Computers in Human Behavior, 15(4), 335-374. https://doi.org/10.1016/S0747-5632(99)00027-8. | https://files.eric.ed.gov/fulltext/ED428124.pdf | No |
Using cognitive task analysis to investigate the contribution of informal education to developing cyber security expertise. | Michael Champion | 2014 | Cognitive task analysis conducted, following administration of an online survey, to explore respondents' interaction with the cyber security field. Researchers interviewed 10 individuals with experience in the cyber security industry to capture education as well as informal activities of highly skilled and expert cyber security professionals. | Not identified | Cyber security/Information Technology | Training | Champion, M., Jariwala, S., Ward., P., & Cooke, N. J. (2014). Using cognitive task analysis to investigate the contribution of informal education to developing cyber security expertise. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 310-314. http://dx.doi.org/10.1177/1541931214581064. | https://www.researchgate.net/publication/271728349_Using_Cognitive_Task_Analysis_to_Investigate_the_Contribution_of_Informal_Education_to_Developing_Cyber_Security_Expertise | No | |
The use of cognitive task analysis to improve instructional descriptions of procedures. | Richard E. Clark | 2012 | Cognitive task analysis conducted in tandem with free recall and free recall with simulation to determine which method more accurately and completely captured descriptions of the procedure for inserting a femoral artery shunt. Researchers interviewed 10 expert trauma surgeons to elicit descriptions of how to perform an emergency shunt procedure. | CPP | Health Care | Trauma surgeons | Training | Clark, R. E., Pugh, C. M., Yates, K. E., Inaba, K., Green, D. J., & Sullivan, M. E. (2012). The use of cognitive task analysis to improve instructional descriptions of procedures. Journal of Surgical Research, 173, 37-42. https://doi.org/10.1016/j.jss.2011.09.003. | https://www.researchgate.net/profile/Kenneth-Yates/publication/51813870_The_Use_of_Cognitive_Task_Analysis_to_Improve_Instructional_Descriptions_of_Procedures/links/611ed71c1e95fe241ae30a1a/The-Use-of-Cognitive-Task-Analysis-to-Improve-Instructional-Descriptions-of-Procedures.pdf | No |
Using cognitive task analysis to identify critical decisions in the laparoscopic environment. | Curtis Craig | 2012 | Cognitive task analysis conducted to identify the critical decisions surgeons need to make regarding laparoscopic surgery, the information these decisions are based on, the strategies employed by surgeons to reach their objectives, and the difficulties experienced by novices. Researchers interviewed eight expert surgeons to capture the critical decisions made during a variety of laparoscopic procedures and identify their implications for training. | CDM | Health Care | Surgeons | Training | Craig, C., Klein, M. I., Griswold, J., Gaitonde, K., McGill, T., & Halldorsson, A. (2012). Using cognitive task analysis to identify critical decisions in the laparoscopic environment. Human Factors, 54(6), 1025–1039. https://doi.org/10.1177/0018720812448393. | https://journals.sagepub.com/doi/full/10.1177/0018720812448393 | No |
Assessing the teaching of procedural skills: Can cognitive task analysis add to our traditional teaching methods? | Maura E. Sullivan | 2008 | Cognitive task analysis conducted to determine if cognitive task analysis could capture steps and decision points that are not articulated during traditional teaching of a colonoscopy. Researchers videotaped SMEs teaching a colonoscopy, followed by a free recall session, and then a series of structured cognitive task analysis interviews to capture decisions that experts make during a colonoscopy procedure and highlight the difficult cognitive portions of the task. | Not identified | Health Care | Colorectal surgeons | Training | Sullivan, M. E., Ortega, A., Wasserberg, N., Kaufman, H., Nyquist, J., & Clark, R. (2008). Assessing the teaching of procedural skills: Can cognitive task analysis add to our traditional teaching methods? American Journal of Surgery, 195, 20-23. https://doi.org/10.1016/j.amjsurg.2007.08.051. | http://publishingimages.s3.amazonaws.com/eZineImages/PracticePerfect/729/Sullivan-assessing-the-teaching.pdf | No |
The use of a cognitive task analysis-based multimedia program to teach surgical decision making in flexor tendon repair. | Kali R. Luker | 2008 | Cognitive task analysis conducted to compare the surgical knowledge of residents before and after receiving a cognitive task analysis-based multimedia teaching module. Researchers interviewed three surgeons experienced in flexor tendon repair to document the technique for the procedure as well as the indications, contradictions, complications, and pitfalls related to flexor tendon repair that informed a new protocol. | Not identified | Health Care | Surgeons | Training | Luker, K. R., Sullivan, M. E., Peyre, S. E., Sherman, R. & Grunwald, T. (2008). The use of a cognitive task analysis-based multimedia program to teach surgical decision making in flexor tendon repair. American Journal of Surgery, 195, 11-15. https://doi.org/10.1016/j.amjsurg.2007.08.052 | https://www.sciencedirect.com/science/article/abs/pii/S0002961007008367 | Yes |
Using cognitive task analysis to facilitate the integration of decision support systems into the neonatal intensive care unit. | Gordon D. Baxter | 2005 | Cognitive task analysis conducted to identify the contextual factors within a neonatal intensive care unit that would affect the successful integration of the FLORENCE expert system designed to support staff in making decisions when treating babies with respiratory distress syndrome. Researchers interviewed 4 experts with 20+ years of experience and 4 personnel with fewer than 5 years experience to identify issues that could inform the development and deployment of the FLORENCE system. | CDM | Health Care | Consultants; Registrars, Senior nurses; and SHOs | Technology design | Baxter, G. D., Monk, A. F., Tan, K., Dear, P. R. F., & Newell, S. J. (2005). Using cognitive task analysis to facilitate the integration of decision support systems into the neonatal intensive care unit. Artificial Intelligence in Medicine, 35(3), 243-257. https://doi.org/10.1016/j.artmed.2005.01.004. | https://www.academia.edu/download/47373770/j.artmed.2005.01.00420160720-20579-ii2bwc.pdf | No |
A multi-phase network situational awareness cognitive task analysis. | Robert F. Erbacher | 2010 | Cognitive task analysis conducted to capture the processes, goals, concerns, and the data and metadata that network analysts analyze. Researchers interviewed six network managers and analysts to identify and requirements and challenges of the work to inform the generation of six scenarios used to elicit feedback from the experts as to their workflow and needs with respect to potential visualization activities. | Not identified | Cyber security/Information Technology | Network managers; Network analysts | Technology design/Interface design | Erbacher, R. F., Frincke, D. A., Wong, P. C., Moody, S., & Fink, G. (2010). A multi-phase network situational awareness cognitive task analysis. Information Visualization, 9(3), 204–219. https://doi.org/10.1057/ivs.2010.5 | https://journals.sagepub.com/doi/10.1057/ivs.2010.5 | Yes |
Utilization of a cognitive task analysis for laparoscopic appendectomy to identify differentiated intraoperative teaching objectives. | Douglas S. Smink | 2012 | Cognitive task analysis conducted to enable experts to articulate operative steps and cognitive decisions during an laparoscopic appendectomy, a complex procedure, to identify key teaching principles to guide intraoperative instruction. Researchers interviewed three expert surgeons with experience in this procedure to generate a list of operative steps and decision points and then identify intraoperative teaching objectives for junior and senior residents. | CDM | Health Care | Surgeons | Training | Smink, D. S., Peyre, S. E., Soybel, D. I., Tavakkolizadeh, A., Vernon, A. H., & Anastakis, D. J. (2012). Utilization of a cognitive task analysis for laparoscopic appendectomy to identify differentiated intraoperative teaching objectives. American Journal of Surgery, 203(4), 540-545. https://doi.org/10.1016/j.amjsurg.2011.11.002. | https://www.sciencedirect.com/science/article/abs/pii/S0002961012000074 | Yes |
Physical and cognitive task analysis in interventional radiology. | Sheena Johnson | 2006 | Cognitive task analysis conducted to identify, describe, and detail the cognitive thought processes, decision-making, and physical actions involved in the preparation and successful performance of core interventional radiology procedures. Researchers conducted observations to five common interventional radiology procedures as well as conducted individual interviews with consultant interventional radiologists. | Not identified | Health Care | Interventional radiologists | Training | Johnson, S., Healey, A., Evans, J., Murphy, M., Crawshaw, M., & Gould, D. (2006). Physical and cognitive task analysis in interventional radiology. Clinical Radiology, 61(1), 97–103. doi:10.1016/j.crad.2005.09.003 10.1016/j.crad.2005.09.003 | https://www.sciencedirect.com/science/article/abs/pii/S0009926005002825 | Yes |
A cognitive task analysis of information management strategies in a computerized provider order entry environment | Charlene R. Weir | 2007 | Cognitive task analysis conducted to explore the information management strategies that clinicians use in the process of adapting to a computerized provider order entry (CPOE) system. Researchers conducted observations and interviews with 88 primary-care clinicians to identify key information management goals, strategies, and tasks. | Goal-directed task analysis | Health Care | Primary-care clinicians | Knowledge management | Weir, C. R., Nebeker, J. J. R., Hicken, B. L., Campo, R., Drews, F., & Lebar, B. (2007). A cognitive task analysis of information management strategies in a computerized provider order entry environment. Journal of the American Medical Informatics Association, 14, 65-75. https://doi.org/10.1197/jamia.M2231. | https://academic.oup.com/jamia/article/14/1/65/747704 | No |
The effectiveness of a cognitive task analysis informed curriculum to increase self-efficacy and improve performance for an open cricothyrotomy | Julia Campbell | 2011 | Cognitive task analysis conducted to explore the effects of cognitive task analysis-informed curriculum to increase surgical skills performance and self-efficacy beliefs for medical students and postgraduate surgical residents learning how to perform an open cricothyrotomy. Researchers conducted interviews with six trauma surgeons to generate a list of major tasks associated with the procedure, analyzed the gold standard cognitive task analysis to identify critical decision points, and used this information to generate the curriculum overview and step-by-step actions and decisions required for the procedure. | CPP | Health Care | Medical Students | Training | Campbell, J., Tirapelle, L., Yates, K., Clark, R., Inaba, K., Green, D., Plurad, D., Lam, L., Tang, A., Cestero, R., & Sullivan, M. (2011). The effectiveness of a cognitive task analysis informed curriculum to increase self-efficacy and improve performance for an open cricothyrotomy. Journal of Surgical Education, 68(5), 403-407. https://doi.org/10.1016/j.jsurg.2011.05.007. | https://apps.dtic.mil/sti/pdfs/ADA575280.pdf | No |
The use of cognitive task analysis to improve the learning of percutaneous tracheostomy placement | Maura E. Sullivan | 2007 | Cognitive task analysis conducted to determine the effectiveness of these methods to develop curriculum to teach the behavioral skills and the cognitive strategies of a percutaneous tracheostomy (PT) placement. Researchers interviewed three experts to generate a task diagram, videotapes them performing a PT to gain insight into the decisions made during the procedure, formulated a cognitive requirements table, and then developed a curriculum that described PT placement step-by-step. | Not identified | Health Care | Medical Students | Training | Sullivan, M. E., Brown, C. V. R., Peyre, S. E., Salim, A., Martin, M., Towfigh, S., & Grunwald, T. (2007). The use of cognitive task analysis to improve the learning of percutaneous tracheostomy placement. American Journal of Surgery, 193, 96-99. https://doi.org/10.1016/j.amjsurg.2006.09.005. | https://www.sciencedirect.com/science/article/abs/pii/S0002961006006416 | Yes |
Investigating cognitive task difficulties and expert skills in e-learning storyboards using a cognitive task analysis technique | Nor'ain M. Yusoff | 2012 | Cognitive task analysis conducted to explore problem aspects of the cognitive task and the skills required of subject matter experts by applying the Applied Cognitive Task Analysis (ACTA) approach from the experts point of view. Researchers conducted the four phases of the ACTA methodology including with three SMEs: Task Diagram interviews to capture a broad overview of the task, knowledge audits to understand the skills, events, and strategies used, Simulations that address the difficult and challenging elements of the task, and a Cognitive Demand table to integrate the data from the previous four phases | ACTA | Education | Designers | Training | Yusoff, N. M. & Salim, S. S. (2012). Investigating cognitive task difficulties and expert skills in e-learning storyboards using a cognitive task analysis technique. Computers and Education, 58, 652-665. https://doi.org/10.1016/j.compedu.2011.09.009. | https://www.sciencedirect.com/science/article/abs/pii/S0360131511002260 | Yes |
Designing simulator-based training: An approach integrating cognitive task analysis and four component instructional design | Irene M. Tjiam | 2012 | Cognitive task analysis integrated with instructional design conducted to inform the design of simulator-based skill training for a nephrostomy procedure. Researchers asked four urologists to complete questionnaires to identify the main steps of the procedure before conducting semi-structured interviews with eight different urologists to capture the automatic and non-automatic substeps of a nephrostomy procedure. | Not identified | Health Care | Urologist | Training/Technology design | Tjiam, I. M., Schout, B. M. A., Hendrikx, A. J. M., Scherpbier, A. J. M., Witjes, J. A., & Van Merrienboer, J. J. G. (2012). Designing simulator-based training: An approach integrating cognitive task analysis and four component instructional design. Medical Teacher, 34(10), 698-707. https://doi.org/10.3109/0142159X.2012.687480. | https://www.tandfonline.com/doi/pdf/10.3109/0142159X.2012.687480 | No |
Cognitive task analysis for developing unmanned aerial vehicle wilderness search support | Julie A. Adams | 2009 | Cognitive task analysis conducted to understand the human-based wilderness search and rescue (WiSAR) response, viewed as a system, in order to determine how to develop UAV capabilities and incorporate the UAC into the response while mitigating the disruptive behaviors found during field trials. Researchers interviewed two Incident Commanders and one moderately experienced search volunteer from a country search and rescue division to inform the design decisions for the UAV autonomous algorithms, operator control interface, and necessary human roles and responsibilities. | Goal-directed task analysis | Search and Rescue | Incident Commanders | Technology design/Interface design | Adams, J. A., Humphrey, C. M., Goodrich, M. A., Cooper, J. L., Morse, B. S., Engh, C. & Rasmussen, N. (2009). Cognitive task analysis for developing unmanned aerial vehicle wilderness search support. Journal of Cognitive Engineering and Decision Making, 3, 1-26. https://doi.org/10.1518/155534309X431926. | https://www.researchgate.net/profile/Michael-Goodrich-2/publication/228644247_Cognitive_Task_Analysis_for_Developing_Unmanned_Aerial_Vehicle_Wilderness_Search_Support/links/0c96051ba2c2ece334000000/Cognitive-Task-Analysis-for-Developing-Unmanned-Aerial-Vehicle-Wilderness-Search-Support.pdf | No |
Integrated studies on the use of cognitive task analysis to capture surgical expertise for central venous catheter placement and open cricothyrotomy. | Kenneth Yates | 2012 | Cognitive task analysis conducted for two surgical procedures to determine: the extent the experts omitted critical information, the number of experts required to capture the optimal amount of information, and the effectiveness of a CTA-informed curriculum. Researchers conducted interviews with six physicians for a central venous catheter placement and open cricothyrotomy to inform the information put into training aids by capturing key decisions and procedural steps. | Not identified | Health Care | Physicians | Training | Yates, K., Sullivan, M., & Clark, R. (2012). Integrated studies on the use of cognitive task analysis to capture surgical expertise for central venous catheter placement and open cricothyrotomy. American Journal of Surgery, 203, 76-80. https://doi.org/10.1016/j.amjsurg.2011.07.011. | https://www.sciencedirect.com/science/article/abs/pii/S0002961011006180 | Yes |
Cognitive task analyses for decision centered design and training. | David O' Hare | 1998 | Three cognitive task analysis conducted to obtain information from expert white-water rafting guides and general aviation pilots, and to redesign the VDU display requirements for ambulance dispatchers. These three case studies are intended to demonstrate the utility of CDM to cognitive task analysis and provide guidance to practitioners applying CTA techniques. | CDM | 1: Raft Guides. 2: General Aviation Pilots. 3: Dispatchers | Training/Technology design/Interface design | O'Hare, D., Wiggins, M., Williams, A., & Wong, W. (1998). Cognitive task analyses for decision centered design and training. Ergonomics, 41(11), 1698-1718. https://doi.org/10.1080/001401398186144. | https://www.researchgate.net/profile/David-Ohare/publication/13466280_Cognitive_Task_Analyses_for_Decision_Centred_Design_and_Training/links/02e7e525313e793a52000000/Cognitive-Task-Analyses-for-Decision-Centred-Design-and-Training.pdf | No | |
Using cognitive task analysis to develop simulation-based training for medical tasks. | Jan Cannon-Bowers | 2013 | Cognitive task analysis conducted to generate training requirements, performance metrics, scenario requirements, and simulator/simulation requirements for medical tasks including cricothyroidotomy and hemorrhage control tasks. Researchers asked nine instructors to complete a think-aloud protocol while doing a procedure on an HPS and to imagine doing the procedure in a combat simulation. Finally, the participants were interviewed using specific probes to elicit critical cues for performance as well as asked questioned regarding the existing simulator and its differences from live tissue. | CDM | Health Care | Military Training Command Instructors | Training/Technology design | Cannon-Bowers, J., Bowers, C., Stout, R., Ricci, K., & Hildabrand, A. (2013). Using cognitive task analysis to develop simulation-based training for medical tasks. Military Medicine, 178(10), 15-21. https://doi.org/10.7205/MILMED-D-13-00211. | https://academic.oup.com/milmed/article/178/suppl_10/15/4344773 | No |
Provider management strategies of abnormal test result alerts: A cognitive task analysis. | Sylvia J. Hysong | 2010 | Cognitive task analysis conducted to evaluate how primary care providers manage alerts related to critical diagnostic test results on their EMR screens, and compare alert-management strategies of providers with high versus low rates of timely follow-up of results. Researchers interviewed 28 primary care providers regarding how they manage alerts, with a specific emphasis on the strategies used to filter alerts, reduce unnecessary alerts, and sort alerts for easier processing. | Not identified | Health Care | Primary-care clinicians | Training/Technology design/ Knowledge management | Hysong, S. J., Sawhney, M. K., Wilson, L., Sittig, D. F., Espadas, D., Davis, T., Singh, H. (2010). Provider management strategies of abnormal test result alerts: A cognitive task analysis. Journal of the American Medical Informatics Association, 17, 71–77. https://doi.org/10.1197/jamia.M3200. | https://academic.oup.com/jamia/article/17/1/71/705272. | No |
Translating expertise into effective instruction: The impacts of cognitive task analysis (CTA) on lab report quality and student retention in the biological sciences | David F. Feldon | 2010 | Cognitive task analysis conducted to test the effectiveness of CTA-based instruction for teaching undergraduate biology students to engage in the scientific process. Researchers interviewed three university biology faculty regarding the way he/she approached the scientific process. | Not identified | Education | Biology professors | Training | Feldon, D. F., Timmerman, B. C., Stowe, K. A., & Showman, R. (2010). Translating expertise into effective instruction: The impacts of cognitive task analysis (CTA) on lab report quality and student retention in the biological sciences. Journal of Research in Science Teaching, 47(10), 1165-1185. https://doi.org/10.1002/tea.20382. | https://onlinelibrary.wiley.com/doi/abs/10.1002/tea.20382 | Yes |
Cognitive task analysis of unmanned aircraft systems pilots | Damon Larcel | 2021 | Cognitive task analysis conducted to define and examine a sampling of the cognitive task requirements of operating a civilian UAS including tasks such as communication, search and rescue mission planning, coping with equipment malfunction, and developing situational awareness of their environment. Researchers interviewed 16 journeymen and expert pilots to identify key cognitive considerations, insights, and examples of where pilots used their expertise to solve operational problems. | ACTA | Military | Unmanned aircraft system pilots | Training | Larcel, D. & Andrews, D. H. (2021). Cognitive task analysis of unmanned aircraft system pilots. International Journal of Aerospace Psychology, 31(4), 319-342. http://dx.doi.org.wrs.idm.oclc.org/10.1080/24721840.2021.1895797. | https://www-tandfonline-com.wrs.idm.oclc.org/doi/full/10.1080/24721840.2021.1895797 | No |
Development and evaluation of a virtual reality training system based on a cognitive task analysis: The case of a CNC tool length offsetting | Dimitris Nathanael | 2016 | Cognitive task analysis conducted to examine whether this methodology is effective in developing virtual reality training systems (VRTS) for a specific machining task. Researchers conducted observations of and interviews with four expert machinists of a task execution to inform the development and calibration of the VRTS system. | Not identified | Manufacturing | Machinists | Training/Technology design | Nathanael, D., Mosialos, S., Vosniakos, G. C., & Tsagkas, V. (2016). Development and evaluation of a virtual reality training system based on a cognitive task analysis: The case of a CNC tool length offsetting. Human Factors and Ergonomics in Manufacturing and Service Industries, 26, 52-67. http://dx.doi.org.wrs.idm.oclc.org/10.1002/hfm.20613 | https://onlinelibrary-wiley-com.wrs.idm.oclc.org/doi/10.1002/hfm.20613 | No |
Leveraging the critical decision method to develop simulation-based training for early recognition of sepsis | Mary D. Patterson | 2016 | Cognitive task analysis conducted to understand differences in how novices and experts notice and interpret clinical cues and to develop simulations that replicate clinical cues to facilitate acquisition of expertise. Researchers conducted 14 interviews including novices, trainees, and experts to assess experience-based differences in sepsis recognition. | CDM | Health Care | Physicians | Training | Patterson, M. D., Militello, L. G., Bunger, A., Taylor, R. G., Wheeler, D. S., Klein, G., & Geis, G. L. (2016). Leveraging the critical decision method to develop simulation-based training for early recognition of sepsis. Journal of Cognitive Engineering and Decision Making, 10(1), 36–56. https://doi.org/10.1177/1555343416629520. | https://www.researchgate.net/publication/296471869_Leveraging_the_Critical_Decision_Method_to_Develop_Simulation-Based_Training_for_Early_Recognition_of_Sepsis | No |
A cognitive modeling approach to decision support tool design for anesthesia provider crisis management. | Noa Segall | 2013 | Cognitive task analysis conducted in tandem with a hierarchical task analysis to identify anesthesia provider procedures in detecting, diagnosing, and rating a critical incident and eliciting goals, decisions, and information requirements. Researchers interviewed three anesthesiologists to inform the design and validation of a crisis management decision support tool. | Hierarchical task analysis; GOMS; Goal-directed task analysis | Health Care | Anesthesiologists | Technology design/Interface design | Segall, N., Kaber, D. B., Taekman, J. M., Wright, M. C. (2013). A cognitive modeling approach to decision support tool design for anesthesia provider crisis management. International Journal of Human-Computer Interaction, 29(2), 55-66. https://doi.org/10.1080/10447318.2012.681220 | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8510443/ | No |
Choice and consequence: A naturalistic analysis of least-worst decision-making in critical incidents | Neil Shortland | 2020 | Cognitive task analysis conducted to explore the psychological processes of making (or not making) least-worst decisions in high consequence situations. Researchers interviewed 27 current or veteran service members of the U.S. armed forces to identify exogenous or external factors such as resources as well as endogenous factors or features of a incident itself that affect the decision making process. | CDM | Military | Current/former U.S. Armed Forces members | Shortland, N., Alison, L., Thompson, L., Barrett-Pink, C., & Swan, L. (2020). Choice and consequence: A naturalistic analysis of least-worst decision-making in critical incidents. Memory and Cognition, 48, 1334–1345. https://doi.org/10.3758/s13421-020-01056-y. | https://link.springer.com/article/10.3758/s13421-020-01056-y#citeas | No | |
Using cognitive task analysis to explore issues in the procurement of intelligent decision support systems | Robert R. Hoffman | 2009 | Cognitive task analysis conducted to study the work domain of IT systems development to reveal specific challenges with regard to human-centering, and ways in which principles, methods, and tools of ergonomics, might help the developers of IT systems better address the human and social aspects of cognitive work. Researchers interviewed software and systems engineers to understand the challenges and barriers to the procurement and development of usable, useful, and understandable IT for sociotechnical systems. | CDM | Information Technology | Software engineers; Systems engineers | Technology design | Hoffman, R.R., Neville, K. & Fowlkes, J. (2009). Using cognitive task analysis to explore issues in the procurement of intelligent decision support systems. Cognition, Technology, and Work, 11, 57–70. https://doi.org/10.1007/s10111-008-0120-5. | https://link.springer.com/article/10.1007/s10111-008-0120-5#citeas | Yes |
Assessing antibiotic prescribing in nurse practitioners: Applied cognitive task analysis | Nataly Martini | 2022 | Cognitive task analysis conducted to identify the cognitive demands of antibiotic prescribing complexity and to explore the cognitive strategies that new nurse practitioners use when prescribing antibiotics. Researchers interviewed five nurse practitioners to identify areas where professional development courses and treatment resources can be targeted to support antibiotic prescribing. | ACTA | Health Care | Nurse practitioners | Training | Martini, N., Choong, J. W., Cruz, P. D. D., Lau, H., Lim, H., Liu, R., Lim, A. G., & Marshall, D. (2022). Assessing antibiotic prescribing in nurse practitioners: Applied cognitive task analysis. International Journal of Nursing Studies Advances, 4, 1-12. https://doi-org.wrs.idm.oclc.org/10.1016/j.ijnsa.2022.100101. | https://www.sciencedirect.com/science/article/pii/S2666142X22000406#:~:text=The%20Applied%20Cognitive%20Task%20Analysis%20Framework%20is%20a,and%20strategies%20that%20influence%20NP%20antibiotic%20prescribing%20practice. | No |
Patient decision-making personas: An application of a patient-centered cognitive analysis | Richard J. Holden | 2020 | Cognitive task analysis conducted to develop personas distinguishing different patient approaches to self-care decision making by applying patient-centered cognitive task analysis to study patients naturalistic decision making. Researchers interviewed 24 patients with chronic heart failure to understand the cognitive work or "patient work" associated with chronical illness which includes effortful activities such as recommended self-care (medications, diet, etc.) avoiding certain behaviors (tobacco use), monitoring and managing symptoms, etc. | Not identified | Health Care | Patients | Technology design | Holden, R. J., Daley, C. N., Mickelson, R. S., Bolchini, D., Toscos, T., Cornet, V. P., Miller, A., & Mirro, M. J. (2020). Patient decision-making personas: An application of a patient-centered cognitive analysis. Applied Ergonomics, 87, 1-11. https://doi-org.wrs.idm.oclc.org/10.1016/j.apergo.2020.103107. | https://www.sciencedirect.com/science/article/abs/pii/S0003687020300685 | Yes |
Using hierarchical and cognitive task analysis to develop an assessment checklist for ultrasound-guided fascia iliaca nerve block (UGFINB) procedures. | M. Dashti | 2022 | Cognitive task analysis conducted in tandem with hierarchical task analysis to elucidate expert knowledge, build a procedural model, and understand the cognitive processes involved during the performance of UGFINB procedures. Researchers interviewed 10 emergency physicians. | Not identified | Health Care | Emergency physicians | Training | Dashti, M., Goldsmith, A., Dias, R., Ebnali, M., & Dobiesz, V. (2022). Using hierarchical and cognitive task analysis to develop an assessment checklist for ultrasound-guided fascia iliaca nerve block procedures. Annals of Emergency Medicine, 80(4; 355, Suppl.), S152-S153. https://doi-org.wrs.idm.oclc.org/10.1016/j.annemergmed.2022.08.384. | https://www.annemergmed.com/article/S0196-0644(22)00973-8/fulltext | No |
Interdisciplinary cognitive task analysis: A strategy to develop a comprehensive endoscopic retrograde cholangiopancreatography protocol for use in fellowship training | Erin Canopy | 2015 | Cognitive task analysis conducted to identify the steps and decision points for an endoscopic retrograde cholangiopancreatography procedure. Researchers interviewed seven experts to develop and then refine a procedural step and cognitive decision point protocol. | Not identified | Health Care | Gastroenterologists; surgeons | Training | Canopy, E., Evans, M., Boehler, M., Roberts, N., Sanfey, H., & Mellinger, J. (2015). Interdisciplinary cognitive task analysis: A strategy to develop a comprehensive endoscopic retrograde cholangiopancreatography protocol for use in fellowship training. American Journal of Surgery, 210(4), 710-714. https://doi-org.wrs.idm.oclc.org/10.1016/j.amjsurg.2015.05.006. | https://www.sciencedirect.com/science/article/abs/pii/S0002961015003566 | Yes |
Overcoming personnel shortages in resource limited settings: Open appendectomy cognitive task analysis | Manisha Bhatia | 2021 | Cognitive task analysis conducted to define operative steps and cognitive decisions for open appendectomy. Researchers interviewed 11 general surgeons to inform a framework that can guide intraoperative instruction and the development of simulated models for open appendectomy. | Not identified | Health Care | General surgeons | Training | Bhatia, M., Rogers, A., Levy, J., Gillio, A., Stefanidis, D., Sankaranarayanan, G., Saruni, I. S., & Hunter-Squires, J. (2021). Overcoming personnel shortages in resource limited settings: Open appendectomy cognitive task analysis. Journal of the American College of Surgeons, 233(5; Suppl. 1), S229. https://doi-org.wrs.idm.oclc.org/10.1016/j.jamcollsurg.2021.07.473. | https://www-sciencedirect-com.wrs.idm.oclc.org/science/article/pii/S107275152100987X | No |
Cognitive task analysis of power grid monitors | David Close | 2009 | Cognitive task analysis conducted to capture information on three desks within power utilities. Researchers interviewed 12 operators to collect information intended to improve operator performance, direct training and simulation strategies, and improve data visualization strategies | Not identified | Utility Power | Power system monitors | Training | Close, D., Babski-Reeves, K., Younan, N., & Schulz, N. (2009). Cognitive task analysis of power grid monitors. Proceedings of the Human Factors and Ergonomics Society, 53(4), 304-308. http://dx.doi.org/10.1518/107118109X12524441080867. | https://www.researchgate.net/publication/241483373_Cognitive_task_analysis_of_power_grid_monitors | No |
Critiquing as a cognitive task analysis (CTA) methodology | Janet E. Miller | 2001 | Cognitive task analysis conducted to walk through a novice's process on a task in order to serve as a probe for elicitation of expert commentary. Researchers conducted critiquing interviews with six experts used to inform training and design for intelligence analysis. | Not identified | Military | Intelligence analysts | Training/Technology design | Miller, J. E., Patterson, E. S., & Woods, D. D. (2001). Critiquing as a cognitive task analysis (CTA) methodology. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 45(4), 518–522. http://dx.doi.org/10.1177/154193120104500453 | https://www.researchgate.net/publication/2398401_Critiquing_as_a_Cognitive_Task_Analysis_CTA_Methodology | No |
Cognitive task analysis of data mining processes in bioinformatics research | Jiao Ma | 2004 | Cognitive task analysis conducted to analyze the data mining processes used by bioinformatics researchers. Researchers interviewed five experts in applying data mining techniques to obtain a surface-level understanding of the cognitive elements of the task as well as understand the skills, contexts in which they are applied, and the strategies for applying them. | ACTA | Health Care | Bioinformatics researchers | Ma, J. & Drury, C. G. (2004). Cognitive task analysis of data mining processes in bioinformatics research. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 48(5), | https://journals.sagepub.com/doi/10.1177/154193120404800533?icid=int.sj-abstract.similar-articles.2 | Yes | |
A cognitive task analysis of NICU nurses' patient assessment skills. | Laura Militello | 1995 | Cognitive task analysis conducted to elicit knowledge from neonatal intensive care unit nurses regarding the assessment of infants at risk for necrotizing enterocolitis. Researcher interviewed 19 NICU nurses including both highly experienced and less experienced nurses to extract information surrounding assessment of NEC from each incident so that comparisons could be made across incidents, hospitals, experience level, and over time. | CDM | Health Care | Neonatal Intensive Care Unit nurses | Training | Militello, L. (1995). A cognitive task analysis of NICU nurses' patient assessment skills. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(11), 733-737. https://doi.org/10.1177/154193129503901104. | https://journals.sagepub.com/doi/10.1177/154193129503901104 | Yes |
Cognitive task analysis methods in envisioned tactical command decision making | Nicolette M. McGeorge | 2019 | Cognitive task analysis conducted to understand tactical command decision making needs for the purpose of designing collaborative decision support information displays. Researchers interviewed 25 experts with experience as army commanders to identify the nature of the tasks that commanders must complete and the dynamic complexity involved in making tactical decisions. | CDM | Military | Army commanders | Technology design/Interface design | McGeorge, N. M., Kane, S., & Muller, C. (2019). Cognitive task analysis methods in envisioned tactical command decision making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63, 262-266. https://doi.org/10.1177/1071181319631407. | https://journals.sagepub.com/doi/10.1177/1071181319631407 | Yes |
Eject, eject, eject! Conducting a cognitive task analysis to assess parachute descent training simulators | Cayla A. Hartley | 2022 | Cognitive task analysis conducted to identify the tasks, knowledge, skills, and abilities required for successful parachute descent procedures training, create performance metrics, and evaluate parachute descent training simulators on their ability to train the required KSAs. Researchers interviewed 10 experts to inform an iterative design process for an emerging training simulator and improve training design and implementation. | CPP; CDM | Military | Navy parachute descent instructors; professional skydiver; pilot | Training/Technology design | Hartley, C. A., Hurley, K. J., Morganson, V. J., Kass, S. J., Atkinson, B. F. W., & Pierce, M. B. (2022). Eject, eject, eject! Conducting a cognitive task analysis to assess parachute descent training simulators. Ergonomics in Design. https://doi.org/10.1177/10648046221124786. | https://journals.sagepub.com/doi/abs/10.1177/10648046221124786 | Yes |
Team briefings in the gynecological operating room: A cognitive task analysis | Emily A. Hildebrand | 2014 | Cognitive task analysis conducted to better understand the informational needs of teams and individual team members with regards to briefings in gynecological surgery. Researchers interviewed 13 members of a large medical team to inform the development of a team briefing model for surgical teams | ACTA | Health Care | Surgeons; Surgical residents; Anesthesiologists; Nurse anesthetists; Surgical assistants; Scrub technicians; Circulating nurses | Hildebrand, E. A., Branaghan, R. J., Hallbeck, M. S., & Blocker, R. C. (2014). Team briefings in the gynecological operating room: A cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 753-757. https://doi.org/10.1177/1541931214581137. | https://www.researchgate.net/publication/271728382_Team_Briefings_in_the_Gynecological_Operating_Room_A_Cognitive_Task_Analysis | No | |
Combining cognitive task analysis and participatory design methods to elicit and represent task flows. | Elizabeth L. Papautsky | 2020 | Cognitive task analysis conducted in tandem with participatory design methods to develop task flows and demonstrating for a submarine watch team's use of an updated imaging system to maintain the ship's safety by forming and maintaining a picture of the external environment. Researchers interviewed experienced submarine watch standers to elicit an overview of the task and identify the cognitively and/or perceptually challenging steps. | ACTA | Military | Submarine watch standers | Training | Papautsky, E. L., Strouse, R., & Dominguez, C. (2020). Combining cognitive task analysis and participatory design methods to elicit and represent task flows. Journal of cognitive engineering and decision making, 14(4), 288-301. https://doi.org/10.1177/1555343420976014. | https://journals.sagepub.com/doi/10.1177/1555343420976014 | Yes |
Development of a hybrid reality display for welders through applied cognitive task analysis | Will Seidelman | 2014 | Cognitive task analysis conducted to identify the needs of expert welders, specifically in regards to the identification of important sensory cues useful when monitoring the welding process in real-time. Researchers interviewed four professional welders to provide requirements for a display development team in identifying critical cues that welders rely on to perform optimally when actively monitoring a weld. | ACTA | Manufacturing | Welders | Technology design/Interface design | Seidelman, W., Lee, M., Kent, T. M., Carswell, C. M., Fu, B., & Yang, R. (2014). Development of a hybrid reality display for welders through applied cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 1174-1178. http://dx.doi.org/10.1177/1541931214581245. | https://www.researchgate.net/publication/271728420_Development_of_a_Hybrid_Reality_Display_for_Welders_through_Applied_Cognitive_Task_Analysis | No |
Integration of cognitive task analysis and design thinking for autonomous helicopter displays. | Elizabeth L. Papautsky | 2015 | Cognitive task analysis conducted to develop interfaces for an operator controlling an autonomous helicopter. Researchers interviewed 27 SMEs with experience in UAS flight operations, helicopter resupply, military ground forces, and marine airspace control to generate requirements for human-system interface design. | CDM | Military | Helicopter pilots; UAS pilots; Marine instructors | Interface design | Papautsky, E. L., Dominguez, C., Strouse, R., & Moon, B. (2015). Integration of cognitive task analysis and design thinking for autonomous helicopter displays. Journal of Cognitive Engineering and Decision Making, 9(4), 283-294. http://dx.doi.org/10.1177/1555343415602624. | https://www.researchgate.net/publication/283169856_Integration_of_Cognitive_Task_Analysis_and_Design_Thinking_for_Autonomous_Helicopter_Displays | No |
Use of critical analysis method to conduct a cognitive task analysis of intelligence analysts. | Susan G. Hutchins | 2003 | Cognitive task analysis conducted to capture data that will provide input to support development of a model of the Intelligence analysts processes, biases and analytic strategies. Researchers interviewed 10 military officer students to provide input for building models of the intelligence analyst and associated processes | ACTA; CDM | Military | Intelligence analysts | Training | Hutchins, S. G., Pirolli, P., & Card, S. (2003). Use of critical analysis method to conduct a cognitive task analysis of intelligence analysts. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 47(3), https://doi.org/10.1177/154193120304700348. | https://journals.sagepub.com/doi/10.1177/154193120304700348 | Yes |
Swift trust in ad hoc teams: A cognitive task analysis of intelligence operators in multi-domain command and control | August Capiola | 2020 | Cognitive task analysis conducted to investigate the antecedents to quickly-formed trust in fast-paced, time-constrained contexts. Researchers interviewed 11 intelligence operators that generated implications for teams operating in high-risk distributed contexts. | ACTA | Military | Intelligence operators | Capiola, A., Baxter, H. C., Pfahler, M. D., Calhoun, C. S., & Bobko, P. (2020). Swift trust in ad hoc teams: A cognitive task analysis of intelligence operators in multi-domain command and control. Journal of Cognitive Engineering and Decision Making, 14(3), 218-241. https://doi.org/10.1177/1555343420943460. | https://journals.sagepub.com/doi/abs/10.1177/1555343420943460 | Yes | |
Cognitive and collaborative demands of freight conductor activities results and implications of a cognitive task analysis | Hadar Rosenhand | 2011 | Cognitive task analysis conducted to examine the cognitive and collaborative demands placed on conductors and the knowledge and skills that experienced conductors have developed that enable them to operate safely and efficiently. Researchers interviewed 17 conductors and/or locomotive engineers to provide insight for future training methods and accelerate building conductor expertise. | Not identified | Transportation | Railroad conductors; Locomotive engineers | Training | Rosenhand, H., Roth, E., & Multer, J. (2011). Cognitive and collaborative demands of freight conductor activities results and implications of a cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 55, 1884-1888. | https://railroads.dot.gov/elibrary/cognitive-and-collaborative-demands-freight-conductor-activities-results-and-implications | No |
Developing a simulated uninhabited aerial vehicle (UAV) task based on cognitive task analysis: Task analysis results and preliminary simulator performance data. | Leo Gugerty | 1999 | Cognitive task analysis conducted to develop a synthetic task (simulator) that represents the key cognitive demands of the UAV task. Researchers interviewed seven air vehicle operators (AVO) and twelve operators familiar with mission planning and payload operators tasks to inform the development of the synthetic (simulator) task. | Not identified | Military | Air vehicle operators; operators | Training | Gugerty, L., DeBoom, D., Walker, R., & Burns, J. (1999). Developing a simulated uninhabited aerial vehicle (UAV) task based on cognitive task analysis: Task analysis results and preliminary simulator performance data. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43, 86-90. https://doi.org/10.1177/154193129904300118 | https://journals.sagepub.com/doi/10.1177/154193129904300118?icid=int.sj-abstract.similar-articles.7 | Yes |
Understanding how train dispatchers manage and control trains: A cognitive task analysis of a distributed team planning task | Emilie M. Roth | 1999 | Cognitive task analysis conducted to examine how experienced railroad dispatchers manage track use. Researchers interviewed experienced train dispatchers that produced implications for communications technologies and dispatcher training. | Not identified | Transportation | Train dispatchers | Training/Technology design | Roth, E. M., Malsch, N., Multer, J., & Coplen, M. (1999). Understanding how train dispatchers manage and control trains: A cognitive task analysis of a distributed team planning task. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43(3), | https://railroads.dot.gov/elibrary/understanding-how-railroad-dispatchers-manage-and-control-trains-cognitive-task-analysis | No |
Application of cognitive task analysis in user requirements definition and prototype design | David E. Kancler | 2005 | Cognitive task analysis conducted to capture where the process of aircraft maintenance troubleshooting is inadequate or breaks down. Researchers interviewed 22 military maintenance technicians that informed design recommendations for graphical system representations, electronic technical orders, electronic wiring diagrams, and access to other information sources. | CDM | Military | Maintenance technicians | Technology design/Interface design | Kancler, D. E., Gorman, M. E., McWesler, M., Bachmann, S., Stimson, D., Curtis, C., Randall, C., & Tidball, B. (2005). Application of cognitive task analysis in user requirements definition and prototype design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(23), 2045-2049. | https://apps.dtic.mil/sti/pdfs/ADA441401.pdf | No |
Assessing decision support needs of those in mental health crisis utilizing cognitive task analysis. | Amanda J. Johnson | 2020 | Cognitive task analysis conducted to inform the design of a decision support-based mobile application that supports individuals during mental health crises. Researchers interviewed 24 individuals who personnally experienced a mental health crisis or doctoral level mental health professionals to capture cognitive support requirements for the mobile application.. | Not identified | Health Care | Mental health professionals; Patients | Technology design | Johnson, A. J., Bisantz, A. M., Reynolds, A. L., & Meier, S. T. (2020). Assessing decision support needs of those in mental health crisis utilizing cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 9, 46-46. https://doi.org/10.1177/2327857920091022 | https://journals.sagepub.com/doi/abs/10.1177/2327857920091022 | No |
Designing colorectal cancer screening decision support: A cognitive engineering enterprise | Laura G. Militello | 2016 | Cognitive task analysis conducted to identify cognitive requirements for and inform the design of a modular software application to support physicians in managing and tracking colorectal cancer screening. Researchers conducted observations across four health care sites as well as interviewed four primary care providers documenting barriers to CRC screening, identifying key cognitive support requirements that drive decision making, to understand commonalities and differences in CRC screening work flow, and to explore strategies for reducing barriers to CRC testing. | ACTA; CDM | Health Care | Primary-care physicians | Technology design | Militello, L. G., Saleem, J. J., Borders, M. R., Sushereba, C. E., Haverkamp, D., Wolf, S. P., & Doebbeling, B. N. (2016). Designing colorectal cancer screening decision support: A cognitive engineering enterprise. Journal of Cognitive Engineering and Decision Making, 10, 74-90. https://doi.org/10.1177/1555343416630875. | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4784691/ | No |
The application of naturalistic decision-making techniques to explore cue use in rugby league playmakers | David Johnston | 2016 | Cognitive task analysis conducted to inform training incentives by investigating the decision processes engaged by rugby league playmakers, such as whether players of varying ability could be differentiated in relation to a key decision process. | ACTA; Concept Mapping | Sports | Rugby league players | Training | Johnston, D. & Morrison, B. W. (2016). The application of naturalistic decision-making techniques to explore cue use in rugby league playmakers. Journal of Cognitive Engineering and Decision Making, 10(4), 391-410. https://doi.org/10.1177/1555343416662181 | https://journals.sagepub.com/doi/10.1177/1555343416662181 | No |
Trialling the SMART approach: Identifying and assessing sense-making | B. L. William Wong | 2013 | Cognitive task analysis conducted to capture expert librarians sense making processes when faced with an ill-defined discovery problem using the INVISQUE system. In addition, this study was intended to assess the SMART probes used to elicit expert sensemaking processes. Researchers conducted interviews with six librarians which indicated that further efforts are needed to improve SMART probes neccesitating a stronger emphasis of cognitive task analysis methods to interpret the findings related to expert librarian sense making processes. | CDM | Librarians | Wong, B. L. W., Kodagoda, N., Roony, C., Attfield, S., & Choudhury, T. (2013). Trialling the SMART approach: Identifying and assessing sense-making. Proceedings of the Human Factors and Ergonomics Society, 57, 215-219. https://doi.org/10.1177/1541931213571048. | https://www.researchgate.net/publication/273296997_Trialling_the_SMART_Approach_Identifying_and_Assessing_Sense-making | No | ||
Using goal directed task analysis with Army brigade officer teams | Cheryl A. Bolstad | 2002 | Cognitive task analysis conducted to obtain an accurate depiction of the situation awareness requirements and key goals of brigade officers. Researchers interviewed 12 brigade officers to draft goal hierarchies that were then analyzed to identify shared information requirements. | Goal-directed task analysis | Military | Intelligence officer; Training officer; Logistics officer; Brigade engineer | Technology design | Bolstad, C. A., Riley, J. M., Jones, D. G., & Endsley, M. R. (2002). Using goal directed task analysis with Army brigade officer teams. Proceedings of the Human Factors and Ergonomics Society, 46(3), 472-476. https://doi.org/10.1177/154193120204600354 | https://www.researchgate.net/publication/255662887_Using_Goal_Directed_Task_Analysis_with_Army_Brigade_Officer_Teams | No |
Providing a foundation for interpretable autonomous agents through elicitation and modeling of criminal investigation pathways | Sam Hepenstal | 2020 | Cognitive task analysis conducted to understand how criminal intelligence analysts question data as they sought to retrieve information to advance their investigations, specifically how questions lead to insights that triggered subsequent inquiries. Researchers interviewed four criminal intelligence analysts to generate an event tree simplified into a graph that serves as a foundation for transparant artificial intelligence autonomous investigations. | CDM | Criminal Justice | Intelligence analysts | Technology design | Hepenstal, S., Zhang, L., Kodogoda, N., & Wong, B. L. W. (2020). Providing a foundation for interpretable autonomous agents through elicitation and modeling of criminal investigation pathways. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 64, 239-243. https://doi.org/10.1177/1071181320641057 | https://eprints.mdx.ac.uk/32174/1/Hepenstal-AA-HFES2020.pdf. | No |
Human performance in space | M. Ephimia Morphew | 2016 | Cognitive task analysis conducted to identify the cognitive and performance challenges associated with operating both the shuttle and station remote manipulator systems (RMSs). Researchers interviewed six experts including RMS trainers and a veteran shuttle astronaut to identify the demands associated with information processing, decision making, problem solving, cognitive workload, judgement, situation assessment, short- and long-term memory, and attentional focuisng involving RMS operations. | CDM | Government | RMS trainers; Shuttle astronaut | Morphew, M. E., Balmer, D. V., & Khoury, G. J. (2016). Human performance in space. Ergonomics in Design, 9(4), 6-11. https://doi.org/10.1177/106480460100900403. | https://journals.sagepub.com/doi/10.1177/106480460100900403 | Yes | |
A case study of source triangulation: Using artifacts as knowledge elicitation tools in healthcare space design | Elizabeth L. Papautsky | 2015 | Cognitive task analysis conducted to triangulate the needs, goals, and design requirements from various stakeholder groups for the design of a clinical workspace. Researchers interviewed 26 stakeholders including the design team and frontline neonatal intensive care unit care providers to elicit different perspectives on design goals and develop representative definitions of the design goals for use in evaluation and refinement of the design plan. | CDM | Health Care | Design team; Architect; Information systems specialists; NICU clinical directors; Frontline NICU care providers | Papautsky, E. L., Crandall, B., Grome, A., & Greenberg, J. M. (2015). A case study of source triangulation: Using artifacts as knowledge elicitation tools in healthcare space design. Journal of Cognitive Engineering and Decision Making, 9(4), 347-358. https://doi.org/10.1177/1555343415613720. | https://journals.sagepub.com/doi/abs/10.1177/1555343415613720 | Yes | |
Adaptive flexibility: Examining the role of expertise in the decision making of authorized firearms officers during armed confrontation | Laura Boulton | 2016 | Cognitive task analysis conducted to identifying the exemplifying characteristics of expert decisional processes involved in decision making of british firearms officers during armed confrontations. Researchers interviewed 23 firearms officers to identify the implications for the acceleration of authorized firearms officers expertise acquisition to bridge the gap in a lack of available qualified operational force commanders. | CDM | Criminal Justice | Firearms officers | Training | Boulton, L. & Cole, J. (2016). Adaptive flexibility: Examining the role of expertise in the decision making of authorized firearms officers during armed confrontation. Journal of Cognitive Engineering and Decision Making, 10(3), 291-308. https://doi.org/10.1177/1555343416646684 | https://journals.sagepub.com/doi/10.1177/1555343416646684 | Yes |
A descriptive model of computer code trustworthiness | Gene M. Alarcon | 2017 | Cognitive task analysis conducted to explore how programmers assess code trustworthiness when asked to reuse existing computer code. Researchers interviewed 14 programmers to identify factors that influence trustworthiness judgments that are necessary to understand to streamline the code writing process. | ACTA | Information Technology | Programmers | Alarcon, G. M., Militello, L. G., Ryan, P., Jessup, S. A., Calhoun, C. S., & Lyons, J. B. (2017). A descriptive model of computer code trustworthiness. Journal of Cognitive Engineering and Decision Making, 11(2), 107-121. https://doi.org/10.1177/1555343416657236 | https://journals.sagepub.com/doi/10.1177/1555343416657236 | No | |
Evaluation of cognitive skill degradation in flight planning | Katherine M. Volz | 2020 | Cognitive task analysis conducted to understand the demands on the cognitive skills needed during planning a flight, what aspects of flight planning are susceptible to errors, and the cognitive skills required. Researchers interviewed six SMEs including two pilots, three flight instructors, and one general aviation pilot to understand what cognitive skill may degrade over time. | ACTA | Commercial Aviation | Pilots; Flight instructors | Volz, K. M. & Dorneich, M. C. (2020). Evaluation of cognitive skill degradation in flight planning. Journal of Cognitive Engineering and Decision Making, 14(4), 263-287. https://doi.org/10.1177/1555343420962897. | https://journals.sagepub.com/doi/abs/10.1177/1555343420962897?journalCode=edma | Yes | |
A study of the perceptions of the labour market by human resource managers in the UK hotel industry: A cognitive approach | Julie Gore | 2000 | Cognitive task analysis conducted to explore the degree to which human resource managers' perceptions of the labour market inhabit the wider complete role of being an HR manager in a hotel. Researchers interviewed five human resource professionals. | ACTA | Hospitality | Human resource managers | Gore, J. & Riley, M. (2000). A study of the perceptions of the labour market by human resource managers in the UK hotel industry: A cognitive approach. Tourism and Hospitality Research, 2(3), 232-241. https://doi.org/10.1177/146735840000200304. | https://journals.sagepub.com/doi/10.1177/146735840000200304 | Yes | |
Cognitive tools for assessment and learning in a high information flow environment | Susanne P. Lajoie | 1998 | Cognitive task analysis conducted to identify the cognitive components of clinical decision making of "expert" surgical nurses. Researchers interviewed three senior nurses to inform the design of a simulation-based intelligent tutoring system (ITS) intended for nurses working in a surgical intensive care unit (SICU). | PARI | Health Care | Nurses | Training | Lajoie, S. P., Azevedo, R., & Fleiszer, D. M. (1998). Cognitive tools for assessment and learning in a high information flow environment. Journal of Educational Computing Research, 18(3), 205-235. https://doi.org/10.2190/LTRW-BR1G-B75L-3F65. | https://www.researchgate.net/publication/275624350_Cognitive_Tools_for_Assessment_and_Learning_in_a_High_Information_Flow_Environment | No |
Design of a cognitive model-based decision support tool for anesthesiology crisis management. | N. Segall | 2006 | Cognitive task analysis conducted to inform the design of a decision support tool intended to alert anesthetists to developing crises. Researchers interviewed six experienced anesthesiologists to identify procedures for detecting, diagnosing, and treating a critical incident; to elicit goals, decisions, and information requirements during crisis management procedures; code natural language information; and prototype and interface. | Hierarchical task analysis; GOMS; Goal-directed task analysis | Health Care | Anesthesiologists | Technology design/Interface design | Segall, N. & Kaber, D. B. (2006). Design of a cognitive model-based decision support tool for anesthesiology crisis management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(11), 1175-1179. https://doi.org/10.1177/154193120605001113. | https://journals.sagepub.com/doi/abs/10.1177/154193120605001113?journalCode=proe | Yes |
Staying in the zone: The cognitive components associated with offshore drillers' situation awareness | Ruby C. Roberts | 2014 | Cognitive task analysis conducted to identify the underlying cognitive components associated with offshore drillers' development and maintenance of SA. Researchers interviewed 18 drilling personnel to develop a preliminary framework of the cognitive components associated with offshore drillers' developing and maintaining SA during well control. | CDM | Drillers; Tool pushers; Drilling superintendent | Roberts, R. C., Flin, R., & Cleland, J. (2014). Staying in the zone: The cognitive components associated with offshore drillers' situation awareness. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 270-274. https://doi.org/10.1177/1541931214581056 | https://core.ac.uk/download/pdf/287597103.pdf | No | ||
Examination of anesthetic practitioners' decisions for the design of a cognitive tool for airway management | R. Schnittker | 2016 | Cognitive task analysis conducted to examine the decisions made by anesthesia providers in emergency and routine clinical situations relating to airway management. Researchers interviewed 13 anesthesiologists and anesthesia assistants to form the basis for design requirements for a cognitive aid for airway management. | CDM | Health Care | Anesthesiologists | Technology design | Schnittker, R., Marshall, S. D., Horberry, T., Young, K., & Lintern, G. (2016). Examination of anesthetic practitioners' decisions for the design of a cognitive tool for airway management. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 60, 1765-1769. https://doi.org/10.1177/1541931213601404. | https://journals.sagepub.com/doi/10.1177/1541931213601404 | Yes |
Eliciting knowledge from helicopter pilots: Recommendations for revising the ACTA method for helicopter landing tasks | Dev Minotra | 2017 | Cognitive task analysis conducted to better understand pilot performance in landing maneuvers. Researchers interviewed three pilots to generate a high-level description of the approach and landing task for a helicopter, elicit information about the pilots knowledge and specific instances of expertise, and capture perceptual skills and mental models of the pilots. | ACTA; CDM | Military | Pilots | Technology design | Minotra, D. & Feigh, K. (2017). Eliciting knowledge from helicopter pilots: Recommendations for revising the ACTA method for helicopter landing tasks. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61, 242-246. https://doi.org/10.1177/1541931213601544. | https://journals.sagepub.com/doi/abs/10.1177/1541931213601544 | Yes |
Understanding preferences in experience-based choice | Claire McAndrew | 2013 | Cognitive task analysis conducted to understand decision makers', specifically financial day traders preferences. Researchers interviewed eight day traders to identify cognitive demands organized according to Prospect theory's pattern of choice. | ACTA | Financial day traders | McAndrew, C. & Gore, J. (2013). Understanding preferences in experience-based choice. Journal of Cognitive Engineering and Decision Making, 7(2), 179-197. https://doi.org/10.1177/1555343412463922. | https://journals.sagepub.com/doi/10.1177/1555343412463922 | No | ||
The impact of a meta-informed on decision-making in intelligence operations | Jonathan Pfautz | 2005 | Cognitive task analysis conducted to understand the influence of meta-information on decision-making in a military intelligence operations environment. Researchers interviewed military intelligence personnel to inform efforts to develop displays and computational support tools. | Not identified | Military | Intelligence analysts | Technology design/Interface design | Pfautz, J., Fouse, A., Fichtl, T., Roth, E., Bisantz, A., & Madden, S. (2005). The impact of a meta-informed on decision-making in intelligence operations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49, 214-218. https://doi.org/10.1177/154193120504900301 | https://journals.sagepub.com/doi/10.1177/154193120504900301 | Yes |
Fostering shared situation awareness and on-track safety across distributed teams in railroad operations | Emilie M. Roth | 2005 | Cognitive task analysis conducted to document cognitively challenging aspects of the current work to anticipate potential impacts of new technologies on roadway worker performance as well as provide guidance for their design and introduction. Researchers conducted interviews and observations with 26 passenger and freight railroad personnel to describe the informal strategies that roadway workers, dispatchers, and train crews develop to facilitate work and enhance on-track safety. | Not identified | Transportation | Trackmen; Signalmen; Dispatchers | Technology design | Roth, E. M. & Multer, J. (2005). Fostering shared situation awareness and on-track safety across distributed teams in railroad operations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(3), 529-533. https://doi.org/10.1177/154193120504900367. | https://journals.sagepub.com/doi/10.1177/154193120504900367 | Yes |
Features of problem detection | Gary Klein | 1999 | Cognitive task analysis conducted to evaluate and revise an initial model of problem detection by capturing how wildland firefighters detect dangers in an already dangerous setting. Researchers interviewed five wildland firefighters to develop a description of problem detection. | CDM | Wildland fighters | Klein, G., Pliske, R. M., Crandall, B., & Woods, D. (1999). Features of problem detection. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43(3), 133-137. https://doi.org/10.1177/154193129904300301. | https://journals.sagepub.com/doi/abs/10.1177/154193129904300301?journalCode=proe | Yes | ||
Everyday expertise: Cognitive demands in diabetes self-management | Katherine D. Lippa | 2008 | Cognitive task analysis conducted to assess the relationship between decision making and successful diabetes self-management. Researchers interviewed 18 patients to examine problem detection, functional relationships, problem-solving strategies, and types of knowledge used to make self-management decisions. | Not identified | Health Care | Patients | Lippa, K. D., Klein, H. A., & Shalin, V. L. (2008). Everyday expertise: Cognitive demands in diabetes self-management. Human Factors, 50, 112-120. https://doi.org/10.1518/001872008X250601. | https://www.researchgate.net/publication/5497487_Everyday_Expertise_Cognitive_Demands_in_Diabetes_Self-Management | No | |
Methods for gathering and analyzing information seeking behavior in electronic resource discovery systems | Hanna Stelmaszewska | 2010 | Cognitive task analysis conducted to identify and understand what students and researchers do when searching for scholarly material using various electronic resource discovery systems as well as presents a visual representation of the process of information seeking developed during data analysis that allowed the patterns of activities to emerge and show the relationship between different actions. Researchers conducted interviews and observations with 34 students. | CDM | Education | Students | Stelmaszewska, H., Wong, B. L. W., & Sanderson, P. M. (2010). Methods for gathering and analyzing information seeking behavior in electronic resource discovery systems. Proceedings of the Human Factors and Ergonomics Society, 54(11), 807-811. https://doi.org/10.1177/154193121005401115. | https://www.researchgate.net/publication/267788798_Methods_for_gathering_and_analyzing_information_seeking_behaviour_in_electronic_resource_discovery_systems | No | |
Electronic checklists in the context of B-2 pilot decision making | Andrea E. Snead | 2004 | Cognitive task analysis conducted to explore the use of paper checklists and other reference materials during flight, particularly during emergency procedures. Researchers interviewed six B-2 pilots, developing a depiction of a typical decision flow during an advisory/caution/warning event and generating a list of recommendations to assist designers with designing electronic checklists for military aircraft. | CDM | Military | Pilots | Technology design | Snead, A. E., Militello, L. G., & Ritter, J. A. (2004). Electronic checklists in the context of B-2 pilot decision making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 48(3), 640-644. https://doi.org/10.1177/154193120404800378. | https://journals.sagepub.com/doi/abs/10.1177/154193120404800378?journalCode=proe | Yes |
Designing automated aids for patient monitoring systems in intensive care units | Huiyang Li | 2013 | Cognitive task analysis conducted to investigate the challenges faced by care givers in using patient monitoring systems, specifically focusing on the needs for automation support in patient monitoring tasks. Researchers conducted observations with four NICU personnel and conducted interviews with five other SMEs to inform the design of two automation aids in support of CRG (cardiorespirography) trends retrieval (information integration) and alarm limits adjusting (a decision making task). | Not identified | Health Care | Physicians; Nurses; Technicians | Technology design | Li, H., Ku, M., Schumacher, R., & Seagull, J. (2013). Designing automated aids for patient monitoring systems in intensive care units. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2, 69-76. https://doi.org/10.1177/2327857913021014. | https://journals.sagepub.com/doi/abs/10.1177/2327857913021014?journalCode=hcsa | Yes |
Incorporation of the ACTA method for bone defect interpretation training | Jack Marzullo | 2022 | Cognitive task analysis conducted to establish additional insight on diagnostic imagery analysis, to guide development of training procedures for bone deficit detection. Researchers interviewed five experts. | ACTA | Health Care | Training/Technology design | Marzullo, J., Farahani, A., Fendley, M., & Caldorera-Moore, M. (2022). Incorporation of the ACTA method for bone defect interpretation training. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 66, 412-416. https://doi.org/10.1177/1071181322661348. | https://journals.sagepub.com/doi/abs/10.1177/1071181322661348 | Yes | |
Barriers and facilitators of common ground in critical care teams | Anna McHugh | 2006 | Cognitive task analysis conducted to investigate collaboration in the critical care environment. Researchers interviewed 20 intensive care unit personnel and identified several factors that contribute to the breakdown of common ground within the critical care team as well as strategies that can be used to facilitate and support maintenance of common ground. | CDM | Health Care | Physicians; Fellows; Residents; Clinical pharmacologist; Nurse practitioner | McHugh, A., Crandall, B., & Miller, T. (2006). Barriers and facilitators of common ground in critical care teams. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(10), 934-938. https://doi.org/10.1177/154193120605001029. | https://journals.sagepub.com/doi/10.1177/154193120605001029 | Yes | |
The good stranger frame for police and military activities | Gary Klein | 2014 | Cognitive task analysis conducted to understand how police officers and military personnel interact with civilians in a way that increases good will and reduces antagonism. Researchers interviewed 17 police officers and 24 warfighters, identifying five factors used to model the way "Good strangers" approach encounters with civilians. | CDM | Military | Police officers; Warfighters | Training | Klein, G., Klein, H. A., Lande, B., Borders, J., & Whitaker, J. C. (2014). The good stranger frame for police and military activities. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 275-279. https://doi.org/10.1177/1541931214581057 | https://www.researchgate.net/publication/271728350_The_Good_Stranger_Frame_for_Police_and_Military_Activities | No |
Internet searching by ear: Decision flow diagrams for sightless internet users | Megan G. Gorman | 2004 | Cognitive task analysis conducted to better understand strategies that sighted and sightless users rely on to navigate the web. Researchers interviewed 18 internet users to provide web designers a better understanding of what information sightless users rely on to navigate the web, how they make sense of the information, and the strategies they used to locate key information in the verbal stream of a screen reader. | ACTA | Information Technology | Interface design | Gorman, M. G., Militello, L. G., Swierenga, S. J., & Walker, J. L. (2004). Internet searching by ear: Decision flow diagrams for sightless internet users. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 48(2), 243-247. https://doi.org/10.1177/154193120404800204 | https://journals.sagepub.com/doi/abs/10.1177/154193120404800204?journalCode=proe | Yes | |
From managing the car to managing the road: The development of driving skills | Helen A. Klein | 1998 | Cognitive task analysis conducted to study experience linked differences in complex cognitive and regional abilities. Researchers interviewed 18 inexperienced and 17 experienced drivers to capture how the participant's understanding of the driving task as well as changes in that understanding with driving experience. | Not identified | Drivers | Training | Klein, H. A., Vincent, E. J., & Isaacson, J. J. (1998). From managing the car to managing the road: The development of driving skills. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(17), 1271-1275. https://doi.org/10.1177/154193129804201720. | https://journals.sagepub.com/doi/abs/10.1177/154193129804201720?journalCode=proe | Yes | |
The role of monitor technicians in enhancing alarm response | Beth Crandall | 2013 | Cognitive task analysis conducted to examine the monitor technician roles from a human factors perspective, with a particular focus on the monitor technicians coordination and communication with nurses and respiratory therapists. Researchers interviewed three MTs, three RNs, and two RTs to capture safety concerns associated with alarm/alert responses and provide recommendations for improving the alarm and alert response. | Not identified | Health Care | Monitor technicians; Nurses; Respiratory therapists | Training/Technology design/Interface design | Crandall, B., Papautsky, E. L., Grome, A., Dressman, K., Greenberg, J., & Geiser, M. (2013). The role of monitor technicians in enhancing alarm response. Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, 2, 116-122. https://doi.org/10.1177/2327857913021023 | https://journals.sagepub.com/doi/abs/10.1177/2327857913021023?journalCode=hcsa | Yes |
Chronic disease management: Improving continuity of care with human factors engineering | Laura L. Gosbee | 2010 | Cognitive task analysis conducted to identify and characterize the critical decision making tasks confronting food allergy patients. Researchers conducted interviews with patients, their families, nurse educators, allergists, school nurses, food manufacturers, and food allergy advocacy groups to identify implications for more supportive resources for patients to manage a disease. | Not identified | Health Care | Training/Technology design | Gosbee, L. L. (2010). Chronic disease management: Improving continuity of care with human factors engineering. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54(10), 919-923. https://doi.org/10.1177/154193121005401224 | https://journals.sagepub.com/doi/10.1177/154193121005401224 | Yes | |
Situation awareness in HRI with collaborating remotely piloted vehicles | Jennifer M. Riley | 2005 | Cognitive task analysis conducted to examine the situation awareness needs in the context of a collaborative military task involving deployment of a single UAV that is coordinating with multiple UGVs to identify "safe lines" for advancing troops. Researchers used goal-directed task analysis to identify the SA requirements for control and tasking of the unmanned systems. | Goal-directed task analysis | Military | UAS Pilots | Riley, J. M. & Endsley, M. R. (2005). Situation awareness in HRI with collaborating remotely piloted vehicles. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(3). 407-411. https://doi.org/10.1177/154193120504900341. | https://www.researchgate.net/publication/255610258_Situation_Awareness_in_Hri_with_Collaborating_Remotely_Piloted_Vehicles | No | |
Helicopter pilots' tasks, subjective workload, and the role of external visual cues during shipboard landing | Martin Tusl | 2020 | Cognitive task analysis conducted to obtain a detailed description of the helicopter shipboard landing procedure, and to identify relevant factors that affect pilots' workload, performance, and safety. Researchers interviewed ten helicopter pilots with implications for improving external visual cues intended to reduce pilot workload and improve overall safety of the task. | ACTA | Military | Helicopter pilots | Technology design/Interface design | Tusl, M., Rainieri, G., Fraboni, F., DeAngelis, M., Depolo, M., Pietrantoni, L., & Pingitore, A. (2020). Helicopter pilots' tasks, subjective workload, and the role of external visual cues during shipboard landing. Journal of Cognitive Engineering and Decision Making, 14(3), 242-257. https://doi.org/10.1177/1555343420948720 | https://journals.sagepub.com/doi/full/10.1177/1555343420948720 | No |
Development and validation of a virtual reality simulator: Human factors input to interventional radiology training | Sheena Johnson | 2011 | Cognitive task analysis conducted to establish the key competencies of the Seldinger procedure to inform simulator design and identify performance measure to be incorporated into the simulator. Researchers interviewed 15 SMEs who provided an outline of the procedure. | Not identified | Health Care | Interventional radiologists; Vascular surgeons | Training/Technology design | Johnson, S. J., Guediri, S. M., Kilkenny, C., & Clough, P. J. (2011). Development and validation of a virtual reality simulator: Human factors input to interventional radiology training. Human Factors, 53(6), 612-625. https://doi.org/10.1177/0018720811425042. | https://journals.sagepub.com/doi/abs/10.1177/0018720811425042 | Yes |
Understanding decision requirements for selection of assistive technology | Yao Ding | 2015 | Cognitive task analysis conducted to reveal the underlying cognitive processes and decision requirements, and identify potential decision aids in support of selecting computer access solutions. Researchers interviewed six consumers with a disability* and five clinicians to identify design requirements to better support consumer needs as well as design implications to support clinicians during the selection process. | Not identified | Health Care | Technology design/Interface design | Ding, Y., Chourasia, A., Anson, D., Atkins, T., & Vanderheiden, G. (2015). Understanding decision requirements for selection of assistive technology. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 160-164. https://doi.org/10.1177/1541931215591033. | https://www.researchgate.net/publication/283542215_Understanding_Decision_Requirements_for_Selection_of_Assistive_Technology | No | |
How analysts think: A preliminary study of human needs and demands for AI-based conversational agents | Sam Hepenstal | 2019 | Cognitive task analysis conducted to identify the intentions of intelligence analysts when retrieving information during live investigations. Researchers interviewed four intelligence analysts to identify implications for designing conversational agents (artificial intelligence) intentions. | CDM | Criminal Justice | Intelligence analysts | Technology design | Hepenstal, S., Wong, B. L. W., Zhang, L., & Kodogoda, N. (2019). How analysts think: A preliminary study of human needs and demands for AI-based conversational agents. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63, 178-182. https://doi.org/10.1177/1071181319631333. | https://journals.sagepub.com/doi/abs/10.1177/1071181319631333 | No |
Exploring decision pathways in challenging airway management episodes | Raphaela Schnittker | 2017 | Cognitive task analysis conducted to identify the cognitive pathways underlying decisions in challenging airway management situations. Researchers interviewed 12 anesthesiologists and four anesthetic nurses to inform requirements for a decision support tool. | CDM | Health Care | Anesthesiologists; Anesthetic nurses | Technology design | Schnittker, R., Marshall, S. D., Horberry, T., Young, K., & Lintern, G. (2017). Exploring decision pathways in challenging airway management episodes. Journal of Cognitive Engineering and Decision Making, 11(4), 353-370. https://doi.org/10.1177/1555343417716843. | https://journals.sagepub.com/doi/10.1177/1555343417716843 | Yes |
Critical decision method interviews to understand the initial treatment planning process in foster care | Connor Wurst | 2022 | Cognitive task analysis conducted to understand the decision-making involved in balancing assessment tasks, and the barriers to using assessment to inform treatment. Researchers interviewed three care coordinators and two clinicians to develop interventions to improve the workflow process and drive better outcomes for youth in foster care. | CDM | Wurst, C., Chen, H-Y. W., Sage, M., Joseph, K., Maggiulli, L. (2022). Critical decision method interviews to understand the initial treatment planning process in foster care. Proceedings of the Human Factors Society Annual Meeting, 66, 1060-1064. https://doi.org/10.1177/1071181322661439. | https://journals.sagepub.com/doi/10.1177/1071181322661439 | Yes | |||
Intensive care decision-making: Identifying the challenges and generating solutions to improve inter-specialty referrals to critical care | Nicola Power | 2018 | Cognitive task analysis conducted to explore intensive care unit referral and admission decision-making. Researchers interviewed nine ICU consultants and six non-ICU consultants to identify core challenges, and possible solutions, to ICCU referral decisions | CDM | Health Care | ICU consultants | Power, N., Plummer, N. R., Baldwin, J., James, F. R., & Laha, S. (2018). Intensive care decision-making: Identifying the challenges and generating solutions to improve inter-specialty referrals to critical care. Journal of the Intensive Care Society, 19(4), 287-298. https://doi.org/10.1177/1751143718758933 | https://journals.sagepub.com/doi/10.1177/1751143718758933 | No | |
Use of cognitive task analysis to understand decision making for management of blunt abdominal trauma in children | T. Ahluwalia | 2018 | Cognitive task analysis conducted to outline expert clinical decision making process for the management of pediatric blunt abdominal injury. | Not identified | Health Care | Training | Ahluwalia, T., Toy, S., & Kennedy, C. (2018). Use of cognitive task analysis to understand decision making for management of blunt abdominal trauma in children. Annals of Emergency Medicine, 72(4; suppl.), S19. https://doi.org/10.1016/j.annemergmed.2018.08.044. | https://doi.org/10.1016/j.annemergmed.2018.08.044 | No | |
Cognitive analyses of a paper medical record and electronic medical record on the documentation of two nursing tasks: Patient education and adherence assessment of insulin administration. | Susan Marie Rinkus | 2002 | Cognitive task analysis conducted to generate comparative data between the paper medical record and the electronic medical record (eRecord) on the nursing documentation of selected tasks. | Time-space; Hierarchical task analysis; GOMS; Distributed task analysis; Work flow analysis | Health Care | Nurse | Technology design | Rinkus, S. M. & Chitwood, A. (2002). Cognitive analyses of a paper medical record and electronic medical record on the documentation of two nursing tasks: Patient education and adherence assessment of insulin administration. Proceedings of the AMIA Annual Symposium, 657–661. http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2244390/. | http://www.ncbi.nlm.nih.gov/pmc/articles/pmc2244390/ | No |
Eliciting and understanding primary care and specialist mental models of cirrhosis care: A cognitive task analysis study | Tanya Barber | 2021 | Cognitive task analysis conducted to compare and identify differences in the mental models of cirrhosis care held by primary and specialty care physicians and nurse practitioners that may be addressed to improve coordination and transitions. Researchers interviewed 8 family physicians, 9 specialists, and 2 nurse practitioners to identify the challenges of cirrhosis care which included factors such as complexity of illness, lack of care coordination, clarity in roles and responsibilities, etc. | Knowledge audit | Health Care | Family physicians; Specialty care physicians; Nurse practitioners | Organizational design | Barber, T., Toon, L., Tandon, P., & Green, L. A. (2021). Eliciting and understanding primary care and specialist mental models of cirrhosis care: A cognitive task analysis study. Canadian Journal of Gastroenterology and Hepatology, 2021, 1-9. https://doi.org/10.1155/2021/5582297 | https://www.hindawi.com/journals/cjgh/2021/5582297/ | No |
Cognitive task analysis of the laparoscopic totally extraperitoneal (TEP) inguinal hernia repair: Efficiency, slow-down moments and teaching principles | Benjamin Zendejas | 2011 | Cognitive task analysis conducted to discern the key cognitive and technical teaching principles. Researchers interviewed five expert laparoscopic totally extraperitoneal (TEP) surgeon to identify strategies to improve efficiency, discover critical operative cues and outline key teaching principles for the TEP repair to inform training. | Not identified | Health Care | Surgeons | Training | Zendejas, B., Peyre, S. E., Smink, D., Swain, J. M., Ramshaw, B., Smith, D., Ferzli, G., Farley, D. R. (2011). Cognitive task analysis of the laparoscopic totally extraperitoneal (TEP) inguinal hernia repair: Efficiency, slow-down moments and teaching principles. Journal of the American College of Surgeons, 213(3; Suppl.), S127. https://doi.org/10.1016/j.jamcollsurg.2011.06.304 | https://www.sciencedirect.com/science/article/abs/pii/S1072751511007149 | Yes |
Developing decision support for cybersecurity threat and incident managers | Rick Van Der Kleij | 2022 | Cognitive task analysis conducted in tandem with cognitive work analysis to develop decision support for cybersecurity threat and incident managers in the financial sector. Researchers interviewed ten cyber defense center professionals from three different financial institutions to identify the main difficulties for cybersecurity threat and incident managers. | ACTA | Cyber security | IT security; Programming; Digital forensics; and intelligence personnel | Technology design/Interface design | Kleij, R. V., Schraagen, J. M., Cadet, B., & Young, H. (2022). Developing decision support for cybersecurity threat and incident managers. Computer & Security, 113, 1-15. https://doi.org/10.1016/j.cose.2021.102535 | https://www.sciencedirect.com/science/article/pii/S016740482100359X#:~:text=The%20following%20seven%20process%20steps,the%20urgency%20for%20further%20investigations. | Yes |
Risk-based decision-making support model for offshore dynamic positioning operations | Sandra Hogenboom | 2021 | Cognitive task analysis conducted to analyze how the different operational settings influence the role and decision-making of the dynamic positioning system. Researchers interviewed 12 SMEs to evaluate the current role of the dynamic positioning operators, in light of the dynamic positioning system and different operations to inform the design of the DP system and training. | ACTA | Dynamic positioning operators | Training/Technology design | Hogenboom, S., Vinnem, J. E., Utne, I. B., & Kongsvik, T. (2021). Risk-based decision-making support model for offshore dynamic positioning operations. Safety Science, 140, 1-14. https://doi.org/10.1016/j.ssci.2021.105280. | https://www.sciencedirect.com/science/article/pii/S0925753521001259 | No | |
Do surgeons and gastroenterologists describe endoscopic retrograde cholangiopancreatography differently? A qualitative study | Margaret L. Boehler | 2016 | Cognitive task analysis conducted to explore the approach that surgeons and gastroenterologists use to train fellows to perform an endoscopic retrograde cholangiopancreatography (ERCP) as well as explain the differences in their respective training methods. Researchers interviewed seven gastroenterologists and four surgeons. | Not identified | Health Care | Surgeons; Gastroenterologists | Boehler, M. L., Roberts, N., Sanfey, H., & Mellinger, J. (2016). Do surgeons and gastroenterologists describe endoscopic retrograde cholangiopancreatography differently? A qualitative study. Journal of Surgical Education, 73, 66-72. https://doi.org/10.1016/j.jsurg.2015.07.015 | https://www.sciencedirect.com/science/article/abs/pii/S1931720415002020 | Yes | |
The cognitive process of wildland fire chainsaw troubleshooting: Structure, content, and training | Elliot Nauert | 2019 | Cognitive task analysis conducted to examine the troubleshooting process of an expert wildland fire sawyer. Researcher interviewed one SME to highlight areas where training and job aids may be improved to support wildland firefighters in chainsaw troubleshooting. | ACTA | Firefighting | Firefighters | Training/Technology design/Interface design | Nauert, E. & Gillan, D. (2019). The cognitive process of wildland fire chainsaw troubleshooting: Structure, content, and training. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63, 1676-1680. https://doi.org/10.1177/1071181319631536. | https://journals.sagepub.com/doi/abs/10.1177/1071181319631536 | No |
Expert knowledge elicitation in the firefighting domain and the implications for training novices. | Justin Okoli | 2022 | Cognitive task analysis conducted to elicit the tacitly held knowledge and intuitive thought processes used while managing a range of complex, non-routine fire incidents. Researcher interviewed 31 experienced firefighters and identified a range of training needs as well as practical implications for transferring expert knowledge into learning tasks that could aid the cognitive development of novices. | CDM | Firefighting | Firefighters | Training | Okoli, J. (2020). Expert knowledge elicitation in the firefighting domain and the implications for training novices. International Journal of Disaster Resilience in the Built Environment, 11(4), 577-578. http://dx.doi.org/10.1108/IJDRBE-09-2020-086 | https://www.emerald.com/insight/content/doi/10.1108/IJDRBE-09-2020-086/full/html | No |
Identifying option awareness requirements for public health crisis decision making | Mark S. Pfaff | 2015 | Cognitive task analysis conducted to uncover cognitive requirements for achieving option awareness, in addition to situation awareness, in complex and emergent decision-making scenarios. Researcher interviewed five SMEs and identified implications for the design of systems supporting decision making under high complexity and uncertainty as well as for training to accelerate the growth of novices into expert decision makers. | ACTA | Health Care | Public health personnel | Training/Technology design/Interface design | Pfaff, M. S. (2015). Identifying option awareness requirements for public health crisis decision making. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59, 548-552. https://doi.org/10.1177/1541931215591119. | https://journals.sagepub.com/doi/10.1177/1541931215591119 | No |
The art of effective handoff communication among medical and surgery residents | Nicholas A. Rattray | 2021 | Cognitive task analysis conducted to understand resident physician handoffs with a focus on the moment-by-moment behaviors that constitute a transfer of duties, rights, and responsibilities known as end-of-shift handoff or handover. Researchers conducted observations of handoffs and/or interviewed 35 residents to inform more effective training of communication practices. | CDM | Health Care | Residents | Training | Rattray, N. A., Flanagan, M. E., Militello, L. G., Barach, P., & Frankel, R. M. (2021). The art of effective handoff communication among medical and surgery residents. Journal of Cognitive Engineering and Decision Making, 15(2-3). https://doi.org/10.1177/15553434211018296. | https://www.researchgate.net/publication/352320052_The_Art_of_Effective_Handoff_Communication_Among_Medical_and_Surgery_Residents | No |
Using SMEs during initial development of small UAS concept of operations | David E. Kancler | 2012 | Cognitive task analysis conducted to collect information and identify system specifications and requirements to better understand current small unmanned aircraft systems (SUAS) missions, capabilities, and expected payload (e.g., sensor or weapon) employments. Researchers interviewed nine experts within the UAS community including researchers and operators to inform the development of a concept of operations for use among government, state, and private sectors. | CDM; Knowledge audit | Military | UAS operators; UAS researchers | Kancler, D. E. & Malek, D. A. (2012). Using SMEs during initial development of small UAS concept of operations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 56, 2339-2343. https://doi.org/10.1177/1071181312561434. | https://journals.sagepub.com/doi/abs/10.1177/1071181312561434?journalCode=proe | Yes | |
A multi-site cognitive task analysis for biomedical query mediation | Gregory W. Hruby | 2016 | Cognitive task analysis conducted to characterize the biomedical query mediation (BQM) processes for electronic health record data retrieval and develop a generic BQM process model. Researchers interviewed 11 data analysts to develop the BQM model and inform the standardization of the BQM process towards improved communication efficiency and accuracy. | Not identified | Health Care | Data analysts | Hruby, G. W., Rasmussen, L. V., Hanauer, D., Patel, V. L., Cimino, J. J., & Weng, C. (2016). A multi-site cognitive task analysis for biomedical query mediation. International Journal of Medical Informatics, 93, 74-84. https://doi.org/10.1016/j.ijmedinf.2016.06.006. | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4957698/ | No | |
Cognitive demands and mental workload: A filed study of the mining control room operators. | Mostafa Mohammadian | 2022 | Cognitive task analysis conducted to investigate the cognitive demands and mental workload as well as the relationship between them among mining control room operators. Researchers interviewed six control room managers and eight control room operators to inform the reallocation of working-memory and problem-solving tasks to computer systems. | Hierarchical task analysis; Concept mapping | Geological mining | Control room managers; Control room operators | Organizational design | Mohammadian, M., Parsaei, H., Mokarami, H., & Kazemi, R. (2022). Cognitive demands and mental workload: A filed study of the mining control room operators. Heliyon, 8(2), 1-6. https://doi.org/10.1016/j.heliyon.2022.e08860. | https://www.cell.com/heliyon/fulltext/S2405-8440(22)00148-7?_returnURL=https%3A%2F%2Flinkinghub.elsevier.com%2Fretrieve%2Fpii%2FS2405844022001487%3Fshowall%3Dtrue | No |
Development of a clinical interface for a novel newborn resuscitation device: Human factors approach to understanding cognitive user requirements | Laura Pickup | 2019 | Cognitive task analysis conducted to understand the requirements of the interface design for a novel medical device using a human factors approach. Researchers conducted simulation interviews with two SMEs in order to enable product developers to understand the preferred requirements of the user interface design for the device. | ACTA | Health Care | Interface design | Pickup, L., Lang, A., Shipley, L., Henry, C., Carpenter, J., McCartney, D., Butler, M., Hayes-Gill, B., & Sharkey, D. (2019). Development of a clinical interface for a novel newborn resuscitation device: Human factors approach to understanding cognitive user requirements. JMIR Human Factors, 6(2), 1-13. https://doi.org/10.2196/12055. | https://humanfactors.jmir.org/2019/2/e12055 | No | |
A task analysis toward characterizing cyber-cognitive situation awareness (CCSA) in cyber defense analysts | Robert S. Gutzwiller | 2016 | Cognitive task analysis conducted to determine the goals and identify key elements that information analysts must attend to during operations to guide their decision-making. Researchers interviewed seven cyber analysts to identify implications for new technologies such as automation of defensive capabilities and cyber visualizations. | Knowledge audit; Concept mapping | Cyber security | Cyber analysts | Gutzwiller, R. S., Hunt, S. M., & Lange, D. S. (2016). A task analysis toward characterizing cyber-cognitive situation awareness (CCSA) in cyber defense analysts. IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support. https://doi.org/10.1109/COGSIMA.2016.7497780. | https://www.researchgate.net/profile/Robert-Gutzwiller/publication/291346566_Task_Analysis_toward_Characterizing_Cyber-Cognitive_Situation_Awareness_CCSA_in_Cyber_Defense_Analysts/links/59e63636a6fdcc0e88248117/Task-Analysis-toward-Characterizing-Cyber-Cognitive-Situation-Awareness-CCSA-in-Cyber-Defense-Analysts.pdf | No | |
Characterizing novice-expert differences in Macrocognition: An exploratory study of cognitive work in the emergency department. | Christiane C. Schubert | 2013 | Cognitive task analysis conducted to elicit and document descriptions of emergency physician expertise, to characterize differences between novice and expert physicians, and to identify areas in which novices' skill and knowledge gaps are most pronounced. Researchers interviewed five interns and six attending physicians to inform the development of training protocols that facilitate the development of expertise in graduate medical educations | CDM | Health Care | Physicians; Surgeons | Training | Schubert, C. C., Denmark, T. K., Crandall, B., Grome, A., & Pappas, J. (2013). Characterizing novice-expert differences in Macrocognition: An exploratory study of cognitive work in the emergency department. Annals of Emergency Medicine, 61, 96-109. https://doi.org/10.1016/j.annemergmed.2012.08.034. | https://www.annemergmed.com/article/S0196-0644(12)01501-6/fulltext | Yes |
Exceptional global leadership as cognitive expertise in the domain of global change | Joyce Osland | 2013 | Cognitive task analysis conducted in tandem with content analysis to identify how exceptional global leaders conceptualize their work contexts, approach their work, and develop their expertise. Researchers interviewed 20 individuals with experience in leadership roles including CEOs and VPs. | ACTA | Business | CEOs; COOs; EVP; VPs; Director of HR; Director of sales | Osland, J., & Oddou, G., Bird, A., Osland, A. (2013). Exceptional global leadership as cognitive expertise in the domain of global change. European Journal of International Management, 7(5), 517-534. https://doi.org/10.1504/EJIM.2013.056475. | https://www.researchgate.net/publication/264835844_Exceptional_global_leadership_as_cognitive_expertise_in_the_domain_of_global_change | No | |
Sustaining "meaningful use" of health information technology in low-resource practices | Lee A. Green | 2015 | Cognitive task analysis conducted as one of two projects to identify barriers to maintenance of meaningful use of EHRs in priority primary care practices. | ACTA | Health Care | Green, L. A., Potworowski, G., Day, A., May-Gentile, R., Vibbert, D., Maki, B., & Kiesel, L. (2015). Sustaining "meaningful use" of health information technology in low-resource practices. Annals of Family Medicine, 13, 17-22. https://doi.org/10.1370/afm.1740. | https://www.annfammed.org/content/13/1/17.short | No | ||
A description of nurses' decision-making in managing electrocardiographic monitor alarms. | Priscilla K. Gazarian | 2014 | Cognitive task analysis conducted to explore nurses decision-making related to continuous ECG monitoring and the associated alarms. Researchers interviewed eight registered nurses to inform the development of learning experiences and inform policies to guide practice. | CDM | Health Care | Registered nurses | Training | Gazarian, P. K., Carrier, N., Cohen, R., Schram, H., & Shiromani, S. (2014). A description of nurses' decision-making in managing electrocardiographic monitor alarms. Journal of Clinical Nursing, 24(1-2), 151-159. https://doi.org/10.1111/jocn.12625. | https://onlinelibrary.wiley.com/doi/abs/10.1111/jocn.12625 | Yes |
Nurse manager cognitive decision-making amidst stress and work complexity | Maria R. Shirey | 2012 | Cognitive task analysis conducted to provide insight into nurse manager cognitive decision-making amidst stress and work complexity. Researchers interviewed 21 nurse managers to identify implications for coaching and mentoring. | CDM | Health Care | Nurse managers | Training | Shirey, M. R., Ebright, P. R., & McDaniel, A. M. (2012). Nurse manager cognitive decision-making amidst stress and work complexity. Journal of Nursing Management, 21, 17-30. https://doi.org/10.1111/j.1365-2834.2012.01380.x. | https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1365-2834.2012.01380.x | No |
Strategies prescribers and pharmacists use to identify and mitigate adverse drug reactions in inpatient and outpatient care: A cognitive task analysis at a US veterans affairs medical center. | Khoa A. Nguyen | 2021 | Cognitive task analysis conducted to develop a descriptive model of the cognitive processes used to identify and resolve adverse drug reactions from the perspectives of healthcare providers in order to inform future informatics efforts. Researchers interviewed ten physicians and ten pharmacists. | CDM | Health Care | Physicians and Pharmacists | Nguyen, K. A., Militello, L. G., Ifeachor, A., Arthur, K. J., Glassman, P. A., Zillich, A. J., Weiner, M., Russ-Jara, A. L. (2021). Strategies prescribers and pharmacists use to identify and mitigate adverse drug reactions in inpatient and outpatient care: A cognitive task analysis at a US veterans affairs medical center. BMJ Open, 12, 1-9. https://doi.org/10.1136%2Fbmjopen-2021-052401. | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8862429/ | No | |
Care coordination strategies and barriers during medication safety incidents: A qualitative, cognitive task analysis | Alissa L. Russ-Jara | 2021 | Cognitive task analysis conducted to identify strategies that hospital and outpatient healthcare professionals use, and barriers encountered when they coordinate care during a medication safety incident involving an adverse drug reaction, drug-drug interactions, or drug-renal concern. Researchers conducted 12 interviewes with SMEs including physicians and pharmacists with implications for future efforts to enhance electronic health record designs for care coordination and to provide more formal guidance recaeding communication modalities. | CDM | Health Care | Physicians and Pharmacists | Training/Technology design | Russ-Jara, A. L., Luckhurts, C. L., Dismore, R. A., Arthur, K. J., Ifeachor, A. P., Militello, L. G., Glassman, P. A., Zillich, A. J., & Weiner, M. (2021). Care coordination strategies and barriers during medication safety incidents: A qualitative, cognitive task analysis. Journal of General Internal Medicine, 36(8), 2212-2220. https://doi.org/10.1007/s11606-020-06386-w. | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8342616/ | No |
Expert intraoperative judgement and decision-making: Defining the cognitive competencies for safe laparoscopic cholecystectomy. | Amin Madani | 2015 | Cognitive task analysis conducted to define and characterize higher-order cognitive competencies required to safely perform a laparascopic cholecystectomy. Researchers interviewed ten surgeons to develop a framework that serves as the basis for instructional design, assessment tools, and quality-control metrics to prevent injuries and promote a culture of patient safety. | Hierarchical task analysis | Health Care | Surgeons | Training | Madani, A., Watanabe, Y., Feldman, L. S., Vassiliou, M. C., Barkun, J. S., Fried, G. M., & Aggarwal, R. (2015). Expert intraoperative judgement and decision-making: Defining the cognitive competencies for safe laparoscopic cholecystectomy. Journal of the American College of Surgeon, 221(5), 931-940. https://doi.org/10.1016/j.jamcollsurg.2015.07.450. | https://journals.lww.com/journalacs/Abstract/2015/11000/Expert_Intraoperative_Judgment_and.4.aspx | Yes |
Comparative cognitive task analyses of experimental science and instructional laboratory courses | Carl Wieman | 2015 | This article describes a "self-CTA" conducted by a physicist to capture the cognitive activities associated with doing experimental research. The findings of this research is intended to inform the design of instructional activities. | Not identified | Education | Physicist | Training | Wieman, C. (2015). Comparative cognitive task analyses of experimental science and instructional laboratory courses. The Physics Teacher, 53(6), 349-351. https://doi.org/10.1119/1.4928349. | https://cwsei.ubc.ca/sites/default/files/cwsei/outcomes/SEIresearch/Wieman_CTA_PT2015.pdf | No |
Articles describing how to do CTA
Title | Lead Author | Year | Gist | Methods | Domain | SubDomain | Application | Full reference | Link to PDF | Paywall |
---|---|---|---|---|---|---|---|---|---|---|
Cognitive task analysis-based training: A meta-analysis of studies. | Colby Tofel-Grehl | 2013 | This research effort examines the overall effectiveness of cognitive task analysis across studies, domains, and practitioners in relation to other means of identifying and representing instructional content. | CDM; PARI | Military, Government, Academic/university, Health Care, Industry | Training | Tofel-Grehl, C. & Feldon, D. F. (2013). Cognitive task analysis-based training: A meta-analysis of studies. Journal of Cognitive Engineering and Decision Making, 7(3), 293-304. https://doi.org/10.1177/1555343412474821. | https://journals.sagepub.com/doi/10.1177/1555343412474821 | No | |
The use of cognitive task analysis in clinical and health services research: A systematic review | Lizzie Swaby | 2022 | This research effort offers a systematic review of the use of cognitive task analysis methods in understanding expert clinical decision-making. | CDM; Hierarchical task analysis; task knowledge structures; Think-aloud exercises; Team knowledge audit; Timeline analysis; Systematic Human Error Reduction and Prediction Approach (SHERPA); CPP | Health Care | Clinicians | Swaby, L., Shu, P., Hind, D., & Sutherland, K. (2022). The use of cognitive task analysis in clinical and health services research: A systematic review. Pilot Feasibility Studies, 8, 1-10. https://doi.org/10.1186/s40814-022-01002-6. | https://pilotfeasibilitystudies.biomedcentral.com/articles/10.1186/s40814-022-01002-6#citeas | No | |
Cognitive task analysis: Bringing Olympic athlete style training to surgical education. | Laura R. Wingfield | 2014 | This research effort provides an overview of evidence on cognitive task analysis as a surgical training method and determine if cognitive task analysis improves surgeon performance in both technical and non-technical skills. | Health Care | Residents, Medical students, Surgeons, and Surgical Interns | Training | Wingfield, L. R., Kulendran, M., Chow, A., Nehme, J., & Purkayastha, S. (2014). Cognitive task analysis: Bringing Olympic athlete style training to surgical education. Surgical Innovation, 22(4), 406-417. https://doi.org/10.1177/1553350614556364. | https://journals.sagepub.com/doi/10.1177/1553350614556364 | No | |
Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. | Robert R. Hoffman | 1998 | This research effort explores the critical decision method as an approach to cognitive task analysis. The authors offer insight into the theory and origins of the critical decision method and discuss many different applications of this method. | CDM | Hoffman, R. R., Crandall, B., & Shadbolt, N. (1998). Use of the Critical Decision Method to Elicit Expert Knowledge: A Case Study in the Methodology of Cognitive Task Analysis. Human Factors, 40(2), 254–276. https://doi.org/10.1518/001872098779480442 | https://journals.sagepub.com/doi/abs/10.1518/001872098779480442 | No | |||
The cognitive task analysis methods for job and task design: Review and appraisal. | June Wei | 2007 | This research effort reviews current research on cognitive task analysis methodology for job or task design and analysis. In addition, the authors describe a validated human-centered information processing model for cognitive task performance developed based on this review of the literature. | Organizational design | Wei, J. & Salvendy, G. (2007). The cognitive task analysis methods for job and task design: Review and appraisal. Behavior and Information Technology, 23(4), 273-299. https://doi.org/10.1080/01449290410001673036. | https://www.tandfonline.com/doi/full/10.1080/01449290410001673036?scroll=top&needAccess=true&role=tab | Yes | |||
Applied cognitive task analysis (ACTA): A practitioner's toolkit for understanding cognitive task demands. | Laura G. Militello | 1998 | This article proposes a streamlined method of cognitive task analysis, ACTA, which consists of three interview methods for extracting the cognitive demands and skills required for a task. This cognitive task analysis method also supports representing the information into a form that more easily translates to applied products such as interface recommendations. | ACTA | Militello, L. G. & Hutton, R. J. B. (1998). Applied cognitive task analysis (ACTA): A practitioner's toolkit for understanding cognitive task demands. Ergonomics, 41(11), 1618-1641. https://doi.org/10.1080/001401398186108. | https://www.academia.edu/download/6172042/10.1.1.89.4503.pdf | No | |||
Cognitive simulation as a tool for cognitive task analysis. | Emilie M. Roth | 1992 | This article proposes the use of cognitive simulations that represent models of human cognitive activities to clarify cognitive demands as part of a cognitive task analysis. | Cognitive Environment Simulation (CES) | Nuclear Power | Roth, E. M., Woods, D. D., & Pople, H. E., Jr. (1992). Cognitive simulation as a tool for cognitive task analysis. Ergonomics, 35(10), 1163-1198. https://doi.org/10.1080/00140139208967389. | https://www.researchgate.net/publication/21638297_Cognitive_Simulation_as_a_Tool_for_Cognitive_Tasks_Analysis | No | ||
A comparison of two tools for cognitive task analysis: Concept mapping and the critical decision method. | Marvin L. Thordsen | 1991 | This article offers a description and comparison of two cognitive task analysis knowledge elicitation methods: concept mapping and the critical decision method. The author defines each method individually and then discusses the use of both techniques in tandem to effectively generate recommendations for training and display design. | CDM; Concept mapping | Thordsen, M. L. (1991). A comparison of two tools for cognitive task analysis: Concept mapping and the critical decision method.. Proceedings of the Human Factors Society Annual Meeting, 35(5), 283–285. https://doi.org/10.1177/154193129103500509. | https://journals.sagepub.com/doi/abs/10.1177/154193129103500509 | No | |||
Integrating cognitive task analysis into instructional systems development | Joan M. Ryder | 1993 | This article reviews developments in cognitive task analysis and the Integrated Task Analysis Model (ITAM) which is a framework for integrating cognitive and behavioral task methods into the instructional systems development model. | CDM | Training/Technology design | Ryder, J. M. & Redding, R. E. (1993). Integrating cognitive task analysis into instructional systems development. Educational Technology Research and Development, 41(2), 75-96. https://doi.org/10.1007/BF02297312. | https://link.springer.com/article/10.1007/BF02297312#citeas | Yes | ||
Using cognitive task analysis to define human interface requirements for first-of-a-kind systems. | Emilie M. Roth | 1995 | This article presents a cognitive task analysis technique used in the design of new person-machine interfaces for first-of-a-kind advanced process control plants. | Protocol analysis | Interface design | Roth, E. M. & Mumaw, R. J. (1995). Using cognitive task analysis to define human interface requirements for first-of-a-kind systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(9), 520-524. https://doi.org/10.1177/154193129503900918. | https://journals.sagepub.com/doi/abs/10.1177/154193129503900918 | No | ||
Protocols for cognitive task analysis | Robert R. Hoffman | 2005 | This report presents guidance, including sample forms and instructions for conducting a variety of cognitive task analysis and cognitive field research methods including both knowledge elicitation and knowledge modeling procedures with a proven track record of utility in service of expertise studies and the design of new technologies. | Protocol analysis; CDM; Work patterns observations; and Goal-directed task analysis | Technology design | Hoffman, R. R. (2005). Protocols for cognitive task analysis (Report No. ADA475456). Florida Institute for Human and Machine Cognition Inc. https://apps.dtic.mil/sti/citations/ADA475456. | https://apps.dtic.mil/sti/citations/ADA475456 | No | ||
Uncovering the requirements of cognitive work | Emilie M. Roth | 2008 | This article provides an overview of cognitive task analysis and cognitive work analysis methods as well as how they can be used to inform system analysis and design. | ACTA; Goal-directed task analysis; Critical incident analysis; Concept mapping; Psychological scaling; Cognitive field observation; CDM | Training/Technology design/Interface Design | Roth, E. M. (2008). Uncovering the requirements of cognitive work. Journal of the Human Factors and Ergonomics Society, 50(3), 475-480. https://doi.org/10.1518/001872008X288556. | https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=9114ebf6d26566ddc88487923f061734545159f6 | No | ||
A procedural guide to cognitive task analysis: The PARI methodology | Ellen P. Hall | 1995 | This report describes the cognitive task analysis technique Precursor, Action, Result, and Interpretation (PARI) methodology | PARI; GOMS | Hall, E. P., Gott, S. E., & Pokorny, R. A. (1995). A procedural guide to cognitive task analysis: The PARI methodology (Report No. ADA303654). Armstrong Lab Brooks Air Force Base Human Resources Directorate. https://apps.dtic.mil/sti/citations/ADA303654. | https://apps.dtic.mil/sti/citations/ADA303654 | No | |||
Using cognitive task analysis to train orthopedic surgeons: Is it time to think differently? A systematic review | Karam Ahmad | 2020 | This report offers a systematic review to analyze whether cognitive task analysis is beneficial to train novice surgeons in common orthopedic and trauma procedures. | Health Care | Surgeons | Training | Ahmad, K., Bhattacharyya, R., & Gupte, C. (2020). Using cognitive task analysis to train orthopedic surgeons: Is it time to think differently? A systematic review. Annals of Medicine and Surgery, 59, 131-137. https://doi-org.wrs.idm.oclc.org/10.1016/j.amsu.2020.09.031. | https://www-sciencedirect-com.wrs.idm.oclc.org/science/article/pii/S2049080120303368 | No | |
Cognitive task analysis for training | Richard E. Clark | 1996 | This article provides a comprehensive overview of cognitive task analysis and its utility in the changing world of work. Furthermore, the authors offer a description of several cognitive task analysis methods including GOMS and PARI as well as lists many of the practical issues and considerations associated with conducting cognitive task analysis. | GOMS; PARI | Training | Clark, R. E. & Estes, F. (1996). Cognitive task analysis for training. International Journal of Educational Research, 25(5), 403-417. https://doi.org/10.1016/S0883-0355(97)81235-9. | https://www.researchgate.net/profile/Richard-Clark-27/publication/222502995_Cognitive_task_analysis/links/5ceb37eea6fdccc9ddd22824/Cognitive-task-analysis.pdf | No | ||
The value added by cognitive task analysis | Gary Klein | 1995 | This article describes the cognitive task analysis methodology. Specifically, it describes the five common steps of cognitive task analysis as well as some applications. | ACTA | Klein, G. (1995). The value added by cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society, 39(9), 530-533. https://doi.org/10.1177/154193129503900920 | https://journals.sagepub.com/doi/10.1177/154193129503900920 | Yes | |||
Comparing, merging, and adapting methods of cognitive task analysis | Robert R. Hoffman | 2009 | This article offers a comprehensive discussion of the types of cognitive task analysis methods combined or merged, discusses rationale for selecting CTA methods, etc. | Hoffman, R. R., Adams, J. A., Bisantz, A., Donmex, B., Kaber, D., & Roth, E. (2009). Comparing, merging, and adapting methods of cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 53(4), 187-191. https://doi.org/10.1177/154193120905300406. | https://journals.sagepub.com/doi/abs/10.1177/154193120905300406 | Yes | ||||
Tailoring cognitive task analysis (CTA) methods for use in health care | Laura Militello | 2014 | This article reflects on strategies for tailoring cognitive task analysis methods for use in healthcare settings, highlights challenges to conducting CTA in healthcare settings, and highlights important contributions of CTA in addressing challenging issues in healthcare. | CDM | Health Care | Militello, L., Dominquez, C., Ebright, P., Moon, B., Russ, A., & Weir, C. (2014). Tailoring cognitive task analysis (CTA) methods for use in healthcare. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58, 758-762. https://doi.org/10.1177/1541931214581138 | https://journals.sagepub.com/doi/10.1177/1541931214581138 | Yes | ||
Taking cognitive task analysis into the field: Bridging the gap from research to application | Richard E. Redding | 1990 | This article discusses the potential of cognitive task analysis as well as the practicality problem including how these methods can receive widespread application among training practitioners and how to transition theory and research into mainstream training development programs | Training | Redding, R. E. (1990). Taking cognitive task analysis into the field: Bridging the gap from research to application. Proceedings of the Human Factors Society Annual Meeting, 34(18), 1304-1308. https://doi.org/10.1177/154193129003401801 | https://journals.sagepub.com/doi/10.1177/154193129003401801 | Yes | |||
Critical decision method for eliciting knowledge | Gary Klein | 1989 | A critical decision method for modeling tasks in naturalistic environments characterized by high time pressure, high information content, and changing conditions. Additionally, this work describes the theoretical background for this methodology, the instruments and procedures for implementation, and candidate applications of this method. | CDM | Klein, G. A., Calderwood, R., & MacGregor, D. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19(3), 462-472. doi: 10.1109/21.31053. | https://ieeexplore.ieee.org/abstract/document/31053/authors#authors | Yes | |||
Efficient cognitive task analysis: Using experts' critiques to acquire expertise. | Robert A. Pokorny | 1998 | Conducting cognitive task analysis may be difficult and time consuming. As such, the author proposes tasking experts with reviewing and critiquing samples of worker performance which has two benefits: describing knowledge that is applicable to good performance, and specifying knowledge that distinguishes poor performers from better performers. | Pokorny, R. A. (1998). Efficient cognitive task analysis: Using experts’ critiques to acquire expertise. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(23), 1607–1607. https://doi.org/10.1177/154193129804202316 | https://journals.sagepub.com/doi/10.1177/154193129804202316?icid=int.sj-abstract.similar-articles.3 | No | ||||
Analyzing the cognitive demands of problem solving environments: An approach to cognitive task analysis | Emilie M. Roth | 1990 | This article describes an approach to cognitive task analysis utilizing two analyses: a model of the cognitive environment and a performance model. The authors describe the former as focused on building a description of the cognitive demands of the world that any intelligent agent deals with, and the latter as an empirical investigation of how practitioners respond to task demands. | Roth, E. M. & Woods, D. D. (1990). Analyzing the cognitive demands of problem solving environments: An approach to cognitive task analysis. Proceedings of the Human Factors and Ergonomics Society, 34(8), 1314-1317. https://doi.org/10.1177/154193129003401803 | https://journals.sagepub.com/doi/abs/10.1177/154193129003401803?journalCode=prob | Yes | ||||
The development of cognitive task analysis methods to aid interface design | M. Ephimia Morphew | 1998 | This article illustrates how the application of cognitive task analysis methods and decision-centered design can be used to uncover and aid the cognitive processes involved with operating complex systems, and in turn, enhance human performance in complex systems. | Interface design | Morphew, M. E., Thordsen, M. L., & Klein, G. (1998). The development of cognitive task analysis methods to aid interface design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(3), 305-309. https://doi.org/10.1177/154193129804200326. | https://journals.sagepub.com/doi/abs/10.1177/154193129804200326 | Yes | |||
Using a knowledge elicitation method to specify the business model of a human factors organization | Jan M. Schraagen | 2009 | This article illustrates the use of concept mapping as a novel method of cognitive task analysis to structure knowledge elicitation interviews with a group of a human factors specialists whose goal was to describe the business model of the department. | Concept mapping | Schraagen, J. M., DeVen, J. V., Hoffman, R. R., & Moon, B. M. (2009). Using a knowledge elicitation method to specify the business model of a human factors organization. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 53(4), 309-313. | https://www.researchgate.net/publication/249956297_Using_a_Knowledge_Elicitation_Method_to_Specify_the_Business_Model_of_a_Human_Factors_Organization | No | |||
Team CTA applications and methodologies | David Klinger | 1998 | This article describes the Team CTA methodology for gathering information about the way a team makes decisions and the way it manages itself. | Klinger, D. & Thordsen, M. (1998). Team CTA applications and methodologies. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(3), 206-209. https://doi.org/10.1177/154193129804200305. | https://journals.sagepub.com/doi/abs/10.1177/154193129804200305 | Yes | ||||
An empirical comparison of methods for eliciting and modeling expert knowledge | Robert R. Hoffman | 2002 | This article discusses the application of a variety of cognitive task analysis methods and cognitive field research to support a complete process from knowledge elicitation to leverage point identification and then to system prototyping. Researchers also offer an empirical comparison and evaluation of the CTA methods. | Military | Naval weather forecasters | Hoffman, R. R., Coffey, J. W., Carnot, M. J., & Novak, J. D. (2002). An empirical comparison of methods for eliciting and modeling expert knowledge. Proceedings of the Human Factors and Ergonomics Society Annual meeting, 46(3), 482-486. https://doi.org/10.1177/154193120204600356. | https://journals.sagepub.com/doi/10.1177/154193120204600356 | Yes | ||
Cognitive task analysis using complementary elicitation methods | Sallie E. Gordon | 1995 | This article describes a complementary method of knowledge elicitation for cognitive task analysis that relies on the successive use of document analysis, interviews, task observation, and induction based on review of task performance. | Gordon, S. E. (1995). Cognitive task analysis using complementary elicitation methods. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(9), 525-529. https://doi.org/10.1177/154193129503900919. | https://journals.sagepub.com/doi/abs/10.1177/154193129503900919 | Yes | ||||
Using cognitive task analysis to build a cognitive model | Gary Klein | 2000 | This article discusses how cognitive task analysis methods can be used to build cognitive models, particularly models that are useful in applied projects, such as system development efforts, rather than basic research efforts where the model is the intended output. | Klein, G. (2000). Using cognitive task analysis to build a cognitive model. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 44(6), 596-599. https://doi.org/10.1177/154193120004400614 | https://journals.sagepub.com/doi/abs/10.1177/154193120004400614?journalCode=proe | Yes | ||||
Using cognitive task analysis to facilitate collaboration in development of simulator to accelerate surgical training | Tiffany Grunwald | 2004 | This article describes the use of cognitive task analysis as well as a framework with which to look at a surgical procedure and develop technology that will complement the educational and cognitive goals of the user. | Health Care | Technology design | Grunwald, T., Clark, D., Fisher, S. S., McLaughlin, M., Narayanan, S., & Piepol, D. (2004). Using cognitive task analysis to facilitate collaboration in development of simulator to accelerate surgical training. Studies in Health Technology and Informatics, 98, 114-120. | https://www.researchgate.net/publication/8183272_Using_cognitive_task_analysis_to_facilitate_collaboration_in_development_of_simulator_to_accelerate_surgical_training | No | ||
Leveling up: Using the tracer method to address training needs for esports players. | Kaitlyn M. Roose | 2021 | This article describes the "Tracer Method" which combines the critical decision method with eye tracking to map multiple types of decision making activities to visual search behaviors to improve acquisition of expertise. Researchers collected eye tracking data for and conducted interviews with 25 experienced esports players to: a) identify critical decisions from a competitive game across a group of players to provide a range of training decisions and b) demonstrate the usefulness of the Tracer Method in an esport context with implications for the application to other domains. | CDM | Esports | Professional esports players | Training | Roose, K. M. & Veinott, E. S. (2021). Leveling up: Using the tracer method to address training needs for esports players. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 64, 1780-1784. https://doi.org/10.1177/1071181320641430. | https://journals.sagepub.com/doi/abs/10.1177/1071181320641430 | Yes |
The critical decision audit: Blending the critical decision method & the knowledge audit | Joseph Borders | 2017 | This article proposes a hybrid cognitive task analysis approach that merges the critical decision method and the knowledge audit to streamline the collection of critical incidents and uncover characteristics of expertise. | Borders, J. & Klein, G. (2017). The critical decision audit: Blending the critical decision method & the knowledge audit. Proceedings of the Bi-Annual International Conference on Naturalistic Decision Making, 33-39. | https://www.researchgate.net/profile/Julie-Gore/publication/320146441_Naturalistic_Decision_Making_and_Uncertainty_Proceedings_of_the_13th_Bi-Annual_Naturalistic_Decision_Making_Conference_University_of_Bath_UK/links/59d0aeb30f7e9b4fd7f9fcbf/Naturalistic-Decision-Making-and-Uncertainty-Proceedings-of-the-13th-Bi-Annual-Naturalistic-Decision-Making-Conference-University-of-Bath-UK.pdf#page=44 | No |