New grant aims to develop a unified assessment system for EM residency programs

UW emergency physician and associate residency program director Benjamin Schnapp, MD, MEd will be the site leader on a grant from the American Medical Association (AMA) titled, “Development of a Unified System of Assessment and Predictive Learning Analytics Using Entrustable Professional Activities Across Emergency Medicine Residency Program.”

Medical education is moving toward a competency-based system, but there is a significant gap between medical school and residency training. The grant will develop specific, measurable outcomes in the form of entrustable and observable professional activities for Emergency Medicine residents and develop an assessment dashboard and learning analytics platform to track residents as they progress through training. Research includes:

  • A multi-site pilot study of six diverse emergency medicine residency programs.
  • Draft and authenticate tiered EPAs for entering interns, junior residents, senior residents, and those transitioning to independent practice. These will be supported by granular observable practice activities (OPAs).
  • Develop, pilot, and implement a learning analytics dashboard that integrates multi-modal assessment data for EPAs and OPAs.
  • Provide the infrastructure for development of individualized learning plans, clinical competency committee summative decision-making processes, and predictive analytics curves.


  • Predictive analytics curves for early identification of areas for improvement and concrete targets for individualization of learning.
  • A model for specialty residency programs to align medical education assessment and individualize residency training in a competency-based framework.
  • Transformation of competency-based assessment across all ACGME-accredited Emergency Medicine training programs.

The grant is also led by UW Emergency Medicine residency program graduate, Holly Caretta-Weyer, MD, MHPE (2016) who is now the Assistant Program Director for the emergency medicine residency program at Stanford University/Stanford Health Care.