Presented at the I.C.E. Exchange 2019

San Diego, CA

Concurrent Session: Test Development and Administration Track

What is the hygiene of your item bank? When was the last time your item bank underwent a systematic “cleaning” to confirm your items are accurate, relevant, and important? Full item pool reviews require a significant investment of time and resources, so how do you know whether it makes sense for your organization to review all the items and retire those that do not make the cut? Pool reviews can also impact your established development cycle, so it’s important to plan accordingly.

This session provides insight into the experiences of one licensure program that committed a full year to undergo an item bank review, assessing every item for industry relevance, cognitive complexity, and statistical performance. We will review the bank maintenance policy that defines how often the bank will be cleaned, processes and tools involved, and the benefits and challenges of what worked and what could be improved.


  • Michelle Cohn, National Council of Architectural Registration Boards (NCARB)
  • Bill Johnson, National Council of Architectural Registration Boards (NCARB)
  • Susan Cooley, PMP, Alpine Testing Solutions
  • Laura Brooks, Alpine Testing Solutions

To view the slides from this session, click the button below: