Prev Next
Close close-icon

Psychometrician – Assessment Operations

  • Location: Virtual Office, U.S.
  • Opening Date: March 9, 2023
  • Reporting to: Manager, Assessment Operations
  • Status: Full-time, Salary

Position Description

The Psychometrician role on the Assessment Operations team works with Assessment Operations team members to design, plan, conduct, and document test development and analysis activities aligned with professional standards and industry best practices in support of program goals and appropriate use and interpretation of test scores.

Key Responsibilities

  • Accountable for conducting and documenting psychometric analyses (e.g., item and test analyses, forms assembly, security analyses, item calibration, scaling, equating) using classical test theory (CTT) and item response theory (IRT) models
  • Accountable for designing and performing ad hoc analysis for client specific projects outside of the standard analysis offerings
  • Accountable for facilitating workshops (e.g., program design, domain analysis, item development/review, standard setting, rubric development)
  • Accountable for deliverables adhering to client requirements and appropriate industry standards
  • Responsible for other test development analysis including standard setting, blueprint surveys, and practice analysis
  • Responsible for quality control of the work completed within the Assessment operations teams including contributing to project review process, QA requirements, and QA checklists.
  • Responsible for assisting in the building, refining, and documenting of facilitation and analysis tools and processes
  • Responsible for working with the Products and Services Team to provide client and industry input for the development and enhancing of Alpine offerings
  • Responsible for training and mentoring Assessment Operations team members (i.e., Psychometric Associates, Test Development Professionals, and Data Analysts
  • Responsible for engaging in industry research, article publications, and presentations


  • Excellent collaboration, communication (written and verbal), interpersonal, and negotiation skills
  • Excellent critical, strategic, analytical thinking, and problem resolution skills
  • Excellent relationship-building and sales skills
  • Ability to communicate effectively with technical and non-technical audiences
  • Excellent time management and organizational skills with attention to detail and the ability to prioritize and meet deadlines
  • Ability to lead, manage, and work effectively in a virtual environment
  • Ability to work well in and across diverse and multi-disciplinary teams
  • Advanced knowledge of Microsoft Office and Azure products

Position Requirements

  • Ph.D. in a measurement related field required
  • 6+ years of experience working with internal and external clients, stakeholders, and policymakers
  • Extensive knowledge and experience in measurement
  • Comfortable discussing the relationship between measurement and technology
  • Up to 25% travel

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.

About Alpine Testing Solutions

  • Our Vision:
    Be the psychometric, test development and validation, and credential management partner of choice for sustainable credentialing and education programs.
  • Our Mission:
    Provide quality, practical solutions that enable test sponsors to develop, maintain, and continuously improve testing programs; contribute to the science and practice of testing; and enrich the world in which we live.
  • Our Culture:
    We are employee owned and encourage ownership thinking. We are committed to the success of our clients. We are customer service driven, entrepreneurial, team oriented, and supportive. We are equally committed to quality of life. We offer opportunities for rewarding and challenging work; a virtual office environment; competitive compensation packages that include comprehensive benefits, a 401(k) retirement plan, and an Employee Stock Ownership Plan (ESOP); and a commitment to a diverse workforce.

Apply Now

Accepted file type: pdf.
Accepted file type: pdf.