Examination Editor II

Examination Editor II

Reports to: Manager, Assessment Development


Our organization

We are a medical specialty certifying board serving anesthesiologists. Since 1938, we have been administering certification exams and today we take an innovative approach to certification and continuous learning. We foster practice standards that instill confidence and trust that board-certified anesthesiologists have the knowledge and skills to provide high-quality patient care. We are dedicated to elevating expertise in an evolving profession. Our mission is to advance the highest standards of the practice of anesthesiology. We work together with physician anesthesiologists to ensure they provide the best care possible for every patient, every day.

Position Description

The Examination Editor II is responsible for supporting ABA examination committees, including question authors and editors, in new item development, exam assembly, exam publication using valid test construction methodologies, and item distribution. The Examination Editor II is also responsible for additional activities that support the Assessment Development team. This may include copyediting items for other assessments, maintaining electronic and reference libraries, or other tasks.

This role will have primary editorial responsibility for Resident Reach, a developing assessment program that will explore innovative and non-traditional item types. The Examination Editor II will work within an evolving framework, contributing to the refinement of processes, workflows, and editorial standards while supporting early-stage assessment development. The Examination Editor II will leverage AI and other innovative technologies to support assessment development processes and serve as a resource to the Assessment Development Team.

Education

• Baccalaureate degree in a liberal arts or business-related field.

Skills

• Demonstrates ability to write clearly and concisely with impeccable grammar.
• Demonstrates ability to edit and proofread.
• Demonstrates intermediate to advanced Microsoft Office Suite skills including ability to type 50+ words per minute, Mail Merge in Word, and calculating values, using formulas, and merging data in Excel.
• Communicates clearly, professionally, and respectfully with physician volunteers.
• Effectively resolves problems related to question assignments and item banking software.
• Successfully adapts to the working style and needs of all assigned examination committees.
• Prioritizes and manages multiple tasks while using resources effectively and efficiently.
• Develops and maintains exam project schedules.
• Regularly produces accurate, thorough, professional work.
• Maintains high standards despite pressing deadlines.
• Demonstrates ability to work independently in a developing program environment, where processes and expectations may evolve.

Experience

• 2 to 3 years of test development, medical editing, or related work experience, with demonstrated ability to meet stated objectives.
• Demonstrated experience or strong knowledge in the use of artificial intelligence or other innovative technologies to streamline processes and improve productivity, particularly as it pertains to assessment development.
• Desirable experience includes: product or program management; working with innovative assessment models, technology-enabled content development, or digital learning tools; working on new or pilot programs, product launches, or early-stage initiatives.

Specific Responsibilities

1. ABA Exam Committee Support & Innovative Assessment Development

• Serves as an examination development liaison to question authors and editors, providing advice and guidance regarding editorial issues, emerging item types, and general administrative procedures.
• Assists in planning annual committee meetings, including development and distribution of meeting agendas, assignments, and timelines, adapting approaches as development needs evolve.
• Records and incorporates changes to exam items during committee review, including non-traditional item formats. Conducts quality analysis following the meetings to confirm revisions have been successfully recorded in the item bank.
• Generates reports on item pool and question author/reviewer performance and communicates item and exam development status to committee leadership through regular meetings and monthly calls.

2. Item Development

• Guides question authors and editors through question-writing assignments in the online item development system, providing oversight and follow-up to ensure that deadlines are met.
• Edits exam items for grammar, punctuation, consistency, and accuracy. Keeps all information about exam items and related material confidential and secure from unauthorized access.
• Evaluates item bank needs through pool analysis and creates writing assignments accordingly. Manages item bank content and metadata.

3. Examination Assembly

• Assembles exam drafts based on blueprints and test development principles.
• Collaborates with committee chairs on examination review.
• Reviews exams for clueing and ambiguity.
• Copyedits exams for grammar and ABA style.
• Provides information as needed to psychometricians prior to exam assembly and after exam administration.

4. Examination Publishing

• Builds exam delivery package in item banking system and specification documents.
• Works with vendors to ensure successful exam transfer and publication for delivery.
• Performs quality analysis checks on published exams prior to delivery.

5. Item Publication and Monitoring

• Formats and uploads new items to database quarterly.
• Performs quality analysis checks on all items prior to distribution.
• Provides item IDs to ABA psychometric staff and uploads statistics to ExamDeveloper.
• Answers queries related to test items and monitors diplomate feedback, working with the committees to review and resolve issues.

6. Project Management

• Manages the overlapping requirements of developing multiple exams, including those in early stages of development, to maintain an orderly and efficient workflow and work environment, while ensuring that deadlines are met.
• Monitors and ensures the quality and integrity of all examination material at all stages of development and production.
• Coordinates tasks and projects with others in the department and organization, providing guidance and feedback to ensure a successful outcome.
• Develops, adapts, and regularly updates exam development schedules as assessment programs evolve.
• Maintains documentation of examination development and production procedures.

7. Other

• Additional responsibilities may include question author recruitment, maintenance of volunteer terms, or managing electronic and reference libraries.
• Provides transcription services for item writing workshops.
• Provides transcription services for 8-10 item and exam review meetings per year.
• Provides occasional copyediting for other assessments.

Special Requirements

• Must provide in-person transcription services up to 2 weekends a year.
• Must provide online transcription services after hours.
• Must be available to provide occasional email coverage after office hours to respond to question authors, editors, and committee chairs regarding item development and exam reviews.
• Ability to lift up to 20 pounds maximum.
• Ability to sit for extended periods of time.