AI Bioinformatics Benchmarking Engineer

Role Description

At Sequencing, you'll build and operate the evaluation and validation infrastructure that keeps our AI systems correct, reliable, and regression-protected. This is an execution-focused role:

• Design, implement, and maintain the benchmarking systems that continuously test AI outputs against curated genomic datasets.
• Partner closely with the AI Bioinformatics Engineering Lead to turn interpretation standards into measurable, operational systems.
• Detail-oriented with a systems-thinking mindset; notice the one VCF out of ten thousand that doesn't look right.

Qualifications

• Degree in Bioinformatics, Computational Biology, Genetics, or a related field.
• Deep, hands-on experience with VCFs and real-world genomic datasets.
• Fluency with ClinVar, dbSNP, HGVS standards, and transcript mapping.
• A track record building evaluation frameworks or testing pipelines, Langfuse or similar.
• Experience evaluating LLM-based systems and standing up automated QA at scale.

Requirements

• Build and run automated evaluation pipelines for AI outputs end-to-end.
• Expand regression datasets that cover variant normalization, transcript ambiguity, and disease-level mapping.
• Execute large-scale validation runs across curated VCF datasets, track performance over time, and surface accuracy regressions the moment they appear.
• Grow a structured question bank using related datasets, encoding the edge cases that matter most.
• Ship automated regression tests for every AI release and build dashboards that make variant-level and case-level accuracy visible to the whole team.
• Partner with engineering to wire validation directly into CI/CD, and diagnose and document failure modes as they emerge.

Benefits

• Comprehensive medical, dental, and vision insurance coverage.
• 401(k) with company matching.
• Paid time off (PTO).
• Paid volunteer time off.
• Fully remote work with home office stipend.
• Parental bonding leave.
• Clinical-grade whole genome sequencing for you and your family (private and confidential).