Remote QA Engineer (AI/ML Focus)

Job Description

Job Description

bout Special Projects Engineering LLC

Special Projects Engineering is a small, elite team based in Seattle tackling complex, high-impact problems using advanced AI and automation. We work across domains like autonomous systems, predictive infrastructure, synthetic biology, and next-gen defense tech. When something hasn’t been done before, we don’t shy away — we build it.

What You’ll Do

As a QA Engineer focused on ML/AI systems , your mission is to ensure the reliability, accuracy, and stability of intelligent systems that operate in messy, real-world environments. You’ll design robust testing frameworks and evaluation pipelines to validate everything from perception models to full-stack ML deployments.

Responsibilities:

• Develop and maintain automated test suites for machine learning pipelines and AI-enabled systems

• Create testing strategies for models handling visual, audio, sensor, and textual data

• Validate data inputs, model outputs, performance benchmarks, and edge-case behavior

• Build tools for continuous integration and regression testing across ML components

• Work with ML engineers to define evaluation metrics and acceptable thresholds

• Help ensure models are safe, stable, and robust before deployment

• Identify gaps in test coverage and build test plans that scale with the codebase

What We’re Looking For

• 3+ years in software QA, test automation, or related role

• Hands-on experience testing ML models or AI systems in production environments

• Strong Python skills; bonus if you’ve worked with PyTorch, TensorFlow, or JAX

• Familiarity with ML lifecycle and model validation techniques

• Experience with CI/CD pipelines, test frameworks, and debugging tools

• Detail-oriented mindset with strong instincts for edge cases and failure modes

• Bonus: background in data validation, simulation environments, or robotics

Why Join Us

• Remote first company

• Competitive salary and equity

• Flexible hours and remote-friendly culture

• Full health, dental, and vision insurance

• High-end GPU hardware and compute resources

• Work on real-world AI systems with a high-caliber team

• Fast-moving environment where your work directly impacts production

If you care about building AI that actually works, works well, and works safely — we’d love to talk.