Operations Eng/Annotation Lead

We are seeking an Operations Eng/Annotation Lead to join our client’s team. Responsibilities Own end-to-end quality and coordination of annotation workflows across concurrent streams. Ensure annotation outputs consistently meet the quality bar; identify and resolve systematic error patterns (label inconsistencies, missed edge cases, boundary errors). Serve as primary interface between ML engineers and external annotation vendor, ensuring timely communication on annotation tasks including clarifications, guideline alignment, and QA feedback. Work with engineers to establish and maintain annotation guidelines, protocols, and gold-set standards; verify ground truth sets against engineer intent before large-scale annotation begins. Identify and implement pre-annotation tooling or workflow improvements that increase annotator efficiency and reduce error rates. Track inter-annotator agreement, QA pass rates, and rejection patterns over time; use findings to drive continuous guideline improvement. Develop deep understanding of system performance, track failures, and keep engineering informed. Build intuition on hard corner cases; communicate regularly with engineering to surface failure patterns, flag emerging issues, and drive issues to resolution. Track pipeline health metrics by building and maintaining appropriate tooling. What We're Looking For Ability to pick up and use tools such as SQL, Python, and dashboard platforms. Strong analytical eye to spot quality issues and failure patterns in structured label data. Clear, crisp communicator; comfortable as connective tissue between engineering and external vendors. Organized and self-directed; maintain tracking systems and keep multiple workstreams moving without close oversight. Work US business hours. Requirements Bachelor’s Degree with 3‑4 years of experience or a Master’s Degree with 2 years’ experience in Computer Science, Electrical Engineering, or related field. General Software Engineering skills with ≥3 years of programming experience in Python, familiarity with Linux, and expertise in infrastructure, cloud, and/or MLOps. Team player, good communication skills, self‑starter. Strong teamwork and communication skills to collaborate with cross‑functional teams, including ML and software engineers. Nice to have: Experience building MLOps pipelines for deep learning based perception solutions on AWS or GCP. EEO Statement EOE of Minorities/Females/Veterans/Disabilities #J-18808-Ljbffr Blackstone Technology Group