Senior Specialist - Data Sciences

We are seeking an AI Testing Engineer to validate and assure quality of AI/ML systems powering real-time contextual advertising on live video streams. The role involves testing multi-modal AI outputs (video + text), ensuring accuracy of detected moments, and automating validation workflows.This role is critical for native moments validation and system-level QA in a real-time streaming environment.Key ResponsibilitiesValidate AI-generated outputs against labelled datasets and expected outcomesPerform content validation for native moments detection across video streamsDesign and implement automated testing frameworks (Python-based)Build validation harness for:JSON parsing and comparisonStructured output validation using defined schemasConduct multi-modal validation (video, audio, transcript outputs)Execute system integration and end-to-end testingTrack accuracy metrics, defect logging, and root cause analysisAutomate regression and validation pipelines across datasetsCollaborate with Applied Scientists to validate LLM and GenAI outputsWork within AWS environment using services such as:S3 (data storage).Lambda (processing).CloudWatch (monitoring)Required Skills & Experience:Strong Python scripting for automation and testing . Experience in AI/ML model validation and QA workflows.Hands-on with: JSON parsing, schema comparison Data validation pipelinesExperience in testing: Multi-modal AI systems (vision + NLP + audio) LLM outputs and generative AI pipelines. Good understanding of: Structured output validation AI accuracy evaluation techniques Familiarity with AWS cloud environment (S3, Lambda, logging/monitoring) Experience with media/video content analysis workflows preferred Ability to handle mixed manual + automated testing approaches