Data Scientist — AI Evaluation Analytics

Hi,

Hope you're doing well.

Momento USA is a global technology consulting, talent acquisition, and creative development firm that addresses clients' most pressing needs and challenges. We are currently looking for a Data Scientist - AI Evaluation Analytics

Location: San Diego, CA (Remote but resource should be in PST time zone)

Position: Data Scientist - AI Evaluation Analytics

Duration: 6 Months

Role Overview

Provide data science and analytical expertise to improve the measurement, reliability, and interpretation of AI system performance through data-driven evaluation approaches.

Key Responsibilities

• Support development and refinement of evaluation metrics, scoring approaches, and benchmark methodologies.
• Validate datasets, data quality criteria, and evaluation inputs to improve reliability of results.
• Analyze evaluation data, performance trends, and measurement signals to generate actionable insights.
• Apply statistical analysis and experimentation techniques to assess AI system effectiveness.
• Develop analytical approaches to identify trends, patterns, and opportunities for improvement.

Required Skills & Experience

• Strong background in data science, analytics, statistics, or related fields.
• Experience designing metrics, analytical frameworks, or measurement approaches.
• Proficiency in Python, SQL, and data analysis techniques.
• Experience working with large datasets and extracting meaningful insights.
• Strong communication skills with the ability to explain analytical results clearly.

Preferred Experience

• Experience evaluating AI/ML systems and agentic AI applications.
• Experience with experimentation, benchmarking, or performance analysis.
• Experience working with software engineering, productivity, or quality metrics.

Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.