Assistant Director Data Scientist

Salary: $116,500 - 169,000 per year Requirements:

• We require a Ph.D. in Computer Science, Machine Learning, Natural Language Processing, Statistics, or another quantitative discipline, or a Masters degree with 2-3 years of experience in machine learning evaluation or a related field.
• We look for a strong grounding in statistical methods, experimental design, and hypothesis testing.
• We need experience assessing machine learning or NLP models, including experiment design and results interpretation.
• We value familiarity with LLM evaluation benchmarks and validation methodologies.
• We require strong programming ability in Python or R.
• We need excellent written and verbal communication skills in English.
• Preferred: experience evaluating LLMs or generative AI systems.
• Preferred: experience working with production machine learning systems.
• Preferred: exposure to cloud platforms such as AWS, GCP, or Azure.
• Preferred: publications or demonstrated work in model evaluation, benchmarking, or a similar area.

• We evaluate and validate large language models for production-grade analytical and decision-support systems.
• We design and build evaluation frameworks to assess LLM performance in credit analytics and decision-support use cases.
• We develop metrics and benchmarks to measure model robustness, reliability, consistency, and output quality.
• We analyze model behavior across varied inputs and identify failure modes, edge cases, and improvement opportunities.
• We partner with model development and deployment teams to embed validation processes into the model lifecycle.
• We carry out systematic checks of model stability over time and across updates.
• We assess model outputs for bias, fairness, and economic relevance in credit risk applications.
• We create and maintain documentation covering evaluation methods, findings, and recommendations.
• We contribute to best practices for LLM evaluation within the Credit COE.

• AI
• AWS
• Azure
• Cloud
• GCP
• Support
• LLM
• Machine Learning
• Python

More:

hackajob is collaborating with Moodys Corporation to connect them with exceptional professionals for this role. At Moodys, we bring together talented people to turn todays risks into tomorrows opportunities, fostering an inclusive environment where everyone can share ideas, think innovatively, and collaborate meaningfully with colleagues and customers. We are transforming how the world understands risk by advancing AI and integrated risk assessment to move from insight to action. Our Credit Center of Excellence (COE) team maintains and enhances our credit analytics and predictive modeling capabilities, working closely with product management, commercial strategy, and go-to-market leaders. You will join a global team spanning US time zones, GMT, and GMT+1. For US-based roles, the anticipated base salary range is $116,500.00 to $169,000.00, with eligibility for incentive compensation. We also offer a competitive benefits package that includes medical, dental, and vision coverage, parental leave, paid time off, a 401(k) plan with company and employee contributions, life, disability, and accident insurance, a discounted employee stock purchase plan, and tuition reimbursement. Moodys is an equal opportunity employer and provides reasonable accommodation in accordance with applicable laws.

last updated 37 week of 2026