Senior Data Scientist

Senior Data Scientist

Working with Us Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the lives of patients, and the careers of those who do it. You'll get the chance to grow and thrive through opportunities uncommon in scale and scope, alongside high-achieving teams. Take your career farther than you thought possible.

Bristol Myers Squibb recognizes the importance of balance and flexibility in our work environment. We offer a wide variety of competitive benefits, services and programs that provide our employees with the resources to pursue their goals, both at work and in their personal lives.

As a Senior Data Scientist within Bristol Myers Squibb's AI Venture Studio delivery team, you will be a hands-on senior individual contributor who helps convert ambiguous scientific and business opportunities into measurable AI product hypotheses, experiments, and working solutions. You will partner with AI Engineers, Data Engineers, App/Cloud Engineers, Frontend Engineers, product owners, and domain experts to build and evaluate AI systems across R&D, Commercialization, Manufacturing, and Enabling Functions.

The role sits at the edge of applied data science and AI engineering: you will design evaluation datasets, build analytical features, prototype models, test agent and retrieval performance, measure product impact, support sandboxed data problem solving, and explain model behavior in ways stakeholders can trust. You will help define the good analytical context agents need to perform reliable work, including query history, column values, explicit instructions, memory, data tools, warehouse context, and curated source meaning.

BMS is an AWS-first engineering environment for these products, and your work will use AWS-aligned data and AI services alongside enterprise-preferred tools such as OpenSearch, Amazon S3 Vectors, Amazon Neptune, PostgreSQL/RDS, LangGraph, LangSmith, and a variety of approved frontier LLM models and APIs. This is a role for someone excited to work hands-on with the latest AI tools and frontier technologies, pushing the limits of what technology can do to help BMS discover, develop, and deliver innovative medicines.

AI/ML Experimentation and Product Prototyping

• Frame ambiguous business and scientific questions into measurable AI product hypotheses, success metrics, evaluation plans, and rapid experiments.
• Contribute to six-sprint, 12-week AI Accelerator agile cycles by testing hypotheses, validating AI product increments, and adapting analyses during two-week sprints.
• Build data science prototypes using Python, SQL, notebooks, APIs, and AWS-aligned data services.
• Support sandboxed data problem solving in non-production environments, enabling agents and analysts to branch, transform, test, and audit code-plus-data experiments before promotion.
• Evaluate and curate the analytical context agents and analysts rely on, including explicit instructions, memory, data tools, and curated meaning from source materials and recommend improvements based on measured impact on agent quality. Develop analytical features, embeddings, classifiers, ranking/scoring methods, recommendation logic, simulation approaches, or optimization methods as needed for product outcomes.
• Partner with Data Engineers to shape reliable datasets, retrieval corpora, metadata, and feature pipelines using S3, Athena, PostgreSQL/RDS, vector databases, and knowledge graphs.

Agentic AI, Retrieval, and Evaluation Science

• Design and execute evaluations for LLM, RAG, and agentic workflows, with emphasis on context quality, knowledge curation, semantic evolution, and model quality.
• Build evaluation rubrics, golden datasets, structured output validation, error taxonomies, hallucination risk measurement, and SME review loops.
• Use tools such as LangGraph, LangSmith, PydanticAI, or similar frameworks to test agent behavior, retrieval quality, reasoning traces, and workflow reliability.
• Evaluate whether curated enterprise context improves agent quality, reliability, traceability, and decision usefulness compared with raw document retrieval.
• Assess model and agent outputs for quality, uncertainty, calibration, bias, hallucination risk, traceability, and fitness for intended use.
• Explore approved proprietary and open model options through enterprise channels and recommend model/task pairings based on evidence, risk, cost, and performance.

Decision Science, Analytics, and Impact Measurement

• Define KPIs and analytical measurement plans for AI products, including adoption, user behavior, workflow efficiency, scientific utility, and business value.
• Use bi-weekly demos, sprint reviews, stakeholder feedback, and performance results to measure MVP progress and assess readiness for scaling or production transition.
• Apply statistical modeling, experimental design, causal inference, or quasi-experimental methods where appropriate to separate signal from noise.
• Create clear analyses, visualizations, and narratives that help product teams and stakeholders understand model behavior, limitations, and opportunities.
• Partner with responsible AI, security, quality, and domain experts to ensure evaluations and analytics respect data privacy, scientific integrity, and enterprise governance.

Reusable Patterns, Collaboration, and Technical Leadership

• Contribute reusable notebooks, context-quality evaluation harnesses, analytics templates, prompt/evaluation assets, and data science patterns that can be adopted across pods.
• Participate in code reviews, analysis reviews, design discussions, and technical problem-solving with engineering and product teams.
• Use coding agents and AI-assisted development tools effectively while validating outputs, documenting assumptions, and maintaining scientific rigor.
• Continuously refine analytical priorities and backlogs as insights emerge, incorporating stakeholder input, performance results, and lessons learned throughout MVP development.
• Coach peers on practical data science, evaluation design, measurement strategy, and evidence-based decision making in fast-moving AI delivery environments.

Qualifications & Experience:

• Bachelor's or higher degree in Data Science, Statistics, Computer Science, Engineering, Bioinformatics, Computational Biology, Applied Mathematics, or a related scientific field.
• 5+ years of experience in data science, machine learning, applied AI, analytics, computational science, or related technology roles with increasing responsibility.
• Proficiency in Python, SQL, R and/or common data science libraries such as pandas, NumPy, scikit-learn, PyTorch, TensorFlow, statsmodels, or similar tools and packages.
• Experience applying machine learning, statistics, NLP, information retrieval, experimentation, or decision science to real-world products or scientific/business workflows.
• Experience with LLM applications, RAG, agentic AI, prompt/evaluation design, structured outputs, context-quality evaluation, knowledge curation, and model quality assessment.
• Familiarity with AWS data and AI services such as S3, Athena, RDS/PostgreSQL, OpenSearch, SageMaker, Bedrock, or equivalent cloud tools.
• Experience with evaluation rubrics, hallucination risk measurement, causal inference, simulation, optimization, recommendation methods, and reusable evaluation harnesses.
• Familiarity with vector databases, knowledge graphs, embeddings, metadata strategy, and data quality practices.
• Familiarity with lightweight web prototyping tools such as Streamlit for sharing analyses and exploratory AI demos.
• Experience communicating quantitative findings, assumptions, limitations, and recommendations to technical and non-technical audiences.
• Effective use of coding agents or AI-assisted development tools such as Claude Code, Codex, Gemini CLI, GitHub Copilot, or similar tools.
• Excitement for experimenting with the latest AI tools and technologies while applying scientific rigor to help discover, develop, and deliver innovative medicines.
• Curious and inquisitive mindset, with comfort working in agile pods, learning new domains quickly, and adapting analysis plans as evidence emerges.

Compensation Overview:

Cambridge Crossing: $151,280 - $183,319 Madison - Giralda - NJ - US: $137,530 - $166,654 Princeton - NJ - US: $137,530 - $166,654 Seattle - WA: $151,280 - $183,319

The starting compensation range(s) for this role are listed above for a full-time employee (FTE) basis. Additional incentive cash and stock opportunities (based on eligibility) may be available. The starting pay rate takes into account characteristics of the job, such as required skills, where the job is performed, the employee's work schedule, job-related knowledge, and experience. Final, individual compensation will be decided based on demonstrated experience. Eligibility for specific benefits listed on our careers