Senior AI Application Engineer

Senior AI Application Engineer

Working with Us Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production line to the latest breakthroughs in cell therapy, this is work that transforms the lives of patients, and the careers of those who do it. You'll get the chance to grow and thrive through opportunities uncommon in scale and scope, alongside high-achieving teams. Take your career farther than you thought possible.

Bristol Myers Squibb recognizes the importance of balance and flexibility in our work environment. We offer a wide variety of competitive benefits, services and programs that provide our employees with the resources to pursue their goals, both at work and in their personal lives.

As a Senior Application Engineer within Bristol Myers Squibb's AI Venture Studio delivery team, you will be a hands-on senior individual contributor responsible for building secure cloud-hosted applications including, but not limited to, agentic AI products and cross functional knowledge and context infrastructure. You will design APIs, services, infrastructure patterns, deployment pipelines, semantic-layer evolution patterns for agent context engineering, and agent runtimes that allow AI Accelerator pods to move quickly without giving up reliability, observability, security, or enterprise alignment.

The role is deeply tied to the AI Accelerator delivery model: six two-week sprints over a 12-week cycle to build, test, validate, and prepare MVPs for scaling in a fully agile model. You will leverage the latest technologies to address pharma-specific unsolved problems across R&D, Commercialization, Manufacturing, and Enabling Functions, where critical context is buried in unstructured knowledge files, multimodal documents and reports, operational records, scientific evidence packages, and other evolving knowledge sources.

BMS is an AWS-first engineering environment for these products, so you will default to AWS-native services and patterns while integrating BMS-preferred AI tools such as LangGraph, FastMCP, OpenSearch, Amazon S3 Vectors, Amazon Neptune, PostgreSQL/RDS, Redis, AWS Fargate, LangSmith, and a variety of approved frontier LLM models and APIs.

This is a role for someone excited to work hands-on with the latest AI tools and frontier technologies, pushing the limits of what technology can do to help BMS discover, develop, and deliver innovative medicines.

Key Responsibilities

• Design, build, and operate backend services, APIs, and application components that power AI Accelerator products.
• Develop Python/FastAPI, TypeScript/Node, or similar services that integrate LLM APIs, retrieval systems, workflow engines, and internal enterprise systems.
• Execute AI Accelerator cycles of six two-week sprints over a 12-week cycle by developing, testing, and validating cloud and agentic AI product increments.
• Develop MCP-accessible services that allow approved agents to read, write, search, and maintain structured (e.g. markdown/YAML) knowledge assets.
• Build MCP/FastMCP read-write-search APIs, permissioned knowledge stores, version control, audit trails, access controls, and integrations with AWS-native storage and identity patterns.
• Implement secure application patterns for authn/authz, BMS SSO, BMS Cloud Creds, secrets management, auditability, input validation, and safe service boundaries.
• Partner with frontend engineers to define clean API contracts, streaming response patterns, error handling, and service-level behaviors for AI-powered user experiences.

Agent Runtime, Retrieval, and AWS Platform Patterns

• Build and host agentic workflows using LangGraph, including workflow state, multi-agent orchestration, tool execution, fan-out/fan-in patterns, and durable checkpoints.
• Develop MCP tool integrations and FastMCP servers that allow agents to use governed enterprise capabilities safely and consistently.
• Implement retrieval, memory, and context services using AWS-aligned data stores such as S3, Athena, PostgreSQL/RDS, ElastiCache/Redis, OpenSearch, Amazon S3 Vectors, and Amazon Neptune.
• Build and evolve the semantic layer for SQL and other natural-language-to-code generating agents, enabling novel analytical questions to be grounded in query history, column values, warehouse context, explicit instructions, memory, and governed data tools.
• Package reusable deployment patterns, starter kits, and golden paths for AWS Fargate, serverless services, containers, and production-adjacent AI applications.

DevOps, Infrastructure, Observability, and Evaluation

• Create and maintain CI/CD pipelines, environment configuration, automated tests, infrastructure-as-code, and release processes for cloud AI applications.
• Instrument application reliability, latency, cost, usage, tracing, and model/agent behavior using enterprise observability and AI evaluation tools such as LangSmith or similar platforms.
• Embed automated quality gates, security scans, regression tests, structured output validation gates, and responsible AI guardrail checks into delivery pipelines.
• Build sandboxed agent execution environments where code and data can branch together, transformations are recoverable, provenance is preserved, and merge/audit workflows protect shared data assets.
• Demonstrate MVP progress through bi-weekly demos and technical updates, tracking platform performance, reliability, cost, security, and business-value signals to assess readiness for scaling.
• Continuously improve shared platform patterns based on lessons learned across pods, changing enterprise standards, and advances in AI engineering practices.

Collaboration, Enablement, and Technical Leadership

• Partner with AI Engineers, Data Engineers, Data Scientists, Frontend Engineers, Pod Leads, architects, and product teams to solve complex delivery challenges.
• Continuously refine delivery priorities and technical backlog items based on stakeholder feedback, performance results, sprint reviews, and lessons learned throughout MVP development.
• Help complete MVP transition activities by maturing AI capabilities, adding key features, validating reliability in practice, confirming business value, and assessing production readiness.
• Provide technical coaching through design reviews, code reviews, architecture reviews, incident learning, documentation, and reusable examples.
• Communicate cloud trade-offs clearly, including when to optimize for speed, cost, reliability, compliance, scalability, or long-term maintainability.

Qualifications & Experience:

• Bachelor's or higher degree in Computer Science, Engineering, Science, or a related field.
• 5+ years of experience in software engineering, cloud engineering, platform engineering, or backend application development with increasing responsibility.
• Hands-on experience building cloud-native applications on AWS; familiarity with services such as S3, RDS/PostgreSQL, Athena, ElastiCache/Redis, OpenSearch, Fargate, Lambda, IAM, and VPC patterns.
• Strong proficiency in Python, FastAPI, TypeScript/Node, or comparable backend application frameworks.
• Experience with containers, CI/CD, GitHub-based workflows, automated testing, environment configuration, and infrastructure-as-code such as Terraform, AWS CDK, or CloudFormation.
• Experience building LLM, RAG, or agentic AI applications using frameworks such as LangGraph, LangChain, PydanticAI, Claude Agent SDK, or similar tools.
• Familiarity with MCP/FastMCP, read-write-search APIs, permissioned markdown/YAML stores, vector databases, knowledge graphs, session/state management, structured output validation gates, and evaluation-driven development.
• Experience with SQL, semantic layers, data warehouse context, query history, and systems that translate LLM-derived meaning from unstructured scientific or operational sources into governed data/context layers.
• Experience building sandboxed execution, data branching, provenance, version control, audit, and access-control patterns for agentic or data-intensive applications.
• Practical experience integrating with model providers and a variety of approved frontier LLM models through enterprise AI services such as OpenAI, Anthropic, Gemini, AWS Bedrock, or similar approved channels.
• Effective use of coding agents or AI-assisted development tools such as Claude Code, Codex, Gemini CLI, GitHub Copilot, or similar tools.
• Excitement for experimenting with the latest AI tools and technologies while turning frontier prototypes into reliable foundations that help discover, develop, and deliver innovative medicines.
• Curious and inquisitive mindset, with strong communication skills and comfort operating in fast-moving, cross-functional agile teams.