Senior Manager, AI Engineer Solutions & Engineering
$153.77k - $186.33kBristol Myers Squibb
At Bristol Myers Squibb our employees often ask Who are you working fora question that fuels collaboration accountability and urgency in our work. Our purpose-driven culture inspires us to discover develop and deliver innovative medicines to prevail over serious diseases. We offer uniquely interesting and meaningful work opportunities for growth and a supportive environment that values inclusion wellbeing flexibility and comprehensive benefits. This is work that transforms the lives of patients and the careers of those who do it.
At BMS digital innovation and technology are central to our vision of transforming patients lives through science. We are applying AI to accelerate content creation speed up decision making and enable more personalized customer engagement increasingly through enterprise AI assistants and agents that commercial teams use in their daily work.
We are looking for a hands-on AI Engineer who solves real business problems with LLMs. You will design how models are prompted grounded equipped with tools evaluated and governed and you will build the solutions that run on top of them using coding agents to move fast. You will understand how models and agent harnesses work well enough to know when a solution will succeed when it will fail and how to design around both.
Key Responsibilities
- Build and ship LLM-powered solutions (assistant extensions connectors agentic workflows and custom applications) from prototype to production
- Build evaluations first: define what good means for each use case create golden datasets graders and regression suites and use them to drive every prompt tool and model change
- Build with coding agents: use agents such as Claude Code as a daily development tool writing specs directing agents and reviewing and testing their output while owning correctness and quality
- Design around the harness: understand how AI assistant platforms run the agent loop (tool calls context assembly permissions sandboxing) and shape solutions to fit
- Engineer context deliberately: system prompts reusable instructions memory retrieval structured outputs and long-context strategy
- Choose the right build pattern: platform extension vs. connector vs. custom app vs. API-based agent and when not to use an agent
- Select the right model for each task by weighing capability cost latency and risk using your own evals as evidence
- Implement guardrails and human-in-the-loop controls suited to regulated pharma content (MLR review compliance auditability data boundaries)
- Monitor and improve quality cost latency and adoption of deployed solutions using production traces and feedback
- Translate business needs into technical solutions with marketing commercial and IT partners
- Enable the business: explain what AI can do where it breaks and what it is worth
- Raise the teams practice: share reusable patterns review peers work and track new models and platform capabilities
Required Knowledge and Skills
Evaluation and quality engineering
- Designing evals for non-deterministic systems: golden datasets rubric and LLM-as-judge graders human review and regression testing
- Evaluating each layer separately: retrieval tool use multi-step agent trajectories and final output
- Validating the judges themselves: calibrating LLM graders against human labels and spotting grader bias
- Running evals in CI so that changes to prompts tools skills or model versions are measured before release
- Turning evaluation results into improvements (error analysis failure categorization targeted fixes)
Working with coding agents
- Current hands-on daily use of coding agents such as Claude Code (or Codex Cursor or similar) to design build test and refactor real software
- Spec-driven workflows: writing clear specs and acceptance tests breaking work into agent-sized tasks and running agents in parallel or over long tasks
- Configuring agents: project instructions skills MCP servers hooks and permissions
- Reviewing agent output critically. You can explain and defend every line you ship and you know when an agent is going off track.
Applied LLM engineering
- Proven LLM solutions in production not just prototypes
- Strong Python (ideally TypeScript too) API-driven development Git CI/CD and a cloud platform (AWS Azure or GCP)
- Advanced prompt and context engineering: system prompt design few-shot patterns structured outputs reasoning and long-context strategies
- Retrieval and grounding: chunking hybrid search reranking metadata filtering and knowing when connectors or direct file access replace a vector DB
- Agentic patterns: tool and function calling multi-step workflows MCP and judgment on when not to use an agent
- Working with unstructured and semi-structured data (documents PDFs content assets)
Understanding how models and harnesses work
- Transformer fundamentals: tokenization attention context windows and sampling
- The training stack (pretraining instruction tuning RLHF/RLAIF) and how reasoning models differ
- How an agent harness works: the loop tool exposure context management and permissions
- Failure modes (hallucination sycophancy position bias prompt injection tool misuse) and the mitigation for each
- Reasoning about cost latency and quality from first principles
Engineering practices
- LLMOps: tracing observability versioning of prompts and models and cost and usage management
- Security basics: prompt injection via tools and documents data leakage PII least-privilege access
Desirable Experience
- Enterprise AI assistant platforms: hands-on experience building on Claude Desktop (Chat Cowork Code; skills projects plugins connectors) ChatGPT Enterprise (custom GPTs connectors projects) Gemini Enterprise / Gemini for Workspace or similar harnesses
- Building or configuring MCP servers and integrating enterprise systems as connectors
- Agent SDK or API-based agent development for cases that outgrow the assistant platform
- Pharma life sciences or other regulated industries (MLR GxP 21 CFR Part 11 awareness)
- Commercial pharma data and systems (Veeva PromoMats IQVIA) digital marketing content supply chain or HCP/DTC engagement
- Enterprise AI rollout: adoption programs workshops champion networks usage governance
- Multi-agent or sub-agent orchestration (LangGraph or similar)
- Multimodal and document-understanding workloads
- Fine-tuning or distillation (LoRA PEFT) and open-weight models (Hugging Face Llama Mistral)
Qualifications
- Bachelors degree in Computer Science Engineering Data Science or a related field (or equivalent experience)
- 5 years of software or ML engineering experience with at least 1 year building LLM or agent-based solutions
- A portfolio of shipped work such as assistant extensions connectors agent workflows or an eval suite you built
- Strong communication skills including explaining trade-offs to business partners
#LI-Onsite
We hire for skills and capabilities not just credentials if this role excites you but doesnt perfectly match your resume we encourage you to apply anyway.
Compensation Overview:
Princeton - NJ - US: $153770 - $186327The starting pay range(s) listed above is for full-time employees (FTE). You may also be eligible for additional discretionary incentive cash and stock opportunities. We determine starting pay thoughtfully carefully considering the nature of the role required skills work location schedule and the knowledge and experience you bring. Final compensation is guided by pay equity principles and applicable employment laws. Compensation programs are reviewed on an ongoing basis and may be adjusted over time to reflect evolving market factors and individual team or Company performance.
Benefits:
Subject to the terms and conditions of the applicable plans then in effect you may be eligible to participate in our comprehensive benefit plans including wellbeing support retirement and financial protection benefits and insurance offerings (medical dental vision life and disability).
U.S.-based exempt employees are eligible for Flexible Time Off (FTO) which provides paid time off without a set accrual limit subject to manager approval along with 11 paid company holidays each year.
Non-exempt employees RayzeBio employees and employees located in Puerto Rico receive 160 hours of paid vacation annually for new hires (subject to manager approval) 11 paid company holidays and 3 optional holidays.
Depending on eligibility employees may also have access to additional time-off benefits including paid sick leave up to two paid volunteer days per year summer hours flexibility and leaves of absence for medical personal parental caregiver bereavement or military needs. Eligible employees also enjoy an annual Global Shutdown between Christmas Day and New Years Day.
U.S.-based job seekers can explore full benefit offerings at We Work
Where you work matters because collaboration innovation and patient impact happen in many settings. Our roles are structured across four work models: site-essential site-by-design field-based and remote-by-design. The model assigned to this role is based on its core responsibilities. Learn more at People with Disabilities
BMS is dedicated to ensuring that people with disabilities can excel through a transparent recruitment process reasonable workplaceaccommodations/adjustmentsand ongoing support in their roles. Applicants can request a reasonable workplaceaccommodation/adjustmentprior to accepting a job offer. If you require reasonableaccommodations/adjustmentsin completing this application or in any part of the recruitment process direct your inquiries to . Visit access our complete Equal Employment Opportunity statement.
Candidate Rights
BMS will consider qualified applicants with arrest and conviction records pursuant to applicable laws in your area.
For roles based in Los Angeles County only: If you live in or expect to work from Los Angeles County if hired for this position please visit this page for important additional information: roles based in Washington State only: If you live in or expect to work from Washington State if hired for this position please visit this page for important information about the Washington Fair Chance Act.
Data Protection
We will never request payments financial information or social security numbers during our application or recruitment process. Learn more about protecting yourself at data processed in connection with role applications will be treated in accordance with applicable data privacy policies and regulations.
If this posting is missing required information required by local law or incorrect contact BMS at with the Job Title and Requisition number. Do not send application-related inquiries to this email. To check your application status please login to your Candidate Home Account.
R: Senior Manager AI Engineer/ Solutions & EngineeringRequired Experience:
Senior Manager
- ...Hiring: Senior AI Data Engineer | Full-Time Location: Princeton, NJ / NYC, NY – Hybrid Experience: 10+ Years ✅ Visa: Visa-independent... ...ML pipelines, Databricks, Spark, Python, and ML lifecycle management . Key Responsibilities • Design and build AI/ML...SeniorFull time
- ...-performance computing and AI, climate friendly cooling,... ...infrastructure---sustainable solutions and more modern living... .... Chemours is seeking a Senior AI Applications Engineer to join our growing AI & Data... ...and compliancestandards. Manage the full lifecycle of deployed...SeniorFull timeWork at officeRemote work
$55.06 - $63.06 per hour
...Description Job Description Genesis10 is currently seeking a Senior AI Engineer for a contract position with a Global Financial Institution... ...modern agentic frameworks to power intelligent enterprise solutions. Responsibilities: Architect & Scale RAG Pipelines:...SeniorHourly payPermanent employmentContract work- ...STV, Inc. is seeking a Water/Wastewater Project Manager for our Water Practice Group. You'll contribute to water and wastewater project development and execution, guiding design, quality control, and client coordination. Responsibilities include leading project teams,...Senior
- Novo Nordisk A/S in Plainsboro, NJ, seeks a Senior Manager, Patient Support Data Intelligence to lead analytics, data integrity and reporting across the NovoCare Patient Support Platforms. You’ll work with Commercial Insights, IT, Data Governance and external partners...Senior
$60k - $80k
...Job Title: Senior Living Sales Director (Community Relations Director) Location: Princeton, New Jersey Salary Range: $60,000-$80,... ...local businesses, and other professional referral partners. Manage leads and sales activity through YARDI or another CRM platform....SeniorFull timeWork at officeLocal areaWeekend work$130.56k - $195.84k
...Senior Manager, Biostatistics At Genmab, we are dedicated to building extraordinary futures, together, by developing antibody products... ...individuals' unique contributions are valued and drive innovative solutions to meet the needs of our patients, care partners, families...SeniorFull time- A leading recruitment firm is seeking a professional Recruiter to manage client relationships throughout the recruitment process. Ideal candidates will have at least 6 years in HR and 4 years in corporate recruitment within the pharmaceutical or consumer goods sectors....Senior
$120k - $217.5k
Senior AI Security Automation EngineerWho we are looking forState... ...Senior AI Security Automation Engineer to help shape the next... ...platforms, intelligent automation solutions, and engineering... ...summarization, and prompt/version management· Engineer cloud-native AI services...SeniorFull timeTemporary workWork at officeLocal areaFlexible hoursShift work2 days per week$170.47k - $206.57k
...provides paid time off without a set accrual limit, subject to manager approval, along with 11 paid company holidays each year. Non... ...status, please login to your Candidate Home Account. R1607948 : Senior Manager, Biostatistics Data Privacy Link We’re creating...SeniorHourly payFull timeSummer workLive inLocal areaRemote workFlexible hours- Perform financial analysis and budget management activities Manage high-volume budgets and large annual spend portfolios Track and monitor forecasts, rolling estimates, and anchor budgets Support enterprise procurement and accounting systems Prepare executive-level financial...Senior
- Novo Nordisk is seeking a senior role to manage day-to-day pharmacy program operations and drive new initiatives that support patient access while maintaining budget discipline. The position requires collaboration with Brand Marketing, Commercial Insights, Managed Markets...Senior
- ...a life sciences organization in Princeton, is looking to add a Senior Talent Acquisition Partner to their team. This is an advanced-level... ..., and supporting roles Partner closely with hiring managers to understand business needs, define role requirements, and develop...Senior
- ...Senior Qualitative Project Manager We are looking for a self-driven team player with a strong interest in the market research and healthcare industries... ...while also identifying, recommending, and implementing solutions to issues that may arise during a market research...SeniorRemote work
$19.92 - $20.17 per hour
...Assistant Store Manager Hourly rate ranges from $19.92 - $20.17 per hour and is dependent upon qualifications and experience. Benefits include: Company Paid Sick Time, Paid Vacation Time, Paid Holidays, Bereavement Pay, Jury Duty Pay, Contest Prize Awards, 401K Plan...SeniorHourly payLocal area- ...Senior Account Executive, Learning And Workforce Solutions Large companies are rethinking how they build skills as AI changes how work gets done. You will sell the learning and workforce... ...knowledge of corporate learning, talent management, or HR advisory markets, and CRM...Senior
- ...Job Title: Senior Training Lead, Schizophrenia Location: Princeton... ...Analytics. • Work with and/or manage external vendors and internal... ...• Problem solving and solutions-oriented team player • Strong... ...Power Point, Excel, Word and AI applications (ChatGPT/MS Co-Pilot...SeniorWork at officeImmediate start
- ...About Seaton Senior Living Seaton Senior Living, part of the Discovery Senior Living family of companies, is a recognized industry... ...through external outreach, presentations, and business development Manage inquiries from all lead sources, providing timely responses and...SeniorWork at officeLocal area
$97.75k - $115k
...Job Title Senior Facilities Manager Job Description Summary This position has managerial oversight of multiple facilities, an entire... ...facility needs are met including custodial, life-safety, engineering and general maintenance. Ensure that staff implements and...SeniorMinimum wageOngoing contractContract workFlexible hours- ...Senior Director, Product Marketing As Senior Director, Product Marketing, you will shape... ...will work with firm leadership, product management, sales and other partners to translate strategy... ...turn technical capabilities, including AI and agentic AI, into credible business...SeniorWork at officeLocal areaWork from homeFlexible hours
$120.3k - $222.6k
Senior Manager -Patient Support Insights and Analytics Facility: Market Access Location: Plainsboro, NJ, US About the Department Our Marketing & Patient Solutions group creates and delivers human-centered experiences, where innovation meets customer-centricity, driving...SeniorLocal areaFlexible hours- LOCATION: Quincy MA/ Princeton NJ [Hybrid]Generative AI Engineering; Cloud AI / Agentic AI development; Python; AI/ML solution design; full delivery lifecycle; agile delivery; data engineering, performance and security standardsCloud AI / Agentic AI development; Python;...
$100k - $180k
...! We are seeking a skilled and motivated AI Engineer to design, develop, and deploy AI-powered applications and automation solutions. The ideal candidate will have hands-on experience... ...: This job description reflects management's assignment of essential functions; it does...Work at officeLocal areaRemote workWork visaFlexible hours1 day per week- ...We’re Hiring: AI/ML Engineer Location: USA (Remote/Hybrid/Onsite) Employment Type: Full-Time / Contract Visa — OPT/F1 Students... ...intelligent systems and transforming data into impactful solutions? We are looking for a talented AI/ML Engineer to join our...Full timeContract workRemote work
$157k - $212k
...we continue to grow, we’re seeking a Senior Project Manager to lead and scale digital health initiatives... ...stakeholders, including clinical, engineering, product, marketing & brand, and... ...similar Agile tools Familiarity with AI productivity tools (e.g., ChatGPT) A proactive...SeniorFull timeSummer workWork at office2 days per week$76.07k - $98.89k
...Technology|Generative AI|Generative AI for Data Analytics Technical... ...value. Our AI-driven solutions empower financial institutions... ...projects across banking, wealth management, and insurance sectors. If... ...and Experience Generative AI Engineering; Hands-on GenAI; LangGraph and...Full timeTemporary workRelocation- ...Senior Technical Account Manager Bloomberg runs on data. Our products are fueled by powerful information... ..., and we implement technology solutions to enhance our systems, products and... ...closely with our Sales, Product, and Engineering departments to support the...Senior
$175k - $225k
...with You.Experience the Transformative Power of Withum Plus You - that’s the Power in the Plus!Job Description:We are seeking a Senior Manager to join our Forensic and Valuation Services Group (“FVS Group”). The Senior Manager can be based out of any of the following...SeniorFull timeWork at officeLocal area- ...the autonomy to reach your goals. EisnerAmper is seeking a Tax Senior Manager to join the Private Client Services (PCS) practice. We are... ...cultures, ideas and experiences come together to create innovative solutions We understand that embracing our differences is what unites...SeniorFull timeTemporary workPrivate practiceWork at officeLocal areaRemote work
$100k - $120k
...We are seeking an experienced AI Agent & MCP Developer to... ...enterprise-grade Agentic AI solutions using Large Language Models (... ...reasoning, task execution, memory management, and agent-to-agent (A2A) communication... ..., architects, and engineering teams to deliver production-ready...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Manager, AI Engineer Solutions & Engineering. Be the first to apply!
- ai engineer Princeton, NJ
- ai developer Princeton, NJ
- international tax senior Princeton, NJ
- senior sales Princeton, NJ
- senior director Princeton, NJ
- senior network engineer remote Princeton, NJ
- senior manager legal Princeton, NJ
- senior windows systems engineer Princeton, NJ
- senior performance engineer Princeton, NJ
- remote senior salesforce administrator Princeton, NJ







