Generative AI Developer

Job ID: R_363991Company: Marsh McLennanLocation: 360 Hamilton Avenue, White Plains, NY 10601, United States of AmericaJob Type: RegularCategory: TechnologyIndustry: Real EstateSalary: 85000Posted Date: 2026-08-31Our not-so-secret sauce.Award-winning, inclusive, Top Workplace culture doesn’t happen overnight. It’s a result of hard work by extraordinary people. The industry’s brightest talent drive our efforts to deliver purposeful work and meaningful impact every day. Learn more about what makes us different and how you can make your mark as a Gen AI Developer at MMA.Marsh McLennan Agency (MMA) provides business insurance, employee health & benefits, retirement, and private client insurance solutions to organizations and individuals seeking limitless possibilities. With offices across North America, we combine the personalized service model of a local consultant with the global resources of the world’s leading professional services firm, Marsh (NYSE: MRSH).A day in the life. We are seeking Gen AI Developer who can build, test, and deploy applications powered by large language models and machine learning tools.Review system performance: Check logs for API errors, latency issues, and output quality from deployed models.Prompt engineering: Refine and test system prompt to improve response accuracy and reduce hallucinations.Integrate APIs: Connect large language models (like GPT-4 or Claude) with internal databases using retrieval-augmented generation (RAG) frameworks.Build pipelines: Write Python code to process data, embed documents, and manage vector databases (such as Pinecone or Milvus).Fine-tune models: Adjust model weights or train smaller open-source models on domain-specific company data.Collaborate with teams: Meet with product managers and software engineers to align AI features with user needs.Run evaluations: Test the application for safety, bias, and edge-case failures using automated testing tools.Optimize costs: Review token usage and API spending to keep cloud infrastructure efficient.Deploy updates: Push new code updates to production environments using CI/CD pipelines.Our future colleague.We’d love to meet you if your professional track record includes these skills:Designing and delivering AI-enabled applications and agentic systems in productionBuilding multi-agent architectures, including planner, executor, reviewer, critic, and supervisor patternsDeveloping tool-calling, function-calling, and memory-enabled agentsUsing LangChain, LangGraph, and similar frameworks for orchestration and workflow designApplying DSPy, prompt engineering, and optimization techniques to improve quality and repeatabilityBuilding production-grade AI services in PythonIntegrating with leading LLM platforms such as Anthropic, OpenAI, and open-source modelsDesigning RAG solutions using vector databasesIntegrating AI systems with enterprise platforms through APIs, workflows, events, and data servicesImplementing observability, evaluation, and optimization for AI systems, including tracing, decision logging, and performance monitoringWorking within governance, security, privacy, and compliance frameworks, ideally in regulated industriesLeading complex technical delivery while collaborating effectively across engineering, product, business, risk, and compliance teamsOverall 10+ years of technology experience, including delivery of scalable, resilient digital productsValuable benefits.We value and respect the impact our colleagues make every day both inside and outside of work. Our culture promotes colleague well-being through robust benefits programs and resources, professional and personal development opportunities, and fulfillment through meaningful work.Some benefits included in this role are:Generous time off, including personal and volunteeringTuition reimbursement and professional development opportunitiesRemote workCharitable contribution match programsStock purchase opportunitiesTo learn more about a career at MMA, check us out our website or flip through recruiting brochure.Follow us on social media to meet our colleagues and see what makes us tick:InstagramFacebookXLinkedInWho you are is who we are. We embrace a culture that celebrates and promotes the many backgrounds, heritages and perspectives of our colleagues and clients. We are always seeking those with ethics, talent, and ambition who are interested in joining our client-focused teams.Marsh McLennan and its affiliates are EOE Minority/Female/Disability/Vet/Sexual Orientation/Gender Identity employers.The applicable base salary range for this role is $83,200 – 124,800. The base pay offered will be determined on factors such as experience, skills, training, location, certifications, education, and any applicable minimum wage requirements. Decisions will be determined on a case-by-case basis. In addition to the base salary, this position may be eligible for performance-based incentives.We are excited to offer a competitive total rewards package which includes health and welfare benefits, tuition assistance, 401K savings and other wellbeing programs as well as employee assistance programs. #LI-REMOTESkillspythonlarge language modelsmachine learningprompt engineeringretrieval-augmented generationvector databaseslangchainlanggraphprompt optimizationproduction deploymentci/cd pipelinesapi integrationai system integrationobservabilityperformance monitoringai governanceai securityai complianceai privacyai evaluationai optimizationai workflow designai system designai feature alignmentai collaborationai technical delivery