Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Cloud DevOps Engineer - AI/ML

Mercor Inc

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.

1. Overview

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking talented Cloud and DevOps Engineers with deep, hands-on expertise in Kubernetes operations, AWS service integration, and Infrastructure-as-Code to bring hands-on technical excellence and elevate the quality of our AI training and inference infrastructure data. This is a full-time commitment of 40 hours per week.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.

2. Key Responsibilities
  • Guide research and engineering teams to close knowledge gaps and improve AI model performance in cloud infrastructure, Kubernetes operations, and Infrastructure-as-Code topics.
  • Design challenging, domain-relevant tasks, and write accurate and well-structured solutions to cluster diagnosis, AWS service integration, and infrastructure automation problems.
  • Evaluate infrastructure engineering tasks and solutions and provide clear, written technical feedback.
  • Develop guidelines and detailed rubrics/evaluation frameworks to assess cluster failure diagnosis, IaC design quality, and CI/CD pipeline reasoning across tasks.
  • Collaborate with other subject matter experts to ensure consistency and accuracy in training data.
3. Core Qualifications
  • 4+ years of dedicated professional experience in cloud infrastructure, DevOps, site reliability, or platform engineering at a recognized, top-tier organization.
  • Hands-on production experience operating Kubernetes, including diagnosing and repairing cluster failures — not solely authoring manifests or using a managed control plane.
  • Production experience with Infrastructure-as-Code, specifically Terraform and/or AWS CDK.
  • Direct experience integrating AWS services in production, including Lambda, API Gateway, and DynamoDB.
  • Experience building and owning CI/CD pipelines.
  • Demonstrable career progression.
  • Ability to engage reliably for at least 40 hours/week during weekdays.
  • Strong written communication skills and the ability to explain complex technical decisions clearly.

About Cincinnatus LLC: Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.

Equal Employment Opportunity: Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

#J-18808-Ljbffr
Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Cloud DevOps Engineer - AI/ML in New York, NY vacancy
  • $75 - $110 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Cloud / DevOps Engineer (Infra & IaC) Type: Contract Compensation: $75–$11... 
    Suggested
    Contract work
    Summer work
    Remote work

    Mercor

    New York, NY
    1 day ago
  •  ...Sciences seeks a Senior/Principal DevOps Engineer to own the infrastructure,...  ...deployment, and reliability of our AI-driven platform serving...  ...NYC, or SF, and requires strong cloud, IaC, and automation skills. You...  ..., and partner with software, ML engineers, and product teams... 
    Suggested

    Prudentia Sciences

    New York, NY
    2 days ago
  • $153k - $260k

     ...Role Over the past year, DV built an AI platform at speed. More than 800 people now...  ...for model traffic, a registry where engineers publish skills and plugins, and a tracing...  ...connector supply chain review. Work across a DevOps org spread over three regions, pairing... 
    Suggested
    Full time
    Work at office
    Remote work

    DoubleVerify Inc.

    New York, NY
    4 days ago
  • $141.1k - $262.1k

     ...Genentech is looking for a Machine Learning Infrastructure DevOps Engineer in New York to join the AI for Drug Discovery team. This role involves designing, implementing, and maintaining scalable ML infrastructure on AWS, collaborating with ML engineers, and automating... 
    Suggested

    Genentech

    New York, NY
    4 days ago
  •  ...architect, build, and maintain the cloud systems that Fortune 500...  ...work closely with backend and ML engineers to ensure our platform is secure...  ...teamMentor team members on DevOps best practices and guide infrastructure...  ...For:Experience supporting ML/AI workloads and GPU... 
    Suggested
    Immediate start
    Home office
    Flexible hours

    Merciv

    New York, NY
    4 days ago
  •  ...TitleQualifications10+ years of experience in IT infrastructure, cloud engineering, and DevOps, with at least 3 years in a leadership role.Bachelor’s...  ...compliance, and vulnerability management.Familiarity with AI/ML concepts and their integration into cloud environments is... 

    Saxon Global

    New York, NY
    4 days ago
  • $160k - $185k

     ...Senior Azure DevOps & Kubernetes Platform Engineer Company Overview: Business Integration...  ..., supplemented with Data & AI, Cybersecurity, Risk &...  ..., and support enterprise cloud platforms. This role will focus...  ...or containerized AI/ML workloads. Familiarity... 
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    19 hours ago
  • $188k - $235k

    Who We AreAddepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable...  ..., Singapore and São Paulo. The RoleWe are seeking a Senior AI Engineer to join our AI Platform team. The AI Platform team is focused on... 
    H1b
    Remote work
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    4 days ago
  •  ...York invites a Lead Architect – Azure & AI to design and deliver cloud-native data solutions on Azure and Snowflake, enabling analytics, ML/AI workloads, and governance. You will...  ...with stakeholders. The role includes DevOps practices and a strong focus on data security... 

    Fractal Analytics

    New York, NY
    23 hours ago
  •  ...AI DevOps EngineerWe are seeking an AI DevOps Engineer to build, automate, and manage the infrastructure and deployment pipelines...  ...role bridges DevOps, MLOps, and cloud engineering to ensure reliable,...  ...).Deploy and support AI/ML models in production using model serving... 
    Remote work

    Ova Technologies

    New York, NY
    4 days ago
  • $193.4k - $290k

     ...services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep...  ...do. Representative Projects Context Engineering & Agent Infrastructure. Build the...  ...systems, with at least 1+ year focused on AI/ML engineering. Staff candidates will typically... 

    Harvey AI

    New York, NY
    3 days ago
  •  ...S:US is seeking an experienced AI Engineer to move AI solutions from experimentation into reliable production. You will build the AI development environment, design agent workflows, and coordinate across IT to deliver secure, reusable capabilities that scale. Reporting... 

    SUS Inc

    New York, NY
    1 day ago
  • $183.1k - $340k

     ...and audit products, including Cloud Audit Suite—a connected set of...  ...Confirmation. As a Principal Software Engineer for Cloud Audit Suite, you will...  ...shift to an engineering-led, AI-native organization, one where...  ...collaborating closely with AI/ML engineers, researchers,... 
    Full time
    Work at office
    Local area
    Flexible hours
    Shift work

    Thomson Reuters

    New York, NY
    5 days ago
  • $146.8k - $272.6k

    Thomson Reuters is building the AI platform that will power the...  ...every day. As a Lead Software Engineer (Staff Engineer), you will own...  ...collaborating closely with AI/ML engineers, researchers, designers...  ...development, building scalable cloud-based applications, web services... 
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    New York, NY
    7 days ago
  • $115k - $225k

     ...week.ABOUT THE TEAMThe Core Platform and AI Engineering team at Parametric is responsible for enhancing...  ...individual will apply deep knowledge of ML, NLP, transformer architectures, and LLMs...  ...standards.Implement and manage cloud deployments using AWS services, ensuring... 
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    3 days per week

    Morgan Stanley

    New York, NY
    9 days ago
  • $155k - $215k

     ...Artificial Intelligence (AI) Development Platform...  ...role is for a platform engineering specialist who will help...  ...- Kubernetes, Cloud (AWS, Azure, and/or Google...  ...organizationsDemonstrated experience in DevOps, understanding of CI/CD...  ...of ModelOps/ ML Ops/ LLM Op.... 
    Temporary work

    Morgan Stanley

    New York, NY
    7 days ago
  • $70 - $85 per hour

     ...Azure AI Application Platform & DevSecOps Engineer Senior Individual Contributor | Azure | Full Stack | Platform...  ...traditional Azure administrator or DevOps position. The successful candidate...  ...Experience with Azure Policy and enterprise cloud governance. · Experience with... 
    Contract work
    Remote work

    Jobrapido

    New York, NY
    2 days ago
  • $123k - $215.25k

     ...benefitsJob Function: Engineering & ArchitectureSchedule:...  ...design, and enterprise AI platforms on behalf of...  ...enabled workloads.Embeds ML-powered AIOps and custom...  ...workloads, including cloud-based LLM platforms such...  ...programming languages, DevOps tools such as Ansible,... 

    American Express

    New York, NY
    5 days ago
  • $200k - $220k

     ...AI Led Engineering – Enterprise AI, Cloud & Platform TransformationSalary: $200,000 – $220,000Role SummaryWe are...  ...brings extensive experience across AI, DevOps, cloud engineering, platform...  ...development, experience deploying AI/ML solutions in production, and the ability... 

    Talent Search PRO

    New York, NY
    4 days ago
  • $253k - $316k

     ...leader who thrives at architecting agentic AI systems and shipping them in production?...  ...investment management software. As a Principal Engineer on the AI Platform team, you will guide...  .... Contributions to open-source AI/ML projects or publications in the space.... 

    Ridgeline, Inc.

    New York, NY
    4 days ago
  •  ...Functional Assignment: The Director of AI Platform Engineering provides strategic leadership for the cloud, platform, and deployment...  ...(API) for the Machine Learning (ML) lifecycle, including model...  ...architecture, ML/AI engineering, or DevOps from leading cloud platforms.... 

    NYC Health + Hospitals

    New York, NY
    2 days ago
  • $152.29k - $250.2k

    Head of AI Platform Engineering - Execution Plane# Careers## Head of AI Platform Engineering...  ...-grade distributed systems, AI/ML platforms, data platforms, or cloud-native runtime services.* Experience...  ...S3, IAM, CloudWatch, and related DevOps tooling.* Familiarity with RAG... 
    Full time
    Work at office
    Local area
    Flexible hours
    3 days per week

    Guardian Life

    New York, NY
    2 days ago
  • $190k - $225k

    ## Director, Digital Engineering – AI & Commerce PlatformsApplyremote type: Hybridlocations...  ..., and evolution of AI-enabled, cloud-native platforms on AWS, with ownership of DevOps and modern engineering practices...  ...supporting or integrating AI/ML capabilities in production... 
    Flexible hours
    Shift work

    Tapestry

    New York, NY
    4 days ago
  • $140k - $200k

     ...industries. Our capabilities span Data & AI, Cybersecurity, Risk & Compliance,...  ...deep industry expertise with engineering excellence to help clients modernize...  ...architecture, leveraging modern AI/ML platforms, agentic workflows, and cloud-native data infrastructure. You... 
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    1 day ago
  •  ...Kensho, the AI innovation hub of S&P Global, offers internship opportunities for aspiring Software Engineers. You will work on server-side and user-facing applications atop ML capabilities, with teams across various product areas. You will learn with experienced engineers... 
    Internship

    S&P Global

    New York, NY
    19 hours ago
  •  ...Nominal Software Engineer OpportunityNominal is building the connected test and operations platform...  ...autonomy leaders like Anduril and Shield AI to next-generation aerospace teams like...  ...machine learning systems.A background in ML, data science, applied AI, or adjacent... 
    Permanent employment

    Nominal

    New York, NY
    2 days ago
  • $205k - $235k

     ...sector expertise, paired with innovative AI-powered technology and an investor...  ...service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business...  ...versioned.Collaborate with Data Engineering and DevOps on pipeline integration, data... 
    Full time
    For contractors
    Work experience placement
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    8 days ago
  • $229.9k - $262.4k

     ...AI Engineer 5 (GenAI Platform, Agentic Infrastructure) Team Description: At Capital One,...  ...questions in real time, our applications of AI & ML are bringing humanity and simplicity to...  ...scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure,... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    AI Engineer 5 (Gen AI Platform Services: Agentic AI)At Capital One, we are creating responsible...  ...in real time, our applications of AI & ML are bringing humanity and simplicity to banking...  ...scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure,... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $229.9k - $262.4k

     ...AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One,...  ...questions in real time, our applications of AI &ML are bringing humanity and simplicity to...  ...scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure,... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Cloud DevOps Engineer - AI/ML. Be the first to apply!