Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI DevOps Engineer

Ova Technologies

Job Description

Job Description

Job Title: AI DevOps EngineerJob Summary

We are seeking an AI DevOps Engineer to build, automate, and manage the infrastructure and deployment pipelines that support AI and machine learning applications. This role bridges DevOps, MLOps, and cloud engineering to ensure reliable, secure, and scalable delivery of AI solutions. The ideal candidate has expertise in cloud platforms, container orchestration, CI/CD, Infrastructure as Code (IaC), and observability, with experience supporting production AI and Generative AI workloads.

Key Responsibilities
  • Design, implement, and maintain CI/CD pipelines for AI and machine learning applications.

  • Automate the deployment, scaling, and lifecycle management of AI services across cloud and hybrid environments.

  • Build and manage containerized AI workloads using Docker and Kubernetes.

  • Provision and manage infrastructure using Infrastructure as Code (Terraform, Pulumi, or CloudFormation).

  • Deploy and support AI/ML models in production using model serving frameworks and MLOps tools.

  • Monitor application health, infrastructure performance, model availability, and operational metrics.

  • Implement logging, tracing, and observability solutions for AI platforms.

  • Optimize cloud resources, GPU utilization, and infrastructure costs.

  • Integrate security best practices, secrets management, identity management, and compliance controls into AI deployment pipelines.

  • Collaborate with AI engineers, ML engineers, data engineers, platform engineers, and software development teams to streamline AI delivery.

  • Support automated testing, release management, rollback strategies, and disaster recovery for AI systems.

  • Troubleshoot production issues related to AI infrastructure, deployments, networking, and performance.

  • Continuously improve deployment automation, reliability, scalability, and operational efficiency.

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

  • 4 years of experience in DevOps, Cloud Engineering, Platform Engineering, or Site Reliability Engineering (SRE).

  • Experience supporting AI, machine learning, or data platforms in production environments.

  • Strong programming and scripting skills in Python and Bash; Go is a plus.

  • Hands-on experience with Docker and Kubernetes.

  • Experience with AWS, Microsoft Azure, or Google Cloud Platform.

  • Experience building CI/CD pipelines using GitHub Actions, GitLab CI, Azure DevOps, or Jenkins.

  • Experience with Infrastructure as Code tools such as Terraform or Pulumi.

  • Strong understanding of Linux administration, networking, and cloud security.

  • Experience with monitoring and observability tools such as Prometheus, Grafana, OpenTelemetry, ELK Stack, or Splunk.

Preferred Qualifications
  • Experience with MLOps platforms such as MLflow, Kubeflow, SageMaker, Vertex AI, or Azure Machine Learning.

  • Experience deploying Large Language Models (LLMs) and Generative AI applications.

  • Knowledge of model serving frameworks such as KServe, NVIDIA Triton Inference Server, Ray Serve, or BentoML.

  • Experience with vector databases and Retrieval-Augmented Generation (RAG) architectures.

  • Familiarity with Apache Airflow, Kafka, Ray, or Apache Spark.

  • Experience with GPU-enabled infrastructure and NVIDIA CUDA environments.

  • Understanding of AI governance, Responsible AI, and model monitoring practices.

Technical Skills
  • Python

  • Bash

  • Go (preferred)

  • Docker

  • Kubernetes

  • Terraform / Pulumi / CloudFormation

  • Git

  • GitHub Actions

  • GitLab CI

  • Azure DevOps

  • Jenkins

  • AWS / Azure / Google Cloud Platform

  • Linux

  • Prometheus

  • Grafana

  • OpenTelemetry

  • ELK Stack

  • Splunk

  • MLflow

  • Kubeflow

  • SageMaker

  • Vertex AI

  • Azure Machine Learning

  • KServe

  • NVIDIA Triton Inference Server

  • Ray Serve

  • BentoML

  • PostgreSQL

  • Redis

Soft Skills
  • Strong analytical and troubleshooting skills

  • Excellent communication and cross-functional collaboration

  • Ownership and accountability

  • Ability to thrive in Agile and DevOps environments

  • Strong automation mindset

  • Continuous learning and adaptability

Nice to Have
  • Experience with LLMOps and Generative AI deployment pipelines

  • Experience implementing GitOps using Argo CD or Flux

  • Knowledge of service mesh technologies such as Istio or Linkerd

  • Experience with FinOps and cloud cost optimization

  • Cloud, Kubernetes, or DevOps certifications (AWS, Azure, GCP, CKA, CKAD, Terraform)

Location

Hybrid / Remote / On-site (as applicable)

Employment Type

Full-time

Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the AI DevOps Engineer in New York, NY vacancy
  •  ...AI DevOps Engineer – Talent Attraction & People Analytics New York City – Onsite 3 days per week Position Summary We are seeking someone to join one of the world’s most respected firms in Global Finance. This person would be on their Generative AI team focused... 
    Suggested
    Full time
    3 days per week

    1872 Consulting

    New York, NY
    1 hour ago
  •  ...Testimonials Employee Glassdoor Reviews If you are a Field Service Engineer looking for excitement, challenge and stability in your work,...  ...potential, leveraging our Disruptive Talent Solution. Role: AI DevOps Engineer Location: New York, NY Work Mode: (Hybrid - 3-4... 
    Suggested
    Contract work
    3 days per week

    Alignity

    New York, NY
    3 days ago
  • $91.1k - $125.2k

    DevOps Engineer Elevate organizational performance: power the cloud platform behind our products as our next DevOps engineer! Ready to accelerate...  ...delivery and shape cloud infrastructure using agentic AI? Trimble is looking for a proactive DevOps engineer to build scalable... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Worldwide

    Trimble AgileAssets

    New York, NY
    1 day ago
  • $150k - $190k

    Senior DevOps Engineer Let's be unstoppable together! Circana is a leading provider of technology, AI, and data solutions for consumer-packaged goods companies, manufacturers, and retailers. Our predictive analytics and Liquid Data® platform help clients measure market... 
    Suggested
    Local area
    Flexible hours
    Shift work

    Circana

    New York, NY
    3 days ago
  •  ...Job Description Job Description Our client is seeking a GenAI DevOps Engineer / AI Engineer to design, develop, and deploy intelligent AI agents using Claude Agent SDK and Amazon Bedrock, building production-grade agent workflows and implementing CI/CD automation... 
    Suggested

    Expert In Recruitment Solutions

    New York, NY
    26 days ago
  • Simple Solutions - GenAI DevOps Engineer /AI Engineer - Remote/Hybrid with Travel We are seeking a Senior GenAI DevOps Engineer / AI Engineer to design, build, deploy, and support production AI agents on AWS. The role combines AI agent development (approximately 60%) with... 
    Remote job

    Twine

    New York, NY
    3 days ago
  • $139k - $243k

    As a Lead DevOps Engineer reporting to the AVP - Systems and Network Administration, you'll play a critical role in building and operating intelligent automation platforms, AI agents, and orchestration frameworks that support mission-critical systems, engineering workflows... 
    Full time
    Temporary work
    Work at office
    Home office
    Flexible hours
    3 days per week

    NASDAQ OMX

    New York, NY
    2 days ago
  •  ...Overview We are looking for a highly experienced Senior Backend AI Engineer – Agentic AI to design, develop, and scale distributed...  ...Gateways, Inference, Evaluation, and Observability. Cloud & DevOps: AWS/GCP, Docker, Kubernetes, CI/CD. Messaging & Workflows... 
    Full time

    Neshent Technologies

    New York, NY
    13 days ago
  • $176k

     ...Current PhD, AI Engineering Internship Program - Summer 2027 Key Role Details This is a full-time paid internship program spanning twelve weeks from June through August. Participation in the internship requires that you are located in the continental United States... 
    Full time
    Part time
    Summer work
    Internship
    Local area

    Capital One

    New York, NY
    3 days ago
  • $120k - $160k

    Genesis10 is currently seeking a Junior Generative AI Engineer - Remote position with a Global Law Firm located in New York, NY. This is a direct hire opportunity. You will join an internal AI Acceleration Team building bespoke AI solutions for legal work, drawing on software... 
    Permanent employment
    Contract work
    Internship
    Remote work

    Genesis10

    New York, NY
    2 hours ago
  •  ...days onsite in New York, NY Our client is seeking a Senior AI Enablement Engineer to design, build, integrate, and operationalize AI-powered...  ...Salesforce, Zendesk, Ironclad, or similar systems. ~ Strong DevOps fundamentals, including CI/CD, infrastructure-as-code,... 

    Eliassen Group

    New York, NY
    18 days ago
  •  ...DevOps / Infrastructure Engineer will Build the infrastructure behind a growing AI platform from the ground up. You’ll own how its API, backend services, and model-serving workloads are deployed, monitored, and scaled through traffic spikes. What you’ll own Set... 
    Hourly pay

    The SeventhHire LLC

    New York, NY
    1 day ago
  •  ...Job Title: DevOps Engineer - ADO Pay: $65 hr/w-2 Location: 100% Remote Summary We are seeking a highly skilled DevOps Engineer specializing in Azure DevOps (ADO) to join a dynamic and forward-thinking team for a 4-month contractual engagement. The ideal candidate... 
    Contract work
    Remote work
    Flexible hours

    Prestige Staffing

    New York, NY
    1 day ago
  • $130k - $180k

     ...Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance, Change...  ...seeking a hands-on Forward Deployed AI Engineer to work directly with business...  ...control, CI/CD, testing, documentation, and DevOps principles. Deliver secure, maintainable... 
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    15 hours ago
  •  ...About the Role The DevOps Team at our firm plays a critical role in keeping the production and development environments running smoothly...  ...collaborative, creative and intellectually curious DevOps Engineers who are passionate about forming and implementing cutting-edge... 

    Hedge Fund

    New York, NY
    3 days ago
  • $200k - $240k

     ...DevOps / Infrastructure Engineer – AI Startup Location: New York City (On-site) Salary: $200,000–$240,000 Base + Equity The Opportunity We're partnering with a well-funded, early-stage AI startup building high-performance infrastructure and developer tools for... 
    Hourly pay
    Full time

    Radley James

    New York, NY
    3 days ago
  •  ...has a need for a dynamic resource: Description: The Lead DevOps Engineer is a deeply technical role responsible for building the...  ...initiative. Specializing in AWS, you will work cross-functionally with AI and ML development teams to design, architect, deploy, and... 
    Full time
    Remote work

    ePlus inc.

    New York, NY
    1 hour ago
  • $300k

     ...comprised of a dynamic group of traders, quantitative researchers, and engineers who work together to examine the global markets, seeking to...  ...research efforts require a fluid mix of skills including AI/ML expertise, engineering pragmatism, statistics, and market intuition... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    3 days ago
  • $30 per hour

     ...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week Engagement: Contract with potential for long-term engagement Eligibility... 
    Contract work
    Immediate start
    Remote work
    Visa sponsorship

    NextGen Coding Company

    New York, NY
    1 day ago
  • $75k - $90k

     ...connecting exceptional technology talent with innovative companies. We provide specialized IT talent across cloud, data, software engineering, and security, delivering secure, scalable, and reliable solutions that help organizations accelerate digital transformation.... 
    Full time

    Clinisoltech

    New York, NY
    1 hour ago
  • $300k

     ...comprised of a dynamic group of traders, quantitative researchers, and engineers who work together to examine the global markets, seeking to...  ...low-latency inference systems, or pushing the boundaries of AI research from concept to production, you'll have the opportunity... 
    Full time
    Internship
    Visa sponsorship
    Work visa
    Flexible hours

    Jump Trading

    New York, NY
    3 days ago
  • $98.3k - $135.2k

     ...Senior and Lead Software Engineers (AI Engineering, .NET, Azure) Chicago, Dallas, Houston or New York (Hybrid) Full-time, direct hire...  ...peer design reviews and pair programming, and has a dedicated DevOps group. Leads set technical direction and mentor while still writing... 
    Full time
    Internship
    Relocation package

    1872 Consulting

    New York, NY
    4 days ago
  • $150k - $220k

     ...AI Led Engineering – Enterprise AI, Cloud and Platform Transformation_New York, Bay Area, Dallas, or Chicago_Hybrid_Full-Time Position: AI...  ...combining enterprise AI engineering, cloud/platform architecture, DevOps/SRE and observability to modernize mission-critical systems... 
    Full time
    Work at office
    Remote work

    Bestinfo Systems LLC

    New York, NY
    24 days ago
  • $197.3k - $225.1k

     ...AI Engineer 4 (Gen AI Platform Services) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences.... 
    Full time
    Part time
    Work at office
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    AI Engineer 5 (Gen AI Platform Services: Agentic Systems) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  •  ...Agentic AI Engineer Location- NYC, NY (Hybrid) Mandatory Skills- ETL, Snowflake, Data migration, Agentic AI, Cortex, LangGraph...  ..., product owners, backend developers, data engineers, and DevOps teams while following best practices for testing, CI/CD,... 

    Lorven Technologies

    New York, NY
    15 hours ago
  • $229.9k - $262.4k

    AI Engineer 5 (GenAI Platform, Agentic Infrastructure) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  •  ...Role:- DevSecops Security Engineer with Python Location:- New York, NY (Hybrid 3 days onsite, 2 days remote) Job Description:...  ...limited to SAST, OSS and SCA applications. Work with Development, DevOps and Security teams to identify and develop automated security... 
    Full time
    Work experience placement
    Remote work

    PTR Global

    New York, NY
    28 days ago
  • $140 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: Scientific / ML Engineer Type: Contract Compensation: $90–$140/hour... 
    Remote job
    Contract work
    Part time
    Summer work
    Weekday work

    Mercor

    New York, NY
    13 days ago
  •  ...AI Engineer Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises...  ...infrastructure (AWS, GCP) including deployment, monitoring, and basic DevOps ~ Experience building internal tools, developer platforms,... 
    Immediate start

    CapitalG

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI DevOps Engineer. Be the first to apply!