AI DevOps Engineer
Ova Technologies
Job Description
Job Description
Job Title: AI DevOps EngineerJob Summary
We are seeking an AI DevOps Engineer to build, automate, and manage the infrastructure and deployment pipelines that support AI and machine learning applications. This role bridges DevOps, MLOps, and cloud engineering to ensure reliable, secure, and scalable delivery of AI solutions. The ideal candidate has expertise in cloud platforms, container orchestration, CI/CD, Infrastructure as Code (IaC), and observability, with experience supporting production AI and Generative AI workloads.
Key Responsibilities-
Design, implement, and maintain CI/CD pipelines for AI and machine learning applications.
-
Automate the deployment, scaling, and lifecycle management of AI services across cloud and hybrid environments.
-
Build and manage containerized AI workloads using Docker and Kubernetes.
-
Provision and manage infrastructure using Infrastructure as Code (Terraform, Pulumi, or CloudFormation).
-
Deploy and support AI/ML models in production using model serving frameworks and MLOps tools.
-
Monitor application health, infrastructure performance, model availability, and operational metrics.
-
Implement logging, tracing, and observability solutions for AI platforms.
-
Optimize cloud resources, GPU utilization, and infrastructure costs.
-
Integrate security best practices, secrets management, identity management, and compliance controls into AI deployment pipelines.
-
Collaborate with AI engineers, ML engineers, data engineers, platform engineers, and software development teams to streamline AI delivery.
-
Support automated testing, release management, rollback strategies, and disaster recovery for AI systems.
-
Troubleshoot production issues related to AI infrastructure, deployments, networking, and performance.
-
Continuously improve deployment automation, reliability, scalability, and operational efficiency.
-
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
-
4 years of experience in DevOps, Cloud Engineering, Platform Engineering, or Site Reliability Engineering (SRE).
-
Experience supporting AI, machine learning, or data platforms in production environments.
-
Strong programming and scripting skills in Python and Bash; Go is a plus.
-
Hands-on experience with Docker and Kubernetes.
-
Experience with AWS, Microsoft Azure, or Google Cloud Platform.
-
Experience building CI/CD pipelines using GitHub Actions, GitLab CI, Azure DevOps, or Jenkins.
-
Experience with Infrastructure as Code tools such as Terraform or Pulumi.
-
Strong understanding of Linux administration, networking, and cloud security.
-
Experience with monitoring and observability tools such as Prometheus, Grafana, OpenTelemetry, ELK Stack, or Splunk.
-
Experience with MLOps platforms such as MLflow, Kubeflow, SageMaker, Vertex AI, or Azure Machine Learning.
-
Experience deploying Large Language Models (LLMs) and Generative AI applications.
-
Knowledge of model serving frameworks such as KServe, NVIDIA Triton Inference Server, Ray Serve, or BentoML.
-
Experience with vector databases and Retrieval-Augmented Generation (RAG) architectures.
-
Familiarity with Apache Airflow, Kafka, Ray, or Apache Spark.
-
Experience with GPU-enabled infrastructure and NVIDIA CUDA environments.
-
Understanding of AI governance, Responsible AI, and model monitoring practices.
-
Python
-
Bash
-
Go (preferred)
-
Docker
-
Kubernetes
-
Terraform / Pulumi / CloudFormation
-
Git
-
GitHub Actions
-
GitLab CI
-
Azure DevOps
-
Jenkins
-
AWS / Azure / Google Cloud Platform
-
Linux
-
Prometheus
-
Grafana
-
OpenTelemetry
-
ELK Stack
-
Splunk
-
MLflow
-
Kubeflow
-
SageMaker
-
Vertex AI
-
Azure Machine Learning
-
KServe
-
NVIDIA Triton Inference Server
-
Ray Serve
-
BentoML
-
PostgreSQL
-
Redis
-
Strong analytical and troubleshooting skills
-
Excellent communication and cross-functional collaboration
-
Ownership and accountability
-
Ability to thrive in Agile and DevOps environments
-
Strong automation mindset
-
Continuous learning and adaptability
-
Experience with LLMOps and Generative AI deployment pipelines
-
Experience implementing GitOps using Argo CD or Flux
-
Knowledge of service mesh technologies such as Istio or Linkerd
-
Experience with FinOps and cloud cost optimization
-
Cloud, Kubernetes, or DevOps certifications (AWS, Azure, GCP, CKA, CKAD, Terraform)
Hybrid / Remote / On-site (as applicable)
Employment TypeFull-time
- ...AI DevOps Engineer – Talent Attraction & People Analytics New York City – Onsite 3 days per week Position Summary We are seeking someone to join one of the world’s most respected firms in Global Finance. This person would be on their Generative AI team focused...SuggestedFull time3 days per week
- ...Testimonials Employee Glassdoor Reviews If you are a Field Service Engineer looking for excitement, challenge and stability in your work,... ...potential, leveraging our Disruptive Talent Solution. Role: AI DevOps Engineer Location: New York, NY Work Mode: (Hybrid - 3-4...SuggestedContract work3 days per week
$91.1k - $125.2k
DevOps Engineer Elevate organizational performance: power the cloud platform behind our products as our next DevOps engineer! Ready to accelerate... ...delivery and shape cloud infrastructure using agentic AI? Trimble is looking for a proactive DevOps engineer to build scalable...SuggestedFull timeWork at officeLocal areaRemote workWorldwide$150k - $190k
Senior DevOps Engineer Let's be unstoppable together! Circana is a leading provider of technology, AI, and data solutions for consumer-packaged goods companies, manufacturers, and retailers. Our predictive analytics and Liquid Data® platform help clients measure market...SuggestedLocal areaFlexible hoursShift work- ...Job Description Job Description Our client is seeking a GenAI DevOps Engineer / AI Engineer to design, develop, and deploy intelligent AI agents using Claude Agent SDK and Amazon Bedrock, building production-grade agent workflows and implementing CI/CD automation...Suggested
- Simple Solutions - GenAI DevOps Engineer /AI Engineer - Remote/Hybrid with Travel We are seeking a Senior GenAI DevOps Engineer / AI Engineer to design, build, deploy, and support production AI agents on AWS. The role combines AI agent development (approximately 60%) with...Remote job
$139k - $243k
As a Lead DevOps Engineer reporting to the AVP - Systems and Network Administration, you'll play a critical role in building and operating intelligent automation platforms, AI agents, and orchestration frameworks that support mission-critical systems, engineering workflows...Full timeTemporary workWork at officeHome officeFlexible hours3 days per week- ...Overview We are looking for a highly experienced Senior Backend AI Engineer – Agentic AI to design, develop, and scale distributed... ...Gateways, Inference, Evaluation, and Observability. Cloud & DevOps: AWS/GCP, Docker, Kubernetes, CI/CD. Messaging & Workflows...Full time
$176k
...Current PhD, AI Engineering Internship Program - Summer 2027 Key Role Details This is a full-time paid internship program spanning twelve weeks from June through August. Participation in the internship requires that you are located in the continental United States...Full timePart timeSummer workInternshipLocal area$120k - $160k
Genesis10 is currently seeking a Junior Generative AI Engineer - Remote position with a Global Law Firm located in New York, NY. This is a direct hire opportunity. You will join an internal AI Acceleration Team building bespoke AI solutions for legal work, drawing on software...Permanent employmentContract workInternshipRemote work- ...days onsite in New York, NY Our client is seeking a Senior AI Enablement Engineer to design, build, integrate, and operationalize AI-powered... ...Salesforce, Zendesk, Ironclad, or similar systems. ~ Strong DevOps fundamentals, including CI/CD, infrastructure-as-code,...
- ...DevOps / Infrastructure Engineer will Build the infrastructure behind a growing AI platform from the ground up. You’ll own how its API, backend services, and model-serving workloads are deployed, monitored, and scaled through traffic spikes. What you’ll own Set...Hourly pay
- ...Job Title: DevOps Engineer - ADO Pay: $65 hr/w-2 Location: 100% Remote Summary We are seeking a highly skilled DevOps Engineer specializing in Azure DevOps (ADO) to join a dynamic and forward-thinking team for a 4-month contractual engagement. The ideal candidate...Contract workRemote workFlexible hours
$130k - $180k
...Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance, Change... ...seeking a hands-on Forward Deployed AI Engineer to work directly with business... ...control, CI/CD, testing, documentation, and DevOps principles. Deliver secure, maintainable...Temporary workRemote workWorldwide- ...About the Role The DevOps Team at our firm plays a critical role in keeping the production and development environments running smoothly... ...collaborative, creative and intellectually curious DevOps Engineers who are passionate about forming and implementing cutting-edge...
$200k - $240k
...DevOps / Infrastructure Engineer – AI Startup Location: New York City (On-site) Salary: $200,000–$240,000 Base + Equity The Opportunity We're partnering with a well-funded, early-stage AI startup building high-performance infrastructure and developer tools for...Hourly payFull time- ...has a need for a dynamic resource: Description: The Lead DevOps Engineer is a deeply technical role responsible for building the... ...initiative. Specializing in AWS, you will work cross-functionally with AI and ML development teams to design, architect, deploy, and...Full timeRemote work
$300k
...comprised of a dynamic group of traders, quantitative researchers, and engineers who work together to examine the global markets, seeking to... ...research efforts require a fluid mix of skills including AI/ML expertise, engineering pragmatism, statistics, and market intuition...Full timeInternshipVisa sponsorshipWork visaFlexible hours$30 per hour
...AI Software Engineer — Python, Document Intelligence & AWS NextGen Coding Company Location: New York City — Hybrid / In-Person Required Compensation: $30/hour Hours: 40 Hours/Week Engagement: Contract with potential for long-term engagement Eligibility...Contract workImmediate startRemote workVisa sponsorship$75k - $90k
...connecting exceptional technology talent with innovative companies. We provide specialized IT talent across cloud, data, software engineering, and security, delivering secure, scalable, and reliable solutions that help organizations accelerate digital transformation....Full time$300k
...comprised of a dynamic group of traders, quantitative researchers, and engineers who work together to examine the global markets, seeking to... ...low-latency inference systems, or pushing the boundaries of AI research from concept to production, you'll have the opportunity...Full timeInternshipVisa sponsorshipWork visaFlexible hours$98.3k - $135.2k
...Senior and Lead Software Engineers (AI Engineering, .NET, Azure) Chicago, Dallas, Houston or New York (Hybrid) Full-time, direct hire... ...peer design reviews and pair programming, and has a dedicated DevOps group. Leads set technical direction and mentor while still writing...Full timeInternshipRelocation package$150k - $220k
...AI Led Engineering – Enterprise AI, Cloud and Platform Transformation_New York, Bay Area, Dallas, or Chicago_Hybrid_Full-Time Position: AI... ...combining enterprise AI engineering, cloud/platform architecture, DevOps/SRE and observability to modernize mission-critical systems...Full timeWork at officeRemote work$197.3k - $225.1k
...AI Engineer 4 (Gen AI Platform Services) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences....Full timePart timeWork at officeLocal area$229.9k - $262.4k
AI Engineer 5 (Gen AI Platform Services: Agentic Systems) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer...Full timePart timeLocal area- ...Agentic AI Engineer Location- NYC, NY (Hybrid) Mandatory Skills- ETL, Snowflake, Data migration, Agentic AI, Cortex, LangGraph... ..., product owners, backend developers, data engineers, and DevOps teams while following best practices for testing, CI/CD,...
$229.9k - $262.4k
AI Engineer 5 (GenAI Platform, Agentic Infrastructure) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer...Full timePart timeLocal area- ...Role:- DevSecops Security Engineer with Python Location:- New York, NY (Hybrid 3 days onsite, 2 days remote) Job Description:... ...limited to SAST, OSS and SCA applications. Work with Development, DevOps and Security teams to identify and develop automated security...Full timeWork experience placementRemote work
$140 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: Scientific / ML Engineer Type: Contract Compensation: $90–$140/hour...Remote jobContract workPart timeSummer workWeekday work- ...AI Engineer Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises... ...infrastructure (AWS, GCP) including deployment, monitoring, and basic DevOps ~ Experience building internal tools, developer platforms,...Immediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI DevOps Engineer. Be the first to apply!
- machine learning ai engineer New York, NY
- ai engineer New York, NY
- ai prompt engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- senior ai engineer New York, NY
- ai ml engineer New York, NY
- ai research engineer New York, NY
- senior devops cloud engineer New York, NY
- devops engineer contract New York, NY









