Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AWS AI Infrastructure Engineer

$45 - $50 per hour

Experis Technology Group

Our client, a technology organization focused on advanced AI and cloud infrastructure is seeking an AWS AI Infrastructure Engineer to join their team. As an AWS AI Infrastructure Engineer, you will be part of the AI Infrastructure Engineering organization supporting large-scale AI/ML platform delivery and distributed model training. The ideal candidate will have hands-on AWS accelerator experience, strong distributed training and LLM understanding, and the ability to optimize and benchmark AI workloads for performance and scalability. Job Title AWS AI Infrastructure Engineer Location Remote (USA) Pay Range $45/hr - $50/hr What's the Job? Design, build, and support scalable AI/ML infrastructure on AWS for distributed model training and inference. Implement and operate AWS AI accelerator workflows using AWS Trainium/Inferentia, EC2 Trn instances, and the AWS Neuron SDK. Deploy and manage AI workloads using SageMaker and Kubernetes (EKS), ensuring reliable, cloud-native operations. Optimize AI performance through benchmarking, profiling, and tuning, including migration from GPU-based environments to AWS AI accelerators. Collaborate on architecture and engineering practices for LLMs, generative AI systems, and scalable distributed training pipelines. What's Needed? 5+ years of experience in Cloud, Data, or AI Infrastructure, with hands-on support of large-scale AI/ML training workloads in AWS environments. Strong experience with AWS Trainium, Inferentia, EC2 Trn instances, and AWS Neuron SDK for AI model training and inference. Solid understanding of LLMs, generative AI, distributed training concepts, and AI/ML infrastructure fundamentals. Hands-on experience with Kubernetes (EKS), Docker, Python, PyTorch, and cloud-native architectures. Exposure to Trainium or Inferentia is highly preferred, along with experience migrating or optimizing workloads for accelerator-based execution. What's in it for me? Work on mission-critical AI infrastructure that enables large-scale distributed training and inference. Build real-world expertise with AWS AI accelerators (Trainium/Inferentia) and the Neuron SDK. Contribute to performance optimization through benchmarking, tuning, and migration from GPU-based setups. Collaborate with teams focused on scalable, cloud-native AI platform engineering. Opportunity to support immediate-start initiatives with a confidential submission process. Upon completion of waiting period consultants are eligible for: Medical and Prescription Drug Plans Dental Plan Vision Plan Health Savings Account Health Flexible Spending Account Dependent Care Flexible Spending Account Supplemental Life Insurance Short Term and Long Term Disability Insurance Business Travel Insurance 401(k), Plus Match Weekly Pay #J-18808-Ljbffr Experis Technology Group

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AWS AI Infrastructure Engineer in New York, NY vacancy
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for...  ..., and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks...  ...such as Kubernetes, Slurm, Run:ai, AWS, Azure, GCP, VMware, Nutanix, Python, Terraform... 
    Amazon Web Service
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    17 hours ago
  •  ...Sr Cloud AI Platform Engineer Contract Hybrid in NYC Must be local. This is not a Full...  .... We'd like candidates to have strong AWS infra experience (Terraform, VPC, EKS...  ...of AWS services. ~ Experience using Infrastructure as Code tools, with Terraform preferred... 
    Amazon Web Service
    Contract work
    Local area

    PRI Technology

    New York, NY
    2 days ago
  • $200k - $230k

    SVP, Lead AI/MLOps Infrastructure Engineer - Full Time - HybridWe’re partnering with our client, a fast-growing fintech firm, on a senior-level hire...  ...here is MLOps and AI infrastructure first, built on deep AWS, Terraform, and production ML / GenAI experience. What You... 
    Amazon Web Service
    Full time
    Remote work

    Benchmark IT

    New York, NY
    1 day ago
  • Experis Technology Group represents a technology organization seeking an AWS AI Infrastructure Engineer to design scalable AI/ML infrastructure on AWS for distributed model training and inference. The role emphasizes hands-on experience with AWS Trainium/Inferentia, EC... 
    Amazon Web Service
    Remote job

    Experis Technology Group

    New York, NY
    2 days ago
  •  ...build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data...  ...(versioning, monitoring, reproducibility)Comfortable with AWS data services (S3, Lambda, ECS, Glue, Redshift, OpenSearch... 
    Amazon Web Service

    Farther Advisors

    New York, NY
    4 days ago
  • $144.25k - $256.25k

     ...applicable) + benefitsJob Function: Engineering & ArchitectureSchedule: Full...  ...data insights.The Enterprise AI Platform organization builds...  ...grounding (RAG) pipelinesLLM infrastructure, inference, and model...  ...tRPC)Cloud and infrastructure: AWS and/or GCP, KubernetesDistributed... 
    Amazon Web Service
    Visa sponsorship

    American Express

    New York, NY
    17 hours ago
  • $180k - $240k

    Head of AI Platform Engineering Job Details: Location: New York, NY (Hybrid/Onsite)Employment Type...  ...building secure, scalable, and resilient AI infrastructure that enables enterprise-wide adoption...  ...frameworks.Hands-on experience with AWS services including Bedrock, SageMaker... 
    Amazon Web Service

    Yoh

    New York, NY
    2 days ago
  • $175k - $200k

     ...owner for OUTFRONT's internal AI platform. Today, our internal...  ...on the Vercel AI SDK and AWS Bedrock) is moving into production...  ..., and our external agent infrastructure (the Agency Connect MCP server...  ...adoption. Both need a senior engineering owner, and both need to grow... 
    Amazon Web Service
    Full time
    Internship

    OUTFRONT Media

    New York, NY
    2 days ago
  • Opportunities in the BragDev network for U.S.-based technical professionals. Senior AI Infrastructure Engineer (GPU and Model Serving) Senior Full-time Remote, U.S. Python AWS PyTorch MLOps Distributed Systems You run the infrastructure behind AI workloads: GPU... 
    Amazon Web Service
    Full time
    Remote work

    BragDev

    New York, NY
    2 days ago
  • $123k - $215.25k

     ...bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full...  ...engineering, architecture, and infrastructure, providing 24x7 support to...  ...product and design, and enterprise AI platforms on behalf of the...  ...-based LLM platforms such as AWS Bedrock, Azure AI Foundry/... 
    Amazon Web Service

    American Express

    New York, NY
    4 days ago
  • $155k - $215k

     ...develop a firmwide Artificial Intelligence (AI) Development Platform that aligns with...  ...our businesses.This role is for a platform engineering specialist who will help build a firmwide...  ...following platforms - Kubernetes, Cloud (AWS, Azure, and/or Google), API based... 
    Amazon Web Service
    Temporary work

    Morgan Stanley

    New York, NY
    2 days ago
  • $200k - $230k

     ...provider of mission-critical, AI-powered technology and...  ...seeking a Director of AI Platform Engineering to lead the design, development...  ..., architect critical infrastructure, and drive the strategy for multi...  ...LLM APIs (OpenAI, Anthropic, AWS Bedrock), agent frameworks, prompt... 
    Amazon Web Service
    Ongoing contract
    Full time
    Casual work
    Work at office
    Worldwide
    Flexible hours

    SS&C Technologies

    New York, NY
    1 day ago
  • $229.9k - $262.4k

    AI Engineer 5 (Gen AI Platform Services - Agentic Systems) Overview: At Capital One, we are...  .... Our investments in technology infrastructure and world-class talent — along with our...  ...Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs,... 
    Amazon Web Service
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $229.9k - $262.4k

    AI Engineer 5 (GenAI Platform, Agentic Infrastructure) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years...  ...stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and... 
    Amazon Web Service
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $162k - $215k

     ...need at least 5 years of experience in infrastructure engineering, with a track record of delivering production...  .... We need hands-on experience with AWS and/or Azure and/or GCP, including...  ...concepts. We need experience supporting AI and machine learning workloads,... 
    Amazon Web Service
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours
    1 day per week

    BlackRock

    New York, NY
    21 days ago
  • R1 RCM Inc. is seeking an Engineering Manager to lead AI/ML and data teams building AI-native revenue cycle solutions. You will mentor engineers, collaborate...  ...shipping 0-1 products, and proficiency with cloud platforms (AWS/Azure/GCP). #J-18808-Ljbffr R1 RCM Holdco Inc.
    Amazon Web Service
    Work at office

    R1 RCM Holdco Inc.

    New York, NY
    1 day ago
  •  ...Senior AI Platform Engineer Location: New York City, NY/Hybrid Duration: 12+ Months Experience...  ...using clean, maintainable Python and AWS-native tooling. Implement cloud-native...  ...budgets, alerts, quota enforcement) using Infrastructure as Code. Act as a subject matter... 
    Amazon Web Service

    InterSources

    New York, NY
    3 days ago
  •  ...Vice President of Software Engineering, Cloud, Platform & AI Engineering About the Company A leading global financial institution expanding cloud...  ..., with a strong background in Python, and expertise in AWS, Kubernetes, and cloud-native architectures. The ideal candidate... 
    Amazon Web Service

    Confidential

    New York, NY
    4 days ago
  • AI Platform Engineer About Tessera Labs Tessera Labs is redefining how enterprises adopt and operationalize...  ...operates the foundational AI agent infrastructure that lets Tessera run reliably,...  ...infrastructure, also support GCP and AWS. Enable portable infrastructure across... 
    Amazon Web Service

    Tessera Labs

    New York, NY
    1 day ago
  • $229.9k - $262.4k

    Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At...  ...experiences. Our investments in technology infrastructure and world-class talent — along with our...  ...and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs,... 
    Amazon Web Service
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $244.7k - $279.2k

    Staff AI Engineer - Enterprise Analysis Platform (Remote Eligible) At Capital One, we are...  ...experiences. Our investments in technology infrastructure and world-class talent — along with our...  ...and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs,... 
    Amazon Web Service
    Full time
    Part time
    Local area
    Remote work

    Capital One

    New York, NY
    2 days ago
  • Job Title: AI Infrastructure Engineer Job Summary We are seeking an AI Infrastructure Engineer to design, implement, and manage the infrastructure...  ...Kubernetes. Experience with one or more cloud platforms: AWS, Microsoft Azure, or Google Cloud Platform. Experience with... 
    Amazon Web Service
    Full time
    Remote work

    Ova Technologies

    New York, NY
    1 day ago
  • Palona’s AI agents operate continuously in production, handle...  ...and face sharp traffic peaks. Infrastructure is therefore part of the...  ...looking for an Infrastructure Engineer who combines cloud and reliability...  ...Python services, Docker, AWS and selected Azure services,... 
    Amazon Web Service
    Temporary work

    Palona AI

    New York, NY
    1 day ago
  • $290k

    A leading AI company is seeking an experienced Backend Engineer to build scalable systems that connect language models to real-world applications. This fully remote...  ...in Go, Ruby, and Python, with a strong background in AWS and Kubernetes. You will collaborate with top... 
    Amazon Web Service
    Remote job

    Open Select

    New York, NY
    1 day ago
  • To support the expansion of AI capabilities, the full-time Lead AI Infrastructure Operations Engineer will enable, operate, and continuously improve infrastructure for production...  ...production applications Familiarity with AWS services and capabilities related to monitoring,... 
    Amazon Web Service
    Full time
    Remote work

    Virtual Vocations Inc

    New York, NY
    4 days ago
  • $162k - $215k

    AI-Enabled Infrastructure And Systems Engineer Aladdin Platform Engineering powers the technology foundation behind BlackRock's Aladdin platform - a unified...  ...infrastructure across multi-cloud environments (AWS, Azure, GCP) that underpins Aladdin's platform and application... 
    Amazon Web Service
    Apprenticeship
    Work at office
    Work from home
    Worldwide
    Flexible hours
    1 day per week

    Hackajob

    New York, NY
    1 day ago
  •  ...Senior Vice President, Lead AI/MLOps Infrastructure Engineer About the Company Fast-growing fintech firm building AI and machine learning infrastructure...  ...of MLOps and AI infrastructure, with a focus on AWS, Terraform, and production ML/GenAI experience. Key responsibilities... 
    Amazon Web Service

    Confidential

    New York, NY
    1 day ago
  • $229.9k - $286.2k

     ...Requirements: We require a bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related discipline, plus at...  ..., responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or comparable private cloud environments... 
    Amazon Web Service
    Full time

    Capital One

    New York, NY
    23 days ago
  • $229.9k - $286.2k

     ...Requirements: We require a bachelors degree in computer science, AI, electrical engineering, computer engineering, or a related field and at least 6...  ..., responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud... 
    Amazon Web Service
    Full time

    Capital One

    New York, NY
    14 days ago
  • $229.9k - $286.2k

     ...year Requirements: ~ Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field and at least 6...  ...scalable, responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud... 
    Amazon Web Service
    Full time

    Capital One

    New York, NY
    14 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS AI Infrastructure Engineer. Be the first to apply!