Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

$180k - $210k

Harnham

AI Infrastructure Engineer
Location: New York, NY (Hybrid)
Pay: $180k - $210k Base + Bonus

Overview
This role sits within a highly technical investment and technologydriven organisation operating at the intersection of advanced data, engineering and artificial intelligence. The business is known for its strong engineering culture, longterm investment in infrastructure, and a highly collaborative, researchled environment.
You will be part of a team responsible for designing and building the core infrastructure that enables AI and agentbased systems to operate securely, reliably and at scale. This is a handson engineering role with real ownership, focused on production systems rather than experimentation.


Responsibilities
  • Design, build and operate productiongrade Kubernetes clusters supporting AI and agentbased workloads
  • Architect and scale core AI infrastructure platforms used across the organisation
  • Build and maintain containerised platforms and supporting DevOps tooling
  • Implement security, governance and access controls across AI infrastructure
  • Support reliability, availability and performance of critical AI systems (SREstyle ownership)
  • Integrate infrastructure with networking, gateways and firewallcontrolled environments
  • Partner closely with AI, platform and engineering teams to enable adoption and best practices
  • Contribute to longterm infrastructure strategy and standards
MustHave Qualifications
  • Minimum 3+ years' experience operating production Kubernetes environments
  • Strong background in infrastructure engineering, SRE or platform engineering
  • Solid experience designing secure systems (API security, authentication, access controls)
  • Experience with containerised systems and modern cloudnative architectures
  • Professional software engineering experience building scalable, reliable systems
  • Computer Science degree or equivalent practical experience
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in New York, NY vacancy
  • $60 per hour

    A technology company seeks proficient programmers to contribute to AI development. This remote role offers flexible scheduling, allowing you to select projects that fit your availability. Applicants should be fluent in English and possess coding skills in languages like... 
    Suggested
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  •  ...transform critical institutions with applied AI. We care that industries that power the...  ...bring: Forward-deployed expertise in engineering, product, and research Mosaic, our in...  ...About the role We're hiring an AI Infrastructure Engineer to own the infrastructure,... 
    Suggested
    Contract work

    Percepta

    New York, NY
    2 days ago
  •  ...HTEC Group is hiring for a software development position focused on next-generation AI compute platforms. You will design and implement software components across various stacks while collaborating with compiler developers and ML scientists. Candidates should have at... 
    Suggested

    HTEC Group Inc

    New York, NY
    3 days ago
  •  ...Founders Fund–backed NVIDIA cloud partner building the infrastructure platform that powers AI at scale. We connect AI Factories—high-performance GPU...  ...onboarding. Your job is to change that. As an AI Infrastructure Engineer, you'll work directly with AI platform customers to get... 
    Suggested
    Remote work

    Slope

    New York, NY
    3 days ago
  • $170k - $210k

     ...Utilidata is a fast‑growing NVIDIA‑backed AI company enabling AI data centers to...  ...more compute capacity from existing energy infrastructure. For over a decade, we have applied AI to...  ...to them. The AI Infrastructure Engineer is responsible for designing, building,... 
    Suggested
    Local area
    Remote work
    Flexible hours

    Utilidata

    New York, NY
    3 days ago
  •  ...As vCluster’s AI Infrastructure Engineer, you will work directly with customers at the earliest and most critical stage of their journey: from bare metal GPU nodes through to a production-ready deployment. This is not a traditional professional services role; you operate... 
    Remote work
    Flexible hours

    vCluster

    New York, NY
    14 hours ago
  • $200k - $250k

     ...AI Infrastructure Engineer Chicago, New York Jump Trading Group is committed to world class research. We empower exceptional talent across the mathematical and computational sciences to push past scientific boundaries and apply cutting edge research to global financial... 

    Jump Trading

    New York, NY
    14 hours ago
  •  ...Tribe is seeking an experienced engineer to deploy AI systems in Fortune 500 enterprises. You will work hands-on with cloud platforms such as AWS, GCP, or Azure and have strong Kubernetes experience. This role demands deep production debugging skills and the ability to... 
    Remote work

    Tribe

    New York, NY
    3 days ago
  •  ...A leading U.S. technology firm is hiring an AI Infrastructure Engineer for a full-time remote position with H-1B visa sponsorship available. This role involves designing and optimizing AI platforms, deploying Kubernetes and Docker container environments, and enhancing... 
    Full time
    H1b
    Remote work
    Visa sponsorship

    NewsNowGh

    New York, NY
    3 days ago
  •  ...TetraScience is the Scientific Data and AI company. We are catalyzing the Scientific...  ...players in compute, cloud, data, and AI infrastructure have converged on TetraScience as the de...  ...We’re looking for a Senior AI Platform Engineer to help design, build, and scale our AI... 
    Immediate start
    Remote work
    Flexible hours

    TetraScience

    New York, NY
    3 days ago
  • $165k - $200k

     ...AI Infrastructure Engineer New York, New York We see the world differently at Capstone Investment Advisors. You will, too. Capstone Investment Advisors, LLC ("Capstone") is a global asset manager, dedicated to exploring alpha opportunities in derivatives and... 
    Minimum wage

    Capstone Investment Advisors

    New York, NY
    2 days ago
  •  ...we partner with a global logistics company leveraging AI, Machine Learning, and Data Engineering to optimize warehouse operations, predictive...  ...route planning. Role: Build and maintain scalable AI infrastructure, enabling teams to run ML experiments, deploy machine... 
    Long term contract
    Remote work

    Sphere Software

    New York, NY
    3 days ago
  •  ...A cutting-edge tech company is seeking a Customer Engineer to bridge technical expertise and sales acumen. The role involves providing technical guidance, leading demonstrations, and cultivating relationships with clients. Candidates should possess a Bachelor's degree... 
    Remote work

    Armada

    New York, NY
    3 days ago
  • $60 - $70 per hour

     ...Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large... 
    Remote work

    The Leadership Agency Inc.

    New York, NY
    3 days ago
  •  ...Lead Software Engineer We have an opportunity to impact your career and provide an adventure...  .... This role requires a strong AI-forward mindset. We are looking for engineers...  ...~ Strong experience with Terraform and infrastructure-as-code principles ~ Solid... 

    Chase

    Jersey City, NJ
    4 days ago
  • A pioneering AI legal tech firm is seeking an Infrastructure Engineer to support its AI-driven platform. You will design and maintain distributed systems, ensuring stability and security while optimizing performance. The ideal candidate has extensive experience in backend... 

    Anytime AI Inc.

    New York, NY
    14 hours ago
  • $150k - $250k

    Owl Labs Inc. is looking for a Senior Software Engineer (Infrastructure) based in New York City. This role involves designing, implementing, and evolving infrastructure solutions using AWS services. Candidates should have 3-6 years of experience, strong AWS skills, and... 

    Owl Labs Inc.

    New York, NY
    4 days ago
  •  ...customers in the initial adoption of the HPE PCAI Private Cloud AI product.* Project manage the customer and use case* Provide...  ...are transitioning to a secure, cloud-enabled, mobile-friendly infrastructure. Many rely on a combination of both. Wherever they are in that... 
    Local area

    Hewlett Packard Enterprise Development LP

    New York, NY
    3 days ago
  • $100k - $200k

     ...Nscale is seeking a Senior Network Engineer for AI Infrastructure to ensure the operational health of their high-speed interconnects. With 5+ years of experience in network engineering, you'll be responsible for maintaining and optimizing large-scale Infiniband and RoCE... 
    Remote work

    Nscale

    New York, NY
    3 days ago
  •  ...NOVA Corporation seeks an AI Engineer to support the International Trade Administration's AI Center of Excellence. The role involves delivering AI solutions across the system lifecycle, focusing on model development, deployment, and optimization within secure federal IT... 
    Remote work

    Nova Usa

    New York, NY
    3 days ago
  •  ...A global technology firm is seeking a Senior AI Software Engineer to enhance cloud networking and AI products. In this role, you will deliver high-quality solutions to complex challenges, manage APIs in cloud-native environments, and mentor team members. The ideal candidate... 

    Solo.io, Inc.

    New York, NY
    3 days ago
  •  ...is seeking a talented developer to join its Corellium team in Washington, DC. The role focuses on developing scalable, cloud-native AI solutions on AWS, including job orchestration and API integrations. Applicants should have proficiency in Python, Typescript, and hands... 

    Cellebrite

    New York, NY
    3 days ago
  •  ...Citrin-Cooperman Advisors LLC is seeking a Senior Cloud Engineer to be part of their AI Solutions team. This role focuses on the architecting, deployment, and management of AI infrastructure, requiring strong expertise in cloud engineering, security, and Infrastructure... 

    Citrin-Cooperman-Advisors-LLC

    New York, NY
    3 days ago
  • A leading technology firm is seeking an experienced Infrastructure Engineer to build and maintain the platform layer for large-scale machine learning...  ...reliability and performance of infrastructure supporting AI systems. Candidates should have over 5 years of experience,... 

    Maxana

    New York, NY
    3 days ago
  •  ...A technology investment firm is seeking an experienced Zero Knowledge engineer to join their team in the United States. The role entails researching, developing, and implementing cutting-edge zero-knowledge systems and algorithms to bring ZK products to a broad audience... 

    Panga Capital

    New York, NY
    3 days ago
  •  ...NOVA Corporation is seeking a Low Code AI Engineer to support the International Trade Administration by developing and maintaining AI solutions. This role requires expertise in machine learning and cloud environments, with a focus on automating and deploying AI models.... 
    Remote work

    Nova Usa

    New York, NY
    3 days ago
  •  ...We are seeking a highly skilled AI Infrastructure & Cloud Engineering Consultant to lead the adoption of AI-enabled operational practices across enterprise infrastructure environments. This role focuses on leveraging Generative AI and Infrastructure as Code (IaC) to improve... 
    Hourly pay
    Freelance

    Solomon Page

    New York, NY
    2 days ago
  •  ...United Therapeutics Corporation is looking for a skilled software engineer to design and develop scalable web AI applications utilizing modern frameworks such as C# Blazor and Azure. The role requires collaboration with business stakeholders and expertise in cloud architecture... 

    United Therapeutics

    New York, NY
    3 days ago
  •  ...A global tech company is seeking an experienced professional to assist customers in adopting their Private Cloud AI product. The role involves managing customer projects, providing hands-on support, and conducting product training. Ideal candidates will have strong skills... 

    Hewlett Packard Enterprise Development LP

    New York, NY
    3 days ago
  •  ...Principal Software Engineer If you are looking for a game-changing career, working for one of the world's leading financial institutions...  ..., design, development, and technical troubleshooting for AI-enabled applications. Creates complex and scalable coding frameworks... 
    Work experience placement
    Work at office

    Chase

    Jersey City, NJ
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!