Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer

Palona AI

Palona's AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.

We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.

Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.

What you will own:
  • Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications.
  • Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention.
  • Build deployment and release systems that make production changes fast, repeatable, auditable, and safe.
  • Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production.
  • Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities.
  • Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries.
  • Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity.
  • Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations.
  • Build internal tooling and paved paths that let engineers ship and operate services with less manual work.
  • Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment.
Requirements
  • 3+ years industrial experience in relevant technical domain.
  • Strong software engineering fundamentals and experience building or operating production distributed systems.
  • Hands-on experience with a major cloud platform; AWS experience is especially relevant.
  • Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging.
  • Ability to write reliable automation and services in Python or another modern programming language.
  • Sound judgment around availability, latency, scalability, security, and cost tradeoffs.
  • A track record of taking ambiguous operational problems from diagnosis through durable resolution.
  • Clear communication during architecture reviews, launches, and incidents.
  • AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems.
Benefits
  • Competitive Salary and Stock Option Plan.
  • Medical, dental, vision, retirement, leave, and disability benefits as applicable.
  • Family Leave
  • Short Term & Long Term Disability
  • Paid time off and company holidays.
  • Learning and development support.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in New York, NY vacancy
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered...  ...(BCM), NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks (vLLM, SGLang),... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    4 days ago
  • $215k - $350k

    We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering... 
    Suggested
    Worldwide
    Home office

    Fortinet

    New York, NY
    1 day ago
  • $350k

     ...Machines The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier...  ...want to build it. About the Role We're hiring an AI Infrastructure Engineer to keep our post-training and reinforcement learning (RL)... 
    Suggested
    Permanent employment
    Visa sponsorship
    Work visa
    Relocation package
    Shift work

    Thinking Machines Lab

    New York, NY
    3 days ago
  • $200k

     ...AI Infrastructure Engineer Location: New York (4 Days Onsite) Base Salary: $200k + 50% bonus This is a rare opportunity to shape the AI foundations of a complex, global organisation at a pivotal moment in its technology journey. You will play a central role... 
    Suggested
    Work at office

    Harnham

    New York, NY
    4 days ago
  •  ...AI Infrastructure SpecialistAs vCluster's AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical...  ...role exists to make that happen.As an AI Infrastructure Engineer, your role will include:Lead Technical Deployments: Drive... 
    Suggested
    Remote work
    Flexible hours

    vCluster

    New York, NY
    3 days ago
  • $112.29k - $161.28k

     ...live and work, in ways they value.In an AI era, we remain ""Guided By Humanity,"" a...  ...OverviewWe are looking for a Senior AI & Cloud Engineer to design, build, and operate...  .... You will bridge the gap between cloud infrastructure, data engineering, and applied AI — developing... 
    Temporary work
    Freelance
    Work at office
    Local area
    Flexible hours

    Publicis Media

    New York, NY
    3 days ago
  • $180k - $225k

    AI Infrastructure Engineer - Agent Sandbox PlatformAs a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code execution layer powering our agentic workflows, deployed across both... 
    Full time
    Immediate start
    Remote work

    Scale AI

    New York, NY
    1 day ago
  •  ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and...  ...of deep industry knowledge and applied AI and data engineering. We help the world’s leading Resources and Utilities organizations... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    2 days ago
  • $175k - $200k

     ...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant...  ...into production, and our external agent infrastructure (the Agency Connect MCP server, which...  ...early partner adoption. Both need a senior engineering owner, and both need to grow into the... 
    Full time
    Internship

    OUTFRONT Media

    New York, NY
    1 day ago
  • $200k - $230k

     ...and technology.Job DescriptionDirector, AI Platform EngineeringLocations: San Francisco...  ...are seeking a Director of AI Platform Engineering to lead the design, development, and...  ...platform engineers, architect critical infrastructure, and drive the strategy for multi-agent... 
    Ongoing contract
    Full time
    Casual work
    Work at office
    Flexible hours

    SS&C Technologies

    New York, NY
    21 hours ago
  • $152.29k - $250.2k

    As the Head of AI Platform Engineering - Execution Plane, you will lead the development and implementation of our enterprise platform’s execution...  ...design reviews, architecture standards, testing, CI/CD, infrastructure automation, incident response, SLOs, runbooks, and... 
    Full time
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    Guardian Life Insurance

    New York, NY
    3 days ago
  •  ...through walls to get things done the right way, we want to build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data foundations powering our financial AI systems. This role sits... 

    Farther Advisors

    New York, NY
    3 days ago
  • $230k - $290k

     ...York( Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps large...  ...same enterprises design, build, and run AI agent platforms on top of it. This role...  ...delivery leadership attached. You will write infrastructure code, agent code, and the documents that... 
    Full time
    Work at office
    Shift work

    AHEAD

    New York, NY
    2 days ago
  • The OpportunityJoin a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data... 

    Goldman Sachs

    New York, NY
    3 days ago
  •  ...The OpportunityMassMutual’s AI Platform Engineering team is seeking an impact-driven AI Platform Engineer to serve as the technical anchor...  ...initiatives. The team operates at the intersection of cloud infrastructure, AI/ML systems, and developer experience—delivering... 

    MassMutual

    New York, NY
    1 day ago
  • $269.1k - $307.2k

     ...Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Work at office
    Remote work

    Capital One

    New York, NY
    3 days ago
  • $205k - $235k

     ...With deep functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with...  ...Within the EY-Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business Leaders, Data... 
    Full time
    For contractors
    Work experience placement
    Summer holiday
    Flexible hours

    EY (Ernst & Young)

    New York, NY
    2 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (GenAI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    21 hours ago
  • $250.8k - $286.2k

     ...Senior Lead AI Engineer (GenAI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    2 days ago
  • $152k - $241.5k

     ...weight models are foundational to American AI leadership and cybersecurity, and that...  ...scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling...  ...and maintain the agent harness.Evaluation infrastructure: Build the systems we use to run and... 
    Full time
    Remote work

    Nvidia

    New York, NY
    3 days ago
  • United States Digital Space LLC is seeking an experienced AI/ML architect for a remote engagement supporting a Fortune 100 pharmaceutical...  ...citizenship or Green Card and a Google Cloud Professional Data Engineer certification. You will leverage Gemini Enterprise, Vertex AI... 
    Remote job

    United States Digital Space LLC

    New York, NY
    2 days ago
  • Google Cloud is seeking a Customer Engineer specializing in Cloud AI to accelerate technical wins and adoption of complex workloads. You will partner with technical sales, write code for prototypes, and deliver demos that showcase new AI solutions to customers. You will... 

    Google

    New York, NY
    21 hours ago
  • $60 - $70 per hour

    Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large-... 
    Remote work

    The Leadership Agency Inc.

    New York, NY
    2 days ago
  • Crusoe Cloud is seeking a Solutions Engineer to help enterprise customers deploy AI/ML workloads on Crusoe's GPU infrastructure. Based in New York City, you will run technical discovery, deliver demos and PoCs, and ensure customers land successfully on the platform. This... 
    Full time

    Linuxconfig

    New York, NY
    4 days ago
  • $120k - $150k

     ...Job Description Job Description Lead Cloud AI Engineer (Lead / Senior) Location: Various U.S. Federal Client Sites (Onsite)...  ...provider of enterprise IT modernization, cloud transformation, and infrastructure solutions supporting U.S. Federal Government agencies. As we... 
    Full time
    Temporary work
    Immediate start

    PGTEK

    New York, NY
    3 days ago
  • As an AI Platform Engineer for AI & Emerging Tech, you will drive AI platform enablement across the enterprise. This role sits at the intersection...  ...guardrails (budgets, alerts, quota enforcement) using Infrastructure as Code. Act as a subject... 

    Luxoft

    New York, NY
    a month ago
  • Shields Group Search is partnering with an AI-native healthcare company to hire its Founding Engineer. This will be the first dedicated engineer on the team, working directly with the CEO to architect, build, and scale the platform powering the business. The platform stack... 

    Shields Group Search

    New York, NY
    1 day ago
  • A leading healthcare AI company in New Jersey is seeking a skilled engineer to build the core platform infrastructure that powers healthcare AI products. You will design scalable services, implement HIPAA-compliant systems, and work closely with AI teams. The ideal candidate... 
    Remote job
    Full time

    Neurex AI Limited

    New York, NY
    2 days ago
  • Traba is seeking a skilled engineer to develop AI products that enhance our staffing marketplace. You will work on implementing frontier models to automate processes across our platform. With over 5 years of experience in full-stack development, you should have strong... 

    Traba

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!