AI Infrastructure Engineer
Palona AI
Palona's AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.
We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona's AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle. Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching. What you will own:- Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications.
- Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention.
- Build deployment and release systems that make production changes fast, repeatable, auditable, and safe.
- Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production.
- Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities.
- Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries.
- Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity.
- Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations.
- Build internal tooling and paved paths that let engineers ship and operate services with less manual work.
- Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment.
- 3+ years industrial experience in relevant technical domain.
- Strong software engineering fundamentals and experience building or operating production distributed systems.
- Hands-on experience with a major cloud platform; AWS experience is especially relevant.
- Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging.
- Ability to write reliable automation and services in Python or another modern programming language.
- Sound judgment around availability, latency, scalability, security, and cost tradeoffs.
- A track record of taking ambiguous operational problems from diagnosis through durable resolution.
- Clear communication during architecture reviews, launches, and incidents.
- AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems.
- Competitive Salary and Stock Option Plan.
- Medical, dental, vision, retirement, leave, and disability benefits as applicable.
- Family Leave
- Short Term & Long Term Disability
- Paid time off and company holidays.
- Learning and development support.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer in New York, NY vacancy
- We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention for the next era of digital solutions powered... ...(BCM), NGC, NCCL, NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving frameworks (vLLM, SGLang),...SuggestedFull timeWork experience placementLive inWork at officeLocal area
$215k - $350k
We are seeking an AI Infrastructure Engineer to build, operate, and continuously enhance the Linux and GPU-based infrastructure that powers our AI platforms and performance testing environments. This is a highly hands-on infrastructure, automation, and performance engineering...SuggestedWorldwideHome office$350k
...Machines The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier... ...want to build it. About the Role We're hiring an AI Infrastructure Engineer to keep our post-training and reinforcement learning (RL)...SuggestedPermanent employmentVisa sponsorshipWork visaRelocation packageShift work$200k
...AI Infrastructure Engineer Location: New York (4 Days Onsite) Base Salary: $200k + 50% bonus This is a rare opportunity to shape the AI foundations of a complex, global organisation at a pivotal moment in its technology journey. You will play a central role...SuggestedWork at office- ...AI Infrastructure SpecialistAs vCluster's AI Infrastructure Specialist, you will work directly with customers at the earliest and most critical... ...role exists to make that happen.As an AI Infrastructure Engineer, your role will include:Lead Technical Deployments: Drive...SuggestedRemote workFlexible hours
$112.29k - $161.28k
...live and work, in ways they value.In an AI era, we remain ""Guided By Humanity,"" a... ...OverviewWe are looking for a Senior AI & Cloud Engineer to design, build, and operate... .... You will bridge the gap between cloud infrastructure, data engineering, and applied AI — developing...Temporary workFreelanceWork at officeLocal areaFlexible hours$180k - $225k
AI Infrastructure Engineer - Agent Sandbox PlatformAs a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code execution layer powering our agentic workflows, deployed across both...Full timeImmediate startRemote work- ...combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and... ...of deep industry knowledge and applied AI and data engineering. We help the world’s leading Resources and Utilities organizations...Full timeWork experience placementLive inWork at officeLocal area
$175k - $200k
...dedicated owner for OUTFRONT's internal AI platform. Today, our internal AI assistant... ...into production, and our external agent infrastructure (the Agency Connect MCP server, which... ...early partner adoption. Both need a senior engineering owner, and both need to grow into the...Full timeInternship$200k - $230k
...and technology.Job DescriptionDirector, AI Platform EngineeringLocations: San Francisco... ...are seeking a Director of AI Platform Engineering to lead the design, development, and... ...platform engineers, architect critical infrastructure, and drive the strategy for multi-agent...Ongoing contractFull timeCasual workWork at officeFlexible hours$152.29k - $250.2k
As the Head of AI Platform Engineering - Execution Plane, you will lead the development and implementation of our enterprise platform’s execution... ...design reviews, architecture standards, testing, CI/CD, infrastructure automation, incident response, SLOs, runbooks, and...Full timeLocal areaVisa sponsorshipWork visaFlexible hours- ...through walls to get things done the right way, we want to build the future of wealth management with you.The RoleAs an AI-Native Data Platform Engineer at Farther, you will design and own the canonical data foundations powering our financial AI systems. This role sits...
$230k - $290k
...York( Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD helps large... ...same enterprises design, build, and run AI agent platforms on top of it. This role... ...delivery leadership attached. You will write infrastructure code, agent code, and the documents that...Full timeWork at officeShift work- The OpportunityJoin a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data...
- ...The OpportunityMassMutual’s AI Platform Engineering team is seeking an impact-driven AI Platform Engineer to serve as the technical anchor... ...initiatives. The team operates at the intersection of cloud infrastructure, AI/ML systems, and developer experience—delivering...
$269.1k - $307.2k
...Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeWork at officeRemote work$205k - $235k
...With deep functional and sector expertise, paired with innovative AI-powered technology and an investor mindset, we partner with... ...Within the EY-Parthenon service line, the EY Growth Platforms AI ML Engineering Director will collaborate with Business Leaders, Data...Full timeFor contractorsWork experience placementSummer holidayFlexible hours$229.9k - $262.4k
...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,...Full timePart timeLocal area$229.9k - $262.4k
...Sr. Lead AI Engineer (GenAI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeLocal area$250.8k - $286.2k
...Senior Lead AI Engineer (GenAI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing... ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience in machine...Full timePart timeLocal area$152k - $241.5k
...weight models are foundational to American AI leadership and cybersecurity, and that... ...scrutiny. Our AI Safety & Security Engineering team builds and evaluates AI-powered tooling... ...and maintain the agent harness.Evaluation infrastructure: Build the systems we use to run and...Full timeRemote work- United States Digital Space LLC is seeking an experienced AI/ML architect for a remote engagement supporting a Fortune 100 pharmaceutical... ...citizenship or Green Card and a Google Cloud Professional Data Engineer certification. You will leverage Gemini Enterprise, Vertex AI...Remote job
- Google Cloud is seeking a Customer Engineer specializing in Cloud AI to accelerate technical wins and adoption of complex workloads. You will partner with technical sales, write code for prototypes, and deliver demos that showcase new AI solutions to customers. You will...
$60 - $70 per hour
Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large-...Remote work- Crusoe Cloud is seeking a Solutions Engineer to help enterprise customers deploy AI/ML workloads on Crusoe's GPU infrastructure. Based in New York City, you will run technical discovery, deliver demos and PoCs, and ensure customers land successfully on the platform. This...Full time
$120k - $150k
...Job Description Job Description Lead Cloud AI Engineer (Lead / Senior) Location: Various U.S. Federal Client Sites (Onsite)... ...provider of enterprise IT modernization, cloud transformation, and infrastructure solutions supporting U.S. Federal Government agencies. As we...Full timeTemporary workImmediate start- As an AI Platform Engineer for AI & Emerging Tech, you will drive AI platform enablement across the enterprise. This role sits at the intersection... ...guardrails (budgets, alerts, quota enforcement) using Infrastructure as Code. Act as a subject...
- Shields Group Search is partnering with an AI-native healthcare company to hire its Founding Engineer. This will be the first dedicated engineer on the team, working directly with the CEO to architect, build, and scale the platform powering the business. The platform stack...
- A leading healthcare AI company in New Jersey is seeking a skilled engineer to build the core platform infrastructure that powers healthcare AI products. You will design scalable services, implement HIPAA-compliant systems, and work closely with AI teams. The ideal candidate...Remote jobFull time
- Traba is seeking a skilled engineer to develop AI products that enhance our staffing marketplace. You will work on implementing frontier models to automate processes across our platform. With over 5 years of experience in full-stack development, you should have strong...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!
Related searches
- ai research engineer New York, NY
- machine learning ai engineer New York, NY
- ai developer New York, NY
- senior ai engineer New York, NY
- ai engineer New York, NY
- ai ml engineer New York, NY
- ai prompt engineer New York, NY
- ai engineer remote New York, NY
- data infrastructure engineer New York, NY
- infrastructure engineering manager New York, NY


