AI Infrastructure Engineer
Palona AI
Palona’s AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.
We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona’s AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.
Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.
What you will own:
- Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications.
- Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention.
- Build deployment and release systems that make production changes fast, repeatable, auditable, and safe.
- Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production.
- Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities.
- Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries.
- Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity.
- Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations.
- Build internal tooling and paved paths that let engineers ship and operate services with less manual work.
- Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment.
- 3+ years industrial experience in relevant technical domain.
- Strong software engineering fundamentals and experience building or operating production distributed systems.
- Hands-on experience with a major cloud platform; AWS experience is especially relevant.
- Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging.
- Ability to write reliable automation and services in Python or another modern programming language.
- Sound judgment around availability, latency, scalability, security, and cost tradeoffs.
- A track record of taking ambiguous operational problems from diagnosis through durable resolution.
- Clear communication during architecture reviews, launches, and incidents.
- AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems.
- Competitive Salary and Stock Option Plan.
- Medical, dental, vision, retirement, leave, and disability benefits as applicable.
- Family Leave
- Short Term & Long Term Disability
- Paid time off and company holidays.
- Learning and development support.
$124.8k - $283.8k
...world class global IT team are our top aspirations.What the Role EntailsRole SummaryWe are looking for an experienced Senior AI Infrastructure Engineer to join our team. This role owns the technical evaluation and end-to-end execution of AI infrastructure deployments —...SuggestedFull timeOverseasRelocation package$190k - $260k
...has developed an artificial intelligence (AI) powered technology stack purpose-built... ...large-scale world models - depends on infrastructure that turns thousands of hours of multimodal... ...training throughput. We are looking for engineers who make model training fast: streaming...SuggestedTemporary workWork at officeVisa sponsorship- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...it. We are seeking a senior software engineer to build the platforms and tools that help... ...You will partner with Cluster Operations, infrastructure, inference, security, and data center...Suggested
$135k - $230k
...is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMSAs an AI Engineer, Platform Infrastructure you will build the tooling, and work with our cleared...SuggestedPermanent employmentTemporary workImmediate startWeekend work- ...ServiceNow in Mountain View seeks an experienced infrastructure engineer to shape the Moveworks AI infrastructure. You will architect the next generation of foundational services and scale our platform to support rapid product development. You will partner with machine...Suggested
$228k - $279k
...SUMMARY We are the Platform-as-a-Service Engineering team at EarnIn. We build the... ...are shifting from manual configuration to AI-augmented orchestration, where the platform... ...and operate the agentic systems and core infrastructure that power our platform. You will work across...Full timeFor contractorsWork at officeLocal areaShift work2 days per week- ...Meta is seeking a Software Engineer, SystemML - AI Networking to join the AI Networking Software team within the DC networking organization. You will help own the NCCL-based stack that enables multi-GPU and multi-node communication, integral to Meta's distributed ML workloads...
- ...Google LLC seeks a Practice Customer Engineer with a Cloud AI specialty to accelerate technical wins and drive adoption of complex workloads. You will prototype solutions and provide technical guidance to customers, collaborating with sales to tailor and demonstrate high...
- ...JPMorganChase & Co. in Palo Alto seeks a Software Engineer III to contribute to a fast-moving Payments Technology team, delivering secure... ..., market-leading software. You will guide code quality, lead AI-assisted development practices, and shape design decisions across...For contractors
- ...Aug 20, 2026 Mid-Level to Senior | Engineering & Platform Ops US-based — CA preferred, open to West Coast + remote. Hybrid-friendly... ...model with an automotive skin. THE VIBE We need a AI/ML Infrastructure Engineer who wants more than tickets — someone ready to...Part timeRemote work
- ...Hewlett Packard Enterprise Development LP is seeking a Principal AI and Machine Learning Engineer to lead AI/ML infrastructure benchmarking and automation. The role focuses on switches, throughput, latency, congestion, and workload performance, guiding AI-driven workload...
- ...Moveworks is seeking a Senior Software Engineer for the Agentic App Platform in Mountain View to scale and optimize a cutting-edge Generative AI product for enterprise users. You will help build a robust infrastructure and APIs, partnering with ML and product teams to...
- ...ServiceNow is seeking a Senior Software Engineer to join the Moveworks Agentic App Platform... ...will scale a cutting-edge Generative AI product delivering instant enterprise assistance... ...engine for latency, and build robust infrastructure with comprehensive logging and metrics....Work at office
- ...Rubrik is building the Agent Cloud to monitor, govern, and remediate AI agents across clouds. You will architect secure, scalable foundations (RBAC/ABAC, IAM) and lead cross-functional efforts from design to deployment. You will implement IaC with Terraform/CloudFormation...
- ...Pinterest is seeking a Senior Staff Software Engineer for the AI Platform to scale the AI/ML evaluation system across the company, shaping modernization and execution of a durable evaluation framework for GenAI workloads. You will partner with engineering, research,...Work at office
- ...Kardow in Sunnyvale, CA seeks a senior software engineer to design high-performance AI frameworks for large-scale distributed systems. You will optimize GPU-driven workloads, integrate LLMs, and lead test-automation infra across Kubernetes-based clusters. You are expected...
- ...Predii is seeking an AI/ML Infrastructure Engineer to own multi‑cloud infrastructure across Azure, GCP, and AWS, leveraging Kubernetes/AKS, Terraform, Ansible, and Helm. You will drive DevOps, CI/CD pipelines, and reliability initiatives while ensuring security and SOC...Remote work
- ...Clera is hiring a product engineering role in Palo Alto to build AI-powered productivity software on-site. You will join a product engineering team and turn advances in agent systems into reliable capabilities that help users complete real work, shaping both the underlying...
$66.52 - $88.14 per hour
...development, and enhancement of processes, tools and infrastructure used to support SHC's Data Scientists as they create and deploy AI/ML solutions utilizing the Enterprise Data... ...Overview The Senior Enterprise Data Engineer is responsible for designing and creating...Hourly pay- ...Stanford Health Care is seeking a Senior Enterprise Data Engineer to design complex data pipelines and curated data structures for use by data analysts. The role supports SHC’s enterprise data platform and collaborates with data scientists on DevOps, SecOps and FinOps...
- ...Google LLC is hiring software engineers to develop next-generation technologies at scale in Sunnyvale, CA. You will work across... ...with opportunities to switch teams as projects evolve. The AI and Infrastructure team delivers breakthrough capabilities, enabling Google...
- ...Walmart is seeking a Distinguished Software Engineer to lead the design and development of scalable, cloud-native AI-powered systems. This role owns system-level execution, assures architectural integrity, and drives operational excellence across platforms to deliver...
$180k - $240k
...facilitating effortless integration into customers' logistics operations. About the role We are seeking a Senior AI Infrastructure Engineer to design, build, and scale the high-performance AI platform powering our autonomous driving models. While researchers focus...Odd jobWork at office- ...JPMorganChase is seeking a Senior Director of Software Engineering to lead Data and AI platforms within the Commercial and Investment Bank Operations group. You will oversee multiple departments, set technical strategy, and drive enterprise-wide AI-enabled engineering...
- ...JPMorgan Chase & Co. in Palo Alto is seeking a Senior Director of Software Engineering to shape data and AI platforms within the Commercial and Investment Bank Operations team. You lead multiple technical areas, manage departments, and collaborate across Data and AI...Bank staff
$184k - $287.5k
Joining NVIDIA's DGX Cloud AI Efficiency Team means contributing to the infrastructure that powers our innovative AI research. This team focuses on developing tools... .... We are seeking an AI infrastructure software engineer to join our team. You'll be instrumental in...Full timeRemote work- ...Google LLC is seeking a Senior Director of Cloud AI Safeguards Engineering to lead strategy, design, development, and operations of Safeguards for the Cloud AI portfolio including Vertex AI and Gemini Enterprise. You will bridge advanced AI engineering with robust safety...
$204k - $337k
...realize their greatest potential.Title and SummaryPrincipal AI Platform Engineer - AI Center of ExcellenceWho is Mastercard?Mastercard is a... ...:The AI Center of Excellence is seeking a Principal AI Infrastructure Engineer to build and scale next-generation infrastructure...Full timePart timeWorldwideFlexible hours$184.7k - $324.8k
...Senior Cloud Infrastructure and AI Efficiency Engineer Cupertino, California, United States Software and Services The people here at Apple don't just create products—they create the kind of wonder that’s revolutionized entire industries. We know our ability to continue...RelocationShift work$183.6k - $297k
...Execution, Integrity, and Inclusion. We weave AI into the fabric of everything we do and... ...of integrating AI into cybersecurity infrastructure — building intelligent systems that... ...incidents at scale. As a Principal Software Engineer, you will own the technical vision for...Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!


