AI Infrastructure Engineer
Palona AI
Palona’s AI agents operate continuously in production, handle real-time guest interactions, integrate with restaurant systems, and face sharp traffic peaks. Infrastructure is therefore part of the product: latency, reliability, deployment safety, observability, security, and cost directly shape the guest and operator experience.
We are looking for an Infrastructure Engineer who combines cloud and reliability depth with strong software engineering judgment. You will build and operate the platform beneath Palona’s AI products, improve how engineers ship, and turn production signals into durable system improvements. This is not a ticket-driven IT or operations role. You will write production code, design systems, automate repetitive work, and own outcomes across the full service lifecycle.
Our current environment includes Python services, Docker, AWS and selected Azure services, ECS and Lambda workloads, API Gateway, load balancers, relational data systems, OpenTofu/Terraform, Datadog, and CI/CD automation. We value the ability to learn and make sound tradeoffs more than exact tool-for-tool matching.
What you will own:
- Design, build, and evolve secure, scalable cloud infrastructure for real-time AI services and customer-facing applications.
- Improve service reliability through clear SLOs, actionable observability, capacity planning, failure testing, and pragmatic incident prevention.
- Build deployment and release systems that make production changes fast, repeatable, auditable, and safe.
- Own infrastructure as code, environment consistency, and reusable platform patterns across development, staging, and production.
- Partner with product and AI engineers on architecture, performance, data flows, and operational readiness for new capabilities.
- Diagnose complex distributed-system failures across application, network, database, model-provider, and third-party integration boundaries.
- Reduce infrastructure and model-serving cost without compromising customer experience or engineering velocity.
- Strengthen secrets management, access controls, backup and recovery, vulnerability management, and other practical security foundations.
- Build internal tooling and paved paths that let engineers ship and operate services with less manual work.
- Participate in incident response and turn incidents into better systems, automation, documentation, and engineering judgment.
Requirements
- 3+ years industrial experience in relevant technical domain.
- Strong software engineering fundamentals and experience building or operating production distributed systems.
- Hands-on experience with a major cloud platform; AWS experience is especially relevant.
- Experience with containers, infrastructure as code, CI/CD, monitoring, alerting, and production debugging.
- Ability to write reliable automation and services in Python or another modern programming language.
- Sound judgment around availability, latency, scalability, security, and cost tradeoffs.
- A track record of taking ambiguous operational problems from diagnosis through durable resolution.
- Clear communication during architecture reviews, launches, and incidents.
- AI-native working habits and curiosity about the operational behavior of LLM- and agent-powered systems.
Benefits
- Competitive Salary and Stock Option Plan.
- Medical, dental, vision, retirement, leave, and disability benefits as applicable.
- Family Leave
- Short Term & Long Term Disability
- Paid time off and company holidays.
- Learning and development support.
$190k - $260k
...has developed an artificial intelligence (AI) powered technology stack purpose-built... ...large-scale world models - depends on infrastructure that turns thousands of hours of multimodal... ...training throughput. We are looking for engineers who make model training fast: streaming...SuggestedTemporary workWork at officeVisa sponsorship$151.3k - $283.8k
...technological advancements such as cloud, AI, and network security. While driving the digitalization... ...of emerging technologies within cloud infrastructure.Who We Look For1.Education: Master’s or Ph.D. degree in Computer Engineering, Electronic Engineering, Microelectronics,...SuggestedFull timeRelocation package$142.8k - $274.8k
...ContributorTravel: Less than 25%Profession: Software EngineeringDiscipline: Software EngineeringCompany: MicrosoftOverviewThe AI Infrastructure Engineering Systems team at Microsoft builds the cloud platform, engineering infrastructure, and developer systems that enable teams...SuggestedOngoing contractLocal area3 days per week$220k - $350k
...actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.SR AI ENGINEER, PLATFORM INFRASTRUCTURE, SPECIAL PROGRAMSAs an AI Engineer, Platform Infrastructure you will build the tooling, and work with our cleared...SuggestedPermanent employmentTemporary workImmediate startWeekend work- A tech company specializing in AI infrastructure is seeking a Software Engineer to build a scalable compute platform for its generative video models. The ideal candidate will have over 5 years of experience in MLOps or AI infrastructure management, along with strong Python...Suggested
- Aisquared, located in Mountain View, California, is seeking a motivated Sales Engineer to join our team. This role involves driving enterprise sales and requires a strong background in AI infrastructure. The ideal candidate will have over 10 years of experience in technical...
- A leading tech company is seeking a Senior Software Engineer for AI and Infrastructure. The ideal candidate will possess strong programming expertise in C++, Java, or Python, with a focus on software design and architecture. Responsibilities include writing and testing...Full time
- Unity is seeking a Senior Software Engineer to raise reliability, scalability, and performance of AI authoring products. You will drive DevOps practices, CI/CD... ...and robust deployment pipelines, while shaping infrastructure and experiments across Azure, Google Cloud, and...
- Google is seeking a Google Cloud Platform Outcome Customer Engineer to lead deployment planning and technical guidance for customers, blending sales, engineering, and project management. You will manage end-to-end deployments with customers and partners, ensuring rapid...
- ...Technical Staff to design and develop scalable software infrastructure optimized for AI and ML workloads. As MTS, you will lead feature development... ...projects. Benefits include opportunities for innovation and influencing engineering strategy directly. #J-18808-Ljbffr S27a
- Barker Staffing Solutions LLC is seeking a Machine Learning Engineer for our Agentic AI Platform in Mountain View, CA. You will architect the full ecosystem where autonomous AI agents reason, act, and learn, spanning core ML architecture to customer-facing experiences....
- Accenture is seeking a Google Cloud Platform (GCP) Agentic AI Delivery Engineer to join the AGCBG. You will be a product-minded technologist, designing and delivering agentic AI solutions on Google Cloud for clients, bridging the gap between software engineering and client...
- Voltai is a Bay Area-based AI hardware company seeking backend engineers to deliver our platform to leading semiconductor and electronics customers. You will own deployments across the SF Bay Area, Cupertino, and Santa Clara, and port features from our cloud product to...
- Affirm is hiring for an engineering role within People Tech & Analytics to build, deploy, and maintain AI-powered systems serving the People function. You will transform messy processes into production-ready solutions, collaborating with Workday, Notion, and case tools...
- Commure's Air AI team is building the intelligence layer that lives inside the clinical workflow, listening, documenting, reasoning, and acting so clinicians don't have to. You'll work across documentation that transcribes patient visits and structures them into clinical...
$160k - $225k
Databricks is hiring a Senior Software Engineer for AI Runtime in Mountain View, California. In this role, you'll drive the architecture... ...and strong knowledge of GPU performance and training infrastructure. This position comes with a competitive salary range of $16...- ...Nubank is seeking a Staff Software Engineer to lead the technical architecture for a private AI banking platform. You’ll own from Flutter mobile apps to distributed backends, enabling real-time AI-driven personalization at scale across web and mobile. You will collaborate...
- Buzz Solutions in Palo Alto is looking for an experienced VP of Engineering to lead and scale our AI, infrastructure, and platform systems. This high-impact role combines technical ownership with people leadership and close collaboration with Product, Solutions, and executive...
$170.5k - $315.49k
Job Details:Job Description: We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures.In this role, you will dive deep into the inference stack and redefine peak performance...Full timeLocal areaImmediate startShift work$200k - $322k
...recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a... ...choice to join us today.Design-for-X Engineering at NVIDIA works on groundbreaking innovations... ...deployment cycles as part of the AI Infrastructure requirements at an org-wide level.For...Full time- Apple is seeking a Software Engineer for the AiDP data services team to build cloud-based data engineering solutions and streaming platforms powering critical business use cases. You will influence platform tools, APIs, and architecture while collaborating with internal...
- Apple Inc. in Sunnyvale, CA, seeks a Senior Software Engineer for AI & Data Platforms (AiDP) to design and build cloud-based data services powering Apple’s AI initiatives and essential business use cases. You will collaborate with database engineers to develop scalable...
- Google's software engineers develop the next-generation technologies that change how billions connect, explore, and interact with information... ...vast data at scale and extend beyond web search, spanning AI, NLP, distributed systems, and mobile. As a software engineer, you...
- ...financial institution is seeking a highly skilled Principal AI/ML and Gen AI Engineer to join their dynamic team in Palo Alto, California. The... ...specifically with AWS and Databricks, focused on scaling infrastructure for AI solutions. Responsibilities include designing AI...
- ...JPMorganChase is seeking a Senior Director of Software Engineering to lead Data and AI platforms within the Commercial and Investment Bank Operations group. You will oversee multiple departments, set technical strategy, and drive enterprise-wide AI-enabled engineering...
- ...GRAIL is seeking a visionary Director of Software Engineering to lead our Data Platform engineering organization in Sunnyvale, CA. You will drive technical strategy, architecture, and delivery of a cloud-native data platform that handles petabyte-scale datasets. You...
- ...JPMorgan Chase & Co. in Palo Alto is seeking a Senior Director of Software Engineering to shape data and AI platforms within the Commercial and Investment Bank Operations team. You lead multiple technical areas, manage departments, and collaborate across Data and AI...Bank staff
- A technology firm is seeking a Senior Data / AI / ML Software Engineer in Palo Alto, California. The ideal candidate will have over 7 years of experience in AI/ML engineering and strong software fundamentals. Responsibilities include designing data extractors, working with...Full time
- Athelas is seeking a Senior Software Engineer for its R&D team in Mountain View, CA. In this hybrid role, you will build infrastructure for sub-agents, deploy advanced AI tools, and collaborate closely with product teams. The ideal candidate has strong fullstack skills,...
- Walmart Data Ventures in Sunnyvale, CA seeks a Director of Software Engineering to lead the execution of complex software, data, and AI/ML systems with a focus on reliability and scalability. You will champion DevOps, drive cloud cost optimization, mentor high-performing...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Infrastructure Engineer. Be the first to apply!
