Staff Software Engineer, Cortex AI Infrastructure
$236k - $309.75kStreamlit
Snowflake AI Infrastructure Engineer
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done.
The Cortex Apps team is building the future of AI for enterprise data. This role focuses on the backend infrastructure that powers our flagship products like Snowflake Intelligence, Cortex Agents and Search making agentic AI fast, reliable, scalable and secure at the enterprise level.
You won't just be using AI tools; you will be building the high-performance systems that orchestrate them. You'll own and influence the architecture for agent execution environments, high-throughput context retrieval, or the ecosystem that allows our customers to iterate and launch agents in production.
What You Will Do In This Role:
Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search indexing, query processing, and result ranking, semantic caching, and automated metadata extraction.
Build the "Evals Engine": Develop the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and "hillclimbing" experiments.
Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.
Optimize Performance & Cost: Direct the infra strategy for model routing, prompt caching, and token optimization to ensure Snowflake's AI features are the most efficient in the industry.
Requirements:
Education: Bachelor's degree in Computer Science or a related technical field.
Experience: 5+ years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
Technical Stack: Deep proficiency in Go or Java (for systems) and Python (for AI orchestration).
Systems Thinking: Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, FoundationDB, etc.).
Domain Expertise: Familiarity with the "plumbing" of AI: vector indices, agent platforms, and building scalable data pipelines.
(Bonus) Experience With:
Query optimization and SQL engine internals.
Designing multi-tenant systems that handle sensitive enterprise data at scale.
Developing search infrastructure for large-scale applications.
Direct experience with any of the subsystems outlined above.
Snowflake is growing fast, and we're scaling our team to help enable and accelerate our growth. We are looking for people who share our values, challenge ordinary thinking, and push the pace of innovation while building a future for themselves and Snowflake.
How do you want to make your impact?
For jobs located in the United States, please visit the job posting on the Snowflake Careers Site for salary and benefits information: careers.snowflake.com
The following represents the expected range of compensation for this role:
- The estimated base salary range for this role is $236,000 - $309,750.
- Additionally, this role is eligible to participate in Snowflake's bonus and equity plan.
The successful candidate's starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location. This role is also eligible for a competitive benefits package that includes: medical, dental, vision, life, and disability insurance; 401(k) retirement plan; flexible spending & health savings account; at least 12 paid holidays; paid time off; parental leave; employee assistance program; and other company benefits.
To comply with pay transparency requirements and other statutes, you can notify us if you believe that a job posting is not compliant by completing this form.
- ...Location Type Hybrid Department Engineering About Anyscale: At Anyscale,... ...and make it accessible to software developers of all skill... ...accelerate the progress of AI applications out into the real... ...Software Engineer to join the Infrastructure team. Anyscale aims to provide...SuggestedFull time
$145k - $235.5k
...Sr Staff Software Engineer We are seeking a Sr Staff Software Engineer for... ...Global Infra Platform and Cortex products. In this role, you... ...shared network and compute infrastructures. You will join a passionate... ...or Docker. Knowledge of AI/ML pipelines, Data Science...SuggestedVisa sponsorshipWork visa- ...Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to... ...global market leader, bringing innovative AI-enhanced technology to over 8,100 customers... ...Job Description Build out core infrastructure services and microservices that impact...SuggestedWork at officeImmediate startRemote workFlexible hours
- ...confidential computing and Confidential AI for hybrid and multicloud environments... ..., and data across clouds, on-premises infrastructure, and devices. Our platform enables... ...and security. The Role Staff Software Engineer (Rust) - Confidential Computing Infrastructure...SuggestedH1b
$190k - $220k
...Lightmatter is leading the revolution in AI data center infrastructure, enabling the next giant leaps in... ...the world's first 3D-stacked photonics engine, Passage™, capable of connecting... ...Temperature Operating Life (HTOL) Test Software system. Your work will involve designing...SuggestedFull timeTemporary workFlexible hours$193.93k - $352.29k
...Staff/Senior Software Engineer, Onboard Infrastructure Mountain View, California (HQ) Who We Are Nuro is a self-driving technology company on a mission... ...world's most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its...$193.93k - $352.29k
...Staff/Senior Software Engineer, Offboard Infrastructure Mountain View, California (HQ) Nuro is a self-driving technology company on a mission to make autonomy... ...'s most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core...$155k - $230k
...using advanced cryptography, encryption, and confidential AI solutions. As data breaches become more frequent... ...towards a safer digital future. As the Senior/Staff Software Engineer - Infrastructure and Devops, you will be a part of our Infrastructure team...Temporary workH1bWorldwideShift work$128k - $184k
...Cortex Code Team Position At Snowflake, we are... ...this new era, we seek AI-native thinkers across... ...You'll own the full AI engineering lifecycle: design, prompt... ...-powered modeling and infrastructure team. What you will do... ..., orchestration, or software with substantial state...Flexible hours$207k - $300k
Staff Software Engineer, On-Device Machine Learning Infrastructure corporate_fare Google place Sunnyvale, CA, USA Qualifications Bachelor’s degree or equivalent practical... ...techniques. Understanding of Generative AI model architectures and their optimization for on-...Full timeShift work$190.9k - $253.75k
...development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high-value challenges that are central to their missions. Our engineering teams build highly technical products that fulfill real,...Local areaWorldwide$207k - $300k
Staff Software Engineer, Infrastructure, Google Chat Qualifications Bachelor's degree or equivalent practical experience. 8 years of experience in software... ...real‑time messaging platform into an intelligent, AI‑first command center, driving the transition into the Augmented...Full time$207k - $300k
Staff Software Engineer, Google Global Infrastructure, NetSoft corporate_fare Google place Sunnyvale, CA, USA Apply Bachelor's degree or equivalent practical... ...stack as we continue to push technology forward. The AI and Infrastructure team is redefining what’s possible...Full timeWorldwide$207k - $300k
A leading technology company is seeking a Staff Software Engineer for its Global Infrastructure team in Sunnyvale, CA. The role focuses on developing large-scale systems and requires at least 8 years of experience in C++ programming and infrastructure development. Candidates...$207k - $300k
Staff Software Engineer, AI and Infrastructure Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders; deep expertise in domain. Bachelor's degree or equivalent practical experience. 8 years of experience programming...$210k - $275k
...The Opportunity Are you an experienced Staff Software Engineer, Backend (Infrastructure) looking to make a significant impact at the intersection of scalable web services and cutting-edge AI technologies? We're seeking a talented engineer to lead the development,...Permanent employment$198k - $326k
...As part of our world-class software engineering team, you will take the lead... ...building the next-generation infrastructure and platforms for LinkedIn,... ...search platform, best-in-class AI/ML infrastructure,... ...within our company. As a Sr. Staff Software Engineer, you will...For contractorsWork at officeFlexible hours$193.93k - $352.29k
...Senior/Staff Software Engineer, ML Data Infrastructure Mountain View, California (HQ) Nuro is a self-driving technology company on a mission to make... ...world's most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core...Work experience placement$214k - $295k
...Staff Software Engineer, Data Infrastructure, AI Compute Platform Redwood City, CA (Hybrid) Biohub is the first large-scale initiative bringing frontier AI models, massive compute, and frontier experimental capabilities under one roof. We're building a general-purpose...Work at officeWorldwideRelocation packageFlexible hours3 days per week$262k - $365k
Senior Staff Software Engineer, ML Infrastructure, Agents Infrastructure Google Sunnyvale, CA, USA Qualifications Bachelor's degree or equivalent practical... ..., maintain, and enhance software solutions. Applied AI builds conversational agents deployed at a large scale that...Full time$262k - $365k
Senior Staff Software Engineer, Infrastructure, Agents Infra Advanced Experience owning outcomes and decision making, solving ambiguous problems and influencing... ...as we continue to push technology forward. Applied AI builds conversational agents deployed at a large scale...Full time- Senior/Staff Software Engineer - AI Agent Infrastructure Honey Health is seeking a Senior/Staff Software Engineer to build leading AI Agent systems that transform healthcare operations. In this role, you will design and implement the infrastructure for training and deploying...Full timeWork at office
$236k - $339.2k
...this new era, we seek AI-native thinkers... ...About the Role The Cortex Code team is building... ...Demos + AMA . As a Staff AI Engineer on Cortex Code... ...tasks. Hill-climb infrastructure: Design and evolve pipelines... ...AI/ML-backed software in production, including...Flexible hours$207k - $300k
Google Inc. is looking for a Staff Software Engineer for its Infrastructure team to develop next-generation technologies within the Google Cloud AI sector. This full-time role requires at least 8 years of software development experience, focusing on large-scale infrastructure...Full time$210k - $250k
The Opportunity Are you an experienced Staff Software Engineer, Backend (Infrastructure) looking to make a significant impact? We're seeking a talented individual... ...with operating systems, particularly Linux. Otter.ai is an equal opportunity employer. We proudly celebrate...$224k - $356.5k
...NVIDIA is hiring engineers to scale up the introduction... ...into its EDA Infrastructure. We expect you to have... ...systems, familiarity with software testing and deployment... ...crowd: Developing ML/AI infrastructure. Developing... ...serves as the visual cortex of modern computers...$220k - $303.6k
...builds some of the most powerful AI advertising solutions in the... ...YouTube's monetization engine and key search advertising technologies... ...campaign management, data infrastructure, and customer integrations.... ...Right For Me? ~7+ years software development experience using...Temporary workWork at officeFlexible hours$236k - $339.2k
...Applied Performance Engineer At Snowflake, we are powering the... ...usher in this new era, we seek AI-native thinkers across every... ...understanding of large-scale infrastructure-as-a-service platforms (e.g.... ...Kafka, Apache Flink, etc.) Software development experience with C...Flexible hours$110k - $230k
...GEICO Duck Creek Software Engineer At GEICO, we offer a rewarding career... ...GEICO oversees the tools, infrastructure, data, reporting, analytics,... ...this role, you will serve as a Staff Engineer, driving secure,... ...Qualifications GitHub Copilot / AI-assisted development hands-...Hourly payWork experience placementFlexible hours$180k - $205k
...most advanced supercomputers or AI systems will never reach.... ...cooling and standard fiber-optic infrastructure. In 2024,... ...develops the algorithms and software needed to make these systems... ...PsiQuantum works closely alongside engineers and scientists in the electronics...Full timeShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Cortex AI Infrastructure. Be the first to apply!
- infrastructure engineer Menlo Park, CA
- infrastructure developer Menlo Park, CA
- id software Menlo Park, CA
- software quality assurance Menlo Park, CA
- software sales Menlo Park, CA
- internship software Menlo Park, CA
- remote software sales Menlo Park, CA
- embedded software Menlo Park, CA
- software asset management analyst Menlo Park, CA
- software engineer - cloud services Menlo Park, CA

