Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Infrastructure Software Engineer, Enterprise AI

$252k - $315k
Full-time

Scale AI

Scale GP is building the infrastructure that makes enterprise AI seamless. We are looking for a Senior or Staff Infrastructure Engineer to act as a primary technical lead, engineering the 'paved road' for our knowledge retrieval and inference engines. You won't just be managing resources; you’ll be defining the deployment standards for Agentic workflows at scale. Your mission is to bridge the gap between complex AI orchestration and world-class infrastructure, ensuring our platform remains the most reliable destination for enterprise agents The ideal candidate thrives in a fast-paced environment, has a passion for both deep technical work and mentoring, and is capable of setting a long-term technical strategy for a critical domain while maintaining a strong, hands-on delivery focus. You will architect and implement solutions across multiple cloud providers (GCP, Azure, AWS) for customers in diverse, highly-regulated industries like healthcare, telecom, finance, and retail. What You’ll Do: * Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers. * Use our own data and AI platform to analyze build and test logs and metrics to identify areas for improvement. * Define the architectural patterns for our multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows for enterprise customers. * Enhance engineering and infrastructure efficiency, reliability, accuracy, and response times, including CI/CD processes, test frameworks, data quality assurance, end-to-end reconciliation, and anomaly detection. * Collaborate with platform and product teams to develop and implement innovative infrastructure that scales to meet evolving needs. * Design and champion highly scalable, reliable, and low-latency infrastructure and frameworks for building, orchestrating, and evaluating multi-agent systems at enterprise scale. * Lead the infrastructure roadmap with a strong focus on compliance, privacy, and security standards, including designing change management and data isolation strategies. * Own the development and maintenance of our best-in-class Agentic observability platform (logging, metrics, tracing, and analytics) to proactively ensure system health and enable rapid incident response. * Drive developer efficiency by building automated tooling and championing Infrastructure-as-Code (IaC) paradigms throughout the engineering organization to improve workflows and operational efficiency. What We're Looking For: * Proven experience in a senior role, with 5+ years of full-time software engineering experience. * Deep understanding of modern infrastructure practices, including CI/CD, IaC (e.g., Terraform, Helm Charts), container orchestration (e.g., Kubernetes) and observability platforms (e.g., Datadog, Prometheus, Grafana). * Extensive experience with at least one major cloud provider (AWS, Azure, or

GCP).

* Strong knowledge of security and compliance in enterprise environments, with a focus on access management, data isolation, and customer-specific VPC setups.
  • Proficiency in Python or JavaScript/TypeScript, and SQL.
  • Bonus points: Hands-on experience and a passion for working with Agents,
LLMs, vector databases, and other emerging AI technologies. Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You'll also receive benefits including, but not limited to: comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend. Please reference the job posting's subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is:

$252,000—$315,000 USD

PLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants. About Us: At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications. We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status. We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at View email address on click.appcast.io. Please see the United States Department of Labor's Know Your Rights poster [ for additional information. We comply with the United States Department of Labor's Pay Transparency provision. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy [ for additional information.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Staff Infrastructure Software Engineer, Enterprise AI in New York, NY vacancy
  •  ...defining product for the new era of agentic AI. Millions of people now use Perplexity...  ...knowledge into action, and the Enterprise Platform team builds the foundation that...  ...Qualifications 4+ years of professional software engineering experience; we’re open to strong junior... 
    Suggested

    Perplexity AI Inc.

    New York, NY
    18 hours ago
  • Perplexity AI Inc. is seeking a software engineer to develop user-facing products for enterprise solutions. The role involves building intelligent systems for onboarding and membership management while collaborating closely with various teams. The ideal candidate has 4+... 
    Suggested

    Perplexity AI Inc.

    New York, NY
    18 hours ago
  • $252k - $315k

    Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs...  ...more. We are looking for a strong engineer to join our team and help us build and...  ...will have a strong understanding of software engineering principles and practices,... 
    Suggested
    Full time

    Scale AI

    New York, NY
    4 days ago
  • $200k - $250k

    About Nscale Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-...  ...About the Role We are hiring a Staff Software Engineer to build the internal platforms... 
    Suggested
    Full time
    Flexible hours

    Nscale

    New York, NY
    10 hours ago
  • Perplexity is seeking creative, AI native engineers to join our Enterprise Adoption team. Our...  ...skills, and evaluation infrastructure that unlock each team's...  ...+ years of professional software engineering experience....  ...the work of non-technical staff across enterprises,... 
    Suggested
    Full time

    Perplexity

    New York, NY
    1 day ago
  •  ...the only first-to-market AI native coaching platform for enterprise, offering personalized,...  ...Role As a Platform Engineer at Valence, you will build...  ..., observability, queue infrastructure, and the centralized LLM...  ...years of experience in software engineering, distributed... 
    Full time
    Freelance
    Remote work
    Worldwide

    Valence

    New York, NY
    4 days ago
  •  ...United States, is seeking a Senior Solutions Engineer to own the technical relationship throughout...  ...customer lifecycle. You will work closely with enterprise IT and security teams to ensure seamless integration of Voxel's AI platform. The role involves leading technical... 

    Voxel

    New York, NY
    3 days ago
  •  ...excited by the idea of AI agents operating...  ...Apollo is pioneering the enterprise agent integration space...  ...This is the critical infrastructure that empowers organizations...  ...that are the engine behind: GraphOS : Apollo...  ...integrate with and manage software safely. If you are... 
    Remote work

    Apollo GraphQL

    New York, NY
    1 day ago
  •  ...Solutions Engineer The Technical Success team is responsible for the customer experience...  ...suite of products, ensuring developers and enterprises maximize benefit, value, and adoption...  ...understand their pre-sales needs, guide their AI strategy, and identify the highest value... 
    Work at office
    Relocation package

    OpenAI

    New York, NY
    4 days ago
  •  ...Staff Software Engineer, Data Platform Appgate secures and protects an organization...  .... Appgate safeguards enterprises and government agencies...  ..., we are building a Data + AI team to unlock the next generation...  ..., frameworks, and cloud infrastructure to ensure scalability,... 
    Temporary work
    Remote work
    Work from home
    Worldwide
    Home office
    Flexible hours
    3 days per week

    Appgate

    New York, NY
    3 days ago
  • $180k - $225k

    Scale GP (Scale Generative AI Platform) is an enterprise-grade AI platform that...  ...are looking for a strong engineer to join our team and help...  ...build and scale our core infrastructure in a fast-paced...  ...strong understanding of software engineering principles and... 
    Full time

    Scale AI

    New York, NY
    4 days ago
  •  ...into the world's software. This team owns the...  ...permissioned, up-to-date enterprise data. We maintain...  ...with product and AI teams to define...  ...for senior and staff). Strong system...  ...experience with modern infrastructure (for example AWS,...  ...other experienced engineers. If you're... 

    Colorwave

    New York, NY
    3 days ago
  •  ...Perplexity innovates at the frontier of AI infrastructure, search, and orchestration to serve...  ...customers: startups, trillion-dollar enterprises, U.S. and allied governments, and everyone...  ...role Perplexity is seeking strong engineers with a passion for delivering frontier... 

    Perplexity AI Inc.

    New York, NY
    1 day ago
  •  ...to define the trajectory of AI, surrounded by a team pushing...  ...About the role As a Solutions Engineer, you'll work with a driven team...  ...technical solutions to many enterprise customers, both directly and...  ...inclusive of a deep understanding of software development, software... 
    Immediate start
    Remote work

    Eleven Labs

    New York, NY
    1 day ago
  • A leading AI solutions provider is seeking a Senior Solutions Engineer to shape the future of their AI-powered solutions in New York. The role involves serving as a technical advisor, assisting enterprise clients with the integration of complex customer ecosystems. Ideal... 

    Decagon

    New York, NY
    4 days ago
  •  ...Valence has built the only AI native coaching platform for enterprise, offering personalized, expert, and...  ...itself. The Role As a Principal Software Engineer, Product, you will be instrumental...  ...partners in product, design, and infrastructure. This is a ground-floor... 
    Remote work
    Worldwide

    Valence

    New York, NY
    2 days ago
  • $176k - $196k

     ...is secured—in the era of agentic AI. Today, Obsidian is trusted by global enterprises and protects more than 200...  ...re looking for 8+ years building software, ideally touching a few different...  ...of thing Background in detection engineering, SIEM, or security ops You’ve built... 
    Work from home
    Flexible hours

    Obsidian Security

    New York, NY
    18 hours ago
  • $220k - $280k

     ...combining frontier agentic AI, an enterprise-grade platform, and deep...  ...customers — from leadership to engineers — and work together to...  ...started. Role Overview As a Staff Software Engineer, Frontend at...  ...tightly with design and backend/infrastructure to shape APIs and UX for... 
    Relocation package

    SwiftCruit

    New York, NY
    18 hours ago
  •  ...deploy Deepgram's voice AI platform into complex...  ...the intersection of engineering, product, and customer...  ...life. You embed with enterprise restaurant brands and...  ...necessary. Deployment infrastructure leadership: Codify...  ...You are an excellent software engineer. You are comfortable... 
    Work at office
    Local area
    Remote work

    Deepgram

    New York, NY
    4 days ago
  • $160k - $180k

     ...Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that...  ...proprietary databases and AI. Our enterprise customers across multiple...  ...Role We're hiring multiple Staff Engineers to join a small, high-...  ...role. Dive deep into our AWS infrastructure, Kubernetes workloads, and JVM... 
    Local area
    Remote work

    Skydrop

    New York, NY
    2 days ago
  • $250k - $300k

     ...typically overlooked by traditional software. As a Staff Software Engineer , you will operate as a senior...  ...systems spanning web, cloud, data, and AI infrastructure, with an eye toward reuse and...  ...AI development stack to develop enterprise grade applications from end to... 
    Work at office
    Local area
    Remote work

    Triedgeinvestments

    New York, NY
    1 day ago
  • $405k

     ...interpretable, and steerable AI systems. We want...  ...researchers, engineers, policy experts,...  ...for experienced software engineers to join...  ..., and own infrastructure and systems that teams...  ...reliability and enterprise trust are the bar:...  ...Currently, we expect all staff to be in one of... 
    Full time
    Currently hiring
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    1 day ago
  • $202k - $278k

     ...and search built on proven AI, AlphaSense delivers insights...  ...platform is trusted by over 6,000 enterprise customers, including a...  ...Team: Our diverse Product & Engineering team values innovation, collaboration...  ...systems Platform or infrastructure engineering Demonstrated... 
    Local area

    AlphaSense, Inc.

    New York, NY
    1 day ago
  •  ...…Fleetio is a modern software platform that helps thousands...  ...Fleetio is seeking a Staff Software Engineer to be the founding...  ...the knowledge infrastructure that connects our internal data to the AI tools employees already...  ...Your job is to add the enterprise capabilities this... 
    Contract work
    Remote work
    Worldwide

    Fleetio

    New York, NY
    1 day ago
  • elevenlabs is seeking a Solutions Engineer to enhance their voice AI platform's implementation for enterprise customers. This role is remote and comes with a variety of unique perks, including opportunities for learning and development. The ideal candidate will have a passion... 
    Remote job

    elevenlabs

    New York, NY
    2 days ago
  •  ...innovative technology solutions, enterprise consulting, and world‑class engineering talent. We partner with...  ...cloud platforms, AI‑driven modernization...  ...Git Docker / Containers Infrastructure as Code Monitoring & Observability...  .... #J-18808-Ljbffr Inabia Software & Consulting Inc.
    Relocation
    Flexible hours

    Inabia Software & Consulting Inc.

    New York, NY
    3 days ago
  • $200k - $275k

     ...speed and accuracy. Our AI-enabled platform turns...  ...as we expand into the enterprise and internationally....  ...Team As an engineering team, we believe strongly...  ...Kubernetes as our underlying infrastructure. About you...  ...crafting and shipping software solutions that delight... 
    Work at office
    Local area

    Peregrine Technologies

    New York, NY
    3 days ago
  • A leading AI technology firm is seeking a Solutions Engineer to support enterprise customers with technical integrations of AI SEO solutions. You'll work closely with customers and various teams to streamline workflows and improve product capabilities. The ideal candidate... 
    Remote job

    Writesonic, Inc.

    New York, NY
    1 day ago
  • $240k - $300k

     ...Traba is the AI operating layer for the industrial supply chain...  ...millions of shifts and deep enterprise relationships. But our edge...  ...the stack.) This is a platform-engineering role first, so you'll go where the priorities are: the infrastructure an agent needs one quarter, a... 
    Temporary work
    Local area
    Shift work

    Traba

    New York, NY
    2 days ago
  • $240k - $325k

     ...brighter way forward. Staff Engineer (P4) - Research Technology & AI Agents Location: New...  ...is not a traditional software engineering role - you...  ...AI coding assistants, enterprise software agents, and LLM...  ...outputs Platform & Infrastructure Build and maintain... 
    Daily paid
    Local area

    JLL

    New York, NY
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Infrastructure Software Engineer, Enterprise AI. Be the first to apply!