Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Infrastructure Engineer, Sandbox Platform

$180k - $225k

Scale AI

AI Infrastructure Engineer - Agent Sandbox PlatformAs a Software Engineer on the AI Infrastructure team, you'll help build and evolve our agent sandboxing platform — the secure, high-performance code execution layer powering our agentic workflows, deployed across both internal and customer-managed environments. This is a role for someone who cares as much about the experience of the engineers and researchers using this system as they do about the kernel internals underneath it.You'll combine deep systems expertise (isolation, virtualization, performance) with an obsession for developer experience: clean APIs, clear error messages, good docs, and a client library that feels well-crafted. You'll partner closely with internal teams to understand how they use the platform, debug their issues, and shape a roadmap that balances immediate needs with long-term architecture.You will:Design and build the sandboxing platform, client library, and API surface for secure code execution across containerized and virtualized environmentsEnsure strong isolation, security, and reproducibility of execution across user sessions and workloadsOptimize for cold-start latency, memory footprint, and resource utilization at scaleDrive down error rates through systematic debugging, monitoring, and proactive fixesPartner closely with internal teams using the platform to understand their needs, debug issues, and build tooling that serves their use casesRespond to incidents and production issues with urgency, conducting root cause analysis and implementing preventive fixesHelp develop and maintain a product roadmap for sandboxing, balancing immediate needs against long-term architectural investmentLead architecture reviews and own projects end-to-end, from design through deployment, in fast-paced cross-functional settingsIdeally you'd have:4+ years of experience building high-performance systems software, with meaningful time spent maintaining libraries, SDKs, or developer-facing APIsDeep understanding of Linux internals: process isolation, memory management, cgroups, namespaces, etc.Experience with containerization and virtualization technologies (e.g., Docker, Firecracker, gVisor, QEMU, Kata Containers)Proficiency in a systems programming language such as Go, Rust, or C/C++A track record of obsessing over developer experience — API design, error propagation, documentation, and the small details that make a library feel well-craftedComfort working across infrastructure layers, from kernel modules to orchestration frameworks (e.g., Kubernetes)Strong debugging skills and the ability to navigate performance/security tradeoffs in production systemsComfort with ambiguity, and the ability to context-switch between reactive incident work and proactive product developmentNice to haves:Experience as a founder or early engineer at an infrastructure-focused startup, owning a product end-to-endFamiliarity with LLM agents and agent frameworks (e.g., OpenHands, Agent2Agent, MCP)Experience running secure workloads in multi-tenant or untrusted environments (e.g., FaaS, CI sandboxes, remote notebooks)Exposure to snapshotting and restore techniques (e.g., CRIU, VM snapshots, overlayfs)Open-source contributions to systems or developer-tools projectsHistory of on-call/incident response for production systemsCompensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You'll also receive benefits including, but not limited to: comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.Please reference the job posting's subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is:$180,000—$225,000 USDPLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.About Us:At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst& Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status. We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at View email address on click.appcast.io. Please see the United States Department of Labor's Know Your Rights poster for additional information.We comply with the United States Department of Labor's Pay Transparency provision. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Infrastructure Engineer, Sandbox Platform in New York, NY vacancy
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time,... 
    Suggested
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $175k - $215k

     ...technology foundation that supports the firm’s business activities. Our Technology team is seeking a Data and AI Infrastructure Engineer to build secure, scalable platforms and pipelines that power the firm’s AI initiatives. This is a platform engineering role — the focus is... 
    Suggested

    PJT Partners

    New York, NY
    18 hours ago
  • We Are:The Global AI Infrastructure team is at the center of enabling infrastructure reinvention...  ...advanced infrastructure that powers AI platforms, GPU-accelerated workloads, large-scale...  ...NVLink, and CUDA along with LLM inference engines (TensorRT-LLM), production serving... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    New York, NY
    2 days ago
  •  ...products.As a Lead Software Engineer (Vice President) at JPMorganChase...  ...secure, stable, and scalable platform and software solutions for...  ...Administrative Office. This role is infrastructure-first (approximately 50%...  ...(approximately 30%) and AI/agentic development (approximately... 
    Suggested
    Work at office

    JP Morgan Chase

    New York, NY
    18 hours ago
  • $147k - $210k

     ...building and maintaining large-scale backend infrastructure or distributed systems.Preferred...  ...access controls.Experience engineering high-throughput production systems with...  ...push technology forward.The Keystore Platforms team is responsible for the security and... 
    Suggested

    Google

    New York, NY
    13 hours ago
  • $200k

     ...AI Infrastructure Engineer Location: New York (4 Days Onsite) Base Salary: $200k + 50% bonus This is a rare opportunity to shape the...  ...who want to be close to real AI use cases while owning core platform decisions, this role offers genuine impact and visibility.... 
    Work at office

    Harnham

    New York, NY
    2 days ago
  •  ...AI Infrastructure SpecialistAs vCluster's AI Infrastructure Specialist, you will work directly...  ...make that happen.As an AI Infrastructure Engineer, your role will include:Lead Technical...  ...ensuring they can operate and grow the platform independently.Scaling through Documentation... 
    Remote work
    Flexible hours

    vCluster

    New York, NY
    1 day ago
  • $165k - $200k

     ...can be part of the disciplined collaboration and transcendent thinking as our AI Platform Engineer at Capstone Investment Advisors here. Overview: We are seeking an AI Infrastructure Engineer to design, build, and scale the foundational infrastructure that enables... 
    Minimum wage

    Capstone Investment Advisors

    New York, NY
    4 days ago
  • $350k

     ...AI Infrastructure Engineer The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication... 
    Permanent employment
    Visa sponsorship
    Work visa
    Relocation package
    Shift work

    Thinking Machines Lab

    New York, NY
    1 day ago
  •  ...Palona’s AI agents operate continuously in production, handle...  ...and face sharp traffic peaks. Infrastructure is therefore part of the...  ...looking for an Infrastructure Engineer who combines cloud and reliability...  ...will build and operate the platform beneath Palona’s AI products,... 
    Temporary work

    Palona AI

    New York, NY
    2 days ago
  • $230k - $290k

     ...Digital Solutions Group ) - Platform Engineering /Full Time /RemoteAHEAD...  ...enterprises design, build, and run AI agent platforms on top of...  ...attached. You will write infrastructure code, agent code, and the...  ...Actions that move agents from sandbox to production through... 
    Full time
    Work at office
    Shift work

    AHEAD

    New York, NY
    13 hours ago
  • $269.1k - $307.2k

     ...Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience... 
    Full time
    Part time
    Work at office
    Remote work

    Capital One

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (GenAI Platform) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $229.9k - $262.4k

     ...Sr. Lead AI Engineer (Gen AI Platform Services) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking...  ...customer experiences. Our investments in technology infrastructure and world-class talent — along with our deep experience... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $229.9k - $286.2k

     ...Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related...  ...and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or...  ...leader. With our advanced technology infrastructure and a talented team, we strive to... 
    Full time

    Capital One

    New York, NY
    19 days ago
  • Fireworks is seeking a Software Engineer for its Cloud Infrastructure team to architect and build foundational systems powering its AI platform. You will design scalable backend services, optimize compute, storage, and networks, and drive reliability across multi-cloud... 

    Fireworks

    New York, NY
    3 days ago
  •  ...York City is seeking a founding engineer to help shape the future of healthcare AI. This in-person, full-time role...  ...intelligent workflows, and voice AI infrastructure. You will move fast, wear many...  ...builds scalable health-tech platforms with ambitious product bets. #J... 
    Full time

    Alden Labs, Inc.

    New York, NY
    18 hours ago
  • $229.9k - $286.2k

     ...Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related...  ...and responsible AI solutions on cloud platforms (such as AWS, Google Cloud, Azure,...  ...experiences, we are investing in technology infrastructure and attracting top talent. Our... 
    Full time

    Capital One

    New York, NY
    19 days ago
  • $139k - $242k

     ...The Essential Cloud for AI. Built for pioneers by...  ...CoreWeave delivers a platform of technology, tools,...  ...CoreWeave combines superior infrastructure performance with deep...  ..., and Linux systems engineering. We partner closely...  ...build, and evolve secure sandboxed runtime environments... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    18 hours ago
  • $60 - $70 per hour

    Senior Technical Recruiter - AI Infrastructure and Engineering Remote, US $60 - $70 Job Title Senior Technical Recruiter - AI Infrastructure and Engineering Location Remote, US Salary Range $60 - $70 Job Description About the Mission We support companies building large-... 
    Remote work

    The Leadership Agency Inc.

    New York, NY
    18 hours ago
  • Crosby is seeking an experienced Infrastructure Engineer to build and scale the systems that power our platform in New York City. The role involves designing and maintaining...  ...networking. You will collaborate closely with backend, AI, and product engineers to improve developer... 

    Slope

    New York, NY
    1 day ago
  • Addepar, Inc. is seeking a Sandbox and Platform Services Product Manager in New York, NY. The role...  ..., training sandboxes, and infrastructure shared services to accelerate developer...  ...security and cost, and collaborate with Engineering, Sales, and R&D to define pricing and... 

    Addepar, Inc.

    New York, NY
    18 hours ago
  • $190k - $200k

     ...protected by law. Description Job Title: AI Engineer Location: New York, NY Department:...  ...including the experimentation framework, sandboxed data, and feedback loops with property...  ...feature sets. Stand up the infrastructure to serve models in production - APIs,... 
    Full time
    Part time
    Work at office
    Remote work
    Shift work
    Night shift

    Rebel Hospitality New York LLC

    New York, NY
    3 days ago
  •  ...We build AI agents that actually work in enterprise...  ..., not demos. We need engineer's who can own the...  ...systems, and leave behind infrastructure clients can operate...  ...the tradeoffs between platforms and can advise clients...  ...real deployments, not sandbox accounts ~ Demonstrated... 
    Temporary work

    Trilagen

    New York, NY
    18 hours ago
  • $130k - $190k

     ...as the first-of-its-kind platform that connects the world with...  ...the cross functional AI team as a dedicated AI engineer. Your job isn't to write...  ...Code, Codex App Server, Sandboxes, MCP, n8n, Temporal, Agent...  ...Notion, Google Workspace Infrastructure: Vercel, AWS Benefits... 
    Hourly pay
    Shift work

    CookUnity

    New York, NY
    4 days ago
  • $195k - $255k

     ...externally. Enabled by modern platforms and AI, you’ll do the most...  ...Labs is the innovation and engineering hub behind Epiq’s next-generation...  ...over, and the evaluation infrastructure used to measure quality....  ...durable state and memory, sandboxing, and trace-level... 
    Full time
    Work at office
    Local area
    3 days per week

    Epiq Systems

    New York, NY
    1 day ago
  • $180k - $247.5k

     ...Every Identity, from AI to HumanIdentity is the...  ...the trusted, neutral infrastructure that enables organizations...  ...The Staff AI Security Engineer OpportunityIdentity is...  ...Hardening & Sandboxing: Establish security architectures...  ...enterprise.Agentic Platform Infrastructure: Design... 
    Local area
    Worldwide
    Flexible hours

    Okta

    New York, NY
    18 hours ago
  • $175k - $350k

    Role Overview Citadel Securities is seeking an exceptional Senior Platform Infrastructure Engineer to join one of our Platform Engineering teams in Miami or New York. Our team is responsible for building and maintaining the foundational platform that orchestrates application... 
    Worldwide

    Citadel Securities

    New York, NY
    2 days ago
  • $153k - $376k

     ...accessible to all. Figma’s platform helps teams bring ideas...  ...code, or iterating with AI. From idea to product, Figma...  ...We’re looking for strong infrastructure and platform-minded engineers to contribute to our...  ...infrastructure: Iterating on the sandboxes, harnesses, and tools... 
    Minimum wage
    Full time
    Local area
    Remote work
    Flexible hours

    Figma

    New York, NY
    18 hours ago
  •  ...New YorkOnsiteFull Time$170k - $200kThis New York City-based organization is building an agentic AI platform transforming financial services. As a Cloud Infrastructure Engineer, you will design and manage scalable, secure infrastructure powering advanced generative AI... 
    Full time
    Remote work

    Motion Recruitment

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Infrastructure Engineer, Sandbox Platform. Be the first to apply!