Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Engineering Manager, Frontier AI Infrastructure - Public Sector

$213.6k - $267k

Scale AI

Scale AI’s Public Sector business is growing quickly as government agencies adopt AI to support critical national security, defense, and public sector missions. We are seeking a hands-on Engineering Manager to lead our Frontier AI Infrastructure team within Public Sector Engineering. This is a 50/50 role: you'll spend roughly half your time writing and reviewing code, and half your time leading, coaching, and growing a small team of engineers.Your team owns the model inference layer — enabling state-of-the-art models, debugging the latest AI tools, managing networking, debugging latency, and tracking pricing/usage metrics for AI models. You'll lead technical discussions on the frontlines with cloud vendors and customers to deliver on critical contracts and debug platform issues, and you'll partner upstream with Product to catch issues before they break, moving the team from "infra-only debugging" to proactive integration testing.You will:As a manager - 50/50 management and hands on coding experience. Lead, coach, and grow a team of engineers — own hiring, onboarding, performance, and career development.Set technical direction and quarterly priorities for the inference layer, and hold the team accountable to delivery on customer and contract commitments.Run the operational rhythm of the team: sprint planning, on-call rotation, incident review, and postmortems.Partner with Product, Program, and Deployed Engineering leadership to translate customer and mission requirements into roadmap.Represent the team in customer engagements and vendor escalations, including with government stakeholders.Design and implement secure, scalable backend systems for Public Sector customers, leveraging Scale's modern cloud-native AI infrastructure.Own services and systems alongside your team, define their long-term health goals, and improve the health of surrounding components.Stay in the code: review PRs, debug production issues, and take on meaningful technical work yourself.Must have:At least 1-2+ years of direct people management experience leading a team of software engineers (hiring, performance management, and career development), plus a strong track record as a hands-on individual contributor.At least an active Secret clearance, and the ability and willingness to up-level to TS/SCI with CI Poly. This is a requirement and candidates will not be considered who do not hold at least a Secret clearance.Willingness to remain hands-on in the code — this is not a purely people-leadership role.Ideally you'd have:Full Stack Development: Proficiency in both front-end and back-end development, including modern web frameworks, programming languages, and databases. Experience developing and delivering software to air-gapped and isolated environments is a plus.Cloud-Native Technologies: Understanding of containerization (e.g., Docker) and orchestration (e.g., Kubernetes). Familiarity with cloud platforms (AWS, Azure, GCP) and experience developing and deploying applications in cloud-native environments.Security Focused: Experience with federal compliance frameworks and requirements (e.g., Cloud SRG, FedRAMP, STIG Benchmarks). Experience delivering software and technical solutions that meet strict security and regulatory requirements.Team Building: Experience building or scaling a team from a small size, and setting engineering standards (code review, testing, on-call) that stick.Problem Solving: Strong analytical skills to understand complex challenges and devise effective solutions. Ability to think critically, identify root causes, and propose innovative approaches to technical obstacles.Collaboration and Communication: Excellent interpersonal and communication skills to collaborate with cross-functional teams, stakeholders, and customers. Ability to clearly articulate technical concepts to non-technical audiences.Adaptability and Learning Agility: Willingness to embrace new technologies, learn new skills, and adapt to evolving requirements in a fast-moving AI landscape.Must be able to support work 3–4 days a week from the DC office.Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You'll also receive benefits including, but not limited to: comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.The base salary range for this full-time position in the location of Washington DC is:$213,600—$267,000 USDPLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.About Us:At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst& Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status. We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at View email address on us.fitly.work. Please see the United States Department of Labor's Know Your Rights poster for additional information.We comply with the United States Department of Labor's Pay Transparency provision. PLEASE NOTE: We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants’ needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Frontier AI Infrastructure - Public Sector in Washington DC vacancy
  • $224k - $356.5k

    NVIDIA’s EDA Infrastructure organization builds and operates the systems that support chip development. We are looking for an engineering manager to lead the team responsible for operational processes...  .... Your team will use automation, AI, and lessons from operational... 
    Suggested
    Full time
    Remote work

    Nvidia

    Washington DC
    5 days ago
  • $191k - $297k

     ...Job DescriptionSr Engineering Manager – Network InfrastructureSNAAP (Security, Network, Access...  ..., GCP, and OCI, Juniper Mist wireless infrastructure, and Infoblox DNS/IPAM. You’ll be responsible...  ...Juniper EX/QFX switching, Mist AI wireless, or comparable campus/branch... 
    Suggested
    Full time

    Nordstrom

    Washington DC
    a month ago
  • $142k - $194k

     ...Computer Science, Computer Engineering, Electrical Engineering, or...  ...in systems, platform, cloud infrastructure, networking, or distributed...  ...experience with hardware lifecycle management, provisioning systems, fleet...  .... Technologies: AI Cloud Embedded Firmware... 
    Suggested
    Full time

    Oracle

    Washington DC
    11 days ago
  • $114.6k - $234.6k

     ...experiencing rapid growth driven by AI/ML adoption and increasing...  ...accelerating innovation across cloud infrastructure, from silicon and programmable...  ...-on Senior Principal Systems Engineer to provide technical leadership for Card Management, a critical platform supporting... 
    Suggested
    Temporary work
    Flexible hours

    Oracle Corporation

    Washington DC
    9 days ago
  • $135k - $175k

     ...Delivering a broad range of Infrastructure Operations, Application Development...  ...a  Chief Infrastructure Engineer  to support the Army Research...  ...storage, virtualization, endpoint management, identity services,...  ...Infrastructure-as-Code (IaC), AI-enabled technologies, and process... 
    Suggested
    Hourly pay
    Full time
    Contract work
    Temporary work
    For contractors
    Work experience placement
    Remote work
    Relocation package

    Link Solutions, Inc.

    Adelphi, MD
    4 days ago
  • $142.3k - $195.7k

     ...community The Principal Storage Engineer is a senior technical leader...  ...and long-term data infrastructure strategy. This role establishes...  ...architecture decisions for on-premises AI infrastructure, including...  ...-as-code, configuration management, and self-service capabilities... 
    Permanent employment
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Work from home
    Home office

    Humana

    Washington DC
    4 days ago
  • $169.8k - $355.4k

    Oracle Cloud Infrastructure (OCI) is hiring experience engineering leader to lead Automation, Tooling, and AI Platform Engineering. This role will build the platforms, developer tools...  ...for Physical Networking.Lead managers and senior engineers across platform and... 
    Temporary work
    Local area
    Flexible hours

    Oracle Corporation

    Washington DC
    3 days ago
  • $146.3k - $306.4k

    Oracle Cloud Infrastructure (OCI) is building some of the world's largest and most...  ...clusters to power the next generation of AI. The Strategic Customer Engineering (SCE) Core Infrastructure team—...  ..., post-sale customer management/support, build automated solutions... 
    Temporary work
    Flexible hours

    Oracle Corporation

    Washington DC
    9 days ago
  • $193.6k - $414.4k

     ...foundational to Oracle Cloud Infrastructure (OCI), providing the...  ...Dataplane software. You will own engineering strategy, architecture, delivery...  ...scale a team of engineering managers and senior technical leaders...  ...life-saving care. And with AI embedded across our products... 
    Temporary work
    Flexible hours

    Oracle Corporation

    Washington DC
    5 days ago
  •  .... For the first time ever, you can manage and automate every part of the employee...  ...addresses.About The RoleRippling Infrastructure operates as a scaled engineering organization responsible for the...  ...persistence, workflow orchestration, and AI enablement across Rippling. Our... 

    Rippling

    Washington DC
    a month ago
  • $135.2k - $306.4k

    Oracle Cloud Infrastructure (OCI) Networking is the foundation that enables...  ...OCI's network control and management systems from the ground up...  ...platforms. We're looking for engineers with strong computer science...  ...life-saving care. And with AI embedded across our products... 
    Temporary work
    Flexible hours

    Oracle Corporation

    Washington DC
    a month ago
  • $146.3k - $306.4k

    Oracle Cloud Infrastructure (OCI) is growing rapidly as one of the world’...  ...platforms. The expansion of AI, machine learning, and traditional...  ...for exceptional systems engineering talent to help shape what comes...  ...Linux OS expertise to manage memory, scheduling, I/O virtualization... 
    Temporary work
    Flexible hours

    Oracle Corporation

    Washington DC
    3 days ago
  •  ...the first time ever, you can manage and automate every part of the...  ...seeking a deeply technical Engineering Manager to lead a high-impact...  ...fully automated IT product and infrastructure ecosystem. At Rippling, our...  ...Healing Procurement: Designing AI-driven algorithms and... 
    Work at office
    Shift work
    3 days per week

    Rippling

    Washington DC
    12 days ago
  • $145.9k - $234.2k

     ...seeking a Senior Technical Program Manager (TPM) to drive project and program management of infrastructure (cloud and on-prem) rationalization and AI-readiness initiatives at Moderna globally...  ...Collaboration work with Cloud Engineering, Systems Engineering, and AI... 
    Permanent employment
    Full time
    Work at office
    Work from home

    Moderna Therapeutics

    Washington DC
    a month ago
  • $168k - $270.25k

     ...parallel computing, and modern AI. Today, NVIDIA high-...  ...reasoning, and large-scale systems engineering. To address these complex challenges...  ...are seeking an Engineering Manager to spearhead our strategy for...  ...build scalable verification infrastructure, improve engineering velocity... 
    Full time

    Nvidia

    Washington DC
    a month ago
  • $150k - $185k

     ...Inclined ( is seeking an Engineering Manager to build and strengthen our...  ...pipelines, including CI/CD, cloud infrastructure, deployment automation, and...  ..., government contracting, public-sector technology, or other secure...  ...teams Experience with AI-assisted software... 
    Local area
    Visa sponsorship
    Work visa

    Inclined Analytics

    Arlington, VA
    23 days ago
  • $272k - $431.25k

     ...constraint is the job. We’re hiring an engineering leader to build and run Infrastructure Security Engineering for EDA...  ...storage including 5+ years leading and managing engineering teams. A Bachelor’s...  ...an existing vacancy. NVIDIA uses AI tools in its recruiting processes.... 
    Full time
    Remote work

    Nvidia

    Washington DC
    12 days ago
  • $200k - $250k

     ...The real world is the next frontier, and at Metropolis, we...  ...Metropolis is seeking a Senior Manager of Machine Learning Engineering within the Advanced...  ...power our next generation of AI. You will oversee 4...  ...annotation pipelines, ML Infrastructure and Deployment of Agentic... 
    Temporary work
    Work at office
    Local area

    Metropolis

    Washington DC
    13 days ago
  • $95k - $120k

     ...enabling human life on Mars.DATA INFRASTRUCTURE OPERATIONS SPECIALIST II (...  ...for the end-to-end management of suppliers, costs, and delivery...  ...continuous improvement of our AI models. We're seeking...  ...Align sourcing strategy with engineering, quality, and performance requirements... 
    Permanent employment
    Temporary work
    Work at office
    Monday to Friday
    Flexible hours

    SpaceX

    Washington DC
    a month ago
  • $180k - $210k

     ...OverviewWe are seeking a Director, IT Infrastructure & Cloud Engineering to lead the platforms powering...  ...visible leadership role, leading through managers and technical leads and partnering closely...  .../CD, SRE, observability, and applied AI to improve scalability, reliability,... 
    Full time

    PMI

    Washington DC
    22 days ago
  • $218.8k - $295.9k

     ...the boundaries of AI/ML technology (e....  ...and management, graph neural networks...  ...The AWS Analytics Engineering (AAE) is at the forefront...  ...technology and infrastructure to redefine how AWS...  ...innovation and publication roadmap, and continuously...  ...push the frontier of what's possible... 
    Flexible hours

    Amazon

    Washington DC
    a month ago
  • $165k - $267.5k

     ...Integrity, and Inclusion. We weave AI into the fabric of everything we...  ...the roleWe are looking for an Engineering Manager to join our Developer Infrastructure team. You’ll be responsible for nurturing...  ...Infrastructure. Familiarity with public cloud infrastructure supporting... 
    Full time
    Work experience placement
    Remote work

    Palo Alto Networks

    Washington DC
    26 days ago
  • $187k - $253k

     ...global clients. We're looking for a Data Engineering Manager to lead and grow our Data Engineering...  ...within 3PX A&I. You will own the data infrastructure, pipelines, and platform capabilities...  ...metrics, deal lifecycle tracking, and AI-powered insights across the global... 
    Worldwide
    Flexible hours
    Shift work

    AmazonWebServices

    Washington DC
    a month ago
  • $193.8k - $285k

     ...DoorDash success. The Data Engineering team builds database...  ...we are looking for managers who are passionate about...  ...closing gaps in data infrastructure and technical...  ...PostgreSQLNotice Regarding Use of AI and Automated Tools:...  ...summary for Gem is publicly available for review at... 
    Hourly pay
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Doordash

    Washington DC
    a month ago
  • About StripeStripe is a financial infrastructure platform for businesses. Millions of companies...  ...Infrastructure enables Stripe’s engineers to build and ship products using efficient...  ...availability.What you’ll doAs an Engineering Manager of Managers within the Service... 
    Remote work

    Stripe

    Washington DC
    3 days ago
  • $264k - $379.5k

     ...To usher in this new era, we seek AI-native thinkers across every...  ....We're looking for a Director of Engineering to join our leadership team in AI...  ...engineering director experience, including managing managersDeep experience with AI infrastructure and LLMsExperience building large... 

    Snowflake

    Washington DC
    15 days ago
  • $275k - $378k

     ...Secure Every Identity, from AI to Human Identity is the...  ...building the trusted, neutral infrastructure that enables organizations...  ...too, let's talk. Director of Engineering, AI takeoff team Secure...  ...engineering leadership and team management experience, including hiring... 
    Local area
    Worldwide
    Flexible hours

    Okta

    Washington DC
    11 days ago
  • $121k - $215k

     ...then we invite you to apply to our Data Engineering Manager position. This position may be filled...  ...be considered. The Data Science & AI and Information Design & Engineering teams...  ...up, establishing the foundational infrastructure needed to ensure high-quality data is... 
    Full time
    Temporary work
    Remote work
    Flexible hours

    Husch Blackwell

    Washington DC
    4 days ago
  • $182.4k - $247k

     ...and running the world's best data and AI infrastructure platform so our customers can use deep...  ...node and more! We're seeking a dedicated Engineering Leader for our Developer Experience...  ...You will report directly to the Senior Manager of Engineering.The main... 
    Local area
    Worldwide

    DataBricks

    Washington DC
    a month ago
  • $61k - $101k

     ...We have experience leading engineering teams that deliver security solutions...  ...a product owner or product manager, with ownership of roadmaps...  ...ability to deliver AI-enabled or automation-driven...  ...controls into CI/CD, cloud, and infrastructure platforms Preferred: We have... 
    Full time

    J.P. Morgan

    Washington DC
    24 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Engineering Manager, Frontier AI Infrastructure - Public Sector. Be the first to apply!