Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. Principal Engineer, Scale-Up (Data Path Features)

Upscale, Inc.

Job Description

Job Description

Why join Upscale, Inc.

Upscale, Inc., is building the high-performance infrastructure powering the next generation of artificial intelligence. Backed by over $500M in funding and rapid global adoption, we are scaling systems designed for the world’s most demanding AI workloads.

We focus on first-principles engineering across silicon, systems, and networking—where performance, scale, and execution are critical. Our team is talent-dense and high-performing. We value ownership, technical rigor, and speed, and we offer the opportunity to work on foundational problems with immediate, real-world impact.

If you’re looking to do high-impact work, move fast, and help define the infrastructure behind the future of AI—Upscale is where you can produce meaningful work at the frontier—and operate at a high standard. 

Position Overview

Senior individual-contributor validation role. You own how data-path features are qualified on our scale-up AI networking platform, from the SAI/SDK programming path through ASIC forwarding and traffic-management behavior. You set the test strategy, own feature readiness and release sign-off, debug the hardest cross-stack failures, and grow the QA engineers around you. Primary depth is traffic management. Feature scope (cycle-accurate model and silicon)

Key Responsibilities

  • Classification and marking: DSCP and 802.1p to traffic class, trust, TC-to-queue, remarking, port versus switch map binding, classification miss, ACL rewrite

  • Queueing: unicast and multicast queues, counters, occupancy, watermarks, drops

  • Scheduling: strict priority, WRR/DWRR, hierarchy, shaping, rate limiting, fairness under oversubscription

  • Buffering: ingress and egress pools, static and dynamic thresholds, priority groups, headroom, reserved versus shared

  • PFC and lossless Ethernet: pause, headroom, lossless queues, watchdog, storm and deadlock, DCB

  • ECN and WRED: thresholds, drop probability, ECT/CE, interaction with DCQCN under RoCEv2

  • Policing: color-blind and color-aware, CIR/PIR/CBS/PBS, trTCM

  • Forwarding and counters: L2/L3, ECMP, mirror and sample, telemetry that makes the above observable

  • Own the validation strategy, test plans, coverage, and release entry/exit criteria for the features above

  • Qualify lossless and congestion behavior under RoCEv2 and GPU collectives (NCCL/RCCL) at line rate, including incast, PFC headroom, ECN accuracy, and no-drop

  • Build the frameworks and debug tools the team depends on, including model-based checks of classification, queueing, scheduling, and drop or mark outcomes

  • Lead root-cause analysis across software, SDK, model, silicon, and Linux, and decide when the spec, the implementation, or the test is wrong

  • Mentor QA engineers, review their plans and automation, and represent validation in design reviews and the development-to-QA handoff

  • Support customer deployments, proofs of concept, and field issues on data-path and congestion behavior

Requirements

  • 15+ years in networking software, system validation, or ASIC/platform QA, with a substantial stretch as a senior individual contributor

  • Deep hands-on traffic management: PFC, scheduling, buffers, classification and marking, queueing, ECN/WRED

  • Strong L2/L3 and ACL fundamentals, and experience with SAI, a switch SDK, or a NOS such as SONiC or FBOSS

  • Ownership of validation frameworks and automation, not only test execution

  • Python or Go at framework-review level; solid Linux and packet- and counter-level debugging

  • Proven mentoring and influence as an individual contributor, and clear written readiness and root-cause reports

Preferred

  • Ethernet ASIC QA in L2/L3, buffers, scheduling, and queueing

  • RoCEv2, RDMA, DCB, PFC tuning, and DCQCN on AI or HPC fabrics; NCCL/RCCL on NVIDIA or AMD GPU clusters

  • ASIC bring-up, C-model or emulation, and pre-silicon to post-silicon correlation

  • Buffer and headroom sizing; incast, microburst, and oversubscription debug

  • Ixia, Keysight, Spirent, or similar line-rate tools

  • NVLink or ESUN; customer, field, or forward-deployed work is a plus

Where you fall within that range depends on your experience, skills, and impact—we benchmark against internal levels to keep things fair and consistent.

Equal Opportunity

Upscale, Inc., is building a team that reflects a wide range of perspectives, backgrounds, and experiences. We’re proud to be an Equal Opportunity Employer and consider all qualified applicants regardless of race, color, religion, national origin, sex, sexual orientation, gender identity, disability, or veteran status.

Accessibility & Accommodations

We’re committed to making our hiring process accessible to everyone. If you need accommodations at any stage, just reach out to us at  View email address on us.fitly.work —we’re happy to help. Note: This inbox is only for accommodation requests.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Sr. Principal Engineer, Scale-Up (Data Path Features) in Washington DC vacancy
  • $208.3k - $281.8k

     ...with their most sensitive data. You will own the...  ...team runs on: escalation paths, inspection cadences, delivery...  ...problems early and scale without adding...  ...strategy covering LLM features across HR applications,...  ...is a team of security engineers and managers embedded with... 
    Data
    Senior
    Flexible hours
    Shift work

    Amazon

    Arlington, VA
    3 days ago
  • $91k - $321.5k

     ...organise leadership team calls and meetings, oversee research and data analysis, promote consistent execution across sectors, and...  ...on the Pricing Desk, you’ll lead strategy for high-value Scaled Engineering Services (SES) deals. Own the full pricing lifecycle—design strategic... 
    Data
    Senior
    Full time
    Contract work
    H1b

    PwC

    Washington DC
    1 day ago
  •  ...choice, we must trailblaze the path and shape the future of our...  ...empowers customers to focus on the data and insights that matter by...  ...roleWe are looking for our Engineering Manager who has a solid track...  ...and will contribute to small features to gain familiarity with the... 
    Data
    Senior
    Full time
    Remote work
    Visa sponsorship
    Work visa

    Palo Alto Networks

    Arlington, VA
    1 day ago
  • $204k - $255k

     ...made from air. We are seeking a Sr. Principal Electrical Design Engineer to join our Plant Design team. The...  ...approve electrical drawings, equipment data sheets and requisition packages,...  ...Owner’s Organizations on industrial-scale engineering, construction projects and... 
    Data
    Senior
    Contract work
    For contractors
    Relocation
    Relocation package

    Twelve

    Washington DC
    a month ago
  •  ...Sr Principal Cybersecurity Engineer Hybrid or remote work environment - Up to 10% travel may be required 6+ Months Contract Senior Cybersecurity...  ...protect enterprise systems, networks, applications, and data. This role is responsible for designing, implementing,... 
    Data
    Senior
    Contract work
    Remote work

    American Unit, Inc

    Washington DC
    12 hours ago
  • $225k - $340k

     ...enabling human life on Mars.PRINCIPAL CYBERSECURITY ENGINEER (STARSHIELD) At SpaceX we’...  ...intelligence and national security data for the US government...  ...implementing security features into our systems, as well as...  ...computer networks and large-scale distributed compute platforms... 
    Data
    Permanent employment
    Temporary work
    Immediate start
    Weekend work

    SpaceX

    Washington DC
    4 days ago
  • $174.25k - $235.75k

     ...Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills...  ...flexibility with global scale, IEX leverages emerging technologies...  ...is seeking a Senior Principal AI Data Engineer to...  ...ready datasets (including features, embeddings, and prompts),... 
    Data
    Senior
    Contract work
    Temporary work
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Jobleads-US

    Arlington, VA
    4 days ago
  • $230k - $255k

     ...seeking a Senior Director of Engineering to provide technical direction...  ...behind WarDrive, a general-purpose data engineering platform that...  ...platform, and a clear growth path for every engineer on the team...  ...customer networks. Oversee petabyte-scale pipelines and analytics... 
    Data
    Senior
    Remote work

    Warfighter AI, LLC

    Arlington, VA
    12 hours ago
  • $101.15k - $192k

     ...and innovative Platform Engineer to help build and...  ...solution focused on moving data from commercial environments...  ...across the stack, own features end-to-end, and help...  ...time to help forge our path forward.LMI is a new breed...  ...system health   Scale systems sustainably through... 
    Data
    Senior
    Contract work
    For contractors
    Work at office

    LMI

    Washington DC
    4 days ago
  • $175.88k - $251.25k

     ...customers from cyberattacks and data loss by securely connecting...  ...looking for a Senior Manager, Sales Engineering, Majors West based in the...  ...sales engineering team Refine and scale core sales engineering...  ...You're comfortable building the path as you walk it. You thrive in... 
    Data
    Senior
    Full time
    Work at office
    Local area
    Remote work

    Zscaler

    Washington DC
    12 hours ago
  • $130k - $175.9k

     ...customer acquisition and revenue growth at scale. Operating through an inside sales model,...  ...The CSC is both a talent destination and engine for AWS, with a strong focus on developing...  ...relationshipsPersuade stakeholders using data-backed recommendations and compelling narrativesDealing... 
    Data
    Senior
    Immediate start
    Flexible hours

    Amazon

    Arlington, VA
    4 days ago
  • $160k - $220k

     ...government agencies with cutting-edge AI/ML and data solutions. We are a leader in autonomous...  ...Distributed Data Systems, Platforms at Scale, and Complex Application Development....  ...backend and frontend to build end-to-end features that make interacting with data easier enabling... 
    Data
    Live in

    Raft Company Website

    Washington DC
    26 days ago
  • $198k - $264k

     ...enables innovators to build and scale AI with confidence....  ...portfolio of mission-critical data center infrastructure to...  ...safely and at scale. The Principal Operational Readiness Engineer will serve as a senior technical...  ...sequencing, and critical path risks across large-scale... 
    Data
    Permanent employment
    Full time
    Temporary work
    For contractors
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    Washington DC
    a month ago
  • $168.1k - $227.4k

     ...followed a traditional path, or includes...  ...a senior software engineer in AWS Commerce Platform...  ...at a massive scale and on multiple dimensions...  ...other senior and principal engineers, and...  ...billing data at scale.- Regularly...  ...AWS’s services and features apart in the industry... 
    Data
    Senior
    Internship
    Flexible hours

    AmazonWebServices

    Arlington, VA
    3 days ago
  • $121k - $206k

     ...to support your career path, as well as compensation...  ..., and TRP Labs to help scale responsible AI...  ...actionable insights.Champion engineering excellence by applying...  ...engineering, real-time data-driven automation, and...  ...ways that matter to you. Featured employee benefits to enrich... 
    Data
    Senior
    Full time
    Local area
    Remote work
    3 days per week

    T. Rowe Price

    Washington DC
    2 days ago
  •  ...PATH is a global nonprofit dedicated to achieving health equity. With more than 40 years...  ...dozens of other specialties, PATH develops and scales up innovative solutions to the world's...  ..., improve commodity security, and enhance data-driven decision-making across malaria, maternal... 
    Data
    Senior

    Path International

    Washington DC
    2 days ago
  • $140k - $215k

     ...platform. We work on large scale distributed systems,...  ...low-level endpoint engineering meets the broader Falcon...  ...engineering to ship sensor features that are fast, safe to...  ...switches, and fallback paths.Define and track the...  ...executives.A habit of using data and customer feedback... 
    Data
    Senior
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    Arlington, VA
    2 days ago
  • $147.9k - $200.1k

     ...architecture, product engineering, partners, marketing) to...  ...cases to support product feature requests for segment...  ...capabilities — through data-driven analytics, financial...  ...with the resources and scale of AWS.About AWSDiverse...  ...followed a traditional path, or includes... 
    Data
    Senior
    Worldwide
    Flexible hours

    AmazonWebServices

    Arlington, VA
    12 hours ago
  • $200k - $250k

     ...Manager of Machine Learning Engineering within the Advanced Technologies...  ...the Machine Learning org:data engineering, annotation pipelines...  ...ML data pipelines and feature stores Collaborate with external...  ...in building enterprise-scale, auditable ETL pipelines and... 
    Data
    Senior
    Full time
    Temporary work
    Work at office
    Local area

    Metropolis

    Washington DC
    1 day ago
  • $207k - $284.9k

     ...s talk.The Federal Operations Engineering GroupOkta's Federal Operations...  ...organization, including setting career paths that bridge deep federal...  ....Experience operating large-scale cloud infrastructure in...  ...have access to protected federal data. As a condition of employment... 
    Data
    Senior
    Permanent employment
    Local area
    Worldwide
    Flexible hours
    Day shift

    Okta

    Washington DC
    2 days ago
  • $148.5k - $237.6k

     ...contributor in the APX platform engineering organization on the...  ...how it connects and scales in Axon's overall...  ...platforms (we have no data centers, so there is no...  ...automation that keeps those paths safe and observable.Advance...  ...how we scale—building features, hardening what runs in... 
    Data
    Senior
    Work experience placement
    Work at office
    Remote work

    Axon

    Washington DC
    1 day ago
  • $250.6k - $384.6k

     ...essential to achieving that vision. As Sr Manager, AV Behavior Safety Engineering, you will lead the strategy and...  ..., closed‑course, and public‑road data and provide clear, prioritized feedback...  ...This Role Is Unique Impact at Scale: Your work will directly influence how... 
    Data
    Senior
    Odd job
    Full time
    Local area
    Remote work
    Work from home
    Flexible hours

    General Motors

    Washington DC
    3 days ago
  • $144.16k - $162.18k

     ...students to forge their path to a better future....  ...searching for a Principal AI & Machine Learning Engineer.  RESPONSIBILITIES...  ...support within the Data Analytics & Research...  ...working with large-scale cloud data platforms...  ...with Databricks AI features, including MLflow, Model... 
    Data
    Temporary work
    Fixed term contract
    Live in
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Common App

    Arlington, VA
    5 days ago
  • $172.5k - $260.1k

     ...looking for an experienced Senior Engineering Manager to lead our...  ...Qualified running reliably at scale while accelerating every product...  ...engineer has a clear leveling path and growth plan, and handle underperformance...  ...how we use your personal data and your rights, including... 
    Data
    Senior
    Full time
    Immediate start
    Remote work

    Salesforce

    Washington DC
    3 days ago
  • $142k - $194k

     ...require 11 years of experience in data science, machine learning,...  ..., Machine Learning, Computer Engineering, Mathematics, Physics, or a...  ...are ready for deployment by scaling them, cleaning code, and meeting...  ...cleaning, preprocessing, and feature identification to prepare for... 
    Data
    Full time

    Oracle

    Washington DC
    4 hours ago
  • $147.9k - $200.1k

     ..., operating at massive scale and enabling businesses...  ...leverage AWS and partner data, analytics, generative...  ...hardware and software engineering leaders, professional services...  ...curation of custom feature requests, regional...  ...followed a traditional path, or includes alternative... 
    Data
    Senior
    Work experience placement
    Flexible hours
    Day shift

    AmazonWebServices

    Arlington, VA
    4 days ago
  • $148.5k - $223.9k

     ...ExperienceOur Public Cloud engineering teams are responsible...  ...maintaining a large scale distributed systems engineering...  ...that ships hundreds of features to production for tens...  ...solving real-world data management challenges,...  ...we can lead the path to equality in part by... 
    Data
    Senior
    Full time
    Work experience placement

    Salesforce

    Washington DC
    1 day ago
  • $100k - $166k

     ...extraordinary experiences at scale — across every customer touchpoint...  ...enabling enterprises to unify data, break down silos, and act on...  ...use of Sprinklr products and features to solve high level business...  ...enhancements, opportunities and paths to solutions that require... 
    Data
    Senior
    Full time
    Contract work
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Sprinklr

    Washington DC
    1 day ago
  •  ...a full-stack software engineer who gets excited about...  ...followed a traditional path, or includes alternative...  ..., APIs, microservices, data layers)- 5+ years of hands...  ...patterns at scale- Familiarity with observability...  ...workflows, LLM-powered features)Acknowledgement of country... 
    Data
    Senior
    Worldwide

    AmazonWebServices

    Washington DC
    2 days ago
  • $148.7k - $201.2k

     ...running. We support all AWS data centers and all of the...  ...hardware, and network engineers, supply chain...  ...faster, lower IT costs, and scale applications. We are growing...  ...followed a traditional path, or includes...  ...business case for new features or geographic expansions... 
    Data
    Senior
    Temporary work
    Fixed term contract
    Worldwide
    Flexible hours

    Amazon

    Arlington, VA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Principal Engineer, Scale-Up (Data Path Features). Be the first to apply!