Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer - AI/HPC Middleware

Cornelis Networks

Senior Software EngineerAt Cornelis we're building the future of AI and HPC networking with an AI-first approach to silicon and software development. We're seeking engineers who are energized by working on cutting-edge ASIC design and distributed software systems, and who are motivated to push the boundaries on how AI can transform everything from chip architecture to system performance at scale.Cornelis Networks delivers the world's highest performance scale-out networking solutions for AI and HPC datacenters. Our differentiated architecture seamlessly integrates hardware, software and system level technologies to maximize the efficiency of GPU, CPU and accelerator-based compute clusters at any scale. Our solutions drive breakthroughs in AI & HPC workloads, empowering our customers to push the boundaries of innovation. Backed by top-tier venture capital and strategic investors, we are committed to innovation, performance and scalability - solving the world's most demanding computational challenges with our next-generation networking solutions.We are a fast-growing, forward-thinking team of architects, engineers, and business professionals with a proven track record of building successful products and companies. As a global organization, our team spans multiple U.S. states and six countries, and we continue to expand with exceptional talent in onsite, hybrid, and fully remote roles.We are seeking an experienced Senior Software Engineer to contribute to the design, development, and upstream enablement of Cornelis Networks' AI/HPC communication middleware. This role focuses on enabling and optimizing HPC middleware (MPI/SHMEM) and AI middleware (collective communication libraries / CCL, e.g., NCCL/RCCL and related stacks) over Cornelis Networks' interconnects. You will help drive performance, correctness, and deployability across real customer workloads by collaborating across the stack (drivers/kernel, switches, systems, and application/framework teams) and by contributing upstream to key open-source projects.Key ResponsibilitiesAI/HPC Middleware Enablement & Optimization: Implement and help optimize features for HPC middleware (HPI and SHMEM) and AI middleware (CCL stacks ie: NCCL/RCCL and related collective communication libraries)Transport & Integration: Assist in integrating middleware capabilities with underlying transports and provider layers (ie: libfabric / OFI, UCX, verbs-like semantics where applicable)Upstream & Open-Source Leadership: Prepare and submit upstream contributions across MPI/SHMEM projects, CCL ecosystems, and related componentsCross-Stack Collaboration & Performance Validation: Collaborate with kernel/driver and switch teams to help deliver end-to-end performance aligned to the Cornelis product roadmapCustomer & Field Impact: Help analyze performance traces and reproduce customer issues, and assist in translating findings into fixes.Minimum Qualifications6+ years of experience in systems programming in C/C++ on Linux; Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience). Master's or Doctorate a plus.Hands-on experience with HPC middleware internals (Open MPI, MPICH, MVAPICH, and/or SHMEM) or optimizing collective communications for AI, including NCCL/RCCL, CUDA/ROCm) and/or other CCL stacks.Demonstrated ability to deliver low-latency/high-throughput communication paths and to diagnose performance issues using profiling/tracing tools.Working knowledge of transport/integration layers such as OFI/libfabric, UCX, verbs-style concepts.Solid background in RDMA concepts and performance tuning.Experience contributing to open-source projects.Preferred QualificationsPrior experience developing or maintaining libfabric providers.Familiarity with Ultra Ethernet (UEC/UET) specifications.Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments.Experience with cluster-scale benchmarking, profiling, and optimization.Background with HPC fabrics, such as Omni-Path.Location: This is a remote position for employees residing within the United States.We offer a competitive compensation package that includes equity, cash, and incentives, along with health and retirement benefits. Our dynamic, flexible work environment provides the opportunity to collaborate with some of the most influential names in the semiconductor industry.In addition to your base pay, you'll have access to a broad range of benefits, including medical, dental, and vision coverage, as well as disability and life insurance, a dependent care flexible spending account, accidental injury insurance, and pet insurance. We also offer generous paid holidays, 401(k) with company match, and Open Time Off (OTO) for regular full-time exempt employees. Other paid time off benefits include sick time, bonding leave, and pregnancy disability leave.Cornelis Networks does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. Cornelis Networks is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants' needs under the respective laws throughout all stages of the recruitment and selection process.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer - AI/HPC Middleware in New York, NY vacancy
  • $149k - $169k

     ...New York University is seeking a Senior Research Software Engineer to design and maintain software for its research and teaching needs. This position...  ...leveraging technology investments, including a state-of-the-art HPC cluster and cloud resources. You will work closely with... 
    Senior

    New York University

    New York, NY
    1 day ago
  •  ...Software EngineerAt Cornelis we're building the future of AI and HPC networking with an AI-first approach to silicon...  .... We're seeking engineers who are energized by working...  ...' AI/HPC communication middleware. Working under the guidance of senior team members, you will... 
    Middleware
    Full time
    Remote work
    Flexible hours

    Cornelis Networks

    New York, NY
    5 days ago
  •  ...Senior Java DeveloperThe role combines hands-on software engineering, cloud-native development, distributed systems, DevOps, AI adaptability, and technical leadership.Job Description:Client is...  ...volume messaging- and rest- based middleware.Experience with defining... 
    Senior
    Middleware

    TriOptus LLC

    New York, NY
    5 days ago
  • $180k - $230k

     ...York City or Washington, D.C., the Senior Software Development Engineer designs, architects, builds, and leads...  ...close partnership with the firm’s AI Platform Engineering team to design...  ...Develop secure APIs, microservices, and middleware components that facilitate... 
    Senior
    Middleware
    Local area
    Flexible hours

    Gibson, Dunn & Crutcher LLP

    New York, NY
    4 hours ago
  • $184k - $287.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An...  .... We are looking for an experienced Software Engineer to develop our core libraries for Agentic...  ...or observability pipelines are a plus. Middleware, plugin systems, guardrails, policy engines... 
    Senior
    Middleware

    NVIDIA

    New York, NY
    4 days ago
  • $170k - $210k

     ...Senior Software EngineerVantage Group Holdings Ltd. (Vantage) was established...  ..., the Senior Software Engineer will be a part of an agile product...  ...experience.Experience using AI development techniques (...  .../Kubernetes, databases, middleware, DevOps.Broad knowledge of software... 
    Senior
    Middleware
    Remote work
    Flexible hours

    Vantage Group Holdings Ltd

    New York, NY
    4 days ago
  • $140k - $200k

     ...verticals, supplemented with Data & AI, Cybersecurity, Risk &...  ...the Role: We are seeking a Senior C++ / Java Developer to support...  ...technology experience. The engineer will partner closely with Treasury...  ..., memory, cache, network, and middleware levels. Ensure production... 
    Senior
    Middleware
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    4 days ago
  •  ...Swayable is seeking a Senior Engineer with strong Python and scientific computing skills to advance our AI-powered analytics engine. You will build and improve tools for high...  ...researchers across ML, visualization, and software architecture. The role emphasizes scalable,... 
    Senior

    Higher Ground Labs

    New York, NY
    4 days ago
  •  ...floor of an evolving, AI-native team. InRhythm...  ...them through AI-native engineering, where agents, reusable...  ...are part of how software gets built, not an add...  ...We Are Looking For a Senior Java AI-Enabled Engineer...  ...applications and integration middleware Create, refine, and... 
    Senior
    Middleware
    Full time
    Work at office
    Immediate start
    Remote work

    InRhythm

    New York, NY
    4 hours ago
  •  ...Senior AI Software DeveloperWe are seeking a Senior AI Software Developer to design, build, and...  ...SAP integration methods such as APIs, middleware, messaging, OData, IDocs, BAPIs, RFCs,...  ...Copilot• Similar AI coding and software engineering tools• Experience developing... 
    Senior
    Middleware

    RIT Solutions

    New York, NY
    5 days ago
  • $150k - $190k

     ...Salesforce CPQ feeding NetSuite via middleware, with mid-contract amendments...  ...week. ** What you can expect as a Senior Salesforce & Integration Engineer: Salesforce / CPQOwn the technical...  ...reliabilityUnderstand and leverage AI (Claude Code) toolsets to increase... 
    Senior
    Middleware
    Contract work
    Work at office
    Worldwide
    Flexible hours

    VTS (View The Space)

    New York, NY
    5 days ago
  • $100k - $143k

     ...Business UnitTechnology, Data, AI and Ventures (TDAV)Within the...  ...4+ years of professional software development experience, with...  ...services using LLMs - e.g., prompt engineering, RAG pipelines, embeddings/...  ...(Spring Boot, messaging middleware such as Kafka, enterprise service... 
    Senior
    Middleware
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    2 days ago
  • $123k - $215.25k

     ...bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full...  ...product and design, and enterprise AI platforms on behalf of the...  ..., secrets management, software supply-chain controls, and operational...  ...and supportKnowledge of middleware technologies Knowledge of software... 
    Senior
    Middleware

    American Express

    New York, NY
    1 day ago
  • $182k - $242k

    CoreWeave is The Essential Cloud for AI. Built for pioneers by...  ...more at .About the roleASoftware Engineer contributes to the design,...  ...yearsCompetency in Go and/or Python software development.Hands-on...  ...Experience testing hardware at scale.HPC Experience.Experience with AI/... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $116k - $182k

     ...Senior Lead Systems Engineer, AI & AutomationAt Braze, we have found our people. We're a genuinely approachable...  ...technology through automation, software engineering, AI, and intelligent...  ...other SaaS applications. Build APIs, middleware, and event-driven workflows that create... 
    Senior
    Middleware
    Work at office

    Braze

    New York, NY
    4 days ago
  • $250k - $300k

     ...Senior Software Engineer, Infrastructure Build reliable, automated financial infrastructure for today...  ...is building the financial layer for AI compute. GPU capacity is still bought and...  ...not required Cloud, neocloud, GPU, or HPC infrastructure including capacity,... 
    Senior
    Contract work

    Liquid Compute

    New York, NY
    4 hours ago
  • Senior Software Engineer Unissant, Inc. delivers innovative capabilities to the agencies that keep our...  ...and platform operations across FEMA's AI portfolio. This individual will build,...  .... Build user interfaces, APIs, middleware, data services, and back-end components... 
    Senior
    Middleware
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    UNISSANT

    New York, NY
    2 days ago
  • Software Engineer Working On Platform Healthcare operations have always depended on people to bridge...  ...over time. By delegating to autonomous AI systems those mission-critical...  ...implement robust APIs, authentication, and middleware that hold up under load Harden production... 
    Senior
    Middleware
    Work at office
    Local area
    Work from home
    Monday to Friday

    Luminai

    New York, NY
    5 days ago
  • $164.4k - $262.6k

     ...team is part of Platform Engineering. We build the internal...  ...requests, we design software that lets teams...  ...Database Engineering, Middleware Engineering, Delivery...  ...About the role As a Senior Software Development Engineer...  ...incidents. Use modern AI-assisted and agentic tooling... 
    Senior
    Middleware
    Permanent employment
    Live in
    Work at office
    Local area
    Remote work

    Zillow

    New York, NY
    2 days ago
  •  ...Crusoe Cloud is seeking a Senior Cloud Support Engineer in the United States to empower customers with sustainable, low-cost GPU compute power. You will be the primary technical contact, handling issues across VMs, hardware, and scaling, while collaborating with SRE and... 
    Senior

    Crusoe

    New York, NY
    1 day ago
  • $91.7k - $163.7k

    Senior Software Engineer Optum is a global organization that delivers care, aided by technology to help...  ..., Cloud, Integration, Automation, and AI-enabled solutions to support critical...  ..., REST APIs, SOAP services, and middleware components supporting enterprise business... 
    Senior
    Middleware
    Minimum wage
    Permanent employment
    Full time
    Work experience placement
    Local area
    Remote work

    Genoa Telepsychiatry

    New York, NY
    2 days ago
  • Baseten is seeking a mid-to-senior Software Engineer to advance HPC and LLM infrastructure. You will define roadmaps, own critical tooling, and drive performance...  ...optimizations across GPU clusters for production-scale AI workloads. You will build internal development... 
    Senior

    BaseTen

    New York, NY
    5 days ago
  • $160k - $240k

    Senior Software Engineer - Cloud Native Compute Infrastructure Core Location New York Business...  ...premises GPU infrastructure supporting AI training and inferenceOur mission is to...  ...drift detection.Experience with GPU and HPC infrastructure, including hardware... 
    Senior
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    1 day ago
  • $160k - $240k

    Senior Software Engineer - Platform as a Service Location New York Business Area Engineering and CTO Ref # 10049539 Description...  ...Bloomberg infrastructure systems, including proprietary middleware, deployment approval workflows, certificate lifecycle... 
    Senior
    Middleware
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $180k - $220k

     ...Senior Infrastructure Software EngineerNew York, New York, United StatesAbout Lightning AILightning AI is the company behind PyTorch Lightning. Founded...  ...Infrastructure Software Engineer to join our Infrastructure...  ...training, inference, and HPC workloads.In this role, you... 
    Senior
    Work at office
    Work from home
    Flexible hours
    2 days per week

    Lightning AI

    New York, NY
    5 days ago
  • Senior Software Engineer Imagine working at a place where innovation meets impact, and every day brings...  ...improving enterprise integrations, middleware platforms, automation, analytics enablement...  ..., machine learning, chatbots, or AI-assisted business process solutions Strong... 
    Senior
    Middleware
    Temporary work
    Remote work
    Home office
    Monday to Friday
    Shift work

    ScriptPro

    New York, NY
    1 day ago
  •  ...CoreWeave is seeking a Senior Specialist Field Engineer to lead customer engagements across high-performance networking and cloud infrastructure. You...  ...engineering with thought leadership, enabling customers to leverage CoreWeave’s cloud for AI workloads. #J-18808-Ljbffr... 
    Senior

    CoreWeave

    New York, NY
    5 days ago
  • $180k - $230k

     ...provider and operator of Coindesk.com. Reports to: Director, Engineering. Engineering Organization & Culture: At Bullish, we are...  ...Advanced Java proficiency, with implementation experience using middleware such as Aeron and Kafka. ~ Expertise in designing clean data... 
    Senior
    Middleware

    Bullish, Inc.

    New York, NY
    4 hours ago
  • $165k - $220k

     ...is The Essential Cloud for AI. Built for pioneers by pioneers...  ...Development team builds the software that makes that possible. We...  ...a talented and experienced Senior Software Engineer to join our Network...  ...Observability, Fleet Engineering, and HPC teams so our automation fits... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  •  ...for high performance computing and AI. Our customers run large...  ...sets our priorities. We are a small engineering company, so engineers here work directly...  ...role Parallel Works is hiring a Senior HPC Applications Engineer to own the software stack and the user experience on... 
    Senior
    Temporary work
    Work at office
    Remote work

    Parallel Works

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer - AI/HPC Middleware. Be the first to apply!