Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer AI/HPC Middleware [Remote]

Full-time

Cornelis Networks

New York, NY
  • Remote job

At Cornelis we’re building the future of AI and HPC networking with an AI-first approach to silicon and software development. We’re seeking engineers who are energized by working on cutting-edge ASIC design and distributed software systems, and who are motivated to push the boundaries on how AI can transform everything from chip architecture to system performance at scale.

Cornelis Networks delivers the world’s highest performance scale-out networking solutions for AI and HPC datacenters. Our differentiated architecture seamlessly integrates hardware, software and system level technologies to maximize the efficiency of GPU, CPU and accelerator-based compute clusters at any scale. Our solutions drive breakthroughs in AI & HPC workloads, empowering our customers to push the boundaries of innovation. Backed by top-tier venture capital and strategic investors, we are committed to innovation, performance and scalability - solving the world’s most demanding computational challenges with our next-generation networking solutions.

We are a fast-growing, forward-thinking team of architects, engineers, and business professionals with a proven track record of building successful products and companies. As a global organization, our team spans multiple U.S. states and six countries, and we continue to expand with exceptional talent in onsite, hybrid, and fully remote roles.

We are seeking an experienced Senior Software Engineer to contribute to the design, development, and upstream enablement of Cornelis Networks' AI/HPC communication middleware. This role focuses on enabling and optimizing HPC middleware (MPI/SHMEM) and AI middleware (collective communication libraries / CCL, e.g., NCCL/RCCL and related stacks) over Cornelis Networks' interconnects. You will help drive performance, correctness, and deployability across real customer workloads by collaborating across the stack (drivers/kernel, switches, systems, and application/framework teams) and by contributing upstream to key open-source projects. 

Key Responsibilities


  • AI/HPC Middleware Enablement & Optimization: Implement and help optimize features for HPC middleware (HPI and SHMEM) and AI middleware (CCL stacks ie: NCCL/RCCL and related collective communication libraries)

  • Transport & Integration: Assist in integrating middleware capabilities with underlying transports and provider layers (ie: libfabric / OFI, UCX, verbs-like semantics where applicable)

  • Upstream & Open-Source Leadership: Prepare and submit upstream contributions across MPI/SHMEM projects, CCL ecosystems, and related components

  • Cross-Stack Collaboration & Performance Validation: Collaborate with kernel/driver and switch teams to help deliver end-to-end performance aligned to the Cornelis product roadmap

  • Customer & Field Impact: Help analyze performance traces and reproduce customer issues, and assist in translating findings into fixes.

Minimum Qualifications


  • 6+ years of experience in systems programming in C/C++ on Linux; Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience). Master's or Doctorate a plus. 

  • Hands-on experience with HPC middleware internals (Open MPI, MPICH, MVAPICH, and/or SHMEM) or optimizing collective communications for AI, including NCCL/RCCL, CUDA/ROCm) and/or other CCL stacks. 

  • Demonstrated ability to deliver low-latency/high-throughput communication paths and to diagnose performance issues using profiling/tracing tools.

  • Working knowledge of transport/integration layers such as OFI/libfabric, UCX, verbs-style concepts. 

  • Solid background in RDMA concepts and performance tuning. 

  • Experience contributing to open-source projects. 

Preferred Qualifications


  • Prior experience developing or maintaining libfabric providers. 

  • Familiarity with Ultra Ethernet (UEC/UET) specifications. 

  • Experience with RoCEv2, congestion control, and/or Ethernet-based RDMA deployments. 

  • Experience with cluster-scale benchmarking, profiling, and optimization. 

  • Background with HPC fabrics, such as Omni-Path. 

Location:  This is a remote position for employees residing within the United States.

We offer a competitive compensation package that includes equity, cash, and incentives, along with health and retirement benefits. Our dynamic, flexible work environment provides the opportunity to collaborate with some of the most influential names in the semiconductor industry.

At Cornelis Networks your base salary is only one component of your comprehensive total rewards package. Your base pay will be determined by factors such as your skills, qualifications, experience, and location relative to the hiring range for the position. Depending on your role, you may also be eligible for performance-based incentives, including an annual bonus or sales incentives. 

In addition to your base pay, you’ll have access to a broad range of benefits, including medical, dental, and vision coverage, as well as disability and life insurance, a dependent care flexible spending account, accidental injury insurance, and pet insurance. We also offer generous paid holidays, 401(k) with company match, and Open Time Off (OTO) for regular full-time exempt employees. Other paid time off benefits include sick time, bonding leave, and pregnancy disability leave.

Cornelis Networks does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. Cornelis Networks is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process. 

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer AI/HPC Middleware [Remote] in New York, NY vacancy
  • $123k - $215.25k

     ...Express is looking for a seasoned Senior Engineer I withextensive full-stack...  ...leading and mentoring software engineering teams. This role...  ...including mobile apps, web UI, middleware, platform services,...  ...experience integrating with AI/ML models to build user-facing... 
    Senior
    Middleware

    American Express

    New York, NY
    3 days ago
  •  ...innovators in this way. The Role: Forge’s software engineering team is passionate about innovation and...  ...with customer domain and marketplace middleware specific business logic Communicate...  ...with C# and .NETExperience integrating AI into daily routine (crafting prompts, reviewing... 
    Senior
    Middleware
    Work experience placement
    Local area
    2 days per week
    3 days per week

    Forge Global

    New York, NY
    2 days ago
  •  ...Senior Developer We are looking for a senior developer,...  ...pipelines following the best software development and DevOps...  ...messaging- and rest- based middleware. Experience with defining...  ...A technically strong AI and software engineering resource who combines hands... 
    Senior
    Middleware

    Saxon Global

    New York, NY
    3 days ago
  •  ...This is not just a Senior Java Developer . The role combines hands-on software engineering, cloud-native development, distributed systems, DevOps, AI adaptability, and technical leadership ....  ...volume messaging- and rest- based middleware. Experience with defining... 
    Senior
    Middleware

    TriOptus LLC

    New York, NY
    2 days ago
  • $240k - $260k

    Get AI-powered advice on this job and more exclusive features. This range is...  ...range $240,000.00/yr - $260,000.00/yr Senior / Staff Software Engineer (AI + Secure Data Infrastructure) —...  ...engineering team to build secure data-sharing middleware that eliminates silos across mission-... 
    Senior
    Middleware
    Full time

    FORTË

    New York, NY
    2 days ago
  • $170k - $210k

     ...over time. By delegating to autonomous AI systems those mission‑critical workflows...  ..., Ramp and Twitch. About The Role As a Software Engineer working on Product, you will design,...  ...implementation of robust API, authentication, and middleware solutions, enhancing the scalability... 
    Senior
    Middleware

    Luminai

    New York, NY
    2 days ago
  •  ...Senior Software Development Engineer Gibson Dunn is a leading global law firm, advising clients on significant...  ...close partnership with the firm's AI Platform Engineering team to design...  ...secure APIs, microservices, and middleware components that facilitate communication... 
    Senior
    Middleware

    Gibson Dunn

    New York, NY
    4 days ago
  •  ...Software Engineer Working On Platform Healthcare operations have always depended on people to...  ...over time. By delegating to autonomous AI systems those mission-critical workflows...  ...robust APIs, authentication, and middleware that hold up under load Harden production... 
    Senior
    Middleware
    Work at office
    Local area
    Work from home
    Monday to Friday

    Luminai

    New York, NY
    1 day ago
  • $150k - $190k

     ...Salesforce CPQ feeding NetSuite via middleware, with mid-contract amendments...  ...week. ** What you can expect as a Senior Salesforce & Integration Engineer: Salesforce / CPQOwn the technical...  ...reliabilityUnderstand and leverage AI (Claude Code) toolsets to increase... 
    Senior
    Middleware
    Contract work
    Work at office
    Worldwide
    Flexible hours

    VTS (View The Space)

    New York, NY
    2 days ago
  •  ...Senior Cloud Architect On a mission to unleash...  ...Responsibilities Hands on engineering capability in support...  ...operating systems and software, ensuring...  ...application development, middleware, database, OS or devops...  ...Demonstrated ability to leverage AI tooling and... 
    Senior
    Middleware
    Shift work

    Paramount Global Services

    New York, NY
    1 day ago
  • $104.9k - $154.95k

     ...applications and delivery, leveraging AI, automation, and contemporary...  ...forward.The OpportunityThe Senior Developer, Sales Technology is a hands-on software engineer responsible for designing,...  ...Bulk APIs, event-based patterns, middleware, ETL/ELT, or enterprise integration... 
    Senior
    Middleware
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Worldwide
    Relocation package
    3 days per week

    Metropolitan Life Insurance Company

    New York, NY
    6 days ago
  • $100k - $143k

     ...technologies like Generative AI to increase...  ...a Salesforce Developer Engineer, you will contribute to...  ...will work closely with senior developers, architects,...  ...Participate in the full software development lifecycle —...  ...Gateway for secure, scalable middleware integrations across... 
    Senior
    Middleware
    Local area
    3 days per week

    New York Life Insurance Co

    New York, NY
    2 days ago
  • $152k - $241.5k

     ...the unlimited potential of AI to define the next era of computing...  ...building reliable systems software for cloud-scale GPU...  ...team. We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet...  ...and operating software in AI, HPC, cloud, or large-scale datacenter... 
    Senior
    Full time
    Local area
    Remote work

    Nvidia

    New York, NY
    2 days ago
  • $320k - $405k

     ...interpretable, and steerable AI systems. We want AI to be safe...  ...of committed researchers, engineers, policy experts, and business...  ...into primitives, platforms, or middleware that support a variety of use...  ...experience building production software, ideally full-stack Can... 
    Middleware
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    10 hours ago
  • $208k - $312k

     ...team behind Next.js, v0, and AI SDK, we create products that...  ...developer experience. Now, software is entering a new era, and the...  ...We're looking for a security engineer who loves finding a whole...  ...framework internals (routing, middleware, caching, server actions, the... 
    Middleware
    Full time
    Work from home
    Worldwide
    Flexible hours

    Vercel

    New York, NY
    3 hours ago
  • $160k - $240k

    Senior Software Engineer - Apache Kafka Infrastructure Location New York Business Area Engineering and CTO Ref # 10051649...  ...provide a concise way for engineers to create data-store and middleware instances. The BMS Streaming team focuses on providing... 
    Senior
    Middleware
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    5 days ago
  • $165k - $200k

     ...the world. StubHub is seeking a Software Engineer II to join our Web Foundations team...  ...reusable component libraries APIs and middleware supporting consumer workflows...  ...performance in web applications Exposure to AI-enabled features or experimentation... 
    Middleware
    Full time
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Stubhub

    New York, NY
    10 hours ago
  •  ...Days Remote In-Person Interview is Mandatory As a Senior Software Engineer in front-end technologies, you will partner with the Product...  ...and mission-critical Applications which consume Data from Middleware Services. Extensive knowledge in implementing single... 
    Senior
    Middleware
    Remote work

    AITA Consulting Services, Inc.

    New York, NY
    1 day ago
  • JOB SUMMARY Senior developer, preferably with exposure to Cloud Architectures & Public...  ...creating CI/CD pipelines following the best software development and DevOps standards. In an...  ...high volume messaging- and rest- based middleware. Experience with defining scalable... 
    Senior
    Middleware

    Compunnel, Inc.

    New York, NY
    2 days ago
  •  ...Description As a Senior Back-End engineer at Bask you will work directly with the CEO and CTO to build and design the software infrastructure that will serve as the backbone of telehealth...  .... Engineering at Bask Health is AI-first and builder-led. Work starts in an... 
    Senior
    Full time

    Bask Health

    New York, NY
    10 hours ago
  •  ...Amigo partners with healthcare organizations to deploy robust AI infrastructure that directly serves patients and providers....  ...on track to 10x this year. About this role As a Senior Backend/Infra Engineer at Amigo, you'll build the core services behind our agent platform... 
    Senior
    Full time
    Flexible hours

    Amigo S.r.l.

    New York, NY
    10 hours ago
  • $200k - $300k

     ...Remote (U.S.) considered for exceptional senior candidates $200,000 - $300,000 per...  ...Equity Our client is a rapidly growing AI startup building next-generation voice automation...  ...of growth and is hiring multiple Senior Software Engineers to help scale its platform from millions... 
    Senior
    Full time
    H1b
    Remote work

    Resourceful Talent Group

    New York, NY
    10 hours ago
  •  ...About Mecka AI Mecka AI is building the data infrastructure layer for robotics and embodied AI. We partner with leading...  ...is dictated by data quality. The Role We are hiring a Senior Software Engineer, Mobile to build high-scale, high-reliability, compute-... 
    Senior
    Full time

    The Mecka

    New York, NY
    10 hours ago
  •  ...Our platform enables modern legal teams to move at the speed of AI, deliver better outcomes, and create measurable business value....  ...problem-solving, and obsessive attention to detail. Our engineering team is elite, our lawyers ship code every day, and we are dedicated... 
    Senior
    Full time
    Work at office
    Flexible hours
    Day shift

    Sandstone

    New York, NY
    10 hours ago
  • $190k - $225k

     ...Why AssemblyAI AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications. Our...  ...encourage you to apply! About the role: We're hiring a Software Engineer to help turn cutting-edge AI research into products our customers... 
    Senior
    Full time

    Assemblyai, Inc.

    New York, NY
    3 hours ago
  •  ...believe in a future in which every person has a personalized, AI-enabled doctor always in their pocket. To accomplish this,...  ...--------------- About The Role We're looking for a Senior Backend Engineer to help define the future of AI-powered, human-led healthcare... 
    Senior
    Full time
    Remote work

    Counsel Health

    New York, NY
    10 hours ago
  • $15 per hour

     ...agents on top. Maybern is founded by top engineering experts with deep knowledge of the fund management...  ...looking for a seasoned product-focused AI engineer that is not afraid to get into...  ...: You can reason through complex software architecture, data flows, and dependencies... 
    Senior
    Work at office
    Work from home
    Flexible hours

    Maybern

    New York, NY
    10 hours ago
  •  ...About Bevel Bevel is an AI Health Companion that helps people make smarter decisions about their health every day. Our app...  ...growth and support from our users. We’re looking for incredible Senior Backend Engineers to help us build an ambitious roadmap . You’ll get an... 
    Senior
    Full time
    Work at office

    Bevel

    New York, NY
    10 hours ago
  •  ...all while ensuring a fast and reliable experience. As a senior software engineer on the Cash App Banking server engineering team, you will lead...  ...and depth through direct coaching and mentoring Apply an AI-first mindset in your everyday work, raising the bar of AI... 
    Senior
    Remote job
    Full time
    Work at office
    Local area

    Block

    New York, NY
    10 hours ago
  • $190k - $240k

     ...Developer Productivity, whose mission is to make software development at Affirm simpler and faster...  ..., code standards, CI/CD, and release engineering, all in service of helping engineers ship...  ...development lifecycle is increasingly AI-enhanced. The team builds and improves the... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Affirm

    New York, NY
    10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer AI/HPC Middleware [Remote]. Be the first to apply!